[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:16:52.360901 18414 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.251.190:35477
I20260709 13:16:52.362537 18414 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:16:52.363668 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:52.381774 18421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:52.381867 18423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:52.382841 18420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:52.383247 18414 server_base.cc:1061] running on GCE node
I20260709 13:16:53.591528 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:53.591815 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:53.591984 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603013591964 us; error 0 us; skew 500 ppm
I20260709 13:16:53.592864 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:53.598817 18414 webserver.cc:533] Webserver started at http://127.17.251.190:45395/ using document root <none> and password file <none>
I20260709 13:16:53.599685 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:53.599884 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:53.600282 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:53.606429 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/master-0-root/instance:
uuid: "76d73e65c6804e70a2265abbb9d1720b"
format_stamp: "Formatted at 2026-07-09 13:16:53 on dist-test-slave-7f95"
I20260709 13:16:53.614993 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:53.620704 18429 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:53.622087 18414 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:16:53.622473 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/master-0-root
uuid: "76d73e65c6804e70a2265abbb9d1720b"
format_stamp: "Formatted at 2026-07-09 13:16:53 on dist-test-slave-7f95"
I20260709 13:16:53.622859 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:53.676940 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:53.679061 18414 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:16:53.679548 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:53.753849 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.190:35477
I20260709 13:16:53.753896 18480 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.190:35477 every 8 connection(s)
I20260709 13:16:53.762513 18481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.784529 18481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b: Bootstrap starting.
I20260709 13:16:53.790701 18481 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.792562 18481 log.cc:826] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b: Log is configured to *not* fsync() on all Append() calls
I20260709 13:16:53.797264 18481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b: No bootstrap required, opened a new log
I20260709 13:16:53.818428 18481 raft_consensus.cc:359] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d73e65c6804e70a2265abbb9d1720b" member_type: VOTER }
I20260709 13:16:53.819015 18481 raft_consensus.cc:385] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.819222 18481 raft_consensus.cc:740] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76d73e65c6804e70a2265abbb9d1720b, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.820205 18481 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d73e65c6804e70a2265abbb9d1720b" member_type: VOTER }
I20260709 13:16:53.820792 18481 raft_consensus.cc:399] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:53.821043 18481 raft_consensus.cc:493] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:53.821334 18481 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.825563 18481 raft_consensus.cc:515] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d73e65c6804e70a2265abbb9d1720b" member_type: VOTER }
I20260709 13:16:53.826400 18481 leader_election.cc:304] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76d73e65c6804e70a2265abbb9d1720b; no voters: 
I20260709 13:16:53.828145 18481 leader_election.cc:290] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:53.828558 18484 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:53.831319 18484 raft_consensus.cc:697] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [term 1 LEADER]: Becoming Leader. State: Replica: 76d73e65c6804e70a2265abbb9d1720b, State: Running, Role: LEADER
I20260709 13:16:53.832265 18484 consensus_queue.cc:237] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d73e65c6804e70a2265abbb9d1720b" member_type: VOTER }
I20260709 13:16:53.832666 18481 sys_catalog.cc:565] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:53.844960 18485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "76d73e65c6804e70a2265abbb9d1720b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d73e65c6804e70a2265abbb9d1720b" member_type: VOTER } }
I20260709 13:16:53.845222 18486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 76d73e65c6804e70a2265abbb9d1720b. Latest consensus state: current_term: 1 leader_uuid: "76d73e65c6804e70a2265abbb9d1720b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d73e65c6804e70a2265abbb9d1720b" member_type: VOTER } }
I20260709 13:16:53.845908 18485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:53.845986 18486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:53.849265 18494 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:53.861030 18494 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:53.863075 18414 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:53.879851 18494 catalog_manager.cc:1383] Generated new cluster ID: 4d1b2293d561490cb88d62cbc4210154
I20260709 13:16:53.880199 18494 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:53.910000 18494 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:53.912425 18494 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:53.938017 18494 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b: Generated new TSK 0
I20260709 13:16:53.939131 18494 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:53.994522 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:54.003151 18503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:54.004966 18504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:54.008354 18414 server_base.cc:1061] running on GCE node
W20260709 13:16:54.009125 18506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:54.010113 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:54.010356 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:54.010543 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603014010526 us; error 0 us; skew 500 ppm
I20260709 13:16:54.011174 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:54.016095 18414 webserver.cc:533] Webserver started at http://127.17.251.129:44699/ using document root <none> and password file <none>
I20260709 13:16:54.016743 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:54.016979 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:54.017293 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:54.018535 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/ts-0-root/instance:
uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
format_stamp: "Formatted at 2026-07-09 13:16:54 on dist-test-slave-7f95"
I20260709 13:16:54.024710 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:16:54.029690 18511 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:54.030694 18414 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:16:54.031020 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/ts-0-root
uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
format_stamp: "Formatted at 2026-07-09 13:16:54 on dist-test-slave-7f95"
I20260709 13:16:54.031358 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:54.052724 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:54.054265 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:54.057235 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:54.062469 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:54.062728 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:54.063087 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:54.063256 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:54.176632 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.129:42349
I20260709 13:16:54.176728 18573 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.129:42349 every 8 connection(s)
I20260709 13:16:54.184245 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:54.194551 18578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:54.197404 18579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:54.204336 18581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:54.205709 18414 server_base.cc:1061] running on GCE node
I20260709 13:16:54.206921 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:54.207230 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:54.207459 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603014207441 us; error 0 us; skew 500 ppm
I20260709 13:16:54.208330 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:54.212261 18414 webserver.cc:533] Webserver started at http://127.17.251.130:43179/ using document root <none> and password file <none>
I20260709 13:16:54.213022 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:54.213055 18574 heartbeater.cc:344] Connected to a master server at 127.17.251.190:35477
I20260709 13:16:54.213374 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:54.213624 18574 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:54.213791 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:54.214732 18574 heartbeater.cc:507] Master 127.17.251.190:35477 requested a full tablet report, sending...
I20260709 13:16:54.215477 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/ts-1-root/instance:
uuid: "986858f96f164e3b953d9042f283441d"
format_stamp: "Formatted at 2026-07-09 13:16:54 on dist-test-slave-7f95"
I20260709 13:16:54.217881 18446 ts_manager.cc:194] Registered new tserver with Master: fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349)
I20260709 13:16:54.220233 18446 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58180
I20260709 13:16:54.223300 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:16:54.228327 18586 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:54.229187 18414 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:16:54.229514 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/ts-1-root
uuid: "986858f96f164e3b953d9042f283441d"
format_stamp: "Formatted at 2026-07-09 13:16:54 on dist-test-slave-7f95"
I20260709 13:16:54.229903 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:54.249748 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:54.251442 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:54.254046 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:54.257871 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:54.258147 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:54.258428 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:54.258636 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:54.351791 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.130:39613
I20260709 13:16:54.351943 18648 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.130:39613 every 8 connection(s)
I20260709 13:16:54.360280 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:54.370428 18652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:54.373450 18653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:54.379601 18649 heartbeater.cc:344] Connected to a master server at 127.17.251.190:35477
I20260709 13:16:54.380106 18649 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:54.381389 18649 heartbeater.cc:507] Master 127.17.251.190:35477 requested a full tablet report, sending...
I20260709 13:16:54.384680 18414 server_base.cc:1061] running on GCE node
I20260709 13:16:54.384812 18446 ts_manager.cc:194] Registered new tserver with Master: 986858f96f164e3b953d9042f283441d (127.17.251.130:39613)
W20260709 13:16:54.386617 18655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:54.386950 18446 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58194
I20260709 13:16:54.387754 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:54.388057 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:54.388274 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603014388252 us; error 0 us; skew 500 ppm
I20260709 13:16:54.389016 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:54.392208 18414 webserver.cc:533] Webserver started at http://127.17.251.131:33467/ using document root <none> and password file <none>
I20260709 13:16:54.392761 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:54.392995 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:54.393296 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:54.394493 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/ts-2-root/instance:
uuid: "0be17c477d094fb197929930b8fa419a"
format_stamp: "Formatted at 2026-07-09 13:16:54 on dist-test-slave-7f95"
I20260709 13:16:54.399890 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:16:54.403931 18660 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:54.404901 18414 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:16:54.405303 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/ts-2-root
uuid: "0be17c477d094fb197929930b8fa419a"
format_stamp: "Formatted at 2026-07-09 13:16:54 on dist-test-slave-7f95"
I20260709 13:16:54.405701 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603012191013-18414-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:54.446708 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:54.448037 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:54.449651 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:54.451876 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:54.452114 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:54.452374 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:54.452551 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:54.557819 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.131:34097
I20260709 13:16:54.557940 18722 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.131:34097 every 8 connection(s)
I20260709 13:16:54.578855 18723 heartbeater.cc:344] Connected to a master server at 127.17.251.190:35477
I20260709 13:16:54.579351 18723 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:54.580410 18723 heartbeater.cc:507] Master 127.17.251.190:35477 requested a full tablet report, sending...
I20260709 13:16:54.583006 18446 ts_manager.cc:194] Registered new tserver with Master: 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:54.584193 18414 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017845994s
I20260709 13:16:54.584631 18446 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58210
I20260709 13:16:54.639230 18446 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58226:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:54.643000 18446 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:54.745314 18614 tablet_service.cc:1511] Processing CreateTablet for tablet 394e630586524166a75f8ccb7b36487d (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:54.747149 18614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394e630586524166a75f8ccb7b36487d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.746917 18611 tablet_service.cc:1511] Processing CreateTablet for tablet dadccd38426441c09950dc14c00c5362 (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:54.748415 18611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dadccd38426441c09950dc14c00c5362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.749581 18613 tablet_service.cc:1511] Processing CreateTablet for tablet eedac45982444b2694146149384eecc6 (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:54.751112 18613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eedac45982444b2694146149384eecc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.752058 18612 tablet_service.cc:1511] Processing CreateTablet for tablet b446d0be3461437fbc4b72e365379739 (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:54.754757 18612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b446d0be3461437fbc4b72e365379739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.755717 18539 tablet_service.cc:1511] Processing CreateTablet for tablet 394e630586524166a75f8ccb7b36487d (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:54.757156 18539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394e630586524166a75f8ccb7b36487d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.763083 18538 tablet_service.cc:1511] Processing CreateTablet for tablet eedac45982444b2694146149384eecc6 (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:54.764585 18538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eedac45982444b2694146149384eecc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.767524 18537 tablet_service.cc:1511] Processing CreateTablet for tablet b446d0be3461437fbc4b72e365379739 (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:54.770653 18536 tablet_service.cc:1511] Processing CreateTablet for tablet dadccd38426441c09950dc14c00c5362 (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:54.773859 18741 tablet_bootstrap.cc:492] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d: Bootstrap starting.
I20260709 13:16:54.773809 18535 tablet_service.cc:1511] Processing CreateTablet for tablet 3b03f75bbbac4deabd017e4b8b7310bb (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:54.775767 18537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b446d0be3461437fbc4b72e365379739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.780099 18535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b03f75bbbac4deabd017e4b8b7310bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.782687 18536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dadccd38426441c09950dc14c00c5362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.792358 18612 tablet_service.cc:1511] Processing CreateTablet for tablet 3b03f75bbbac4deabd017e4b8b7310bb (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:54.794333 18612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b03f75bbbac4deabd017e4b8b7310bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.806391 18688 tablet_service.cc:1511] Processing CreateTablet for tablet 394e630586524166a75f8ccb7b36487d (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:54.809340 18687 tablet_service.cc:1511] Processing CreateTablet for tablet eedac45982444b2694146149384eecc6 (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:54.814535 18688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394e630586524166a75f8ccb7b36487d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.811097 18686 tablet_service.cc:1511] Processing CreateTablet for tablet b446d0be3461437fbc4b72e365379739 (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:54.816885 18687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eedac45982444b2694146149384eecc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.815658 18685 tablet_service.cc:1511] Processing CreateTablet for tablet dadccd38426441c09950dc14c00c5362 (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:54.819568 18686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b446d0be3461437fbc4b72e365379739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.821924 18685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dadccd38426441c09950dc14c00c5362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.834194 18684 tablet_service.cc:1511] Processing CreateTablet for tablet 3b03f75bbbac4deabd017e4b8b7310bb (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:54.837590 18684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b03f75bbbac4deabd017e4b8b7310bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.846916 18534 tablet_service.cc:1511] Processing CreateTablet for tablet ed009757b7834a2ca88c1cefee374b9c (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:54.850018 18534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed009757b7834a2ca88c1cefee374b9c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:54.855093 18493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:54.874078 18614 tablet_service.cc:1511] Processing CreateTablet for tablet ed009757b7834a2ca88c1cefee374b9c (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:54.875525 18614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed009757b7834a2ca88c1cefee374b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.884496 18741 tablet_bootstrap.cc:654] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.896416 18533 tablet_service.cc:1511] Processing CreateTablet for tablet 2be9bebe23ce482db62df897c49c491c (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:54.897104 18683 tablet_service.cc:1511] Processing CreateTablet for tablet ed009757b7834a2ca88c1cefee374b9c (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:54.902627 18533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be9bebe23ce482db62df897c49c491c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.905651 18683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed009757b7834a2ca88c1cefee374b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.907768 18612 tablet_service.cc:1511] Processing CreateTablet for tablet 2be9bebe23ce482db62df897c49c491c (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:54.910048 18612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be9bebe23ce482db62df897c49c491c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.913686 18742 tablet_bootstrap.cc:492] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a: Bootstrap starting.
I20260709 13:16:54.916317 18743 tablet_bootstrap.cc:492] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58: Bootstrap starting.
I20260709 13:16:54.925096 18538 tablet_service.cc:1511] Processing CreateTablet for tablet bc12bc5743f54d799d5961dbd948b487 (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:54.929358 18538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc12bc5743f54d799d5961dbd948b487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.928598 18613 tablet_service.cc:1511] Processing CreateTablet for tablet bc12bc5743f54d799d5961dbd948b487 (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:54.931674 18613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc12bc5743f54d799d5961dbd948b487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.936695 18539 tablet_service.cc:1511] Processing CreateTablet for tablet 910fb7bb019f4c54a7be5fbec560bee4 (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:54.939435 18539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910fb7bb019f4c54a7be5fbec560bee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.940598 18685 tablet_service.cc:1511] Processing CreateTablet for tablet 2be9bebe23ce482db62df897c49c491c (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:54.951339 18684 tablet_service.cc:1511] Processing CreateTablet for tablet bc12bc5743f54d799d5961dbd948b487 (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:54.955786 18611 tablet_service.cc:1511] Processing CreateTablet for tablet 910fb7bb019f4c54a7be5fbec560bee4 (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:54.958173 18611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910fb7bb019f4c54a7be5fbec560bee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.963874 18686 tablet_service.cc:1511] Processing CreateTablet for tablet 910fb7bb019f4c54a7be5fbec560bee4 (DEFAULT_TABLE table=test-workload [id=01359bae05b0411d9ce0dd7f00cdf506]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:54.966046 18686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910fb7bb019f4c54a7be5fbec560bee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.973471 18685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be9bebe23ce482db62df897c49c491c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.983495 18742 tablet_bootstrap.cc:654] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.983824 18743 tablet_bootstrap.cc:654] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.987469 18741 tablet_bootstrap.cc:492] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d: No bootstrap required, opened a new log
I20260709 13:16:54.988018 18741 ts_tablet_manager.cc:1403] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d: Time spent bootstrapping tablet: real 0.215s	user 0.012s	sys 0.025s
I20260709 13:16:54.985504 18684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc12bc5743f54d799d5961dbd948b487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.996068 18741 raft_consensus.cc:359] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:54.997087 18741 raft_consensus.cc:385] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.997468 18741 raft_consensus.cc:740] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 986858f96f164e3b953d9042f283441d, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.998538 18741 consensus_queue.cc:260] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.018491 18743 tablet_bootstrap.cc:492] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58: No bootstrap required, opened a new log
I20260709 13:16:55.020931 18743 ts_tablet_manager.cc:1403] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58: Time spent bootstrapping tablet: real 0.105s	user 0.016s	sys 0.002s
I20260709 13:16:55.023824 18741 ts_tablet_manager.cc:1434] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d: Time spent starting tablet: real 0.035s	user 0.019s	sys 0.000s
I20260709 13:16:55.024164 18649 heartbeater.cc:499] Master 127.17.251.190:35477 was elected leader, sending a full tablet report...
I20260709 13:16:55.025192 18741 tablet_bootstrap.cc:492] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d: Bootstrap starting.
I20260709 13:16:55.026248 18743 raft_consensus.cc:359] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.033247 18743 raft_consensus.cc:385] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.035482 18743 raft_consensus.cc:740] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.037573 18743 consensus_queue.cc:260] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.039371 18742 tablet_bootstrap.cc:492] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a: No bootstrap required, opened a new log
I20260709 13:16:55.040452 18742 ts_tablet_manager.cc:1403] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a: Time spent bootstrapping tablet: real 0.129s	user 0.019s	sys 0.012s
I20260709 13:16:55.045230 18742 raft_consensus.cc:359] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.048996 18743 ts_tablet_manager.cc:1434] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.011s
I20260709 13:16:55.051155 18742 raft_consensus.cc:385] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.051571 18742 raft_consensus.cc:740] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.051672 18574 heartbeater.cc:499] Master 127.17.251.190:35477 was elected leader, sending a full tablet report...
I20260709 13:16:55.052037 18743 tablet_bootstrap.cc:492] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58: Bootstrap starting.
I20260709 13:16:55.052567 18742 consensus_queue.cc:260] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.050791 18741 tablet_bootstrap.cc:654] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.061936 18743 tablet_bootstrap.cc:654] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.062687 18723 heartbeater.cc:499] Master 127.17.251.190:35477 was elected leader, sending a full tablet report...
I20260709 13:16:55.065819 18741 tablet_bootstrap.cc:492] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d: No bootstrap required, opened a new log
I20260709 13:16:55.066313 18741 ts_tablet_manager.cc:1403] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.001s
W20260709 13:16:55.067425 18724 tablet.cc:2406] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:16:55.064363 18742 ts_tablet_manager.cc:1434] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a: Time spent starting tablet: real 0.024s	user 0.000s	sys 0.010s
I20260709 13:16:55.068990 18742 tablet_bootstrap.cc:492] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a: Bootstrap starting.
I20260709 13:16:55.076588 18742 tablet_bootstrap.cc:654] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.082878 18741 raft_consensus.cc:359] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.083909 18741 raft_consensus.cc:385] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.084414 18741 raft_consensus.cc:740] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 986858f96f164e3b953d9042f283441d, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.086180 18741 consensus_queue.cc:260] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.090855 18743 tablet_bootstrap.cc:492] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58: No bootstrap required, opened a new log
I20260709 13:16:55.091491 18741 ts_tablet_manager.cc:1434] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.002s
I20260709 13:16:55.091491 18743 ts_tablet_manager.cc:1403] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.005s
I20260709 13:16:55.093343 18741 tablet_bootstrap.cc:492] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d: Bootstrap starting.
I20260709 13:16:55.096027 18743 raft_consensus.cc:359] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.096928 18743 raft_consensus.cc:385] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.097286 18743 raft_consensus.cc:740] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.098097 18749 raft_consensus.cc:493] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.098644 18749 raft_consensus.cc:515] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.101449 18741 tablet_bootstrap.cc:654] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.104966 18749 leader_election.cc:290] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 986858f96f164e3b953d9042f283441d (127.17.251.130:39613)
I20260709 13:16:55.107550 18743 consensus_queue.cc:260] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.110060 18742 tablet_bootstrap.cc:492] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a: No bootstrap required, opened a new log
I20260709 13:16:55.110131 18743 ts_tablet_manager.cc:1434] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 13:16:55.110773 18742 ts_tablet_manager.cc:1403] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.007s
I20260709 13:16:55.111472 18743 tablet_bootstrap.cc:492] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58: Bootstrap starting.
I20260709 13:16:55.122166 18742 raft_consensus.cc:359] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.123569 18742 raft_consensus.cc:385] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.123982 18742 raft_consensus.cc:740] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.124858 18742 consensus_queue.cc:260] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.130441 18742 ts_tablet_manager.cc:1434] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.006s
I20260709 13:16:55.131628 18742 tablet_bootstrap.cc:492] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a: Bootstrap starting.
I20260709 13:16:55.134521 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedac45982444b2694146149384eecc6" candidate_uuid: "0be17c477d094fb197929930b8fa419a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" is_pre_election: true
I20260709 13:16:55.135459 18549 raft_consensus.cc:2468] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0be17c477d094fb197929930b8fa419a in term 0.
I20260709 13:16:55.137217 18663 leader_election.cc:304] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:16:55.138178 18749 raft_consensus.cc:2804] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.138607 18749 raft_consensus.cc:493] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.138957 18749 raft_consensus.cc:3060] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.140530 18743 tablet_bootstrap.cc:654] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.137867 18741 tablet_bootstrap.cc:492] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d: No bootstrap required, opened a new log
I20260709 13:16:55.150290 18741 ts_tablet_manager.cc:1403] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.002s
I20260709 13:16:55.153007 18743 tablet_bootstrap.cc:492] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58: No bootstrap required, opened a new log
I20260709 13:16:55.153604 18743 ts_tablet_manager.cc:1403] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.012s
I20260709 13:16:55.156232 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedac45982444b2694146149384eecc6" candidate_uuid: "0be17c477d094fb197929930b8fa419a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "986858f96f164e3b953d9042f283441d" is_pre_election: true
I20260709 13:16:55.148797 18749 raft_consensus.cc:515] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.157755 18743 raft_consensus.cc:359] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
W20260709 13:16:55.158780 18664 leader_election.cc:343] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 986858f96f164e3b953d9042f283441d (127.17.251.130:39613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.159297 18749 leader_election.cc:290] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 1 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 986858f96f164e3b953d9042f283441d (127.17.251.130:39613)
I20260709 13:16:55.157226 18741 raft_consensus.cc:359] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.160102 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedac45982444b2694146149384eecc6" candidate_uuid: "0be17c477d094fb197929930b8fa419a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:16:55.160672 18549 raft_consensus.cc:3060] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.161044 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedac45982444b2694146149384eecc6" candidate_uuid: "0be17c477d094fb197929930b8fa419a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "986858f96f164e3b953d9042f283441d"
W20260709 13:16:55.162611 18664 leader_election.cc:343] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 986858f96f164e3b953d9042f283441d (127.17.251.130:39613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.162957 18742 tablet_bootstrap.cc:654] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.160440 18741 raft_consensus.cc:385] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.165946 18741 raft_consensus.cc:740] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 986858f96f164e3b953d9042f283441d, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.166893 18741 consensus_queue.cc:260] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.158481 18743 raft_consensus.cc:385] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.169935 18743 raft_consensus.cc:740] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.170967 18743 consensus_queue.cc:260] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.172084 18741 ts_tablet_manager.cc:1434] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260709 13:16:55.173331 18743 ts_tablet_manager.cc:1434] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:16:55.174384 18743 tablet_bootstrap.cc:492] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58: Bootstrap starting.
I20260709 13:16:55.175915 18741 tablet_bootstrap.cc:492] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d: Bootstrap starting.
I20260709 13:16:55.177930 18549 raft_consensus.cc:2468] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0be17c477d094fb197929930b8fa419a in term 1.
I20260709 13:16:55.179646 18663 leader_election.cc:304] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 986858f96f164e3b953d9042f283441d
I20260709 13:16:55.181028 18749 raft_consensus.cc:2804] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.188176 18749 raft_consensus.cc:697] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 1 LEADER]: Becoming Leader. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Running, Role: LEADER
I20260709 13:16:55.189307 18742 tablet_bootstrap.cc:492] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a: No bootstrap required, opened a new log
I20260709 13:16:55.189262 18749 consensus_queue.cc:237] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.190107 18742 ts_tablet_manager.cc:1403] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.015s
I20260709 13:16:55.192508 18743 tablet_bootstrap.cc:654] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.194433 18742 raft_consensus.cc:359] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.195287 18742 raft_consensus.cc:385] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.195638 18742 raft_consensus.cc:740] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.196664 18742 consensus_queue.cc:260] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.200589 18741 tablet_bootstrap.cc:654] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.201413 18742 ts_tablet_manager.cc:1434] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:16:55.204062 18742 tablet_bootstrap.cc:492] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a: Bootstrap starting.
I20260709 13:16:55.212657 18743 tablet_bootstrap.cc:492] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58: No bootstrap required, opened a new log
I20260709 13:16:55.211501 18444 catalog_manager.cc:5697] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0be17c477d094fb197929930b8fa419a (127.17.251.131). New cstate: current_term: 1 leader_uuid: "0be17c477d094fb197929930b8fa419a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:55.213246 18743 ts_tablet_manager.cc:1403] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58: Time spent bootstrapping tablet: real 0.039s	user 0.004s	sys 0.014s
I20260709 13:16:55.213933 18742 tablet_bootstrap.cc:654] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.216795 18743 raft_consensus.cc:359] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.217866 18743 raft_consensus.cc:385] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.218289 18743 raft_consensus.cc:740] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.219484 18743 consensus_queue.cc:260] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.222765 18743 ts_tablet_manager.cc:1434] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.003s
I20260709 13:16:55.224045 18743 tablet_bootstrap.cc:492] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58: Bootstrap starting.
I20260709 13:16:55.226292 18742 tablet_bootstrap.cc:492] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a: No bootstrap required, opened a new log
I20260709 13:16:55.226814 18742 ts_tablet_manager.cc:1403] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.012s
I20260709 13:16:55.230068 18742 raft_consensus.cc:359] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.230813 18742 raft_consensus.cc:385] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.231228 18743 tablet_bootstrap.cc:654] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.231343 18742 raft_consensus.cc:740] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.232946 18742 consensus_queue.cc:260] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.235790 18742 ts_tablet_manager.cc:1434] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:16:55.236990 18742 tablet_bootstrap.cc:492] T ed009757b7834a2ca88c1cefee374b9c P 0be17c477d094fb197929930b8fa419a: Bootstrap starting.
I20260709 13:16:55.240588 18741 tablet_bootstrap.cc:492] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d: No bootstrap required, opened a new log
I20260709 13:16:55.241371 18741 ts_tablet_manager.cc:1403] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.012s
I20260709 13:16:55.244046 18743 tablet_bootstrap.cc:492] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58: No bootstrap required, opened a new log
I20260709 13:16:55.244545 18743 ts_tablet_manager.cc:1403] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 13:16:55.245256 18742 tablet_bootstrap.cc:654] T ed009757b7834a2ca88c1cefee374b9c P 0be17c477d094fb197929930b8fa419a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.246753 18741 raft_consensus.cc:359] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.247555 18741 raft_consensus.cc:385] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.247970 18741 raft_consensus.cc:740] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 986858f96f164e3b953d9042f283441d, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.247562 18743 raft_consensus.cc:359] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.248685 18743 raft_consensus.cc:385] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.249081 18743 raft_consensus.cc:740] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.248896 18741 consensus_queue.cc:260] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.250465 18743 consensus_queue.cc:260] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.253234 18743 ts_tablet_manager.cc:1434] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:16:55.255335 18743 tablet_bootstrap.cc:492] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58: Bootstrap starting.
I20260709 13:16:55.256826 18741 ts_tablet_manager.cc:1434] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:16:55.270658 18741 tablet_bootstrap.cc:492] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d: Bootstrap starting.
I20260709 13:16:55.275463 18742 tablet_bootstrap.cc:492] T ed009757b7834a2ca88c1cefee374b9c P 0be17c477d094fb197929930b8fa419a: No bootstrap required, opened a new log
I20260709 13:16:55.276010 18742 ts_tablet_manager.cc:1403] T ed009757b7834a2ca88c1cefee374b9c P 0be17c477d094fb197929930b8fa419a: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.017s
I20260709 13:16:55.263782 18743 tablet_bootstrap.cc:654] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.277655 18741 tablet_bootstrap.cc:654] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.279177 18742 raft_consensus.cc:359] T ed009757b7834a2ca88c1cefee374b9c P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.279987 18742 raft_consensus.cc:385] T ed009757b7834a2ca88c1cefee374b9c P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.280308 18742 raft_consensus.cc:740] T ed009757b7834a2ca88c1cefee374b9c P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.281214 18742 consensus_queue.cc:260] T ed009757b7834a2ca88c1cefee374b9c P 0be17c477d094fb197929930b8fa419a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.284409 18743 tablet_bootstrap.cc:492] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58: No bootstrap required, opened a new log
I20260709 13:16:55.284907 18742 ts_tablet_manager.cc:1434] T ed009757b7834a2ca88c1cefee374b9c P 0be17c477d094fb197929930b8fa419a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:16:55.285004 18743 ts_tablet_manager.cc:1403] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.001s
I20260709 13:16:55.286387 18742 tablet_bootstrap.cc:492] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a: Bootstrap starting.
I20260709 13:16:55.289870 18741 tablet_bootstrap.cc:492] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d: No bootstrap required, opened a new log
I20260709 13:16:55.290468 18741 ts_tablet_manager.cc:1403] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.009s
I20260709 13:16:55.290094 18743 raft_consensus.cc:359] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.291088 18743 raft_consensus.cc:385] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.291456 18743 raft_consensus.cc:740] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.292294 18743 consensus_queue.cc:260] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.294252 18742 tablet_bootstrap.cc:654] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.294205 18741 raft_consensus.cc:359] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.295112 18741 raft_consensus.cc:385] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.295463 18741 raft_consensus.cc:740] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 986858f96f164e3b953d9042f283441d, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.297134 18743 ts_tablet_manager.cc:1434] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.006s
I20260709 13:16:55.296288 18741 consensus_queue.cc:260] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.298370 18743 tablet_bootstrap.cc:492] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58: Bootstrap starting.
I20260709 13:16:55.300230 18741 ts_tablet_manager.cc:1434] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:16:55.302800 18746 raft_consensus.cc:493] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.303406 18746 raft_consensus.cc:515] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.305759 18743 tablet_bootstrap.cc:654] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.306327 18742 tablet_bootstrap.cc:492] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a: No bootstrap required, opened a new log
I20260709 13:16:55.306370 18746 leader_election.cc:290] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:55.302294 18741 tablet_bootstrap.cc:492] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d: Bootstrap starting.
I20260709 13:16:55.306929 18742 ts_tablet_manager.cc:1403] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 13:16:55.310062 18742 raft_consensus.cc:359] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.310875 18748 raft_consensus.cc:493] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.311465 18748 raft_consensus.cc:515] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.314808 18748 leader_election.cc:290] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 986858f96f164e3b953d9042f283441d (127.17.251.130:39613), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:55.310846 18742 raft_consensus.cc:385] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.317229 18742 raft_consensus.cc:740] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.337548 18743 tablet_bootstrap.cc:492] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58: No bootstrap required, opened a new log
I20260709 13:16:55.338411 18743 ts_tablet_manager.cc:1403] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58: Time spent bootstrapping tablet: real 0.040s	user 0.029s	sys 0.007s
I20260709 13:16:55.341411 18743 raft_consensus.cc:359] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.342473 18743 raft_consensus.cc:385] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.333334 18742 consensus_queue.cc:260] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.344633 18746 raft_consensus.cc:493] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.343181 18743 raft_consensus.cc:740] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.345146 18746 raft_consensus.cc:515] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.348270 18746 leader_election.cc:290] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:55.349936 18742 ts_tablet_manager.cc:1434] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.007s
I20260709 13:16:55.349429 18743 consensus_queue.cc:260] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.352082 18741 tablet_bootstrap.cc:654] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.355124 18749 raft_consensus.cc:493] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.354146 18742 tablet_bootstrap.cc:492] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a: Bootstrap starting.
I20260709 13:16:55.359530 18749 raft_consensus.cc:515] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.361243 18743 ts_tablet_manager.cc:1434] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:16:55.363191 18743 tablet_bootstrap.cc:492] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58: Bootstrap starting.
I20260709 13:16:55.363359 18749 leader_election.cc:290] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 986858f96f164e3b953d9042f283441d (127.17.251.130:39613)
I20260709 13:16:55.367962 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b03f75bbbac4deabd017e4b8b7310bb" candidate_uuid: "0be17c477d094fb197929930b8fa419a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" is_pre_election: true
I20260709 13:16:55.368721 18549 raft_consensus.cc:2468] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0be17c477d094fb197929930b8fa419a in term 0.
I20260709 13:16:55.370718 18663 leader_election.cc:304] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:16:55.373497 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b03f75bbbac4deabd017e4b8b7310bb" candidate_uuid: "0be17c477d094fb197929930b8fa419a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "986858f96f164e3b953d9042f283441d" is_pre_election: true
I20260709 13:16:55.374277 18624 raft_consensus.cc:2468] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0be17c477d094fb197929930b8fa419a in term 0.
I20260709 13:16:55.375473 18749 raft_consensus.cc:2804] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.376180 18749 raft_consensus.cc:493] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.377933 18749 raft_consensus.cc:3060] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.382398 18746 raft_consensus.cc:493] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.382479 18548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b446d0be3461437fbc4b72e365379739" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" is_pre_election: true
I20260709 13:16:55.383328 18746 raft_consensus.cc:515] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.384039 18548 raft_consensus.cc:2468] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 0.
I20260709 13:16:55.400030 18698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394e630586524166a75f8ccb7b36487d" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be17c477d094fb197929930b8fa419a" is_pre_election: true
I20260709 13:16:55.402050 18698 raft_consensus.cc:2468] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 0.
I20260709 13:16:55.404780 18590 leader_election.cc:304] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, 986858f96f164e3b953d9042f283441d; no voters: 
I20260709 13:16:55.405985 18698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b446d0be3461437fbc4b72e365379739" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be17c477d094fb197929930b8fa419a" is_pre_election: true
I20260709 13:16:55.406827 18698 raft_consensus.cc:2468] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 0.
I20260709 13:16:55.417356 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394e630586524166a75f8ccb7b36487d" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" is_pre_election: true
I20260709 13:16:55.418857 18549 raft_consensus.cc:2468] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 0.
I20260709 13:16:55.419432 18749 raft_consensus.cc:515] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.418932 18746 leader_election.cc:290] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:55.421079 18746 raft_consensus.cc:493] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.433101 18746 raft_consensus.cc:515] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.433513 18749 leader_election.cc:290] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 1 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 986858f96f164e3b953d9042f283441d (127.17.251.130:39613)
I20260709 13:16:55.434116 18742 tablet_bootstrap.cc:654] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.438120 18743 tablet_bootstrap.cc:654] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.438212 18589 leader_election.cc:304] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 986858f96f164e3b953d9042f283441d, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:16:55.437567 18746 leader_election.cc:290] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:55.441975 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b03f75bbbac4deabd017e4b8b7310bb" candidate_uuid: "0be17c477d094fb197929930b8fa419a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "986858f96f164e3b953d9042f283441d"
I20260709 13:16:55.442579 18624 raft_consensus.cc:3060] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.442337 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadccd38426441c09950dc14c00c5362" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" is_pre_election: true
I20260709 13:16:55.442395 18746 raft_consensus.cc:2804] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.445219 18746 raft_consensus.cc:493] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.446184 18746 raft_consensus.cc:3060] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.446074 18548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b03f75bbbac4deabd017e4b8b7310bb" candidate_uuid: "0be17c477d094fb197929930b8fa419a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:16:55.443265 18549 raft_consensus.cc:2468] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 0.
I20260709 13:16:55.446905 18548 raft_consensus.cc:3060] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.449378 18748 raft_consensus.cc:493] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.451272 18748 raft_consensus.cc:515] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.450371 18777 raft_consensus.cc:2804] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.454420 18748 leader_election.cc:290] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 986858f96f164e3b953d9042f283441d (127.17.251.130:39613), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:55.451679 18547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedac45982444b2694146149384eecc6" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" is_pre_election: true
I20260709 13:16:55.456188 18777 raft_consensus.cc:493] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.457226 18777 raft_consensus.cc:3060] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.460573 18547 raft_consensus.cc:2393] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 986858f96f164e3b953d9042f283441d in current term 1: Already voted for candidate 0be17c477d094fb197929930b8fa419a in this term.
W20260709 13:16:55.463532 18590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:34097, user_credentials={real_user=slave}} blocked reactor thread for 59345.3us
I20260709 13:16:55.459057 18589 leader_election.cc:304] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 986858f96f164e3b953d9042f283441d, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:16:55.478641 18698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadccd38426441c09950dc14c00c5362" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be17c477d094fb197929930b8fa419a" is_pre_election: true
I20260709 13:16:55.479430 18698 raft_consensus.cc:2468] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 0.
I20260709 13:16:55.482105 18697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedac45982444b2694146149384eecc6" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be17c477d094fb197929930b8fa419a" is_pre_election: true
I20260709 13:16:55.486442 18779 raft_consensus.cc:2804] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.487179 18779 raft_consensus.cc:493] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.484695 18590 leader_election.cc:304] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 986858f96f164e3b953d9042f283441d; no voters: 0be17c477d094fb197929930b8fa419a, fdb2a960ea40486b97fe1dd5bceb6e58
I20260709 13:16:55.488293 18779 raft_consensus.cc:3060] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.500864 18748 raft_consensus.cc:493] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.502673 18748 raft_consensus.cc:515] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.505004 18748 leader_election.cc:290] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 986858f96f164e3b953d9042f283441d (127.17.251.130:39613), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:55.508993 18742 tablet_bootstrap.cc:492] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a: No bootstrap required, opened a new log
I20260709 13:16:55.509686 18742 ts_tablet_manager.cc:1403] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a: Time spent bootstrapping tablet: real 0.159s	user 0.024s	sys 0.042s
I20260709 13:16:55.513291 18746 raft_consensus.cc:515] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.520118 18624 raft_consensus.cc:2468] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0be17c477d094fb197929930b8fa419a in term 1.
I20260709 13:16:55.522259 18548 raft_consensus.cc:2468] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0be17c477d094fb197929930b8fa419a in term 1.
I20260709 13:16:55.526037 18664 leader_election.cc:304] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, 986858f96f164e3b953d9042f283441d; no voters: 
I20260709 13:16:55.527192 18749 raft_consensus.cc:2804] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.528160 18749 raft_consensus.cc:697] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 1 LEADER]: Becoming Leader. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Running, Role: LEADER
I20260709 13:16:55.529263 18741 tablet_bootstrap.cc:492] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d: No bootstrap required, opened a new log
W20260709 13:16:55.529960 18590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:34097, user_credentials={real_user=slave}} blocked reactor thread for 45157.4us
I20260709 13:16:55.528999 18749 consensus_queue.cc:237] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.529922 18741 ts_tablet_manager.cc:1403] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d: Time spent bootstrapping tablet: real 0.228s	user 0.014s	sys 0.015s
I20260709 13:16:55.532320 18743 tablet_bootstrap.cc:492] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58: No bootstrap required, opened a new log
I20260709 13:16:55.532810 18743 ts_tablet_manager.cc:1403] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58: Time spent bootstrapping tablet: real 0.170s	user 0.007s	sys 0.025s
I20260709 13:16:55.533386 18742 raft_consensus.cc:359] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.534487 18741 raft_consensus.cc:359] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.535046 18742 raft_consensus.cc:385] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.535240 18741 raft_consensus.cc:385] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.535573 18741 raft_consensus.cc:740] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 986858f96f164e3b953d9042f283441d, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.535530 18742 raft_consensus.cc:740] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.536126 18743 raft_consensus.cc:359] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.536787 18743 raft_consensus.cc:385] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.536572 18741 consensus_queue.cc:260] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.537046 18743 raft_consensus.cc:740] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.537937 18743 consensus_queue.cc:260] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.539857 18743 ts_tablet_manager.cc:1434] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:55.540822 18743 tablet_bootstrap.cc:492] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58: Bootstrap starting.
I20260709 13:16:55.537235 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394e630586524166a75f8ccb7b36487d" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "986858f96f164e3b953d9042f283441d" is_pre_election: true
I20260709 13:16:55.528913 18777 raft_consensus.cc:515] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.554697 18746 leader_election.cc:290] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:55.555366 18746 raft_consensus.cc:3060] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.557042 18624 raft_consensus.cc:2393] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fdb2a960ea40486b97fe1dd5bceb6e58 in current term 1: Already voted for candidate 986858f96f164e3b953d9042f283441d in this term.
I20260709 13:16:55.557324 18697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394e630586524166a75f8ccb7b36487d" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be17c477d094fb197929930b8fa419a" is_pre_election: true
I20260709 13:16:55.559062 18697 raft_consensus.cc:2468] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdb2a960ea40486b97fe1dd5bceb6e58 in term 0.
I20260709 13:16:55.562315 18696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910fb7bb019f4c54a7be5fbec560bee4" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be17c477d094fb197929930b8fa419a" is_pre_election: true
I20260709 13:16:55.564301 18698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed009757b7834a2ca88c1cefee374b9c" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be17c477d094fb197929930b8fa419a" is_pre_election: true
I20260709 13:16:55.562445 18548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394e630586524166a75f8ccb7b36487d" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:16:55.565188 18698 raft_consensus.cc:2468] T ed009757b7834a2ca88c1cefee374b9c P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdb2a960ea40486b97fe1dd5bceb6e58 in term 0.
I20260709 13:16:55.565236 18548 raft_consensus.cc:3060] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.550957 18742 consensus_queue.cc:260] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.573374 18623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910fb7bb019f4c54a7be5fbec560bee4" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "986858f96f164e3b953d9042f283441d" is_pre_election: true
I20260709 13:16:55.575258 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed009757b7834a2ca88c1cefee374b9c" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "986858f96f164e3b953d9042f283441d" is_pre_election: true
I20260709 13:16:55.578754 18696 raft_consensus.cc:2468] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdb2a960ea40486b97fe1dd5bceb6e58 in term 0.
I20260709 13:16:55.578979 18698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394e630586524166a75f8ccb7b36487d" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:16:55.579663 18698 raft_consensus.cc:3060] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.580860 18742 ts_tablet_manager.cc:1434] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a: Time spent starting tablet: real 0.071s	user 0.004s	sys 0.004s
I20260709 13:16:55.585176 18742 tablet_bootstrap.cc:492] T 2be9bebe23ce482db62df897c49c491c P 0be17c477d094fb197929930b8fa419a: Bootstrap starting.
I20260709 13:16:55.585755 18515 leader_election.cc:304] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:16:55.554806 18444 catalog_manager.cc:5697] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0be17c477d094fb197929930b8fa419a (127.17.251.131). New cstate: current_term: 1 leader_uuid: "0be17c477d094fb197929930b8fa419a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:55.588467 18743 tablet_bootstrap.cc:654] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:55.588737 18515 leader_election.cc:343] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 986858f96f164e3b953d9042f283441d (127.17.251.130:39613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.591426 18741 ts_tablet_manager.cc:1434] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d: Time spent starting tablet: real 0.060s	user 0.023s	sys 0.011s
W20260709 13:16:55.591625 18515 leader_election.cc:343] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 986858f96f164e3b953d9042f283441d (127.17.251.130:39613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.589254 18779 raft_consensus.cc:515] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.593372 18515 leader_election.cc:304] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 986858f96f164e3b953d9042f283441d
I20260709 13:16:55.597026 18741 tablet_bootstrap.cc:492] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d: Bootstrap starting.
I20260709 13:16:55.599725 18547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b446d0be3461437fbc4b72e365379739" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:16:55.600385 18547 raft_consensus.cc:3060] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.600498 18548 raft_consensus.cc:2468] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 1.
I20260709 13:16:55.601564 18748 raft_consensus.cc:2764] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:16:55.605731 18589 leader_election.cc:304] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 986858f96f164e3b953d9042f283441d, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:16:55.606112 18698 raft_consensus.cc:2468] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 1.
I20260709 13:16:55.612453 18515 leader_election.cc:304] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 986858f96f164e3b953d9042f283441d
I20260709 13:16:55.610977 18785 raft_consensus.cc:2804] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.610823 18777 leader_election.cc:290] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:55.617314 18779 leader_election.cc:290] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:55.614168 18785 raft_consensus.cc:697] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Becoming Leader. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:16:55.620033 18743 tablet_bootstrap.cc:492] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58: No bootstrap required, opened a new log
I20260709 13:16:55.620555 18743 ts_tablet_manager.cc:1403] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58: Time spent bootstrapping tablet: real 0.080s	user 0.007s	sys 0.006s
I20260709 13:16:55.616217 18548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadccd38426441c09950dc14c00c5362" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:16:55.618845 18698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b446d0be3461437fbc4b72e365379739" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:16:55.621388 18698 raft_consensus.cc:3060] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.621965 18746 raft_consensus.cc:2749] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.623759 18696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadccd38426441c09950dc14c00c5362" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:16:55.624563 18696 raft_consensus.cc:3060] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.622406 18548 raft_consensus.cc:3060] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.620764 18785 consensus_queue.cc:237] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.653823 18749 consensus_queue.cc:1048] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [LEADER]: Connected to new peer: Peer: permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:55.666981 18758 consensus_queue.cc:1048] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:16:55.695724 18696 raft_consensus.cc:2468] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 1.
I20260709 13:16:55.686275 18787 raft_consensus.cc:2804] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.686245 18743 raft_consensus.cc:359] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.698138 18743 raft_consensus.cc:385] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.697873 18787 raft_consensus.cc:493] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.698505 18743 raft_consensus.cc:740] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.682124 18786 raft_consensus.cc:2804] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.695000 18741 tablet_bootstrap.cc:654] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.698714 18787 raft_consensus.cc:3060] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.698966 18786 raft_consensus.cc:493] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.698359 18590 leader_election.cc:304] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, 986858f96f164e3b953d9042f283441d; no voters: 
I20260709 13:16:55.691852 18547 raft_consensus.cc:2468] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 1.
I20260709 13:16:55.699874 18785 raft_consensus.cc:2804] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.699997 18786 raft_consensus.cc:3060] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.700573 18785 raft_consensus.cc:697] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Becoming Leader. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:16:55.701756 18785 consensus_queue.cc:237] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.699275 18743 consensus_queue.cc:260] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.694661 18742 tablet_bootstrap.cc:654] T 2be9bebe23ce482db62df897c49c491c P 0be17c477d094fb197929930b8fa419a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.705540 18548 raft_consensus.cc:2468] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 1.
I20260709 13:16:55.705094 18589 leader_election.cc:304] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 986858f96f164e3b953d9042f283441d, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:16:55.722993 18746 raft_consensus.cc:2804] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.724571 18746 raft_consensus.cc:697] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Becoming Leader. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:16:55.728039 18743 ts_tablet_manager.cc:1434] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58: Time spent starting tablet: real 0.107s	user 0.027s	sys 0.035s
I20260709 13:16:55.726826 18779 raft_consensus.cc:493] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.728056 18746 consensus_queue.cc:237] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.739449 18698 raft_consensus.cc:2468] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 1.
I20260709 13:16:55.730268 18779 raft_consensus.cc:515] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.760771 18779 leader_election.cc:290] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:55.763760 18698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be9bebe23ce482db62df897c49c491c" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be17c477d094fb197929930b8fa419a" is_pre_election: true
W20260709 13:16:55.767146 18590 leader_election.cc:343] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.766888 18741 tablet_bootstrap.cc:492] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d: No bootstrap required, opened a new log
I20260709 13:16:55.768144 18741 ts_tablet_manager.cc:1403] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d: Time spent bootstrapping tablet: real 0.172s	user 0.023s	sys 0.000s
I20260709 13:16:55.774852 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be9bebe23ce482db62df897c49c491c" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" is_pre_election: true
I20260709 13:16:55.758570 18786 raft_consensus.cc:515] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.775624 18549 raft_consensus.cc:2468] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 0.
I20260709 13:16:55.783309 18742 tablet_bootstrap.cc:492] T 2be9bebe23ce482db62df897c49c491c P 0be17c477d094fb197929930b8fa419a: No bootstrap required, opened a new log
I20260709 13:16:55.784097 18742 ts_tablet_manager.cc:1403] T 2be9bebe23ce482db62df897c49c491c P 0be17c477d094fb197929930b8fa419a: Time spent bootstrapping tablet: real 0.202s	user 0.033s	sys 0.038s
I20260709 13:16:55.778409 18741 raft_consensus.cc:359] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.778846 18787 raft_consensus.cc:515] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.788846 18741 raft_consensus.cc:385] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.789357 18741 raft_consensus.cc:740] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 986858f96f164e3b953d9042f283441d, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.789907 18589 leader_election.cc:304] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 986858f96f164e3b953d9042f283441d, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 0be17c477d094fb197929930b8fa419a
I20260709 13:16:55.793315 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed009757b7834a2ca88c1cefee374b9c" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "986858f96f164e3b953d9042f283441d"
I20260709 13:16:55.792223 18746 raft_consensus.cc:2804] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.790251 18741 consensus_queue.cc:260] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.795737 18746 raft_consensus.cc:493] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.796087 18624 raft_consensus.cc:3060] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.796355 18746 raft_consensus.cc:3060] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.797986 18741 ts_tablet_manager.cc:1434] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.001s
I20260709 13:16:55.799096 18741 tablet_bootstrap.cc:492] T 910fb7bb019f4c54a7be5fbec560bee4 P 986858f96f164e3b953d9042f283441d: Bootstrap starting.
I20260709 13:16:55.800669 18698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910fb7bb019f4c54a7be5fbec560bee4" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:16:55.801306 18698 raft_consensus.cc:3060] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.802865 18622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910fb7bb019f4c54a7be5fbec560bee4" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "986858f96f164e3b953d9042f283441d"
W20260709 13:16:55.806113 18515 leader_election.cc:343] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 986858f96f164e3b953d9042f283441d (127.17.251.130:39613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.804566 18787 leader_election.cc:290] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 1 election: Requested vote from peers 986858f96f164e3b953d9042f283441d (127.17.251.130:39613), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:55.808718 18742 raft_consensus.cc:359] T 2be9bebe23ce482db62df897c49c491c P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.809417 18742 raft_consensus.cc:385] T 2be9bebe23ce482db62df897c49c491c P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.809594 18742 raft_consensus.cc:740] T 2be9bebe23ce482db62df897c49c491c P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.810420 18742 consensus_queue.cc:260] T 2be9bebe23ce482db62df897c49c491c P 0be17c477d094fb197929930b8fa419a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.813170 18742 ts_tablet_manager.cc:1434] T 2be9bebe23ce482db62df897c49c491c P 0be17c477d094fb197929930b8fa419a: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 13:16:55.813220 18624 raft_consensus.cc:2468] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdb2a960ea40486b97fe1dd5bceb6e58 in term 1.
I20260709 13:16:55.808034 18746 raft_consensus.cc:515] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.814306 18742 tablet_bootstrap.cc:492] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a: Bootstrap starting.
I20260709 13:16:55.815411 18741 tablet_bootstrap.cc:654] T 910fb7bb019f4c54a7be5fbec560bee4 P 986858f96f164e3b953d9042f283441d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.818476 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be9bebe23ce482db62df897c49c491c" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:16:55.819136 18549 raft_consensus.cc:3060] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.823452 18742 tablet_bootstrap.cc:654] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.824368 18698 raft_consensus.cc:2468] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdb2a960ea40486b97fe1dd5bceb6e58 in term 1.
I20260709 13:16:55.825750 18515 leader_election.cc:304] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 986858f96f164e3b953d9042f283441d
I20260709 13:16:55.828333 18787 raft_consensus.cc:2804] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.829473 18787 raft_consensus.cc:697] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 LEADER]: Becoming Leader. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Running, Role: LEADER
I20260709 13:16:55.830708 18787 consensus_queue.cc:237] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.826308 18549 raft_consensus.cc:2468] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 1.
I20260709 13:16:55.834061 18443 catalog_manager.cc:5697] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d reported cstate change: term changed from 0 to 1, leader changed from <none> to 986858f96f164e3b953d9042f283441d (127.17.251.130). New cstate: current_term: 1 leader_uuid: "986858f96f164e3b953d9042f283441d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.838969 18515 leader_election.cc:304] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 986858f96f164e3b953d9042f283441d, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:16:55.839865 18748 raft_consensus.cc:2804] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.840385 18748 raft_consensus.cc:697] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 LEADER]: Becoming Leader. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Running, Role: LEADER
I20260709 13:16:55.841284 18748 consensus_queue.cc:237] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.844899 18589 leader_election.cc:304] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 986858f96f164e3b953d9042f283441d, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:16:55.845793 18785 raft_consensus.cc:2804] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.845913 18786 leader_election.cc:290] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 1 election: Requested vote from peers 986858f96f164e3b953d9042f283441d (127.17.251.130:39613), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:55.846298 18785 raft_consensus.cc:697] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Becoming Leader. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:16:55.847122 18785 consensus_queue.cc:237] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.847560 18698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed009757b7834a2ca88c1cefee374b9c" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:16:55.848133 18698 raft_consensus.cc:3060] T ed009757b7834a2ca88c1cefee374b9c P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.855633 18698 raft_consensus.cc:2468] T ed009757b7834a2ca88c1cefee374b9c P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdb2a960ea40486b97fe1dd5bceb6e58 in term 1.
W20260709 13:16:55.857537 18493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:55.857432 18443 catalog_manager.cc:5697] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d reported cstate change: term changed from 0 to 1, leader changed from <none> to 986858f96f164e3b953d9042f283441d (127.17.251.130). New cstate: current_term: 1 leader_uuid: "986858f96f164e3b953d9042f283441d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.858369 18696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be9bebe23ce482db62df897c49c491c" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:16:55.858969 18746 leader_election.cc:290] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:55.859207 18696 raft_consensus.cc:3060] T 2be9bebe23ce482db62df897c49c491c P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.860469 18443 catalog_manager.cc:5697] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d reported cstate change: term changed from 0 to 1, leader changed from <none> to 986858f96f164e3b953d9042f283441d (127.17.251.130). New cstate: current_term: 1 leader_uuid: "986858f96f164e3b953d9042f283441d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.879065 18696 raft_consensus.cc:2468] T 2be9bebe23ce482db62df897c49c491c P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 1.
I20260709 13:16:55.879930 18741 tablet_bootstrap.cc:492] T 910fb7bb019f4c54a7be5fbec560bee4 P 986858f96f164e3b953d9042f283441d: No bootstrap required, opened a new log
I20260709 13:16:55.880414 18741 ts_tablet_manager.cc:1403] T 910fb7bb019f4c54a7be5fbec560bee4 P 986858f96f164e3b953d9042f283441d: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.019s
I20260709 13:16:55.881778 18742 tablet_bootstrap.cc:492] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a: No bootstrap required, opened a new log
I20260709 13:16:55.882205 18742 ts_tablet_manager.cc:1403] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a: Time spent bootstrapping tablet: real 0.068s	user 0.025s	sys 0.010s
I20260709 13:16:55.883047 18741 raft_consensus.cc:359] T 910fb7bb019f4c54a7be5fbec560bee4 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.883713 18741 raft_consensus.cc:385] T 910fb7bb019f4c54a7be5fbec560bee4 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.883960 18741 raft_consensus.cc:740] T 910fb7bb019f4c54a7be5fbec560bee4 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 986858f96f164e3b953d9042f283441d, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.884691 18742 raft_consensus.cc:359] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.885262 18742 raft_consensus.cc:385] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.885519 18742 raft_consensus.cc:740] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.886410 18742 consensus_queue.cc:260] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.888422 18742 ts_tablet_manager.cc:1434] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:55.884580 18741 consensus_queue.cc:260] T 910fb7bb019f4c54a7be5fbec560bee4 P 986858f96f164e3b953d9042f283441d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.891068 18741 ts_tablet_manager.cc:1434] T 910fb7bb019f4c54a7be5fbec560bee4 P 986858f96f164e3b953d9042f283441d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:16:55.891983 18741 tablet_bootstrap.cc:492] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d: Bootstrap starting.
I20260709 13:16:55.897634 18741 tablet_bootstrap.cc:654] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.898052 18443 catalog_manager.cc:5697] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 reported cstate change: term changed from 0 to 1, leader changed from <none> to fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.899444 18443 catalog_manager.cc:5697] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 reported cstate change: term changed from 0 to 1, leader changed from <none> to fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.902793 18741 tablet_bootstrap.cc:492] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d: No bootstrap required, opened a new log
I20260709 13:16:55.903294 18741 ts_tablet_manager.cc:1403] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:16:55.906019 18741 raft_consensus.cc:359] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.906762 18741 raft_consensus.cc:385] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.907015 18741 raft_consensus.cc:740] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 986858f96f164e3b953d9042f283441d, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.907888 18741 consensus_queue.cc:260] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.910058 18741 ts_tablet_manager.cc:1434] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:16:55.909487 18445 catalog_manager.cc:5697] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d reported cstate change: term changed from 0 to 1, leader changed from <none> to 986858f96f164e3b953d9042f283441d (127.17.251.130). New cstate: current_term: 1 leader_uuid: "986858f96f164e3b953d9042f283441d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.935204 18785 raft_consensus.cc:493] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.935667 18785 raft_consensus.cc:515] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.937456 18785 leader_election.cc:290] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:55.938313 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc12bc5743f54d799d5961dbd948b487" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" is_pre_election: true
I20260709 13:16:55.938664 18696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc12bc5743f54d799d5961dbd948b487" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be17c477d094fb197929930b8fa419a" is_pre_election: true
I20260709 13:16:55.938891 18549 raft_consensus.cc:2468] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 0.
I20260709 13:16:55.939292 18696 raft_consensus.cc:2468] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 0.
I20260709 13:16:55.940035 18589 leader_election.cc:304] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 986858f96f164e3b953d9042f283441d, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:16:55.940896 18785 raft_consensus.cc:2804] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.941300 18785 raft_consensus.cc:493] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.941658 18785 raft_consensus.cc:3060] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.948715 18785 raft_consensus.cc:515] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.951022 18785 leader_election.cc:290] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:55.951869 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc12bc5743f54d799d5961dbd948b487" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:16:55.952095 18696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc12bc5743f54d799d5961dbd948b487" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:16:55.952474 18549 raft_consensus.cc:3060] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.952665 18696 raft_consensus.cc:3060] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.959276 18549 raft_consensus.cc:2468] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 1.
I20260709 13:16:55.959882 18696 raft_consensus.cc:2468] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 1.
I20260709 13:16:55.961335 18589 leader_election.cc:304] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 986858f96f164e3b953d9042f283441d, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:16:55.962524 18785 raft_consensus.cc:2804] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.963042 18785 raft_consensus.cc:697] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Becoming Leader. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:16:55.963883 18785 consensus_queue.cc:237] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:55.969151 18749 consensus_queue.cc:1048] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:55.973078 18445 catalog_manager.cc:5697] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d reported cstate change: term changed from 0 to 1, leader changed from <none> to 986858f96f164e3b953d9042f283441d (127.17.251.130). New cstate: current_term: 1 leader_uuid: "986858f96f164e3b953d9042f283441d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.985138 18749 consensus_queue.cc:1048] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [LEADER]: Connected to new peer: Peer: permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:56.021323 18624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "394e630586524166a75f8ccb7b36487d"
dest_uuid: "986858f96f164e3b953d9042f283441d"
mode: GRACEFUL
new_leader_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
 from {username='slave'} at 127.0.0.1:56228
I20260709 13:16:56.022020 18624 raft_consensus.cc:606] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Received request to transfer leadership to TS fdb2a960ea40486b97fe1dd5bceb6e58
I20260709 13:16:56.028784 18785 consensus_queue.cc:1048] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.038295 18696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eedac45982444b2694146149384eecc6"
dest_uuid: "0be17c477d094fb197929930b8fa419a"
mode: GRACEFUL
new_leader_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
 from {username='slave'} at 127.0.0.1:60564
I20260709 13:16:56.039142 18696 raft_consensus.cc:606] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 1 LEADER]: Received request to transfer leadership to TS fdb2a960ea40486b97fe1dd5bceb6e58
I20260709 13:16:56.046628 18746 raft_consensus.cc:993] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d: : Instructing follower fdb2a960ea40486b97fe1dd5bceb6e58 to start an election
I20260709 13:16:56.047133 18746 raft_consensus.cc:1081] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Signalling peer fdb2a960ea40486b97fe1dd5bceb6e58 to start an election
I20260709 13:16:56.051649 18777 consensus_queue.cc:1048] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.051885 18548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "394e630586524166a75f8ccb7b36487d"
dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
 from {username='slave'} at 127.0.0.1:42372
I20260709 13:16:56.052592 18548 raft_consensus.cc:493] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:56.053010 18548 raft_consensus.cc:3060] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.052950 18624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b446d0be3461437fbc4b72e365379739"
dest_uuid: "986858f96f164e3b953d9042f283441d"
mode: GRACEFUL
new_leader_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
 from {username='slave'} at 127.0.0.1:56228
I20260709 13:16:56.053766 18624 raft_consensus.cc:606] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Received request to transfer leadership to TS fdb2a960ea40486b97fe1dd5bceb6e58
I20260709 13:16:56.064144 18548 raft_consensus.cc:515] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.064858 18624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dadccd38426441c09950dc14c00c5362"
dest_uuid: "986858f96f164e3b953d9042f283441d"
mode: GRACEFUL
new_leader_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
 from {username='slave'} at 127.0.0.1:56228
I20260709 13:16:56.065450 18624 raft_consensus.cc:606] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Received request to transfer leadership to TS fdb2a960ea40486b97fe1dd5bceb6e58
I20260709 13:16:56.071648 18548 leader_election.cc:290] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 2 election: Requested vote from peers 986858f96f164e3b953d9042f283441d (127.17.251.130:39613), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:56.072767 18698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394e630586524166a75f8ccb7b36487d" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:16:56.076623 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394e630586524166a75f8ccb7b36487d" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "986858f96f164e3b953d9042f283441d"
I20260709 13:16:56.077191 18624 raft_consensus.cc:3055] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:56.077502 18624 raft_consensus.cc:740] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:16:56.078303 18624 consensus_queue.cc:260] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.079298 18698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b03f75bbbac4deabd017e4b8b7310bb"
dest_uuid: "0be17c477d094fb197929930b8fa419a"
mode: GRACEFUL
new_leader_uuid: "986858f96f164e3b953d9042f283441d"
 from {username='slave'} at 127.0.0.1:60564
I20260709 13:16:56.079916 18624 raft_consensus.cc:3060] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.080032 18698 raft_consensus.cc:606] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 1 LEADER]: Received request to transfer leadership to TS 986858f96f164e3b953d9042f283441d
I20260709 13:16:56.087827 18624 raft_consensus.cc:2468] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdb2a960ea40486b97fe1dd5bceb6e58 in term 2.
I20260709 13:16:56.089035 18515 leader_election.cc:304] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 986858f96f164e3b953d9042f283441d, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 0be17c477d094fb197929930b8fa419a
I20260709 13:16:56.090225 18787 raft_consensus.cc:2804] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:56.090719 18787 raft_consensus.cc:697] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Becoming Leader. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Running, Role: LEADER
I20260709 13:16:56.091531 18787 consensus_queue.cc:237] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.100868 18446 catalog_manager.cc:5697] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 reported cstate change: term changed from 1 to 2, leader changed from 986858f96f164e3b953d9042f283441d (127.17.251.130) to fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.102849 18548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed009757b7834a2ca88c1cefee374b9c"
dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
mode: GRACEFUL
new_leader_uuid: "986858f96f164e3b953d9042f283441d"
 from {username='slave'} at 127.0.0.1:42374
I20260709 13:16:56.103655 18548 raft_consensus.cc:606] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 LEADER]: Received request to transfer leadership to TS 986858f96f164e3b953d9042f283441d
I20260709 13:16:56.115614 18548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "910fb7bb019f4c54a7be5fbec560bee4"
dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
mode: GRACEFUL
new_leader_uuid: "0be17c477d094fb197929930b8fa419a"
 from {username='slave'} at 127.0.0.1:42374
I20260709 13:16:56.116272 18548 raft_consensus.cc:606] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 LEADER]: Received request to transfer leadership to TS 0be17c477d094fb197929930b8fa419a
I20260709 13:16:56.132405 18777 consensus_queue.cc:1048] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.139431 18783 raft_consensus.cc:993] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d: : Instructing follower fdb2a960ea40486b97fe1dd5bceb6e58 to start an election
I20260709 13:16:56.139890 18783 raft_consensus.cc:1081] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Signalling peer fdb2a960ea40486b97fe1dd5bceb6e58 to start an election
I20260709 13:16:56.144518 18779 consensus_queue.cc:1048] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.148032 18549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b446d0be3461437fbc4b72e365379739"
dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
 from {username='slave'} at 127.0.0.1:42372
I20260709 13:16:56.148628 18549 raft_consensus.cc:493] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:56.149025 18549 raft_consensus.cc:3060] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.153856 18779 consensus_queue.cc:1048] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.156119 18749 raft_consensus.cc:993] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a: : Instructing follower fdb2a960ea40486b97fe1dd5bceb6e58 to start an election
I20260709 13:16:56.156579 18749 raft_consensus.cc:1081] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 1 LEADER]: Signalling peer fdb2a960ea40486b97fe1dd5bceb6e58 to start an election
I20260709 13:16:56.158094 18549 raft_consensus.cc:515] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.160305 18548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eedac45982444b2694146149384eecc6"
dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
 from {username='slave'} at 127.0.0.1:42362
I20260709 13:16:56.161060 18548 raft_consensus.cc:493] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:56.162593 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b446d0be3461437fbc4b72e365379739" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "986858f96f164e3b953d9042f283441d"
I20260709 13:16:56.163203 18624 raft_consensus.cc:3055] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:56.163539 18624 raft_consensus.cc:740] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:16:56.164636 18624 consensus_queue.cc:260] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.165905 18624 raft_consensus.cc:3060] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.161446 18548 raft_consensus.cc:3060] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.173967 18697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b446d0be3461437fbc4b72e365379739" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:16:56.181128 18624 raft_consensus.cc:2468] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdb2a960ea40486b97fe1dd5bceb6e58 in term 2.
I20260709 13:16:56.182575 18515 leader_election.cc:304] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 986858f96f164e3b953d9042f283441d, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 0be17c477d094fb197929930b8fa419a
I20260709 13:16:56.183516 18787 raft_consensus.cc:2804] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:56.183981 18787 raft_consensus.cc:697] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Becoming Leader. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Running, Role: LEADER
I20260709 13:16:56.184798 18787 consensus_queue.cc:237] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.185693 18548 raft_consensus.cc:515] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.186411 18779 consensus_queue.cc:1048] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.187723 18548 leader_election.cc:290] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 2 election: Requested vote from peers 986858f96f164e3b953d9042f283441d (127.17.251.130:39613), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:56.171454 18549 leader_election.cc:290] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 2 election: Requested vote from peers 986858f96f164e3b953d9042f283441d (127.17.251.130:39613), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:56.191866 18623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedac45982444b2694146149384eecc6" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "986858f96f164e3b953d9042f283441d"
I20260709 13:16:56.192242 18697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedac45982444b2694146149384eecc6" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:16:56.192467 18623 raft_consensus.cc:3060] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.192811 18697 raft_consensus.cc:3055] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:56.193123 18697 raft_consensus.cc:740] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Running, Role: LEADER
I20260709 13:16:56.196038 18697 consensus_queue.cc:260] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.197698 18697 raft_consensus.cc:3060] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.208567 18623 raft_consensus.cc:2468] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdb2a960ea40486b97fe1dd5bceb6e58 in term 2.
I20260709 13:16:56.209910 18515 leader_election.cc:304] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 986858f96f164e3b953d9042f283441d, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:16:56.210894 18787 raft_consensus.cc:2804] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:56.211436 18787 raft_consensus.cc:697] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Becoming Leader. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Running, Role: LEADER
I20260709 13:16:56.212473 18787 consensus_queue.cc:237] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.224001 18697 raft_consensus.cc:2468] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdb2a960ea40486b97fe1dd5bceb6e58 in term 2.
I20260709 13:16:56.228046 18783 raft_consensus.cc:993] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d: : Instructing follower fdb2a960ea40486b97fe1dd5bceb6e58 to start an election
I20260709 13:16:56.228524 18783 raft_consensus.cc:1081] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Signalling peer fdb2a960ea40486b97fe1dd5bceb6e58 to start an election
I20260709 13:16:56.229770 18445 catalog_manager.cc:5697] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 reported cstate change: term changed from 1 to 2, leader changed from 986858f96f164e3b953d9042f283441d (127.17.251.130) to fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.231022 18548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dadccd38426441c09950dc14c00c5362"
dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
 from {username='slave'} at 127.0.0.1:42372
I20260709 13:16:56.231580 18548 raft_consensus.cc:493] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:56.231978 18548 raft_consensus.cc:3060] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.238965 18548 raft_consensus.cc:515] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.240151 18549 raft_consensus.cc:1240] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Rejecting Update request from peer 986858f96f164e3b953d9042f283441d for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:56.242033 18623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadccd38426441c09950dc14c00c5362" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "986858f96f164e3b953d9042f283441d"
I20260709 13:16:56.245774 18777 consensus_queue.cc:1059] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.246348 18548 leader_election.cc:290] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 2 election: Requested vote from peers 986858f96f164e3b953d9042f283441d (127.17.251.130:39613), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:56.245787 18623 raft_consensus.cc:3055] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:56.248842 18623 raft_consensus.cc:740] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:16:56.248140 18697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadccd38426441c09950dc14c00c5362" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:16:56.250545 18697 raft_consensus.cc:3060] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.254832 18446 catalog_manager.cc:5697] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 reported cstate change: term changed from 1 to 2, leader changed from 0be17c477d094fb197929930b8fa419a (127.17.251.131) to fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.256163 18697 raft_consensus.cc:2468] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdb2a960ea40486b97fe1dd5bceb6e58 in term 2.
I20260709 13:16:56.257072 18623 consensus_queue.cc:260] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.257443 18515 leader_election.cc:304] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:16:56.258400 18787 raft_consensus.cc:2804] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:56.258401 18623 raft_consensus.cc:3060] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.259249 18787 raft_consensus.cc:697] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Becoming Leader. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Running, Role: LEADER
I20260709 13:16:56.260795 18787 consensus_queue.cc:237] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.265837 18777 consensus_queue.cc:1048] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.266206 18623 raft_consensus.cc:2468] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdb2a960ea40486b97fe1dd5bceb6e58 in term 2.
W20260709 13:16:56.266968 18746 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:16:56.273159 18445 catalog_manager.cc:5697] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 reported cstate change: term changed from 1 to 2, leader changed from 986858f96f164e3b953d9042f283441d (127.17.251.130) to fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.278856 18779 consensus_queue.cc:1048] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.310866 18787 consensus_queue.cc:1048] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.317566 18786 raft_consensus.cc:993] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58: : Instructing follower 0be17c477d094fb197929930b8fa419a to start an election
I20260709 13:16:56.318069 18786 raft_consensus.cc:1081] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 LEADER]: Signalling peer 0be17c477d094fb197929930b8fa419a to start an election
I20260709 13:16:56.319926 18698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "910fb7bb019f4c54a7be5fbec560bee4"
dest_uuid: "0be17c477d094fb197929930b8fa419a"
 from {username='slave'} at 127.0.0.1:60560
I20260709 13:16:56.320504 18698 raft_consensus.cc:493] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:56.320870 18698 raft_consensus.cc:3060] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.323348 18623 raft_consensus.cc:3060] T 910fb7bb019f4c54a7be5fbec560bee4 P 986858f96f164e3b953d9042f283441d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.327651 18698 raft_consensus.cc:515] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.329020 18697 raft_consensus.cc:1240] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Rejecting Update request from peer fdb2a960ea40486b97fe1dd5bceb6e58 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:56.330667 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910fb7bb019f4c54a7be5fbec560bee4" candidate_uuid: "0be17c477d094fb197929930b8fa419a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:16:56.331257 18698 leader_election.cc:290] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 2 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 986858f96f164e3b953d9042f283441d (127.17.251.130:39613)
I20260709 13:16:56.331319 18549 raft_consensus.cc:3055] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:56.331815 18549 raft_consensus.cc:740] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Running, Role: LEADER
I20260709 13:16:56.331854 18787 consensus_queue.cc:1059] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:56.332912 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910fb7bb019f4c54a7be5fbec560bee4" candidate_uuid: "0be17c477d094fb197929930b8fa419a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "986858f96f164e3b953d9042f283441d"
I20260709 13:16:56.333456 18624 raft_consensus.cc:3060] T 910fb7bb019f4c54a7be5fbec560bee4 P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.333470 18549 consensus_queue.cc:260] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.334857 18787 consensus_queue.cc:1048] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.336158 18549 raft_consensus.cc:3060] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.338903 18624 raft_consensus.cc:2468] T 910fb7bb019f4c54a7be5fbec560bee4 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0be17c477d094fb197929930b8fa419a in term 2.
I20260709 13:16:56.340010 18664 leader_election.cc:304] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, 986858f96f164e3b953d9042f283441d; no voters: 
I20260709 13:16:56.340793 18809 raft_consensus.cc:2804] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:56.341307 18809 raft_consensus.cc:697] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [term 2 LEADER]: Becoming Leader. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Running, Role: LEADER
I20260709 13:16:56.342095 18809 consensus_queue.cc:237] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.342724 18549 raft_consensus.cc:2468] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0be17c477d094fb197929930b8fa419a in term 2.
I20260709 13:16:56.349237 18446 catalog_manager.cc:5697] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a reported cstate change: term changed from 1 to 2, leader changed from fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129) to 0be17c477d094fb197929930b8fa419a (127.17.251.131). New cstate: current_term: 2 leader_uuid: "0be17c477d094fb197929930b8fa419a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:56.411146 18779 consensus_queue.cc:1048] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.424958 18779 consensus_queue.cc:1048] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:56.429997 18748 consensus_queue.cc:1048] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.447739 18787 consensus_queue.cc:1048] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.459712 18787 raft_consensus.cc:993] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58: : Instructing follower 986858f96f164e3b953d9042f283441d to start an election
I20260709 13:16:56.460258 18787 raft_consensus.cc:1081] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 LEADER]: Signalling peer 986858f96f164e3b953d9042f283441d to start an election
I20260709 13:16:56.461882 18624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed009757b7834a2ca88c1cefee374b9c"
dest_uuid: "986858f96f164e3b953d9042f283441d"
 from {username='slave'} at 127.0.0.1:56218
I20260709 13:16:56.462402 18624 raft_consensus.cc:493] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:56.462808 18624 raft_consensus.cc:3060] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.467389 18624 raft_consensus.cc:515] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.470122 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed009757b7834a2ca88c1cefee374b9c" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:16:56.470772 18549 raft_consensus.cc:3055] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:56.470841 18624 leader_election.cc:290] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 2 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:56.471155 18549 raft_consensus.cc:740] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Running, Role: LEADER
I20260709 13:16:56.471350 18623 raft_consensus.cc:1275] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Refusing update from remote peer fdb2a960ea40486b97fe1dd5bceb6e58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:56.471982 18549 consensus_queue.cc:260] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.473080 18549 raft_consensus.cc:3060] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.473161 18697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed009757b7834a2ca88c1cefee374b9c" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:16:56.473788 18697 raft_consensus.cc:3060] T ed009757b7834a2ca88c1cefee374b9c P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.477030 18787 consensus_queue.cc:1048] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:56.480086 18549 raft_consensus.cc:2468] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 2.
I20260709 13:16:56.482353 18589 leader_election.cc:304] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 986858f96f164e3b953d9042f283441d, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:16:56.483484 18697 raft_consensus.cc:2468] T ed009757b7834a2ca88c1cefee374b9c P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 2.
I20260709 13:16:56.483512 18779 raft_consensus.cc:2804] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:56.484266 18779 raft_consensus.cc:697] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d [term 2 LEADER]: Becoming Leader. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:16:56.485110 18779 consensus_queue.cc:237] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.488458 18697 raft_consensus.cc:3060] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.495995 18697 raft_consensus.cc:1275] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Refusing update from remote peer fdb2a960ea40486b97fe1dd5bceb6e58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:56.498258 18786 consensus_queue.cc:1048] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:56.500770 18446 catalog_manager.cc:5697] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d reported cstate change: term changed from 1 to 2, leader changed from fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129) to 986858f96f164e3b953d9042f283441d (127.17.251.130). New cstate: current_term: 2 leader_uuid: "986858f96f164e3b953d9042f283441d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.578220 18758 raft_consensus.cc:993] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a: : Instructing follower 986858f96f164e3b953d9042f283441d to start an election
I20260709 13:16:56.578729 18809 raft_consensus.cc:1081] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 1 LEADER]: Signalling peer 986858f96f164e3b953d9042f283441d to start an election
I20260709 13:16:56.580492 18623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b03f75bbbac4deabd017e4b8b7310bb"
dest_uuid: "986858f96f164e3b953d9042f283441d"
 from {username='slave'} at 127.0.0.1:56208
I20260709 13:16:56.581085 18623 raft_consensus.cc:493] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:56.581458 18623 raft_consensus.cc:3060] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.588196 18623 raft_consensus.cc:515] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.590291 18623 leader_election.cc:290] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 2 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:16:56.591176 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b03f75bbbac4deabd017e4b8b7310bb" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:16:56.591785 18549 raft_consensus.cc:3060] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.591666 18697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b03f75bbbac4deabd017e4b8b7310bb" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:16:56.592334 18697 raft_consensus.cc:3055] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:56.592664 18697 raft_consensus.cc:740] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Running, Role: LEADER
I20260709 13:16:56.593458 18697 consensus_queue.cc:260] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.594645 18697 raft_consensus.cc:3060] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.598527 18549 raft_consensus.cc:2468] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 2.
I20260709 13:16:56.599177 18698 raft_consensus.cc:1275] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Refusing update from remote peer fdb2a960ea40486b97fe1dd5bceb6e58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:56.599952 18589 leader_election.cc:304] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 986858f96f164e3b953d9042f283441d, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:16:56.600931 18779 raft_consensus.cc:2804] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:56.600800 18786 consensus_queue.cc:1048] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:56.601389 18779 raft_consensus.cc:697] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 2 LEADER]: Becoming Leader. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:16:56.602248 18779 consensus_queue.cc:237] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:56.606410 18697 raft_consensus.cc:2468] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 2.
I20260709 13:16:56.624634 18623 raft_consensus.cc:1275] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Refusing update from remote peer fdb2a960ea40486b97fe1dd5bceb6e58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:56.626423 18697 raft_consensus.cc:3060] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.640771 18697 raft_consensus.cc:1275] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Refusing update from remote peer fdb2a960ea40486b97fe1dd5bceb6e58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:56.693248 18748 consensus_queue.cc:1048] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:56.695603 18786 consensus_queue.cc:1048] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:56.718308 18624 raft_consensus.cc:1275] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Refusing update from remote peer fdb2a960ea40486b97fe1dd5bceb6e58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:56.719885 18748 consensus_queue.cc:1048] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:56.734660 18445 catalog_manager.cc:5697] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d reported cstate change: term changed from 1 to 2, leader changed from 0be17c477d094fb197929930b8fa419a (127.17.251.131) to 986858f96f164e3b953d9042f283441d (127.17.251.130). New cstate: current_term: 2 leader_uuid: "986858f96f164e3b953d9042f283441d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.822495 18624 raft_consensus.cc:1275] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Refusing update from remote peer fdb2a960ea40486b97fe1dd5bceb6e58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:56.825012 18748 consensus_queue.cc:1048] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:56.835486 18697 raft_consensus.cc:1275] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Refusing update from remote peer fdb2a960ea40486b97fe1dd5bceb6e58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:56.838340 18624 raft_consensus.cc:1275] T 910fb7bb019f4c54a7be5fbec560bee4 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Refusing update from remote peer 0be17c477d094fb197929930b8fa419a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:56.839884 18809 consensus_queue.cc:1048] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [LEADER]: Connected to new peer: Peer: permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.841018 18793 consensus_queue.cc:1048] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:56.882687 18549 raft_consensus.cc:1275] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Refusing update from remote peer 0be17c477d094fb197929930b8fa419a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:56.884593 18758 consensus_queue.cc:1048] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:56.921489 18549 raft_consensus.cc:1275] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Refusing update from remote peer 986858f96f164e3b953d9042f283441d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:56.923009 18785 consensus_queue.cc:1048] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:56.931090 18698 raft_consensus.cc:1275] T ed009757b7834a2ca88c1cefee374b9c P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Refusing update from remote peer 986858f96f164e3b953d9042f283441d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:56.932705 18785 consensus_queue.cc:1048] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:57.008118 18549 raft_consensus.cc:1275] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Refusing update from remote peer 986858f96f164e3b953d9042f283441d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:57.009577 18785 consensus_queue.cc:1048] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:57.018275 18698 raft_consensus.cc:1275] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Refusing update from remote peer 986858f96f164e3b953d9042f283441d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:57.020146 18779 consensus_queue.cc:1048] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:57.763581 18645 debug-util.cc:398] Leaking SignalData structure 0x7b080012c000 after lost signal to thread 18417
W20260709 13:16:57.764328 18645 debug-util.cc:398] Leaking SignalData structure 0x7b080012c6e0 after lost signal to thread 18480
W20260709 13:16:57.765060 18645 debug-util.cc:398] Leaking SignalData structure 0x7b08001edfa0 after lost signal to thread 18573
W20260709 13:16:57.765753 18645 debug-util.cc:398] Leaking SignalData structure 0x7b08001eda00 after lost signal to thread 18648
W20260709 13:16:57.766530 18645 debug-util.cc:398] Leaking SignalData structure 0x7b080015ada0 after lost signal to thread 18722
I20260709 13:16:59.154115 18414 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:16:59.154991 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:59.175601 18549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b446d0be3461437fbc4b72e365379739"
dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
mode: GRACEFUL
new_leader_uuid: "0be17c477d094fb197929930b8fa419a"
 from {username='slave'} at 127.0.0.1:42384
I20260709 13:16:59.176167 18549 raft_consensus.cc:606] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Received request to transfer leadership to TS 0be17c477d094fb197929930b8fa419a
I20260709 13:16:59.188247 18623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc12bc5743f54d799d5961dbd948b487"
dest_uuid: "986858f96f164e3b953d9042f283441d"
mode: GRACEFUL
new_leader_uuid: "0be17c477d094fb197929930b8fa419a"
 from {username='slave'} at 127.0.0.1:56244
I20260709 13:16:59.188810 18623 raft_consensus.cc:606] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Received request to transfer leadership to TS 0be17c477d094fb197929930b8fa419a
I20260709 13:16:59.190156 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:59.190821 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:59.308573 18833 raft_consensus.cc:993] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58: : Instructing follower 0be17c477d094fb197929930b8fa419a to start an election
I20260709 13:16:59.309079 18786 raft_consensus.cc:1081] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Signalling peer 0be17c477d094fb197929930b8fa419a to start an election
I20260709 13:16:59.310735 18697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b446d0be3461437fbc4b72e365379739"
dest_uuid: "0be17c477d094fb197929930b8fa419a"
 from {username='slave'} at 127.0.0.1:60560
I20260709 13:16:59.311249 18697 raft_consensus.cc:493] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:59.311563 18697 raft_consensus.cc:3060] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:59.316076 18697 raft_consensus.cc:515] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:59.318919 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b446d0be3461437fbc4b72e365379739" candidate_uuid: "0be17c477d094fb197929930b8fa419a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:16:59.318969 18623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b446d0be3461437fbc4b72e365379739" candidate_uuid: "0be17c477d094fb197929930b8fa419a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "986858f96f164e3b953d9042f283441d"
I20260709 13:16:59.319590 18549 raft_consensus.cc:3055] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:59.319659 18623 raft_consensus.cc:3060] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:59.320021 18549 raft_consensus.cc:740] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Running, Role: LEADER
I20260709 13:16:59.321110 18697 leader_election.cc:290] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 3 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 986858f96f164e3b953d9042f283441d (127.17.251.130:39613)
I20260709 13:16:59.320797 18549 consensus_queue.cc:260] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:59.322149 18549 raft_consensus.cc:3060] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:59.326484 18623 raft_consensus.cc:2468] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0be17c477d094fb197929930b8fa419a in term 3.
I20260709 13:16:59.327764 18664 leader_election.cc:304] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, 986858f96f164e3b953d9042f283441d; no voters: 
I20260709 13:16:59.328625 18758 raft_consensus.cc:2804] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:59.328719 18549 raft_consensus.cc:2468] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0be17c477d094fb197929930b8fa419a in term 3.
I20260709 13:16:59.330780 18758 raft_consensus.cc:697] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 3 LEADER]: Becoming Leader. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Running, Role: LEADER
I20260709 13:16:59.331741 18758 consensus_queue.cc:237] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:59.346426 18444 catalog_manager.cc:5697] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a reported cstate change: term changed from 2 to 3, leader changed from fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129) to 0be17c477d094fb197929930b8fa419a (127.17.251.131). New cstate: current_term: 3 leader_uuid: "0be17c477d094fb197929930b8fa419a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.449749 18840 raft_consensus.cc:993] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d: : Instructing follower 0be17c477d094fb197929930b8fa419a to start an election
I20260709 13:16:59.450260 18779 raft_consensus.cc:1081] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Signalling peer 0be17c477d094fb197929930b8fa419a to start an election
I20260709 13:16:59.451948 18697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc12bc5743f54d799d5961dbd948b487"
dest_uuid: "0be17c477d094fb197929930b8fa419a"
 from {username='slave'} at 127.0.0.1:60554
I20260709 13:16:59.452464 18697 raft_consensus.cc:493] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:59.452780 18697 raft_consensus.cc:3060] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.457525 18697 raft_consensus.cc:515] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:59.459352 18697 leader_election.cc:290] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 2 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 986858f96f164e3b953d9042f283441d (127.17.251.130:39613)
I20260709 13:16:59.460244 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc12bc5743f54d799d5961dbd948b487" candidate_uuid: "0be17c477d094fb197929930b8fa419a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:16:59.460567 18623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc12bc5743f54d799d5961dbd948b487" candidate_uuid: "0be17c477d094fb197929930b8fa419a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "986858f96f164e3b953d9042f283441d"
I20260709 13:16:59.460948 18549 raft_consensus.cc:3060] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.461184 18623 raft_consensus.cc:3055] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:59.461572 18623 raft_consensus.cc:740] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:16:59.462368 18623 consensus_queue.cc:260] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:59.463286 18623 raft_consensus.cc:3060] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.467797 18623 raft_consensus.cc:2468] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0be17c477d094fb197929930b8fa419a in term 2.
I20260709 13:16:59.468021 18549 raft_consensus.cc:2468] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0be17c477d094fb197929930b8fa419a in term 2.
I20260709 13:16:59.468859 18664 leader_election.cc:304] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, 986858f96f164e3b953d9042f283441d; no voters: 
I20260709 13:16:59.469776 18758 raft_consensus.cc:2804] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:59.470300 18758 raft_consensus.cc:697] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 2 LEADER]: Becoming Leader. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Running, Role: LEADER
I20260709 13:16:59.471117 18758 consensus_queue.cc:237] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:16:59.479760 18444 catalog_manager.cc:5697] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a reported cstate change: term changed from 1 to 2, leader changed from 986858f96f164e3b953d9042f283441d (127.17.251.130) to 0be17c477d094fb197929930b8fa419a (127.17.251.131). New cstate: current_term: 2 leader_uuid: "0be17c477d094fb197929930b8fa419a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.788889 18623 raft_consensus.cc:1275] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Refusing update from remote peer 0be17c477d094fb197929930b8fa419a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:59.790526 18758 consensus_queue.cc:1048] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [LEADER]: Connected to new peer: Peer: permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:59.801153 18549 raft_consensus.cc:1275] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Refusing update from remote peer 0be17c477d094fb197929930b8fa419a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:59.803128 18758 consensus_queue.cc:1048] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:59.904091 18549 raft_consensus.cc:1275] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Refusing update from remote peer 0be17c477d094fb197929930b8fa419a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:59.905507 18758 consensus_queue.cc:1048] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:59.915997 18623 raft_consensus.cc:1275] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Refusing update from remote peer 0be17c477d094fb197929930b8fa419a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:59.918197 18834 consensus_queue.cc:1048] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [LEADER]: Connected to new peer: Peer: permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.191807 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:00.206195 18549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "394e630586524166a75f8ccb7b36487d"
dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
mode: GRACEFUL
new_leader_uuid: "986858f96f164e3b953d9042f283441d"
 from {username='slave'} at 127.0.0.1:42374
I20260709 13:17:00.206704 18549 raft_consensus.cc:606] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Received request to transfer leadership to TS 986858f96f164e3b953d9042f283441d
I20260709 13:17:00.212219 18549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eedac45982444b2694146149384eecc6"
dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
mode: GRACEFUL
new_leader_uuid: "986858f96f164e3b953d9042f283441d"
 from {username='slave'} at 127.0.0.1:42374
I20260709 13:17:00.212711 18549 raft_consensus.cc:606] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Received request to transfer leadership to TS 986858f96f164e3b953d9042f283441d
I20260709 13:17:00.218117 18697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b446d0be3461437fbc4b72e365379739"
dest_uuid: "0be17c477d094fb197929930b8fa419a"
mode: GRACEFUL
new_leader_uuid: "986858f96f164e3b953d9042f283441d"
 from {username='slave'} at 127.0.0.1:60564
I20260709 13:17:00.218307 18847 raft_consensus.cc:993] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58: : Instructing follower 986858f96f164e3b953d9042f283441d to start an election
I20260709 13:17:00.218762 18697 raft_consensus.cc:606] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 3 LEADER]: Received request to transfer leadership to TS 986858f96f164e3b953d9042f283441d
I20260709 13:17:00.219038 18847 raft_consensus.cc:1081] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Signalling peer 986858f96f164e3b953d9042f283441d to start an election
I20260709 13:17:00.220788 18623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eedac45982444b2694146149384eecc6"
dest_uuid: "986858f96f164e3b953d9042f283441d"
 from {username='slave'} at 127.0.0.1:56218
I20260709 13:17:00.221449 18623 raft_consensus.cc:493] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:00.221864 18623 raft_consensus.cc:3060] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:00.224370 18549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dadccd38426441c09950dc14c00c5362"
dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
mode: GRACEFUL
new_leader_uuid: "986858f96f164e3b953d9042f283441d"
 from {username='slave'} at 127.0.0.1:42374
I20260709 13:17:00.224830 18549 raft_consensus.cc:606] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Received request to transfer leadership to TS 986858f96f164e3b953d9042f283441d
I20260709 13:17:00.229291 18623 raft_consensus.cc:515] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:00.232582 18623 leader_election.cc:290] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 3 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:17:00.232373 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedac45982444b2694146149384eecc6" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:17:00.233477 18697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedac45982444b2694146149384eecc6" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:17:00.234037 18697 raft_consensus.cc:3060] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:00.234607 18549 raft_consensus.cc:3055] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:00.234954 18549 raft_consensus.cc:740] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Running, Role: LEADER
I20260709 13:17:00.235680 18549 consensus_queue.cc:260] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:00.236685 18549 raft_consensus.cc:3060] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:00.244179 18697 raft_consensus.cc:2468] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 3.
I20260709 13:17:00.248610 18549 raft_consensus.cc:2468] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 3.
I20260709 13:17:00.249909 18589 leader_election.cc:304] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 986858f96f164e3b953d9042f283441d, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:17:00.250142 18698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc12bc5743f54d799d5961dbd948b487"
dest_uuid: "0be17c477d094fb197929930b8fa419a"
mode: GRACEFUL
new_leader_uuid: "986858f96f164e3b953d9042f283441d"
 from {username='slave'} at 127.0.0.1:60564
I20260709 13:17:00.250741 18698 raft_consensus.cc:606] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 2 LEADER]: Received request to transfer leadership to TS 986858f96f164e3b953d9042f283441d
I20260709 13:17:00.251020 18779 raft_consensus.cc:2804] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:00.252602 18779 raft_consensus.cc:697] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [term 3 LEADER]: Becoming Leader. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:17:00.253545 18779 consensus_queue.cc:237] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:00.261010 18445 catalog_manager.cc:5697] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d reported cstate change: term changed from 2 to 3, leader changed from fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129) to 986858f96f164e3b953d9042f283441d (127.17.251.130). New cstate: current_term: 3 leader_uuid: "986858f96f164e3b953d9042f283441d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.315960 18786 raft_consensus.cc:993] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58: : Instructing follower 986858f96f164e3b953d9042f283441d to start an election
I20260709 13:17:00.316365 18847 raft_consensus.cc:1081] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Signalling peer 986858f96f164e3b953d9042f283441d to start an election
I20260709 13:17:00.317984 18623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dadccd38426441c09950dc14c00c5362"
dest_uuid: "986858f96f164e3b953d9042f283441d"
 from {username='slave'} at 127.0.0.1:56218
I20260709 13:17:00.318579 18623 raft_consensus.cc:493] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:00.318960 18623 raft_consensus.cc:3060] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:00.326398 18623 raft_consensus.cc:515] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:00.328685 18623 leader_election.cc:290] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 3 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:17:00.329468 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadccd38426441c09950dc14c00c5362" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:17:00.329885 18697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadccd38426441c09950dc14c00c5362" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:17:00.330075 18549 raft_consensus.cc:3055] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:00.330523 18549 raft_consensus.cc:740] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Running, Role: LEADER
I20260709 13:17:00.330559 18697 raft_consensus.cc:3060] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:00.331277 18549 consensus_queue.cc:260] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:00.332346 18549 raft_consensus.cc:3060] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:00.336613 18549 raft_consensus.cc:2468] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 3.
I20260709 13:17:00.337581 18589 leader_election.cc:304] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 986858f96f164e3b953d9042f283441d, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:17:00.337697 18697 raft_consensus.cc:2468] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 3.
I20260709 13:17:00.338377 18779 raft_consensus.cc:2804] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:00.339058 18779 raft_consensus.cc:697] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 3 LEADER]: Becoming Leader. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:17:00.339783 18779 consensus_queue.cc:237] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:00.347777 18445 catalog_manager.cc:5697] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d reported cstate change: term changed from 2 to 3, leader changed from fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129) to 986858f96f164e3b953d9042f283441d (127.17.251.130). New cstate: current_term: 3 leader_uuid: "986858f96f164e3b953d9042f283441d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.440536 18856 raft_consensus.cc:993] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a: : Instructing follower 986858f96f164e3b953d9042f283441d to start an election
I20260709 13:17:00.441041 18834 raft_consensus.cc:1081] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 2 LEADER]: Signalling peer 986858f96f164e3b953d9042f283441d to start an election
I20260709 13:17:00.442813 18623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc12bc5743f54d799d5961dbd948b487"
dest_uuid: "986858f96f164e3b953d9042f283441d"
 from {username='slave'} at 127.0.0.1:56208
I20260709 13:17:00.443428 18623 raft_consensus.cc:493] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:00.443804 18623 raft_consensus.cc:3060] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:00.451737 18623 raft_consensus.cc:515] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:00.453797 18623 leader_election.cc:290] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 3 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:17:00.454720 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc12bc5743f54d799d5961dbd948b487" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:17:00.454826 18697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc12bc5743f54d799d5961dbd948b487" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:17:00.455332 18549 raft_consensus.cc:3060] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:00.455410 18697 raft_consensus.cc:3055] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:00.455791 18697 raft_consensus.cc:740] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Running, Role: LEADER
I20260709 13:17:00.456562 18697 consensus_queue.cc:260] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:00.457763 18697 raft_consensus.cc:3060] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:00.459790 18549 raft_consensus.cc:2468] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 3.
I20260709 13:17:00.460911 18589 leader_election.cc:304] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 986858f96f164e3b953d9042f283441d, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:17:00.461706 18779 raft_consensus.cc:2804] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:00.462155 18779 raft_consensus.cc:697] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 3 LEADER]: Becoming Leader. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:17:00.462953 18779 consensus_queue.cc:237] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:00.464581 18697 raft_consensus.cc:2468] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 3.
I20260709 13:17:00.469282 18445 catalog_manager.cc:5697] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d reported cstate change: term changed from 2 to 3, leader changed from 0be17c477d094fb197929930b8fa419a (127.17.251.131) to 986858f96f164e3b953d9042f283441d (127.17.251.130). New cstate: current_term: 3 leader_uuid: "986858f96f164e3b953d9042f283441d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.563104 18786 raft_consensus.cc:993] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58: : Instructing follower 986858f96f164e3b953d9042f283441d to start an election
I20260709 13:17:00.563573 18847 raft_consensus.cc:1081] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Signalling peer 986858f96f164e3b953d9042f283441d to start an election
I20260709 13:17:00.565127 18623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "394e630586524166a75f8ccb7b36487d"
dest_uuid: "986858f96f164e3b953d9042f283441d"
 from {username='slave'} at 127.0.0.1:56218
I20260709 13:17:00.565793 18623 raft_consensus.cc:493] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:00.566195 18623 raft_consensus.cc:3060] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:00.574101 18623 raft_consensus.cc:515] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:00.576440 18623 leader_election.cc:290] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 3 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:17:00.577543 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394e630586524166a75f8ccb7b36487d" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:17:00.578220 18549 raft_consensus.cc:3055] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:00.578562 18549 raft_consensus.cc:740] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Running, Role: LEADER
I20260709 13:17:00.578724 18697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394e630586524166a75f8ccb7b36487d" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:17:00.579423 18697 raft_consensus.cc:3060] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:00.579413 18549 consensus_queue.cc:260] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:00.580461 18549 raft_consensus.cc:3060] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:00.584772 18549 raft_consensus.cc:2468] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 3.
I20260709 13:17:00.586017 18589 leader_election.cc:304] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 986858f96f164e3b953d9042f283441d, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:17:00.586838 18779 raft_consensus.cc:2804] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:00.587227 18697 raft_consensus.cc:2468] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 3.
I20260709 13:17:00.587332 18779 raft_consensus.cc:697] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 3 LEADER]: Becoming Leader. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:17:00.588721 18779 consensus_queue.cc:237] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:00.596741 18445 catalog_manager.cc:5697] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d reported cstate change: term changed from 2 to 3, leader changed from fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129) to 986858f96f164e3b953d9042f283441d (127.17.251.130). New cstate: current_term: 3 leader_uuid: "986858f96f164e3b953d9042f283441d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.647710 18856 raft_consensus.cc:993] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a: : Instructing follower 986858f96f164e3b953d9042f283441d to start an election
I20260709 13:17:00.648270 18834 raft_consensus.cc:1081] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 3 LEADER]: Signalling peer 986858f96f164e3b953d9042f283441d to start an election
I20260709 13:17:00.649825 18623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b446d0be3461437fbc4b72e365379739"
dest_uuid: "986858f96f164e3b953d9042f283441d"
 from {username='slave'} at 127.0.0.1:56208
I20260709 13:17:00.650295 18623 raft_consensus.cc:493] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:00.650590 18623 raft_consensus.cc:3060] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:00.654676 18623 raft_consensus.cc:515] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:00.656183 18623 leader_election.cc:290] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 4 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:17:00.657199 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b446d0be3461437fbc4b72e365379739" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:17:00.657589 18697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b446d0be3461437fbc4b72e365379739" candidate_uuid: "986858f96f164e3b953d9042f283441d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:17:00.657809 18549 raft_consensus.cc:3060] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:00.658120 18697 raft_consensus.cc:3055] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:00.658413 18697 raft_consensus.cc:740] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Running, Role: LEADER
I20260709 13:17:00.659034 18697 consensus_queue.cc:260] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:00.659866 18697 raft_consensus.cc:3060] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:00.664803 18698 raft_consensus.cc:1275] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Refusing update from remote peer 986858f96f164e3b953d9042f283441d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:00.665359 18697 raft_consensus.cc:2468] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 4.
I20260709 13:17:00.666067 18549 raft_consensus.cc:2468] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 986858f96f164e3b953d9042f283441d in term 4.
I20260709 13:17:00.666522 18850 consensus_queue.cc:1048] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:00.666680 18590 leader_election.cc:304] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, 986858f96f164e3b953d9042f283441d; no voters: 
I20260709 13:17:00.667959 18779 raft_consensus.cc:2804] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:00.668546 18779 raft_consensus.cc:697] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 4 LEADER]: Becoming Leader. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:17:00.669552 18779 consensus_queue.cc:237] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:00.679430 18444 catalog_manager.cc:5697] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d reported cstate change: term changed from 3 to 4, leader changed from 0be17c477d094fb197929930b8fa419a (127.17.251.131) to 986858f96f164e3b953d9042f283441d (127.17.251.130). New cstate: current_term: 4 leader_uuid: "986858f96f164e3b953d9042f283441d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.683593 18549 raft_consensus.cc:1275] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Refusing update from remote peer 986858f96f164e3b953d9042f283441d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:00.685097 18860 consensus_queue.cc:1048] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:00.749814 18549 raft_consensus.cc:1275] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Refusing update from remote peer 986858f96f164e3b953d9042f283441d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:00.751271 18860 consensus_queue.cc:1048] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:00.761408 18697 raft_consensus.cc:1275] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Refusing update from remote peer 986858f96f164e3b953d9042f283441d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:00.763196 18850 consensus_queue.cc:1048] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:00.860836 18549 raft_consensus.cc:1275] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Refusing update from remote peer 986858f96f164e3b953d9042f283441d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:00.862182 18860 consensus_queue.cc:1048] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:00.870683 18697 raft_consensus.cc:1275] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Refusing update from remote peer 986858f96f164e3b953d9042f283441d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:00.872534 18850 consensus_queue.cc:1048] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:01.071280 18549 raft_consensus.cc:1275] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Refusing update from remote peer 986858f96f164e3b953d9042f283441d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:01.072535 18850 consensus_queue.cc:1048] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:01.080516 18697 raft_consensus.cc:1275] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Refusing update from remote peer 986858f96f164e3b953d9042f283441d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:01.082222 18850 consensus_queue.cc:1048] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:01.110036 18697 raft_consensus.cc:1275] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 4 FOLLOWER]: Refusing update from remote peer 986858f96f164e3b953d9042f283441d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:01.111198 18850 consensus_queue.cc:1048] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:01.116472 18549 raft_consensus.cc:1275] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 4 FOLLOWER]: Refusing update from remote peer 986858f96f164e3b953d9042f283441d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:01.121920 18860 consensus_queue.cc:1048] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:03.256343 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:03.264070 18623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2be9bebe23ce482db62df897c49c491c"
dest_uuid: "986858f96f164e3b953d9042f283441d"
mode: GRACEFUL
new_leader_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
 from {username='slave'} at 127.0.0.1:56244
I20260709 13:17:03.264909 18623 raft_consensus.cc:606] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Received request to transfer leadership to TS fdb2a960ea40486b97fe1dd5bceb6e58
I20260709 13:17:03.267760 18623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "394e630586524166a75f8ccb7b36487d"
dest_uuid: "986858f96f164e3b953d9042f283441d"
mode: GRACEFUL
new_leader_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
 from {username='slave'} at 127.0.0.1:56244
I20260709 13:17:03.268199 18623 raft_consensus.cc:606] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 3 LEADER]: Received request to transfer leadership to TS fdb2a960ea40486b97fe1dd5bceb6e58
I20260709 13:17:03.270570 18623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b03f75bbbac4deabd017e4b8b7310bb"
dest_uuid: "986858f96f164e3b953d9042f283441d"
mode: GRACEFUL
new_leader_uuid: "0be17c477d094fb197929930b8fa419a"
 from {username='slave'} at 127.0.0.1:56244
I20260709 13:17:03.271019 18623 raft_consensus.cc:606] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 2 LEADER]: Received request to transfer leadership to TS 0be17c477d094fb197929930b8fa419a
I20260709 13:17:03.273313 18623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b446d0be3461437fbc4b72e365379739"
dest_uuid: "986858f96f164e3b953d9042f283441d"
mode: GRACEFUL
new_leader_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
 from {username='slave'} at 127.0.0.1:56244
I20260709 13:17:03.273795 18623 raft_consensus.cc:606] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 4 LEADER]: Received request to transfer leadership to TS fdb2a960ea40486b97fe1dd5bceb6e58
I20260709 13:17:03.276198 18623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc12bc5743f54d799d5961dbd948b487"
dest_uuid: "986858f96f164e3b953d9042f283441d"
mode: GRACEFUL
new_leader_uuid: "0be17c477d094fb197929930b8fa419a"
 from {username='slave'} at 127.0.0.1:56244
I20260709 13:17:03.276736 18623 raft_consensus.cc:606] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 3 LEADER]: Received request to transfer leadership to TS 0be17c477d094fb197929930b8fa419a
I20260709 13:17:03.277869 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:03.278407 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:03.306290 18850 raft_consensus.cc:993] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d: : Instructing follower fdb2a960ea40486b97fe1dd5bceb6e58 to start an election
I20260709 13:17:03.306846 18872 raft_consensus.cc:1081] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 4 LEADER]: Signalling peer fdb2a960ea40486b97fe1dd5bceb6e58 to start an election
I20260709 13:17:03.308560 18549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b446d0be3461437fbc4b72e365379739"
dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
 from {username='slave'} at 127.0.0.1:42372
I20260709 13:17:03.309067 18549 raft_consensus.cc:493] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:03.309428 18549 raft_consensus.cc:3060] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:03.314392 18549 raft_consensus.cc:515] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:03.316056 18549 leader_election.cc:290] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 5 election: Requested vote from peers 986858f96f164e3b953d9042f283441d (127.17.251.130:39613), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:17:03.317085 18623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b446d0be3461437fbc4b72e365379739" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "986858f96f164e3b953d9042f283441d"
I20260709 13:17:03.317437 18697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b446d0be3461437fbc4b72e365379739" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:17:03.317749 18623 raft_consensus.cc:3055] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:03.318004 18697 raft_consensus.cc:3060] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:03.318039 18623 raft_consensus.cc:740] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:17:03.319010 18623 consensus_queue.cc:260] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:03.319953 18623 raft_consensus.cc:3060] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:03.322769 18697 raft_consensus.cc:2468] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdb2a960ea40486b97fe1dd5bceb6e58 in term 5.
I20260709 13:17:03.323997 18515 leader_election.cc:304] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:17:03.324374 18623 raft_consensus.cc:2468] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdb2a960ea40486b97fe1dd5bceb6e58 in term 5.
I20260709 13:17:03.325762 18873 raft_consensus.cc:2804] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:03.326718 18873 raft_consensus.cc:697] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 5 LEADER]: Becoming Leader. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Running, Role: LEADER
I20260709 13:17:03.327603 18873 consensus_queue.cc:237] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:03.334996 18446 catalog_manager.cc:5697] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 reported cstate change: term changed from 4 to 5, leader changed from 986858f96f164e3b953d9042f283441d (127.17.251.130) to fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129). New cstate: current_term: 5 leader_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.553375 18850 raft_consensus.cc:993] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d: : Instructing follower fdb2a960ea40486b97fe1dd5bceb6e58 to start an election
I20260709 13:17:03.553781 18850 raft_consensus.cc:1081] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Signalling peer fdb2a960ea40486b97fe1dd5bceb6e58 to start an election
I20260709 13:17:03.555285 18549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2be9bebe23ce482db62df897c49c491c"
dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
 from {username='slave'} at 127.0.0.1:42372
I20260709 13:17:03.555728 18549 raft_consensus.cc:493] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:03.555989 18549 raft_consensus.cc:3060] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:03.560110 18549 raft_consensus.cc:515] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:03.561779 18549 leader_election.cc:290] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 2 election: Requested vote from peers 986858f96f164e3b953d9042f283441d (127.17.251.130:39613), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:17:03.562637 18623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be9bebe23ce482db62df897c49c491c" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "986858f96f164e3b953d9042f283441d"
I20260709 13:17:03.562897 18697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be9bebe23ce482db62df897c49c491c" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:17:03.563192 18623 raft_consensus.cc:3055] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:03.563403 18697 raft_consensus.cc:3060] T 2be9bebe23ce482db62df897c49c491c P 0be17c477d094fb197929930b8fa419a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:03.563486 18623 raft_consensus.cc:740] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:17:03.564245 18623 consensus_queue.cc:260] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:03.565069 18623 raft_consensus.cc:3060] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:03.567904 18697 raft_consensus.cc:2468] T 2be9bebe23ce482db62df897c49c491c P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdb2a960ea40486b97fe1dd5bceb6e58 in term 2.
I20260709 13:17:03.568934 18515 leader_election.cc:304] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:17:03.569296 18623 raft_consensus.cc:2468] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdb2a960ea40486b97fe1dd5bceb6e58 in term 2.
I20260709 13:17:03.569854 18873 raft_consensus.cc:2804] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:03.570382 18873 raft_consensus.cc:697] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Becoming Leader. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Running, Role: LEADER
I20260709 13:17:03.571198 18873 consensus_queue.cc:237] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:03.577698 18446 catalog_manager.cc:5697] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 reported cstate change: term changed from 1 to 2, leader changed from 986858f96f164e3b953d9042f283441d (127.17.251.130) to fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.609705 18872 raft_consensus.cc:993] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d: : Instructing follower fdb2a960ea40486b97fe1dd5bceb6e58 to start an election
I20260709 13:17:03.610150 18850 raft_consensus.cc:1081] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 3 LEADER]: Signalling peer fdb2a960ea40486b97fe1dd5bceb6e58 to start an election
I20260709 13:17:03.611516 18549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "394e630586524166a75f8ccb7b36487d"
dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
 from {username='slave'} at 127.0.0.1:42372
I20260709 13:17:03.611951 18549 raft_consensus.cc:493] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:03.612223 18549 raft_consensus.cc:3060] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:03.616304 18549 raft_consensus.cc:515] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:03.617806 18549 leader_election.cc:290] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 4 election: Requested vote from peers 986858f96f164e3b953d9042f283441d (127.17.251.130:39613), 0be17c477d094fb197929930b8fa419a (127.17.251.131:34097)
I20260709 13:17:03.618726 18623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394e630586524166a75f8ccb7b36487d" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "986858f96f164e3b953d9042f283441d"
I20260709 13:17:03.619068 18697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394e630586524166a75f8ccb7b36487d" candidate_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0be17c477d094fb197929930b8fa419a"
I20260709 13:17:03.619292 18623 raft_consensus.cc:3055] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:03.619565 18697 raft_consensus.cc:3060] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:03.619589 18623 raft_consensus.cc:740] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:17:03.620410 18623 consensus_queue.cc:260] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:03.621479 18623 raft_consensus.cc:3060] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:03.625663 18697 raft_consensus.cc:2468] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdb2a960ea40486b97fe1dd5bceb6e58 in term 4.
I20260709 13:17:03.626757 18515 leader_election.cc:304] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:17:03.627135 18623 raft_consensus.cc:2468] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdb2a960ea40486b97fe1dd5bceb6e58 in term 4.
I20260709 13:17:03.627492 18873 raft_consensus.cc:2804] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:03.627954 18873 raft_consensus.cc:697] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 4 LEADER]: Becoming Leader. State: Replica: fdb2a960ea40486b97fe1dd5bceb6e58, State: Running, Role: LEADER
I20260709 13:17:03.628827 18873 consensus_queue.cc:237] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:03.636319 18872 raft_consensus.cc:993] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d: : Instructing follower 0be17c477d094fb197929930b8fa419a to start an election
I20260709 13:17:03.636032 18446 catalog_manager.cc:5697] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 reported cstate change: term changed from 3 to 4, leader changed from 986858f96f164e3b953d9042f283441d (127.17.251.130) to fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129). New cstate: current_term: 4 leader_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.636788 18850 raft_consensus.cc:1081] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 3 LEADER]: Signalling peer 0be17c477d094fb197929930b8fa419a to start an election
I20260709 13:17:03.638438 18697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc12bc5743f54d799d5961dbd948b487"
dest_uuid: "0be17c477d094fb197929930b8fa419a"
 from {username='slave'} at 127.0.0.1:60554
I20260709 13:17:03.638938 18697 raft_consensus.cc:493] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:03.639283 18697 raft_consensus.cc:3060] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:03.644315 18697 raft_consensus.cc:515] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:03.645988 18697 leader_election.cc:290] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 4 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 986858f96f164e3b953d9042f283441d (127.17.251.130:39613)
I20260709 13:17:03.646735 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc12bc5743f54d799d5961dbd948b487" candidate_uuid: "0be17c477d094fb197929930b8fa419a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:17:03.647068 18623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc12bc5743f54d799d5961dbd948b487" candidate_uuid: "0be17c477d094fb197929930b8fa419a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "986858f96f164e3b953d9042f283441d"
I20260709 13:17:03.647246 18549 raft_consensus.cc:3060] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:03.647593 18623 raft_consensus.cc:3055] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:03.647857 18623 raft_consensus.cc:740] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:17:03.648445 18623 consensus_queue.cc:260] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:03.649271 18623 raft_consensus.cc:3060] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:03.652004 18549 raft_consensus.cc:2468] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0be17c477d094fb197929930b8fa419a in term 4.
I20260709 13:17:03.653074 18663 leader_election.cc:304] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:17:03.653307 18623 raft_consensus.cc:2468] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0be17c477d094fb197929930b8fa419a in term 4.
I20260709 13:17:03.653885 18834 raft_consensus.cc:2804] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:03.654930 18834 raft_consensus.cc:697] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 4 LEADER]: Becoming Leader. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Running, Role: LEADER
I20260709 13:17:03.655747 18834 consensus_queue.cc:237] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:03.662763 18446 catalog_manager.cc:5697] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a reported cstate change: term changed from 3 to 4, leader changed from 986858f96f164e3b953d9042f283441d (127.17.251.130) to 0be17c477d094fb197929930b8fa419a (127.17.251.131). New cstate: current_term: 4 leader_uuid: "0be17c477d094fb197929930b8fa419a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:03.773046 18872 raft_consensus.cc:993] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d: : Instructing follower 0be17c477d094fb197929930b8fa419a to start an election
I20260709 13:17:03.773526 18850 raft_consensus.cc:1081] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 2 LEADER]: Signalling peer 0be17c477d094fb197929930b8fa419a to start an election
I20260709 13:17:03.775007 18697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b03f75bbbac4deabd017e4b8b7310bb"
dest_uuid: "0be17c477d094fb197929930b8fa419a"
 from {username='slave'} at 127.0.0.1:60554
I20260709 13:17:03.775454 18697 raft_consensus.cc:493] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:03.775738 18697 raft_consensus.cc:3060] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.779692 18697 raft_consensus.cc:515] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:03.781145 18697 leader_election.cc:290] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 3 election: Requested vote from peers fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349), 986858f96f164e3b953d9042f283441d (127.17.251.130:39613)
I20260709 13:17:03.782147 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b03f75bbbac4deabd017e4b8b7310bb" candidate_uuid: "0be17c477d094fb197929930b8fa419a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58"
I20260709 13:17:03.782259 18623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b03f75bbbac4deabd017e4b8b7310bb" candidate_uuid: "0be17c477d094fb197929930b8fa419a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "986858f96f164e3b953d9042f283441d"
I20260709 13:17:03.782707 18549 raft_consensus.cc:3060] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.782810 18623 raft_consensus.cc:3055] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:03.783164 18623 raft_consensus.cc:740] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 986858f96f164e3b953d9042f283441d, State: Running, Role: LEADER
I20260709 13:17:03.783876 18623 consensus_queue.cc:260] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:03.784962 18623 raft_consensus.cc:3060] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.786978 18549 raft_consensus.cc:2468] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0be17c477d094fb197929930b8fa419a in term 3.
I20260709 13:17:03.787942 18663 leader_election.cc:304] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be17c477d094fb197929930b8fa419a, fdb2a960ea40486b97fe1dd5bceb6e58; no voters: 
I20260709 13:17:03.788717 18834 raft_consensus.cc:2804] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:03.789139 18834 raft_consensus.cc:697] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 3 LEADER]: Becoming Leader. State: Replica: 0be17c477d094fb197929930b8fa419a, State: Running, Role: LEADER
I20260709 13:17:03.789501 18623 raft_consensus.cc:2468] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0be17c477d094fb197929930b8fa419a in term 3.
I20260709 13:17:03.790127 18834 consensus_queue.cc:237] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } }
I20260709 13:17:03.796466 18446 catalog_manager.cc:5697] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a reported cstate change: term changed from 2 to 3, leader changed from 986858f96f164e3b953d9042f283441d (127.17.251.130) to 0be17c477d094fb197929930b8fa419a (127.17.251.131). New cstate: current_term: 3 leader_uuid: "0be17c477d094fb197929930b8fa419a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:03.888795 18623 raft_consensus.cc:1275] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 5 FOLLOWER]: Refusing update from remote peer fdb2a960ea40486b97fe1dd5bceb6e58: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:03.890312 18873 consensus_queue.cc:1048] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:03.901441 18697 raft_consensus.cc:1275] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 5 FOLLOWER]: Refusing update from remote peer fdb2a960ea40486b97fe1dd5bceb6e58: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:03.903409 18873 consensus_queue.cc:1048] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:04.020476 18623 raft_consensus.cc:1275] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Refusing update from remote peer fdb2a960ea40486b97fe1dd5bceb6e58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:04.021674 18873 consensus_queue.cc:1048] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:04.030774 18697 raft_consensus.cc:1275] T 2be9bebe23ce482db62df897c49c491c P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Refusing update from remote peer fdb2a960ea40486b97fe1dd5bceb6e58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:04.033062 18873 consensus_queue.cc:1048] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:04.057863 18623 raft_consensus.cc:1275] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 4 FOLLOWER]: Refusing update from remote peer fdb2a960ea40486b97fe1dd5bceb6e58: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:04.059048 18873 consensus_queue.cc:1048] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:04.069011 18697 raft_consensus.cc:1275] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a [term 4 FOLLOWER]: Refusing update from remote peer fdb2a960ea40486b97fe1dd5bceb6e58: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:04.071946 18894 consensus_queue.cc:1048] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be17c477d094fb197929930b8fa419a" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:04.127723 18549 raft_consensus.cc:1275] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 4 FOLLOWER]: Refusing update from remote peer 0be17c477d094fb197929930b8fa419a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:04.129199 18834 consensus_queue.cc:1048] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb2a960ea40486b97fe1dd5bceb6e58" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:04.138592 18623 raft_consensus.cc:1275] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 4 FOLLOWER]: Refusing update from remote peer 0be17c477d094fb197929930b8fa419a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:04.139966 18834 consensus_queue.cc:1048] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [LEADER]: Connected to new peer: Peer: permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:04.279350 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:04.284616 18414 tablet_server.cc:179] TabletServer@127.17.251.129:0 shutting down...
W20260709 13:17:04.303907 18589 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:17:04.311765 18589 consensus_peers.cc:597] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d -> Peer fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349): Couldn't send request to peer fdb2a960ea40486b97fe1dd5bceb6e58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:04.326637 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:04.327628 18414 tablet_replica.cc:333] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58: stopping tablet replica
I20260709 13:17:04.328485 18414 raft_consensus.cc:2243] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:17:04.328863 18663 consensus_peers.cc:597] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a -> Peer fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349): Couldn't send request to peer fdb2a960ea40486b97fe1dd5bceb6e58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:04.329418 18414 raft_consensus.cc:2272] T 2be9bebe23ce482db62df897c49c491c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.332077 18414 tablet_replica.cc:333] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58: stopping tablet replica
I20260709 13:17:04.332703 18414 raft_consensus.cc:2243] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.333204 18414 raft_consensus.cc:2272] T bc12bc5743f54d799d5961dbd948b487 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.335933 18414 tablet_replica.cc:333] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58: stopping tablet replica
I20260709 13:17:04.336462 18414 raft_consensus.cc:2243] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.336886 18414 raft_consensus.cc:2272] T 910fb7bb019f4c54a7be5fbec560bee4 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.338531 18414 tablet_replica.cc:333] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58: stopping tablet replica
I20260709 13:17:04.338999 18414 raft_consensus.cc:2243] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.339416 18414 raft_consensus.cc:2272] T ed009757b7834a2ca88c1cefee374b9c P fdb2a960ea40486b97fe1dd5bceb6e58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.341061 18414 tablet_replica.cc:333] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58: stopping tablet replica
I20260709 13:17:04.341542 18414 raft_consensus.cc:2243] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:17:04.342281 18414 raft_consensus.cc:2272] T b446d0be3461437fbc4b72e365379739 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.344158 18414 tablet_replica.cc:333] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58: stopping tablet replica
I20260709 13:17:04.344631 18414 raft_consensus.cc:2243] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:04.345458 18414 raft_consensus.cc:2272] T 394e630586524166a75f8ccb7b36487d P fdb2a960ea40486b97fe1dd5bceb6e58 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.346855 18624 raft_consensus.cc:1275] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Refusing update from remote peer 0be17c477d094fb197929930b8fa419a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:04.347643 18414 tablet_replica.cc:333] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58: stopping tablet replica
I20260709 13:17:04.348304 18414 raft_consensus.cc:2243] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.348266 18898 consensus_queue.cc:1048] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [LEADER]: Connected to new peer: Peer: permanent_uuid: "986858f96f164e3b953d9042f283441d" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 39613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:04.348928 18414 raft_consensus.cc:2272] T dadccd38426441c09950dc14c00c5362 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.351078 18414 tablet_replica.cc:333] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58: stopping tablet replica
I20260709 13:17:04.351732 18414 raft_consensus.cc:2243] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.352164 18414 raft_consensus.cc:2272] T 3b03f75bbbac4deabd017e4b8b7310bb P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.354748 18414 tablet_replica.cc:333] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58: stopping tablet replica
I20260709 13:17:04.355445 18414 raft_consensus.cc:2243] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.356014 18414 raft_consensus.cc:2272] T eedac45982444b2694146149384eecc6 P fdb2a960ea40486b97fe1dd5bceb6e58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.458725 18414 tablet_server.cc:196] TabletServer@127.17.251.129:0 shutdown complete.
W20260709 13:17:04.460323 18589 consensus_peers.cc:597] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d -> Peer fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349): Couldn't send request to peer fdb2a960ea40486b97fe1dd5bceb6e58. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:42349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:04.476858 18414 tablet_server.cc:179] TabletServer@127.17.251.130:0 shutting down...
I20260709 13:17:04.500762 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:04.501511 18414 tablet_replica.cc:333] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d: stopping tablet replica
I20260709 13:17:04.502164 18414 raft_consensus.cc:2243] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.502614 18414 raft_consensus.cc:2272] T bc12bc5743f54d799d5961dbd948b487 P 986858f96f164e3b953d9042f283441d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.505337 18414 tablet_replica.cc:333] T 910fb7bb019f4c54a7be5fbec560bee4 P 986858f96f164e3b953d9042f283441d: stopping tablet replica
I20260709 13:17:04.505904 18414 raft_consensus.cc:2243] T 910fb7bb019f4c54a7be5fbec560bee4 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.506315 18414 raft_consensus.cc:2272] T 910fb7bb019f4c54a7be5fbec560bee4 P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.508035 18414 tablet_replica.cc:333] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d: stopping tablet replica
I20260709 13:17:04.508656 18414 raft_consensus.cc:2243] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.509054 18414 raft_consensus.cc:2272] T 2be9bebe23ce482db62df897c49c491c P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.511025 18414 tablet_replica.cc:333] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d: stopping tablet replica
I20260709 13:17:04.511518 18414 raft_consensus.cc:2243] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.511934 18414 raft_consensus.cc:2272] T 3b03f75bbbac4deabd017e4b8b7310bb P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.513953 18414 tablet_replica.cc:333] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d: stopping tablet replica
I20260709 13:17:04.514448 18414 raft_consensus.cc:2243] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:04.515154 18414 raft_consensus.cc:2272] T eedac45982444b2694146149384eecc6 P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.516724 18414 tablet_replica.cc:333] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d: stopping tablet replica
I20260709 13:17:04.517199 18414 raft_consensus.cc:2243] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:04.517937 18414 raft_consensus.cc:2272] T dadccd38426441c09950dc14c00c5362 P 986858f96f164e3b953d9042f283441d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.519621 18414 tablet_replica.cc:333] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d: stopping tablet replica
I20260709 13:17:04.520072 18414 raft_consensus.cc:2243] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:04.520773 18414 raft_consensus.cc:2272] T ed009757b7834a2ca88c1cefee374b9c P 986858f96f164e3b953d9042f283441d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.522432 18414 tablet_replica.cc:333] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d: stopping tablet replica
I20260709 13:17:04.522876 18414 raft_consensus.cc:2243] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.523255 18414 raft_consensus.cc:2272] T b446d0be3461437fbc4b72e365379739 P 986858f96f164e3b953d9042f283441d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.525089 18414 tablet_replica.cc:333] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d: stopping tablet replica
I20260709 13:17:04.525525 18414 raft_consensus.cc:2243] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.525957 18414 raft_consensus.cc:2272] T 394e630586524166a75f8ccb7b36487d P 986858f96f164e3b953d9042f283441d [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:04.559072 18663 consensus_peers.cc:597] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a -> Peer fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349): Couldn't send request to peer fdb2a960ea40486b97fe1dd5bceb6e58. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:42349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:04.562106 18664 consensus_peers.cc:597] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a -> Peer 986858f96f164e3b953d9042f283441d (127.17.251.130:39613): Couldn't send request to peer 986858f96f164e3b953d9042f283441d. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:39613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:04.580322 18414 tablet_server.cc:196] TabletServer@127.17.251.130:0 shutdown complete.
W20260709 13:17:04.594228 18663 consensus_peers.cc:597] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a -> Peer fdb2a960ea40486b97fe1dd5bceb6e58 (127.17.251.129:42349): Couldn't send request to peer fdb2a960ea40486b97fe1dd5bceb6e58. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:42349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:04.599272 18414 tablet_server.cc:179] TabletServer@127.17.251.131:0 shutting down...
I20260709 13:17:04.626650 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:04.627341 18414 tablet_replica.cc:333] T 2be9bebe23ce482db62df897c49c491c P 0be17c477d094fb197929930b8fa419a: stopping tablet replica
I20260709 13:17:04.627986 18414 raft_consensus.cc:2243] T 2be9bebe23ce482db62df897c49c491c P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.628471 18414 raft_consensus.cc:2272] T 2be9bebe23ce482db62df897c49c491c P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.630650 18414 tablet_replica.cc:333] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a: stopping tablet replica
I20260709 13:17:04.631170 18414 raft_consensus.cc:2243] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:04.631906 18414 raft_consensus.cc:2272] T bc12bc5743f54d799d5961dbd948b487 P 0be17c477d094fb197929930b8fa419a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.634039 18414 tablet_replica.cc:333] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a: stopping tablet replica
I20260709 13:17:04.634547 18414 raft_consensus.cc:2243] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:04.635268 18414 raft_consensus.cc:2272] T 910fb7bb019f4c54a7be5fbec560bee4 P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.636835 18414 tablet_replica.cc:333] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a: stopping tablet replica
I20260709 13:17:04.637331 18414 raft_consensus.cc:2243] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.637797 18414 raft_consensus.cc:2272] T 394e630586524166a75f8ccb7b36487d P 0be17c477d094fb197929930b8fa419a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.639679 18414 tablet_replica.cc:333] T ed009757b7834a2ca88c1cefee374b9c P 0be17c477d094fb197929930b8fa419a: stopping tablet replica
I20260709 13:17:04.640182 18414 raft_consensus.cc:2243] T ed009757b7834a2ca88c1cefee374b9c P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.640607 18414 raft_consensus.cc:2272] T ed009757b7834a2ca88c1cefee374b9c P 0be17c477d094fb197929930b8fa419a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.642501 18414 tablet_replica.cc:333] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a: stopping tablet replica
I20260709 13:17:04.642969 18414 raft_consensus.cc:2243] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.643405 18414 raft_consensus.cc:2272] T b446d0be3461437fbc4b72e365379739 P 0be17c477d094fb197929930b8fa419a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.645342 18414 tablet_replica.cc:333] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a: stopping tablet replica
I20260709 13:17:04.645901 18414 raft_consensus.cc:2243] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.646338 18414 raft_consensus.cc:2272] T eedac45982444b2694146149384eecc6 P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.648025 18414 tablet_replica.cc:333] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a: stopping tablet replica
I20260709 13:17:04.648478 18414 raft_consensus.cc:2243] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:04.649187 18414 raft_consensus.cc:2272] T 3b03f75bbbac4deabd017e4b8b7310bb P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.651170 18414 tablet_replica.cc:333] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a: stopping tablet replica
I20260709 13:17:04.651614 18414 raft_consensus.cc:2243] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.652034 18414 raft_consensus.cc:2272] T dadccd38426441c09950dc14c00c5362 P 0be17c477d094fb197929930b8fa419a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.679356 18414 tablet_server.cc:196] TabletServer@127.17.251.131:0 shutdown complete.
I20260709 13:17:04.697343 18414 master.cc:562] Master@127.17.251.190:35477 shutting down...
I20260709 13:17:04.913035 18414 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:04.913715 18414 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.914109 18414 tablet_replica.cc:333] T 00000000000000000000000000000000 P 76d73e65c6804e70a2265abbb9d1720b: stopping tablet replica
I20260709 13:17:04.935053 18414 master.cc:584] Master@127.17.251.190:35477 shutdown complete.
0be17c477d094fb197929930b8fa419a  1
986858f96f164e3b953d9042f283441d  4
fdb2a960ea40486b97fe1dd5bceb6e58  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12617 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:17:04.975366 18414 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.251.190:34067
I20260709 13:17:04.976632 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:04.982398 18906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:04.983530 18907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:04.984027 18414 server_base.cc:1061] running on GCE node
W20260709 13:17:04.984123 18909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:04.985188 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:04.985443 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:04.985673 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603024985652 us; error 0 us; skew 500 ppm
I20260709 13:17:04.986261 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:04.988876 18414 webserver.cc:533] Webserver started at http://127.17.251.190:45091/ using document root <none> and password file <none>
I20260709 13:17:04.989531 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:04.990091 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:04.990424 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:04.991722 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/master-0-root/instance:
uuid: "06cde7260ac24cb9aad19e818f13aa11"
format_stamp: "Formatted at 2026-07-09 13:17:04 on dist-test-slave-7f95"
I20260709 13:17:04.996598 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:05.000033 18914 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:05.000803 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:05.001091 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/master-0-root
uuid: "06cde7260ac24cb9aad19e818f13aa11"
format_stamp: "Formatted at 2026-07-09 13:17:04 on dist-test-slave-7f95"
I20260709 13:17:05.001401 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:05.010457 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:05.011698 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:05.050801 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.190:34067
I20260709 13:17:05.050904 18965 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.190:34067 every 8 connection(s)
I20260709 13:17:05.054725 18966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.064355 18966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11: Bootstrap starting.
I20260709 13:17:05.069164 18966 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:05.073812 18966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11: No bootstrap required, opened a new log
I20260709 13:17:05.076136 18966 raft_consensus.cc:359] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06cde7260ac24cb9aad19e818f13aa11" member_type: VOTER }
I20260709 13:17:05.076566 18966 raft_consensus.cc:385] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:05.076864 18966 raft_consensus.cc:740] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06cde7260ac24cb9aad19e818f13aa11, State: Initialized, Role: FOLLOWER
I20260709 13:17:05.077677 18966 consensus_queue.cc:260] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06cde7260ac24cb9aad19e818f13aa11" member_type: VOTER }
I20260709 13:17:05.078176 18966 raft_consensus.cc:399] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:05.078395 18966 raft_consensus.cc:493] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:05.078637 18966 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:05.082882 18966 raft_consensus.cc:515] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06cde7260ac24cb9aad19e818f13aa11" member_type: VOTER }
I20260709 13:17:05.083403 18966 leader_election.cc:304] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 06cde7260ac24cb9aad19e818f13aa11; no voters: 
I20260709 13:17:05.084599 18966 leader_election.cc:290] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:05.084939 18969 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:05.086337 18969 raft_consensus.cc:697] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [term 1 LEADER]: Becoming Leader. State: Replica: 06cde7260ac24cb9aad19e818f13aa11, State: Running, Role: LEADER
I20260709 13:17:05.087062 18969 consensus_queue.cc:237] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06cde7260ac24cb9aad19e818f13aa11" member_type: VOTER }
I20260709 13:17:05.087827 18966 sys_catalog.cc:565] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:05.092178 18970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "06cde7260ac24cb9aad19e818f13aa11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06cde7260ac24cb9aad19e818f13aa11" member_type: VOTER } }
I20260709 13:17:05.092584 18971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 06cde7260ac24cb9aad19e818f13aa11. Latest consensus state: current_term: 1 leader_uuid: "06cde7260ac24cb9aad19e818f13aa11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06cde7260ac24cb9aad19e818f13aa11" member_type: VOTER } }
I20260709 13:17:05.093068 18970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:05.093323 18971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:05.099046 18976 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:05.104285 18976 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:05.105825 18414 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:05.113636 18976 catalog_manager.cc:1383] Generated new cluster ID: 1913b8872aed437b8383e6a75c8db0c0
I20260709 13:17:05.113951 18976 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:05.132956 18976 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:05.134320 18976 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:05.147369 18976 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11: Generated new TSK 0
I20260709 13:17:05.148068 18976 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:05.172798 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:05.178746 18987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:05.179534 18988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:05.181020 18990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:05.181999 18414 server_base.cc:1061] running on GCE node
I20260709 13:17:05.182854 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:05.183068 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:05.183243 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603025183205 us; error 0 us; skew 500 ppm
I20260709 13:17:05.183765 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:05.186194 18414 webserver.cc:533] Webserver started at http://127.17.251.129:34179/ using document root <none> and password file <none>
I20260709 13:17:05.186707 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:05.186916 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:05.187189 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:05.188249 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/ts-0-root/instance:
uuid: "7490b33c011e49fc8a864ef7362a2f8b"
format_stamp: "Formatted at 2026-07-09 13:17:05 on dist-test-slave-7f95"
I20260709 13:17:05.192893 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:05.196355 18995 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:05.197147 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:05.197476 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/ts-0-root
uuid: "7490b33c011e49fc8a864ef7362a2f8b"
format_stamp: "Formatted at 2026-07-09 13:17:05 on dist-test-slave-7f95"
I20260709 13:17:05.197880 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:05.225734 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:05.227013 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:05.228502 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:05.230784 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:05.231040 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:05.231326 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:05.231524 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:05.271824 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.129:41771
I20260709 13:17:05.271919 19057 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.129:41771 every 8 connection(s)
I20260709 13:17:05.276787 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:05.284466 19062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:05.285476 19063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:05.287813 19065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:05.288511 18414 server_base.cc:1061] running on GCE node
I20260709 13:17:05.289602 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:05.289860 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:05.289983 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603025289972 us; error 0 us; skew 500 ppm
I20260709 13:17:05.290416 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:05.292544 18414 webserver.cc:533] Webserver started at http://127.17.251.130:44371/ using document root <none> and password file <none>
I20260709 13:17:05.293211 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:05.293485 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:05.293829 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:05.295400 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/ts-1-root/instance:
uuid: "fbc16e1221514f298575c7b78608c5ee"
format_stamp: "Formatted at 2026-07-09 13:17:05 on dist-test-slave-7f95"
I20260709 13:17:05.296044 19058 heartbeater.cc:344] Connected to a master server at 127.17.251.190:34067
I20260709 13:17:05.296396 19058 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:05.297116 19058 heartbeater.cc:507] Master 127.17.251.190:34067 requested a full tablet report, sending...
I20260709 13:17:05.299158 18931 ts_manager.cc:194] Registered new tserver with Master: 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771)
I20260709 13:17:05.300787 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:17:05.301046 18931 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33210
I20260709 13:17:05.304491 19070 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:05.305215 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:05.305513 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/ts-1-root
uuid: "fbc16e1221514f298575c7b78608c5ee"
format_stamp: "Formatted at 2026-07-09 13:17:05 on dist-test-slave-7f95"
I20260709 13:17:05.305864 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:05.317250 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:05.318539 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:05.319993 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:05.322278 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:05.322520 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:05.322757 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:05.322924 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:05.363268 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.130:33869
I20260709 13:17:05.363382 19132 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.130:33869 every 8 connection(s)
I20260709 13:17:05.368420 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:05.375885 19136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:05.377573 19137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:05.379148 18414 server_base.cc:1061] running on GCE node
W20260709 13:17:05.379920 19139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:05.381074 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:05.381335 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:05.381548 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603025381530 us; error 0 us; skew 500 ppm
I20260709 13:17:05.382184 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:05.382498 19133 heartbeater.cc:344] Connected to a master server at 127.17.251.190:34067
I20260709 13:17:05.382925 19133 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:05.383926 19133 heartbeater.cc:507] Master 127.17.251.190:34067 requested a full tablet report, sending...
I20260709 13:17:05.385018 18414 webserver.cc:533] Webserver started at http://127.17.251.131:35441/ using document root <none> and password file <none>
I20260709 13:17:05.385658 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:05.385926 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:05.386245 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:05.386477 18931 ts_manager.cc:194] Registered new tserver with Master: fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869)
I20260709 13:17:05.387470 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/ts-2-root/instance:
uuid: "5c916045b6e34ed1b4c32953031b1508"
format_stamp: "Formatted at 2026-07-09 13:17:05 on dist-test-slave-7f95"
I20260709 13:17:05.387876 18931 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33214
I20260709 13:17:05.392704 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:17:05.396633 19144 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:05.397454 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:05.397804 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/ts-2-root
uuid: "5c916045b6e34ed1b4c32953031b1508"
format_stamp: "Formatted at 2026-07-09 13:17:05 on dist-test-slave-7f95"
I20260709 13:17:05.398111 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603012191013-18414-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:05.416630 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:05.417948 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:05.419431 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:05.421653 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:05.421893 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:05.422137 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:05.422312 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:05.461720 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.131:40741
I20260709 13:17:05.461809 19206 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.131:40741 every 8 connection(s)
I20260709 13:17:05.475299 19207 heartbeater.cc:344] Connected to a master server at 127.17.251.190:34067
I20260709 13:17:05.475687 19207 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:05.476439 19207 heartbeater.cc:507] Master 127.17.251.190:34067 requested a full tablet report, sending...
I20260709 13:17:05.478403 18931 ts_manager.cc:194] Registered new tserver with Master: 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:05.479393 18414 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014502294s
I20260709 13:17:05.479687 18931 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33226
I20260709 13:17:05.504598 18931 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33238:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:05.507922 18931 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:05.582230 19023 tablet_service.cc:1511] Processing CreateTablet for tablet 932c5a10652141c79949901aaef16b6e (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:05.584383 19023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932c5a10652141c79949901aaef16b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.587854 19022 tablet_service.cc:1511] Processing CreateTablet for tablet dfdc6a7f8213432197ec1a2f2c8b3789 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:05.589411 19022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdc6a7f8213432197ec1a2f2c8b3789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.590019 19021 tablet_service.cc:1511] Processing CreateTablet for tablet 3fb65c3aedff40a599064479a7059a2d (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:05.590828 19098 tablet_service.cc:1511] Processing CreateTablet for tablet 932c5a10652141c79949901aaef16b6e (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:05.591421 19021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fb65c3aedff40a599064479a7059a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.592139 19098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932c5a10652141c79949901aaef16b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.596576 19020 tablet_service.cc:1511] Processing CreateTablet for tablet 98674cadcd8246e9aa0aa18e247cccb8 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:05.597419 19096 tablet_service.cc:1511] Processing CreateTablet for tablet 3fb65c3aedff40a599064479a7059a2d (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:05.598290 19020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98674cadcd8246e9aa0aa18e247cccb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.598026 19097 tablet_service.cc:1511] Processing CreateTablet for tablet dfdc6a7f8213432197ec1a2f2c8b3789 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:05.599042 19096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fb65c3aedff40a599064479a7059a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.599690 19097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdc6a7f8213432197ec1a2f2c8b3789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.609668 19095 tablet_service.cc:1511] Processing CreateTablet for tablet 98674cadcd8246e9aa0aa18e247cccb8 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:05.611068 19095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98674cadcd8246e9aa0aa18e247cccb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.623198 19019 tablet_service.cc:1511] Processing CreateTablet for tablet f1bd7cd292db40bba4b1d1b4c3370280 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:05.624644 19019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1bd7cd292db40bba4b1d1b4c3370280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.634579 19094 tablet_service.cc:1511] Processing CreateTablet for tablet f1bd7cd292db40bba4b1d1b4c3370280 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:05.636031 19094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1bd7cd292db40bba4b1d1b4c3370280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.647068 19172 tablet_service.cc:1511] Processing CreateTablet for tablet 932c5a10652141c79949901aaef16b6e (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:05.648448 19172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932c5a10652141c79949901aaef16b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.650528 19166 tablet_service.cc:1511] Processing CreateTablet for tablet aed23ed153d54327a682e9b52fb09145 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:05.650835 19171 tablet_service.cc:1511] Processing CreateTablet for tablet dfdc6a7f8213432197ec1a2f2c8b3789 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:05.654212 19169 tablet_service.cc:1511] Processing CreateTablet for tablet 98674cadcd8246e9aa0aa18e247cccb8 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:05.656270 19167 tablet_service.cc:1511] Processing CreateTablet for tablet 10c18565d8e24ff0b77593a18bbc17a5 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:05.658759 19166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aed23ed153d54327a682e9b52fb09145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.663108 19168 tablet_service.cc:1511] Processing CreateTablet for tablet f1bd7cd292db40bba4b1d1b4c3370280 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:05.665104 19168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1bd7cd292db40bba4b1d1b4c3370280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.666368 19171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdc6a7f8213432197ec1a2f2c8b3789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.666980 19170 tablet_service.cc:1511] Processing CreateTablet for tablet 3fb65c3aedff40a599064479a7059a2d (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:05.668815 19170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fb65c3aedff40a599064479a7059a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.673273 19165 tablet_service.cc:1511] Processing CreateTablet for tablet 82d295c9661748e489115d29f9988159 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:05.674315 19021 tablet_service.cc:1511] Processing CreateTablet for tablet 10c18565d8e24ff0b77593a18bbc17a5 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:05.674729 19165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d295c9661748e489115d29f9988159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.676286 19021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10c18565d8e24ff0b77593a18bbc17a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.676836 19163 tablet_service.cc:1511] Processing CreateTablet for tablet d518696ecaa246959a1f91c778cc2238 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:05.684541 19164 tablet_service.cc:1511] Processing CreateTablet for tablet 6372bcfc73b241e2b94661027aaa5771 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:05.684863 19097 tablet_service.cc:1511] Processing CreateTablet for tablet 10c18565d8e24ff0b77593a18bbc17a5 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:05.684945 19092 tablet_service.cc:1511] Processing CreateTablet for tablet 82d295c9661748e489115d29f9988159 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:05.686455 19097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10c18565d8e24ff0b77593a18bbc17a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.686551 19090 tablet_service.cc:1511] Processing CreateTablet for tablet d518696ecaa246959a1f91c778cc2238 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:05.687203 19222 tablet_bootstrap.cc:492] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b: Bootstrap starting.
I20260709 13:17:05.688297 19090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d518696ecaa246959a1f91c778cc2238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.688597 19163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d518696ecaa246959a1f91c778cc2238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.689175 19092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d295c9661748e489115d29f9988159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.684945 19091 tablet_service.cc:1511] Processing CreateTablet for tablet 6372bcfc73b241e2b94661027aaa5771 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:05.690037 19164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6372bcfc73b241e2b94661027aaa5771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.690590 19091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6372bcfc73b241e2b94661027aaa5771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.694151 19167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10c18565d8e24ff0b77593a18bbc17a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.694622 19020 tablet_service.cc:1511] Processing CreateTablet for tablet 82d295c9661748e489115d29f9988159 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:05.680459 19093 tablet_service.cc:1511] Processing CreateTablet for tablet aed23ed153d54327a682e9b52fb09145 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:05.696875 19093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aed23ed153d54327a682e9b52fb09145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.697077 19018 tablet_service.cc:1511] Processing CreateTablet for tablet 6372bcfc73b241e2b94661027aaa5771 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:05.698376 19020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d295c9661748e489115d29f9988159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.700727 19018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6372bcfc73b241e2b94661027aaa5771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.701185 19223 tablet_bootstrap.cc:492] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee: Bootstrap starting.
I20260709 13:17:05.701102 19017 tablet_service.cc:1511] Processing CreateTablet for tablet d518696ecaa246959a1f91c778cc2238 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:05.708245 19022 tablet_service.cc:1511] Processing CreateTablet for tablet aed23ed153d54327a682e9b52fb09145 (DEFAULT_TABLE table=test-workload [id=3e816df3b5f94914b84e220f7ec2719d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:05.708987 19017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d518696ecaa246959a1f91c778cc2238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.710256 19169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98674cadcd8246e9aa0aa18e247cccb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.723817 19022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aed23ed153d54327a682e9b52fb09145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.730376 19222 tablet_bootstrap.cc:654] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:05.739956 19223 tablet_bootstrap.cc:654] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:05.791373 19222 tablet_bootstrap.cc:492] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b: No bootstrap required, opened a new log
I20260709 13:17:05.792052 19222 ts_tablet_manager.cc:1403] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b: Time spent bootstrapping tablet: real 0.105s	user 0.007s	sys 0.009s
I20260709 13:17:05.803169 19222 raft_consensus.cc:359] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.809943 19224 tablet_bootstrap.cc:492] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508: Bootstrap starting.
I20260709 13:17:05.813583 19222 raft_consensus.cc:385] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:05.821844 19222 raft_consensus.cc:740] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Initialized, Role: FOLLOWER
I20260709 13:17:05.822811 19222 consensus_queue.cc:260] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.824075 19224 tablet_bootstrap.cc:654] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:05.831100 19058 heartbeater.cc:499] Master 127.17.251.190:34067 was elected leader, sending a full tablet report...
I20260709 13:17:05.831853 19222 ts_tablet_manager.cc:1434] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.007s
I20260709 13:17:05.833154 19222 tablet_bootstrap.cc:492] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b: Bootstrap starting.
I20260709 13:17:05.835202 19223 tablet_bootstrap.cc:492] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee: No bootstrap required, opened a new log
I20260709 13:17:05.835690 19223 ts_tablet_manager.cc:1403] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee: Time spent bootstrapping tablet: real 0.135s	user 0.020s	sys 0.008s
I20260709 13:17:05.838580 19223 raft_consensus.cc:359] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.839313 19223 raft_consensus.cc:385] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:05.839607 19223 raft_consensus.cc:740] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Initialized, Role: FOLLOWER
I20260709 13:17:05.840322 19223 consensus_queue.cc:260] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.843282 19222 tablet_bootstrap.cc:654] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:05.844939 19224 tablet_bootstrap.cc:492] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508: No bootstrap required, opened a new log
I20260709 13:17:05.845561 19224 ts_tablet_manager.cc:1403] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.011s
I20260709 13:17:05.849267 19133 heartbeater.cc:499] Master 127.17.251.190:34067 was elected leader, sending a full tablet report...
I20260709 13:17:05.849786 19223 ts_tablet_manager.cc:1434] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.006s
I20260709 13:17:05.850744 19223 tablet_bootstrap.cc:492] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee: Bootstrap starting.
I20260709 13:17:05.850831 19224 raft_consensus.cc:359] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.851595 19224 raft_consensus.cc:385] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:05.851886 19224 raft_consensus.cc:740] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Initialized, Role: FOLLOWER
I20260709 13:17:05.852596 19224 consensus_queue.cc:260] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.858445 19223 tablet_bootstrap.cc:654] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:05.880239 19207 heartbeater.cc:499] Master 127.17.251.190:34067 was elected leader, sending a full tablet report...
I20260709 13:17:05.880733 19224 ts_tablet_manager.cc:1434] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508: Time spent starting tablet: real 0.035s	user 0.016s	sys 0.015s
I20260709 13:17:05.881745 19224 tablet_bootstrap.cc:492] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508: Bootstrap starting.
I20260709 13:17:05.889670 19224 tablet_bootstrap.cc:654] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:05.904273 19224 tablet_bootstrap.cc:492] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508: No bootstrap required, opened a new log
I20260709 13:17:05.904986 19224 ts_tablet_manager.cc:1403] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.003s
I20260709 13:17:05.906523 19222 tablet_bootstrap.cc:492] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b: No bootstrap required, opened a new log
I20260709 13:17:05.907025 19222 ts_tablet_manager.cc:1403] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.049s
I20260709 13:17:05.907802 19223 tablet_bootstrap.cc:492] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee: No bootstrap required, opened a new log
I20260709 13:17:05.907862 19224 raft_consensus.cc:359] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.908382 19223 ts_tablet_manager.cc:1403] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee: Time spent bootstrapping tablet: real 0.058s	user 0.022s	sys 0.025s
I20260709 13:17:05.908660 19224 raft_consensus.cc:385] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:05.908993 19224 raft_consensus.cc:740] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Initialized, Role: FOLLOWER
I20260709 13:17:05.909967 19224 consensus_queue.cc:260] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.910349 19222 raft_consensus.cc:359] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.911052 19222 raft_consensus.cc:385] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:05.911345 19222 raft_consensus.cc:740] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Initialized, Role: FOLLOWER
I20260709 13:17:05.911491 19223 raft_consensus.cc:359] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.912366 19224 ts_tablet_manager.cc:1434] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:17:05.912427 19223 raft_consensus.cc:385] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:05.912107 19222 consensus_queue.cc:260] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.912819 19223 raft_consensus.cc:740] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Initialized, Role: FOLLOWER
I20260709 13:17:05.913717 19224 tablet_bootstrap.cc:492] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508: Bootstrap starting.
I20260709 13:17:05.913705 19223 consensus_queue.cc:260] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.914321 19222 ts_tablet_manager.cc:1434] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:17:05.915294 19222 tablet_bootstrap.cc:492] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b: Bootstrap starting.
I20260709 13:17:05.916138 19223 ts_tablet_manager.cc:1434] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:05.917155 19223 tablet_bootstrap.cc:492] T dfdc6a7f8213432197ec1a2f2c8b3789 P fbc16e1221514f298575c7b78608c5ee: Bootstrap starting.
I20260709 13:17:05.920852 19224 tablet_bootstrap.cc:654] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:05.921761 19222 tablet_bootstrap.cc:654] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:05.924161 19231 raft_consensus.cc:493] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.924836 19231 raft_consensus.cc:515] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.935148 19231 leader_election.cc:290] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869)
I20260709 13:17:05.939105 19223 tablet_bootstrap.cc:654] T dfdc6a7f8213432197ec1a2f2c8b3789 P fbc16e1221514f298575c7b78608c5ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:05.952368 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdc6a7f8213432197ec1a2f2c8b3789" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b" is_pre_election: true
I20260709 13:17:05.953526 19223 tablet_bootstrap.cc:492] T dfdc6a7f8213432197ec1a2f2c8b3789 P fbc16e1221514f298575c7b78608c5ee: No bootstrap required, opened a new log
I20260709 13:17:05.953465 19033 raft_consensus.cc:2468] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 0.
I20260709 13:17:05.955828 19145 leader_election.cc:304] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, 7490b33c011e49fc8a864ef7362a2f8b; no voters: 
I20260709 13:17:05.965852 19231 raft_consensus.cc:2804] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:05.966311 19231 raft_consensus.cc:493] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.966724 19231 raft_consensus.cc:3060] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:05.954327 19223 ts_tablet_manager.cc:1403] T dfdc6a7f8213432197ec1a2f2c8b3789 P fbc16e1221514f298575c7b78608c5ee: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.000s
I20260709 13:17:05.988544 19108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdc6a7f8213432197ec1a2f2c8b3789" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbc16e1221514f298575c7b78608c5ee" is_pre_election: true
W20260709 13:17:05.990845 19145 leader_election.cc:343] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:05.989180 19231 raft_consensus.cc:515] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.992569 19224 tablet_bootstrap.cc:492] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508: No bootstrap required, opened a new log
I20260709 13:17:05.993122 19224 ts_tablet_manager.cc:1403] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508: Time spent bootstrapping tablet: real 0.080s	user 0.039s	sys 0.035s
I20260709 13:17:05.993512 19222 tablet_bootstrap.cc:492] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b: No bootstrap required, opened a new log
I20260709 13:17:05.993685 19231 leader_election.cc:290] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 election: Requested vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869)
I20260709 13:17:05.994167 19222 ts_tablet_manager.cc:1403] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b: Time spent bootstrapping tablet: real 0.079s	user 0.036s	sys 0.041s
I20260709 13:17:05.994844 19223 raft_consensus.cc:359] T dfdc6a7f8213432197ec1a2f2c8b3789 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.995324 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdc6a7f8213432197ec1a2f2c8b3789" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
I20260709 13:17:05.995608 19223 raft_consensus.cc:385] T dfdc6a7f8213432197ec1a2f2c8b3789 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:05.995915 19223 raft_consensus.cc:740] T dfdc6a7f8213432197ec1a2f2c8b3789 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Initialized, Role: FOLLOWER
I20260709 13:17:05.996748 19224 raft_consensus.cc:359] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.997133 19108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdc6a7f8213432197ec1a2f2c8b3789" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
I20260709 13:17:05.996869 19223 consensus_queue.cc:260] T dfdc6a7f8213432197ec1a2f2c8b3789 P fbc16e1221514f298575c7b78608c5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.997510 19224 raft_consensus.cc:385] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:05.997824 19108 raft_consensus.cc:3060] T dfdc6a7f8213432197ec1a2f2c8b3789 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:05.997928 19224 raft_consensus.cc:740] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Initialized, Role: FOLLOWER
I20260709 13:17:05.997769 19222 raft_consensus.cc:359] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.998672 19222 raft_consensus.cc:385] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:05.999001 19222 raft_consensus.cc:740] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Initialized, Role: FOLLOWER
I20260709 13:17:05.998827 19224 consensus_queue.cc:260] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:05.999707 19222 consensus_queue.cc:260] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.001556 19224 ts_tablet_manager.cc:1434] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:17:06.001863 19222 ts_tablet_manager.cc:1434] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:17:06.002971 19222 tablet_bootstrap.cc:492] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b: Bootstrap starting.
I20260709 13:17:05.995893 19033 raft_consensus.cc:3060] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.006448 19108 raft_consensus.cc:2468] T dfdc6a7f8213432197ec1a2f2c8b3789 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 1.
I20260709 13:17:06.008404 19224 tablet_bootstrap.cc:492] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508: Bootstrap starting.
I20260709 13:17:06.009398 19222 tablet_bootstrap.cc:654] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.010008 19145 leader_election.cc:304] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, fbc16e1221514f298575c7b78608c5ee; no voters: 
I20260709 13:17:06.010142 19229 raft_consensus.cc:493] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.010916 19231 raft_consensus.cc:2804] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:06.010701 19229 raft_consensus.cc:515] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.016047 19224 tablet_bootstrap.cc:654] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.019819 19033 raft_consensus.cc:2468] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 1.
I20260709 13:17:06.021466 19229 leader_election.cc:290] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:06.038457 19223 ts_tablet_manager.cc:1434] T dfdc6a7f8213432197ec1a2f2c8b3789 P fbc16e1221514f298575c7b78608c5ee: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.001s
I20260709 13:17:06.039646 19223 tablet_bootstrap.cc:492] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee: Bootstrap starting.
I20260709 13:17:06.042897 19238 raft_consensus.cc:493] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.043414 19238 raft_consensus.cc:515] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.046227 19222 tablet_bootstrap.cc:492] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b: No bootstrap required, opened a new log
I20260709 13:17:06.046605 19231 raft_consensus.cc:697] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 1 LEADER]: Becoming Leader. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Running, Role: LEADER
I20260709 13:17:06.046959 19222 ts_tablet_manager.cc:1403] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.006s
I20260709 13:17:06.047528 19231 consensus_queue.cc:237] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.046396 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c18565d8e24ff0b77593a18bbc17a5" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b" is_pre_election: true
W20260709 13:17:06.051762 19145 leader_election.cc:343] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:06.055055 19238 leader_election.cc:290] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869)
I20260709 13:17:06.059454 19108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c18565d8e24ff0b77593a18bbc17a5" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbc16e1221514f298575c7b78608c5ee" is_pre_election: true
I20260709 13:17:06.061764 19224 tablet_bootstrap.cc:492] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508: No bootstrap required, opened a new log
W20260709 13:17:06.061956 19145 leader_election.cc:343] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:06.062342 19224 ts_tablet_manager.cc:1403] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508: Time spent bootstrapping tablet: real 0.054s	user 0.030s	sys 0.011s
I20260709 13:17:06.062024 19222 raft_consensus.cc:359] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.062638 19145 leader_election.cc:304] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508; no voters: 7490b33c011e49fc8a864ef7362a2f8b, fbc16e1221514f298575c7b78608c5ee
I20260709 13:17:06.062876 19222 raft_consensus.cc:385] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.063256 19222 raft_consensus.cc:740] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.063949 19238 raft_consensus.cc:2749] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:06.066666 19224 raft_consensus.cc:359] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.067425 19224 raft_consensus.cc:385] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.067723 19224 raft_consensus.cc:740] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.068457 19224 consensus_queue.cc:260] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.069478 19222 consensus_queue.cc:260] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.070762 19224 ts_tablet_manager.cc:1434] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:06.070967 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb65c3aedff40a599064479a7059a2d" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b" is_pre_election: true
I20260709 13:17:06.071847 19224 tablet_bootstrap.cc:492] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508: Bootstrap starting.
I20260709 13:17:06.071704 19033 raft_consensus.cc:2468] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 0.
I20260709 13:17:06.072600 19223 tablet_bootstrap.cc:654] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.071784 19222 ts_tablet_manager.cc:1434] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b: Time spent starting tablet: real 0.024s	user 0.000s	sys 0.007s
I20260709 13:17:06.076505 19222 tablet_bootstrap.cc:492] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b: Bootstrap starting.
I20260709 13:17:06.077461 19071 leader_election.cc:304] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7490b33c011e49fc8a864ef7362a2f8b, fbc16e1221514f298575c7b78608c5ee; no voters: 
I20260709 13:17:06.078446 19229 raft_consensus.cc:2804] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:06.078838 19229 raft_consensus.cc:493] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.077968 18931 catalog_manager.cc:5697] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "5c916045b6e34ed1b4c32953031b1508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.079231 19229 raft_consensus.cc:3060] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.083544 19222 tablet_bootstrap.cc:654] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.087620 19229 raft_consensus.cc:515] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.094177 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb65c3aedff40a599064479a7059a2d" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c916045b6e34ed1b4c32953031b1508" is_pre_election: true
I20260709 13:17:06.095971 19229 leader_election.cc:290] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 election: Requested vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
W20260709 13:17:06.096218 19074 leader_election.cc:343] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:06.097821 19224 tablet_bootstrap.cc:654] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.097820 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb65c3aedff40a599064479a7059a2d" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
I20260709 13:17:06.098336 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb65c3aedff40a599064479a7059a2d" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:06.098614 19033 raft_consensus.cc:3060] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:06.101027 18979 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:17:06.102336 19074 leader_election.cc:343] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:06.106698 19033 raft_consensus.cc:2468] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 1.
I20260709 13:17:06.108278 19071 leader_election.cc:304] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7490b33c011e49fc8a864ef7362a2f8b, fbc16e1221514f298575c7b78608c5ee; no voters: 5c916045b6e34ed1b4c32953031b1508
I20260709 13:17:06.109933 19229 raft_consensus.cc:2804] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:06.115761 19223 tablet_bootstrap.cc:492] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee: No bootstrap required, opened a new log
I20260709 13:17:06.116297 19222 tablet_bootstrap.cc:492] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b: No bootstrap required, opened a new log
I20260709 13:17:06.116614 19223 ts_tablet_manager.cc:1403] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.019s
I20260709 13:17:06.116879 19222 ts_tablet_manager.cc:1403] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.005s
I20260709 13:17:06.121220 19222 raft_consensus.cc:359] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.122447 19222 raft_consensus.cc:385] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.123745 19223 raft_consensus.cc:359] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.122890 19222 raft_consensus.cc:740] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.125974 19222 consensus_queue.cc:260] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.126266 19229 raft_consensus.cc:697] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 1 LEADER]: Becoming Leader. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Running, Role: LEADER
I20260709 13:17:06.128357 19222 ts_tablet_manager.cc:1434] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:17:06.127655 19229 consensus_queue.cc:237] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.129479 19222 tablet_bootstrap.cc:492] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b: Bootstrap starting.
I20260709 13:17:06.132516 19223 raft_consensus.cc:385] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.133033 19223 raft_consensus.cc:740] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.136109 19223 consensus_queue.cc:260] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.136961 19222 tablet_bootstrap.cc:654] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.146289 19223 ts_tablet_manager.cc:1434] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.007s
I20260709 13:17:06.147418 19223 tablet_bootstrap.cc:492] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee: Bootstrap starting.
I20260709 13:17:06.149338 19222 tablet_bootstrap.cc:492] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b: No bootstrap required, opened a new log
I20260709 13:17:06.149592 19224 tablet_bootstrap.cc:492] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508: No bootstrap required, opened a new log
I20260709 13:17:06.149952 19222 ts_tablet_manager.cc:1403] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.015s
I20260709 13:17:06.150172 19224 ts_tablet_manager.cc:1403] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508: Time spent bootstrapping tablet: real 0.079s	user 0.027s	sys 0.029s
I20260709 13:17:06.152384 19222 raft_consensus.cc:359] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.153009 19222 raft_consensus.cc:385] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.153316 19222 raft_consensus.cc:740] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.153369 19224 raft_consensus.cc:359] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.154333 19224 raft_consensus.cc:385] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.154093 19222 consensus_queue.cc:260] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.154695 19224 raft_consensus.cc:740] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.155620 19224 consensus_queue.cc:260] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.156656 19222 ts_tablet_manager.cc:1434] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:17:06.157698 19222 tablet_bootstrap.cc:492] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b: Bootstrap starting.
I20260709 13:17:06.157936 19223 tablet_bootstrap.cc:654] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.158277 19224 ts_tablet_manager.cc:1434] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:06.159345 19224 tablet_bootstrap.cc:492] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508: Bootstrap starting.
I20260709 13:17:06.164553 19222 tablet_bootstrap.cc:654] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.163692 18931 catalog_manager.cc:5697] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee reported cstate change: term changed from 0 to 1, leader changed from <none> to fbc16e1221514f298575c7b78608c5ee (127.17.251.130). New cstate: current_term: 1 leader_uuid: "fbc16e1221514f298575c7b78608c5ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:06.167722 19224 tablet_bootstrap.cc:654] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.176469 19222 tablet_bootstrap.cc:492] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b: No bootstrap required, opened a new log
I20260709 13:17:06.176985 19222 ts_tablet_manager.cc:1403] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.010s
I20260709 13:17:06.181553 19224 tablet_bootstrap.cc:492] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508: No bootstrap required, opened a new log
I20260709 13:17:06.182284 19224 ts_tablet_manager.cc:1403] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.005s
I20260709 13:17:06.182614 19222 raft_consensus.cc:359] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.183408 19222 raft_consensus.cc:385] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.183790 19222 raft_consensus.cc:740] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.184655 19222 consensus_queue.cc:260] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.186355 19224 raft_consensus.cc:359] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.187338 19222 ts_tablet_manager.cc:1434] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:17:06.187362 19224 raft_consensus.cc:385] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.187965 19224 raft_consensus.cc:740] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.188380 19222 tablet_bootstrap.cc:492] T d518696ecaa246959a1f91c778cc2238 P 7490b33c011e49fc8a864ef7362a2f8b: Bootstrap starting.
I20260709 13:17:06.189175 19224 consensus_queue.cc:260] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.195120 19222 tablet_bootstrap.cc:654] T d518696ecaa246959a1f91c778cc2238 P 7490b33c011e49fc8a864ef7362a2f8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.195348 19224 ts_tablet_manager.cc:1434] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:17:06.196769 19224 tablet_bootstrap.cc:492] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508: Bootstrap starting.
I20260709 13:17:06.199020 19227 raft_consensus.cc:493] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.199653 19227 raft_consensus.cc:515] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.205603 19231 raft_consensus.cc:493] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.205892 19224 tablet_bootstrap.cc:654] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.206164 19231 raft_consensus.cc:515] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.207015 19222 tablet_bootstrap.cc:492] T d518696ecaa246959a1f91c778cc2238 P 7490b33c011e49fc8a864ef7362a2f8b: No bootstrap required, opened a new log
I20260709 13:17:06.207561 19222 ts_tablet_manager.cc:1403] T d518696ecaa246959a1f91c778cc2238 P 7490b33c011e49fc8a864ef7362a2f8b: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.002s
I20260709 13:17:06.208354 19231 leader_election.cc:290] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869)
I20260709 13:17:06.210405 19108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed23ed153d54327a682e9b52fb09145" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbc16e1221514f298575c7b78608c5ee" is_pre_election: true
W20260709 13:17:06.212018 19145 leader_election.cc:343] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:06.210395 19222 raft_consensus.cc:359] T d518696ecaa246959a1f91c778cc2238 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.213433 19222 raft_consensus.cc:385] T d518696ecaa246959a1f91c778cc2238 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.213740 19222 raft_consensus.cc:740] T d518696ecaa246959a1f91c778cc2238 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.214754 19227 leader_election.cc:290] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:06.214661 19222 consensus_queue.cc:260] T d518696ecaa246959a1f91c778cc2238 P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.227110 19224 tablet_bootstrap.cc:492] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508: No bootstrap required, opened a new log
I20260709 13:17:06.227106 19222 ts_tablet_manager.cc:1434] T d518696ecaa246959a1f91c778cc2238 P 7490b33c011e49fc8a864ef7362a2f8b: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.005s
I20260709 13:17:06.227916 19224 ts_tablet_manager.cc:1403] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.012s
I20260709 13:17:06.228459 19222 tablet_bootstrap.cc:492] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b: Bootstrap starting.
I20260709 13:17:06.232172 19224 raft_consensus.cc:359] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.233232 19224 raft_consensus.cc:385] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.233662 19224 raft_consensus.cc:740] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.234932 19222 tablet_bootstrap.cc:654] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.234694 19224 consensus_queue.cc:260] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.237607 19229 raft_consensus.cc:493] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.237893 19224 ts_tablet_manager.cc:1434] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:17:06.238186 19229 raft_consensus.cc:515] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.238948 19224 tablet_bootstrap.cc:492] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508: Bootstrap starting.
I20260709 13:17:06.240419 19229 leader_election.cc:290] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:06.242733 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98674cadcd8246e9aa0aa18e247cccb8" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b" is_pre_election: true
I20260709 13:17:06.243496 19033 raft_consensus.cc:2468] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 0.
I20260709 13:17:06.245088 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98674cadcd8246e9aa0aa18e247cccb8" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c916045b6e34ed1b4c32953031b1508" is_pre_election: true
I20260709 13:17:06.246269 19224 tablet_bootstrap.cc:654] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.246680 19071 leader_election.cc:304] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7490b33c011e49fc8a864ef7362a2f8b, fbc16e1221514f298575c7b78608c5ee; no voters: 
W20260709 13:17:06.248138 19074 leader_election.cc:343] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:06.249104 19229 raft_consensus.cc:2804] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:06.249644 19229 raft_consensus.cc:493] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.250133 19229 raft_consensus.cc:3060] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.261277 19229 raft_consensus.cc:515] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.271975 19261 raft_consensus.cc:493] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.272617 19261 raft_consensus.cc:515] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.272850 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed23ed153d54327a682e9b52fb09145" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b" is_pre_election: true
W20260709 13:17:06.274792 19145 leader_election.cc:343] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:06.275338 19261 leader_election.cc:290] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:06.275491 19145 leader_election.cc:304] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508; no voters: 7490b33c011e49fc8a864ef7362a2f8b, fbc16e1221514f298575c7b78608c5ee
I20260709 13:17:06.276579 19231 raft_consensus.cc:2749] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:06.277910 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98674cadcd8246e9aa0aa18e247cccb8" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
I20260709 13:17:06.278542 19033 raft_consensus.cc:3060] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.296412 19222 tablet_bootstrap.cc:492] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b: No bootstrap required, opened a new log
I20260709 13:17:06.297053 19224 tablet_bootstrap.cc:492] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508: No bootstrap required, opened a new log
I20260709 13:17:06.297073 19222 ts_tablet_manager.cc:1403] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b: Time spent bootstrapping tablet: real 0.069s	user 0.032s	sys 0.016s
I20260709 13:17:06.297681 19033 raft_consensus.cc:2468] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 1.
I20260709 13:17:06.297891 19224 ts_tablet_manager.cc:1403] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508: Time spent bootstrapping tablet: real 0.059s	user 0.025s	sys 0.029s
I20260709 13:17:06.298928 19071 leader_election.cc:304] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7490b33c011e49fc8a864ef7362a2f8b, fbc16e1221514f298575c7b78608c5ee; no voters: 
I20260709 13:17:06.300084 19250 raft_consensus.cc:2804] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:06.300871 19222 raft_consensus.cc:359] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.301713 19222 raft_consensus.cc:385] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.302277 19222 raft_consensus.cc:740] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.301663 19224 raft_consensus.cc:359] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.302992 19224 raft_consensus.cc:385] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.303357 19224 raft_consensus.cc:740] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.303335 19222 consensus_queue.cc:260] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.304608 19224 consensus_queue.cc:260] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.305922 19222 ts_tablet_manager.cc:1434] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:06.306919 19222 tablet_bootstrap.cc:492] T 6372bcfc73b241e2b94661027aaa5771 P 7490b33c011e49fc8a864ef7362a2f8b: Bootstrap starting.
I20260709 13:17:06.311107 19224 ts_tablet_manager.cc:1434] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:17:06.312085 19224 tablet_bootstrap.cc:492] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508: Bootstrap starting.
I20260709 13:17:06.317577 19108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bd7cd292db40bba4b1d1b4c3370280" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbc16e1221514f298575c7b78608c5ee" is_pre_election: true
I20260709 13:17:06.318056 19224 tablet_bootstrap.cc:654] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.317818 19107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d295c9661748e489115d29f9988159" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbc16e1221514f298575c7b78608c5ee" is_pre_election: true
W20260709 13:17:06.320371 18996 leader_election.cc:343] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:06.320782 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bd7cd292db40bba4b1d1b4c3370280" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c916045b6e34ed1b4c32953031b1508" is_pre_election: true
W20260709 13:17:06.321172 18996 leader_election.cc:343] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:06.323257 19181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d295c9661748e489115d29f9988159" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c916045b6e34ed1b4c32953031b1508" is_pre_election: true
W20260709 13:17:06.323570 18999 leader_election.cc:343] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:06.323972 19181 raft_consensus.cc:2468] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 0.
I20260709 13:17:06.324003 18999 leader_election.cc:304] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7490b33c011e49fc8a864ef7362a2f8b; no voters: 5c916045b6e34ed1b4c32953031b1508, fbc16e1221514f298575c7b78608c5ee
I20260709 13:17:06.325219 19261 raft_consensus.cc:2749] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:06.328265 18999 leader_election.cc:304] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, 7490b33c011e49fc8a864ef7362a2f8b; no voters: fbc16e1221514f298575c7b78608c5ee
I20260709 13:17:06.329445 19261 raft_consensus.cc:2804] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:06.329849 19261 raft_consensus.cc:493] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.329929 19224 tablet_bootstrap.cc:492] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508: No bootstrap required, opened a new log
I20260709 13:17:06.330237 19261 raft_consensus.cc:3060] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.330608 19224 ts_tablet_manager.cc:1403] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:17:06.330791 19222 tablet_bootstrap.cc:654] T 6372bcfc73b241e2b94661027aaa5771 P 7490b33c011e49fc8a864ef7362a2f8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.334301 19224 raft_consensus.cc:359] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.335286 19224 raft_consensus.cc:385] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.335634 19224 raft_consensus.cc:740] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.336881 19224 consensus_queue.cc:260] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.339756 19223 tablet_bootstrap.cc:492] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee: No bootstrap required, opened a new log
I20260709 13:17:06.340256 19223 ts_tablet_manager.cc:1403] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee: Time spent bootstrapping tablet: real 0.193s	user 0.040s	sys 0.078s
I20260709 13:17:06.342376 19224 ts_tablet_manager.cc:1434] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:17:06.342095 19261 raft_consensus.cc:515] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.343355 19224 tablet_bootstrap.cc:492] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508: Bootstrap starting.
I20260709 13:17:06.343246 19223 raft_consensus.cc:359] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.343995 19223 raft_consensus.cc:385] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.344275 19223 raft_consensus.cc:740] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.345182 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98674cadcd8246e9aa0aa18e247cccb8" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:06.345055 19223 consensus_queue.cc:260] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.345937 19182 raft_consensus.cc:3060] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.352240 19231 raft_consensus.cc:493] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.352782 19231 raft_consensus.cc:515] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.353660 19224 tablet_bootstrap.cc:654] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.355217 19231 leader_election.cc:290] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869)
I20260709 13:17:06.357259 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6372bcfc73b241e2b94661027aaa5771" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b" is_pre_election: true
I20260709 13:17:06.357813 19107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6372bcfc73b241e2b94661027aaa5771" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbc16e1221514f298575c7b78608c5ee" is_pre_election: true
W20260709 13:17:06.359936 19145 leader_election.cc:343] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:06.360890 19145 leader_election.cc:343] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:06.361455 19145 leader_election.cc:304] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508; no voters: 7490b33c011e49fc8a864ef7362a2f8b, fbc16e1221514f298575c7b78608c5ee
I20260709 13:17:06.362879 19231 raft_consensus.cc:2749] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:06.363829 19223 ts_tablet_manager.cc:1434] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.010s
I20260709 13:17:06.365763 19229 leader_election.cc:290] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 election: Requested vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:06.366932 19223 tablet_bootstrap.cc:492] T d518696ecaa246959a1f91c778cc2238 P fbc16e1221514f298575c7b78608c5ee: Bootstrap starting.
I20260709 13:17:06.368356 19182 raft_consensus.cc:2468] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 1.
I20260709 13:17:06.366976 19229 raft_consensus.cc:493] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.371301 19229 raft_consensus.cc:515] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.375301 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed23ed153d54327a682e9b52fb09145" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b" is_pre_election: true
I20260709 13:17:06.376176 19033 raft_consensus.cc:2468] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 0.
I20260709 13:17:06.377791 19071 leader_election.cc:304] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7490b33c011e49fc8a864ef7362a2f8b, fbc16e1221514f298575c7b78608c5ee; no voters: 
I20260709 13:17:06.379081 19267 raft_consensus.cc:2804] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:06.380236 19227 raft_consensus.cc:493] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.380910 19227 raft_consensus.cc:515] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.382632 19107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d295c9661748e489115d29f9988159" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
W20260709 13:17:06.385139 18996 leader_election.cc:343] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:06.385645 19181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c18565d8e24ff0b77593a18bbc17a5" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c916045b6e34ed1b4c32953031b1508" is_pre_election: true
I20260709 13:17:06.385998 19227 leader_election.cc:290] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:06.386544 19181 raft_consensus.cc:2468] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 0.
I20260709 13:17:06.386986 19250 raft_consensus.cc:697] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 1 LEADER]: Becoming Leader. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Running, Role: LEADER
I20260709 13:17:06.388625 18999 leader_election.cc:304] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, 7490b33c011e49fc8a864ef7362a2f8b; no voters: 
I20260709 13:17:06.388338 19250 consensus_queue.cc:237] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.379830 19267 raft_consensus.cc:493] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.390825 19107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c18565d8e24ff0b77593a18bbc17a5" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbc16e1221514f298575c7b78608c5ee" is_pre_election: true
I20260709 13:17:06.391247 19267 raft_consensus.cc:3060] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.392359 19227 raft_consensus.cc:2804] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:06.392863 19227 raft_consensus.cc:493] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:06.392784 18996 leader_election.cc:343] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:06.394214 19227 raft_consensus.cc:3060] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.400799 19229 leader_election.cc:290] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:06.402560 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed23ed153d54327a682e9b52fb09145" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c916045b6e34ed1b4c32953031b1508" is_pre_election: true
I20260709 13:17:06.403491 19182 raft_consensus.cc:2468] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 0.
I20260709 13:17:06.408351 19224 tablet_bootstrap.cc:492] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508: No bootstrap required, opened a new log
I20260709 13:17:06.408911 19224 ts_tablet_manager.cc:1403] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508: Time spent bootstrapping tablet: real 0.066s	user 0.023s	sys 0.038s
I20260709 13:17:06.408843 19261 leader_election.cc:290] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 1 election: Requested vote from peers fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:06.410208 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d295c9661748e489115d29f9988159" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:06.410959 19182 raft_consensus.cc:3060] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.411958 19227 raft_consensus.cc:515] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.412497 19222 tablet_bootstrap.cc:492] T 6372bcfc73b241e2b94661027aaa5771 P 7490b33c011e49fc8a864ef7362a2f8b: No bootstrap required, opened a new log
I20260709 13:17:06.413076 19222 ts_tablet_manager.cc:1403] T 6372bcfc73b241e2b94661027aaa5771 P 7490b33c011e49fc8a864ef7362a2f8b: Time spent bootstrapping tablet: real 0.106s	user 0.016s	sys 0.058s
I20260709 13:17:06.415187 19107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c18565d8e24ff0b77593a18bbc17a5" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
I20260709 13:17:06.412350 19224 raft_consensus.cc:359] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.415827 19224 raft_consensus.cc:385] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.416049 19181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c18565d8e24ff0b77593a18bbc17a5" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:06.416134 19224 raft_consensus.cc:740] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.416296 19222 raft_consensus.cc:359] T 6372bcfc73b241e2b94661027aaa5771 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.416781 19181 raft_consensus.cc:3060] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:06.416922 18996 leader_election.cc:343] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:06.417133 19227 leader_election.cc:290] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 1 election: Requested vote from peers fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:06.417269 19224 consensus_queue.cc:260] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.417773 19222 raft_consensus.cc:385] T 6372bcfc73b241e2b94661027aaa5771 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.418169 19222 raft_consensus.cc:740] T 6372bcfc73b241e2b94661027aaa5771 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.419020 19222 consensus_queue.cc:260] T 6372bcfc73b241e2b94661027aaa5771 P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.419668 19224 ts_tablet_manager.cc:1434] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:17:06.420020 19223 tablet_bootstrap.cc:654] T d518696ecaa246959a1f91c778cc2238 P fbc16e1221514f298575c7b78608c5ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.421466 19222 ts_tablet_manager.cc:1434] T 6372bcfc73b241e2b94661027aaa5771 P 7490b33c011e49fc8a864ef7362a2f8b: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 13:17:06.423955 19267 raft_consensus.cc:515] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.428265 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed23ed153d54327a682e9b52fb09145" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
I20260709 13:17:06.428896 19033 raft_consensus.cc:3060] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.428793 19182 raft_consensus.cc:2468] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 1.
I20260709 13:17:06.430214 18999 leader_election.cc:304] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, 7490b33c011e49fc8a864ef7362a2f8b; no voters: fbc16e1221514f298575c7b78608c5ee
I20260709 13:17:06.431480 19227 raft_consensus.cc:2804] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:06.432245 19227 raft_consensus.cc:697] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 LEADER]: Becoming Leader. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:06.433164 19227 consensus_queue.cc:237] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.434057 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed23ed153d54327a682e9b52fb09145" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:06.434685 19182 raft_consensus.cc:3060] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.435595 19223 tablet_bootstrap.cc:492] T d518696ecaa246959a1f91c778cc2238 P fbc16e1221514f298575c7b78608c5ee: No bootstrap required, opened a new log
I20260709 13:17:06.436085 19223 ts_tablet_manager.cc:1403] T d518696ecaa246959a1f91c778cc2238 P fbc16e1221514f298575c7b78608c5ee: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.002s
I20260709 13:17:06.430226 19267 leader_election.cc:290] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 election: Requested vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:06.439152 19223 raft_consensus.cc:359] T d518696ecaa246959a1f91c778cc2238 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.439862 19223 raft_consensus.cc:385] T d518696ecaa246959a1f91c778cc2238 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.440213 19223 raft_consensus.cc:740] T d518696ecaa246959a1f91c778cc2238 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.439666 18931 catalog_manager.cc:5697] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee reported cstate change: term changed from 0 to 1, leader changed from <none> to fbc16e1221514f298575c7b78608c5ee (127.17.251.130). New cstate: current_term: 1 leader_uuid: "fbc16e1221514f298575c7b78608c5ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:06.440968 19223 consensus_queue.cc:260] T d518696ecaa246959a1f91c778cc2238 P fbc16e1221514f298575c7b78608c5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.443461 19223 ts_tablet_manager.cc:1434] T d518696ecaa246959a1f91c778cc2238 P fbc16e1221514f298575c7b78608c5ee: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:06.444537 19223 tablet_bootstrap.cc:492] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee: Bootstrap starting.
I20260709 13:17:06.446942 19182 raft_consensus.cc:2468] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 1.
I20260709 13:17:06.440479 19033 raft_consensus.cc:2468] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 1.
I20260709 13:17:06.448565 19074 leader_election.cc:304] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, fbc16e1221514f298575c7b78608c5ee; no voters: 
I20260709 13:17:06.450573 19267 raft_consensus.cc:2804] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:06.452174 19181 raft_consensus.cc:2468] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 1.
I20260709 13:17:06.453572 18999 leader_election.cc:304] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, 7490b33c011e49fc8a864ef7362a2f8b; no voters: fbc16e1221514f298575c7b78608c5ee
I20260709 13:17:06.453821 19267 raft_consensus.cc:697] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 1 LEADER]: Becoming Leader. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Running, Role: LEADER
I20260709 13:17:06.454700 19227 raft_consensus.cc:2804] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:06.454700 19267 consensus_queue.cc:237] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.455369 19227 raft_consensus.cc:697] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 LEADER]: Becoming Leader. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:06.456261 19227 consensus_queue.cc:237] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.457669 19231 raft_consensus.cc:493] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.456993 18930 catalog_manager.cc:5697] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129). New cstate: current_term: 1 leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:06.459514 19231 raft_consensus.cc:515] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.462275 19250 raft_consensus.cc:493] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.463116 19223 tablet_bootstrap.cc:654] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.462786 19250 raft_consensus.cc:515] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.462296 19231 leader_election.cc:290] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869)
I20260709 13:17:06.466279 19250 leader_election.cc:290] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:06.468590 19181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932c5a10652141c79949901aaef16b6e" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c916045b6e34ed1b4c32953031b1508" is_pre_election: true
I20260709 13:17:06.469697 19242 raft_consensus.cc:493] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.469777 19032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932c5a10652141c79949901aaef16b6e" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b" is_pre_election: true
I20260709 13:17:06.470490 19032 raft_consensus.cc:2468] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 0.
I20260709 13:17:06.470314 19242 raft_consensus.cc:515] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.471993 19071 leader_election.cc:304] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7490b33c011e49fc8a864ef7362a2f8b, fbc16e1221514f298575c7b78608c5ee; no voters: 
I20260709 13:17:06.472425 19242 leader_election.cc:290] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869)
I20260709 13:17:06.473088 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d518696ecaa246959a1f91c778cc2238" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b" is_pre_election: true
I20260709 13:17:06.473730 19033 raft_consensus.cc:2468] T d518696ecaa246959a1f91c778cc2238 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 0.
I20260709 13:17:06.476049 19231 consensus_queue.cc:1048] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:06.476882 19145 leader_election.cc:304] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, 7490b33c011e49fc8a864ef7362a2f8b; no voters: 
I20260709 13:17:06.477336 19108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932c5a10652141c79949901aaef16b6e" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbc16e1221514f298575c7b78608c5ee" is_pre_election: true
I20260709 13:17:06.468618 19107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d518696ecaa246959a1f91c778cc2238" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbc16e1221514f298575c7b78608c5ee" is_pre_election: true
I20260709 13:17:06.477983 19231 raft_consensus.cc:2804] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:06.478157 19107 raft_consensus.cc:2468] T d518696ecaa246959a1f91c778cc2238 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 0.
I20260709 13:17:06.478320 19267 raft_consensus.cc:2804] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:06.478842 19267 raft_consensus.cc:493] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.479050 19181 raft_consensus.cc:2468] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 0.
I20260709 13:17:06.479238 19267 raft_consensus.cc:3060] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.478387 19231 raft_consensus.cc:493] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.479772 19231 raft_consensus.cc:3060] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.482577 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932c5a10652141c79949901aaef16b6e" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b" is_pre_election: true
I20260709 13:17:06.483887 19033 raft_consensus.cc:2468] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 0.
I20260709 13:17:06.485549 19145 leader_election.cc:304] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, 7490b33c011e49fc8a864ef7362a2f8b; no voters: 
I20260709 13:17:06.486363 19238 consensus_queue.cc:1048] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:06.487715 19242 raft_consensus.cc:2804] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:06.488238 19242 raft_consensus.cc:493] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.488682 19242 raft_consensus.cc:3060] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.504529 19242 raft_consensus.cc:515] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.507223 19032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932c5a10652141c79949901aaef16b6e" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
I20260709 13:17:06.508129 19032 raft_consensus.cc:3060] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.512118 19231 raft_consensus.cc:515] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.518079 19242 leader_election.cc:290] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 election: Requested vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869)
I20260709 13:17:06.520486 19107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932c5a10652141c79949901aaef16b6e" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
I20260709 13:17:06.525550 19231 leader_election.cc:290] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 election: Requested vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869)
I20260709 13:17:06.524013 18930 catalog_manager.cc:5697] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129). New cstate: current_term: 1 leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:06.530851 19032 raft_consensus.cc:2468] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 1.
I20260709 13:17:06.526633 19267 raft_consensus.cc:515] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.537477 19108 raft_consensus.cc:2393] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c916045b6e34ed1b4c32953031b1508 in current term 1: Already voted for candidate fbc16e1221514f298575c7b78608c5ee in this term.
I20260709 13:17:06.538817 19267 leader_election.cc:290] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 election: Requested vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:06.539005 19181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932c5a10652141c79949901aaef16b6e" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:06.540100 19181 raft_consensus.cc:2393] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fbc16e1221514f298575c7b78608c5ee in current term 1: Already voted for candidate 5c916045b6e34ed1b4c32953031b1508 in this term.
I20260709 13:17:06.542819 19223 tablet_bootstrap.cc:492] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee: No bootstrap required, opened a new log
I20260709 13:17:06.542773 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932c5a10652141c79949901aaef16b6e" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
I20260709 13:17:06.543519 19223 ts_tablet_manager.cc:1403] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.007s
I20260709 13:17:06.543658 19033 raft_consensus.cc:2393] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fbc16e1221514f298575c7b78608c5ee in current term 1: Already voted for candidate 5c916045b6e34ed1b4c32953031b1508 in this term.
I20260709 13:17:06.545466 19071 leader_election.cc:304] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbc16e1221514f298575c7b78608c5ee; no voters: 5c916045b6e34ed1b4c32953031b1508, 7490b33c011e49fc8a864ef7362a2f8b
I20260709 13:17:06.546729 19267 raft_consensus.cc:2749] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:06.551460 19032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d518696ecaa246959a1f91c778cc2238" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
I20260709 13:17:06.550642 18931 catalog_manager.cc:5697] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee reported cstate change: term changed from 0 to 1, leader changed from <none> to fbc16e1221514f298575c7b78608c5ee (127.17.251.130). New cstate: current_term: 1 leader_uuid: "fbc16e1221514f298575c7b78608c5ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:06.552028 19032 raft_consensus.cc:3060] T d518696ecaa246959a1f91c778cc2238 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.554436 19108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d518696ecaa246959a1f91c778cc2238" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
I20260709 13:17:06.555279 19108 raft_consensus.cc:3060] T d518696ecaa246959a1f91c778cc2238 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.550691 19223 raft_consensus.cc:359] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.556488 19223 raft_consensus.cc:385] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.556782 19223 raft_consensus.cc:740] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.558993 19145 leader_election.cc:304] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, 7490b33c011e49fc8a864ef7362a2f8b; no voters: fbc16e1221514f298575c7b78608c5ee
I20260709 13:17:06.559792 19231 raft_consensus.cc:2804] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:06.560257 19231 raft_consensus.cc:697] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 1 LEADER]: Becoming Leader. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Running, Role: LEADER
I20260709 13:17:06.561048 19032 raft_consensus.cc:2468] T d518696ecaa246959a1f91c778cc2238 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 1.
I20260709 13:17:06.561074 19231 consensus_queue.cc:237] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.557507 19223 consensus_queue.cc:260] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.587330 19108 raft_consensus.cc:2468] T d518696ecaa246959a1f91c778cc2238 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 1.
I20260709 13:17:06.583041 19223 ts_tablet_manager.cc:1434] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:17:06.582741 19145 leader_election.cc:304] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, 7490b33c011e49fc8a864ef7362a2f8b; no voters: 
I20260709 13:17:06.590241 19279 raft_consensus.cc:2804] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:06.590781 19279 raft_consensus.cc:697] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [term 1 LEADER]: Becoming Leader. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Running, Role: LEADER
I20260709 13:17:06.591290 19223 tablet_bootstrap.cc:492] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee: Bootstrap starting.
I20260709 13:17:06.591593 19279 consensus_queue.cc:237] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.600623 18931 catalog_manager.cc:5697] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "5c916045b6e34ed1b4c32953031b1508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.604893 19223 tablet_bootstrap.cc:654] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.609444 19223 tablet_bootstrap.cc:492] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee: No bootstrap required, opened a new log
I20260709 13:17:06.609923 19223 ts_tablet_manager.cc:1403] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:17:06.612023 19223 raft_consensus.cc:359] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.612510 19223 raft_consensus.cc:385] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.612736 19223 raft_consensus.cc:740] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.613300 19223 consensus_queue.cc:260] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.615134 19223 ts_tablet_manager.cc:1434] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:06.616020 19223 tablet_bootstrap.cc:492] T f1bd7cd292db40bba4b1d1b4c3370280 P fbc16e1221514f298575c7b78608c5ee: Bootstrap starting.
I20260709 13:17:06.615743 18931 catalog_manager.cc:5697] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "5c916045b6e34ed1b4c32953031b1508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.622059 19223 tablet_bootstrap.cc:654] T f1bd7cd292db40bba4b1d1b4c3370280 P fbc16e1221514f298575c7b78608c5ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.625636 19181 raft_consensus.cc:3060] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.629969 19223 tablet_bootstrap.cc:492] T f1bd7cd292db40bba4b1d1b4c3370280 P fbc16e1221514f298575c7b78608c5ee: No bootstrap required, opened a new log
I20260709 13:17:06.630445 19223 ts_tablet_manager.cc:1403] T f1bd7cd292db40bba4b1d1b4c3370280 P fbc16e1221514f298575c7b78608c5ee: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:17:06.632536 19223 raft_consensus.cc:359] T f1bd7cd292db40bba4b1d1b4c3370280 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.632725 19267 consensus_queue.cc:1048] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:06.633255 19223 raft_consensus.cc:385] T f1bd7cd292db40bba4b1d1b4c3370280 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.633538 19223 raft_consensus.cc:740] T f1bd7cd292db40bba4b1d1b4c3370280 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.634222 19223 consensus_queue.cc:260] T f1bd7cd292db40bba4b1d1b4c3370280 P fbc16e1221514f298575c7b78608c5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.636148 19223 ts_tablet_manager.cc:1434] T f1bd7cd292db40bba4b1d1b4c3370280 P fbc16e1221514f298575c7b78608c5ee: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:06.637133 19223 tablet_bootstrap.cc:492] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee: Bootstrap starting.
I20260709 13:17:06.642865 19223 tablet_bootstrap.cc:654] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:06.645984 19267 consensus_queue.cc:1048] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:06.647817 19223 tablet_bootstrap.cc:492] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee: No bootstrap required, opened a new log
I20260709 13:17:06.648332 19223 ts_tablet_manager.cc:1403] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.002s
I20260709 13:17:06.650913 19223 raft_consensus.cc:359] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.651584 19223 raft_consensus.cc:385] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:06.651867 19223 raft_consensus.cc:740] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Initialized, Role: FOLLOWER
I20260709 13:17:06.652527 19223 consensus_queue.cc:260] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.655259 19223 ts_tablet_manager.cc:1434] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:06.655278 19267 raft_consensus.cc:493] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.657829 19267 raft_consensus.cc:515] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.660648 19267 leader_election.cc:290] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:06.661839 19181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6372bcfc73b241e2b94661027aaa5771" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c916045b6e34ed1b4c32953031b1508" is_pre_election: true
I20260709 13:17:06.662650 19181 raft_consensus.cc:2468] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 0.
I20260709 13:17:06.661832 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6372bcfc73b241e2b94661027aaa5771" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b" is_pre_election: true
I20260709 13:17:06.669708 19033 raft_consensus.cc:2468] T 6372bcfc73b241e2b94661027aaa5771 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 0.
I20260709 13:17:06.663628 19074 leader_election.cc:304] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, fbc16e1221514f298575c7b78608c5ee; no voters: 
I20260709 13:17:06.670552 19250 raft_consensus.cc:2804] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:06.670982 19250 raft_consensus.cc:493] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.671372 19250 raft_consensus.cc:3060] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.677587 19250 raft_consensus.cc:515] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.679464 19250 leader_election.cc:290] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 election: Requested vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:06.680503 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6372bcfc73b241e2b94661027aaa5771" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
I20260709 13:17:06.680709 19231 raft_consensus.cc:493] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.680716 19181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6372bcfc73b241e2b94661027aaa5771" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:06.681221 19033 raft_consensus.cc:3060] T 6372bcfc73b241e2b94661027aaa5771 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.681583 19181 raft_consensus.cc:3060] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.681269 19231 raft_consensus.cc:515] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.683853 19231 leader_election.cc:290] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869)
I20260709 13:17:06.685058 19032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bd7cd292db40bba4b1d1b4c3370280" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b" is_pre_election: true
I20260709 13:17:06.685249 19106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bd7cd292db40bba4b1d1b4c3370280" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbc16e1221514f298575c7b78608c5ee" is_pre_election: true
I20260709 13:17:06.685782 19032 raft_consensus.cc:2468] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 0.
I20260709 13:17:06.685946 19106 raft_consensus.cc:2468] T f1bd7cd292db40bba4b1d1b4c3370280 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 0.
I20260709 13:17:06.687305 19145 leader_election.cc:304] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, fbc16e1221514f298575c7b78608c5ee; no voters: 
I20260709 13:17:06.688239 19231 raft_consensus.cc:2804] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:06.688695 19231 raft_consensus.cc:493] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.688733 19181 raft_consensus.cc:2468] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 1.
I20260709 13:17:06.689079 19033 raft_consensus.cc:2468] T 6372bcfc73b241e2b94661027aaa5771 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 1.
I20260709 13:17:06.689224 19231 raft_consensus.cc:3060] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.690126 19074 leader_election.cc:304] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, fbc16e1221514f298575c7b78608c5ee; no voters: 
I20260709 13:17:06.690845 19250 raft_consensus.cc:2804] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:06.691361 19250 raft_consensus.cc:697] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [term 1 LEADER]: Becoming Leader. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Running, Role: LEADER
I20260709 13:17:06.692226 19250 consensus_queue.cc:237] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.696863 19231 raft_consensus.cc:515] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.698885 19231 leader_election.cc:290] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 election: Requested vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869)
I20260709 13:17:06.699815 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bd7cd292db40bba4b1d1b4c3370280" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
I20260709 13:17:06.700394 19033 raft_consensus.cc:3060] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.700599 19106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bd7cd292db40bba4b1d1b4c3370280" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
I20260709 13:17:06.701251 19106 raft_consensus.cc:3060] T f1bd7cd292db40bba4b1d1b4c3370280 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.702771 18931 catalog_manager.cc:5697] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee reported cstate change: term changed from 0 to 1, leader changed from <none> to fbc16e1221514f298575c7b78608c5ee (127.17.251.130). New cstate: current_term: 1 leader_uuid: "fbc16e1221514f298575c7b78608c5ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:06.705821 19033 raft_consensus.cc:2468] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 1.
I20260709 13:17:06.707042 19145 leader_election.cc:304] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, 7490b33c011e49fc8a864ef7362a2f8b; no voters: 
I20260709 13:17:06.707864 19231 raft_consensus.cc:2804] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:06.708199 19106 raft_consensus.cc:2468] T f1bd7cd292db40bba4b1d1b4c3370280 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 1.
I20260709 13:17:06.708401 19231 raft_consensus.cc:697] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 1 LEADER]: Becoming Leader. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Running, Role: LEADER
I20260709 13:17:06.709280 19231 consensus_queue.cc:237] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.717144 18931 catalog_manager.cc:5697] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "5c916045b6e34ed1b4c32953031b1508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.739286 19181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "932c5a10652141c79949901aaef16b6e"
dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
mode: GRACEFUL
new_leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:59190
I20260709 13:17:06.739836 19181 raft_consensus.cc:606] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 1 LEADER]: Received request to transfer leadership to TS 7490b33c011e49fc8a864ef7362a2f8b
I20260709 13:17:06.745178 19181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfdc6a7f8213432197ec1a2f2c8b3789"
dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
mode: GRACEFUL
new_leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:59190
I20260709 13:17:06.745765 19181 raft_consensus.cc:606] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 1 LEADER]: Received request to transfer leadership to TS 7490b33c011e49fc8a864ef7362a2f8b
I20260709 13:17:06.758507 19106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fb65c3aedff40a599064479a7059a2d"
dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
mode: GRACEFUL
new_leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:54918
I20260709 13:17:06.759063 19106 raft_consensus.cc:606] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 1 LEADER]: Received request to transfer leadership to TS 7490b33c011e49fc8a864ef7362a2f8b
I20260709 13:17:06.764495 19106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98674cadcd8246e9aa0aa18e247cccb8"
dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
mode: GRACEFUL
new_leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:54918
I20260709 13:17:06.765054 19106 raft_consensus.cc:606] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 1 LEADER]: Received request to transfer leadership to TS 7490b33c011e49fc8a864ef7362a2f8b
I20260709 13:17:06.770525 19181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1bd7cd292db40bba4b1d1b4c3370280"
dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
mode: GRACEFUL
new_leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:59190
I20260709 13:17:06.771016 19181 raft_consensus.cc:606] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 1 LEADER]: Received request to transfer leadership to TS 7490b33c011e49fc8a864ef7362a2f8b
I20260709 13:17:06.784802 19033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10c18565d8e24ff0b77593a18bbc17a5"
dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
mode: GRACEFUL
new_leader_uuid: "fbc16e1221514f298575c7b78608c5ee"
 from {username='slave'} at 127.0.0.1:57390
I20260709 13:17:06.785358 19033 raft_consensus.cc:606] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 LEADER]: Received request to transfer leadership to TS fbc16e1221514f298575c7b78608c5ee
I20260709 13:17:06.793489 19033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82d295c9661748e489115d29f9988159"
dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
mode: GRACEFUL
new_leader_uuid: "fbc16e1221514f298575c7b78608c5ee"
 from {username='slave'} at 127.0.0.1:57390
I20260709 13:17:06.794077 19033 raft_consensus.cc:606] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 LEADER]: Received request to transfer leadership to TS fbc16e1221514f298575c7b78608c5ee
I20260709 13:17:06.832437 19106 raft_consensus.cc:3060] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.839102 19227 consensus_queue.cc:1048] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:06.842136 19267 consensus_queue.cc:1048] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:06.848325 19261 raft_consensus.cc:993] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b: : Instructing follower fbc16e1221514f298575c7b78608c5ee to start an election
I20260709 13:17:06.848982 19227 raft_consensus.cc:1081] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 LEADER]: Signalling peer fbc16e1221514f298575c7b78608c5ee to start an election
I20260709 13:17:06.851843 19108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82d295c9661748e489115d29f9988159"
dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
 from {username='slave'} at 127.0.0.1:54912
I20260709 13:17:06.852456 19108 raft_consensus.cc:493] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:06.852826 19108 raft_consensus.cc:3060] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:06.857913 19264 consensus_queue.cc:1048] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:06.867657 19297 consensus_queue.cc:1048] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:06.872793 19108 raft_consensus.cc:515] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.874027 19106 raft_consensus.cc:1240] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Rejecting Update request from peer 7490b33c011e49fc8a864ef7362a2f8b for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:06.876107 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d295c9661748e489115d29f9988159" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
I20260709 13:17:06.876271 19181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d295c9661748e489115d29f9988159" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:06.876797 19033 raft_consensus.cc:3055] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:06.877142 19033 raft_consensus.cc:740] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:06.877975 19033 consensus_queue.cc:260] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.876118 19108 leader_election.cc:290] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 2 election: Requested vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:06.878819 19297 consensus_queue.cc:1059] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:06.882835 19033 raft_consensus.cc:3060] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:06.885224 19108 raft_consensus.cc:3060] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:06.890405 19033 raft_consensus.cc:2468] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 2.
I20260709 13:17:06.891654 19071 leader_election.cc:304] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7490b33c011e49fc8a864ef7362a2f8b, fbc16e1221514f298575c7b78608c5ee; no voters: 5c916045b6e34ed1b4c32953031b1508
I20260709 13:17:06.892472 19267 raft_consensus.cc:2804] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:06.892963 19267 raft_consensus.cc:697] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 2 LEADER]: Becoming Leader. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Running, Role: LEADER
I20260709 13:17:06.893702 19229 consensus_queue.cc:1048] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:06.893821 19267 consensus_queue.cc:237] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.897920 19298 consensus_queue.cc:1048] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:06.905050 18931 catalog_manager.cc:5697] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee reported cstate change: term changed from 1 to 2, leader changed from 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129) to fbc16e1221514f298575c7b78608c5ee (127.17.251.130). New cstate: current_term: 2 leader_uuid: "fbc16e1221514f298575c7b78608c5ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:06.917944 19298 raft_consensus.cc:993] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b: : Instructing follower fbc16e1221514f298575c7b78608c5ee to start an election
I20260709 13:17:06.918548 19295 raft_consensus.cc:1081] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 LEADER]: Signalling peer fbc16e1221514f298575c7b78608c5ee to start an election
I20260709 13:17:06.920384 19264 consensus_queue.cc:1048] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:06.920998 19106 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10c18565d8e24ff0b77593a18bbc17a5"
dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
 from {username='slave'} at 127.0.0.1:54912
I20260709 13:17:06.922354 19106 raft_consensus.cc:493] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:06.922803 19106 raft_consensus.cc:3060] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:06.925143 19261 consensus_queue.cc:1048] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:06.931486 19264 raft_consensus.cc:993] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee: : Instructing follower 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:06.931962 19250 raft_consensus.cc:1081] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 1 LEADER]: Signalling peer 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:06.932753 19106 raft_consensus.cc:515] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.935685 19033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98674cadcd8246e9aa0aa18e247cccb8"
dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:57386
I20260709 13:17:06.936071 19032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c18565d8e24ff0b77593a18bbc17a5" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
I20260709 13:17:06.936241 19033 raft_consensus.cc:493] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:06.936654 19032 raft_consensus.cc:3055] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:06.936987 19032 raft_consensus.cc:740] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:06.937405 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c18565d8e24ff0b77593a18bbc17a5" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:06.937781 19032 consensus_queue.cc:260] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.938691 19032 raft_consensus.cc:3060] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:06.939014 19106 leader_election.cc:290] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 2 election: Requested vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:06.936666 19033 raft_consensus.cc:3060] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:06.945348 19032 raft_consensus.cc:2468] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 2.
I20260709 13:17:06.947355 19071 leader_election.cc:304] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7490b33c011e49fc8a864ef7362a2f8b, fbc16e1221514f298575c7b78608c5ee; no voters: 5c916045b6e34ed1b4c32953031b1508
I20260709 13:17:06.947748 19033 raft_consensus.cc:515] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.948380 19250 raft_consensus.cc:2804] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:06.948880 19250 raft_consensus.cc:697] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 2 LEADER]: Becoming Leader. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Running, Role: LEADER
I20260709 13:17:06.949733 19250 consensus_queue.cc:237] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.950999 19106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98674cadcd8246e9aa0aa18e247cccb8" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
I20260709 13:17:06.951584 19106 raft_consensus.cc:3055] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:06.951896 19106 raft_consensus.cc:740] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Running, Role: LEADER
I20260709 13:17:06.952661 19106 consensus_queue.cc:260] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.953783 19106 raft_consensus.cc:3060] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:06.954706 19033 leader_election.cc:290] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 2 election: Requested vote from peers fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:06.956095 19181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98674cadcd8246e9aa0aa18e247cccb8" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:06.956712 19181 raft_consensus.cc:3060] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:06.961004 19106 raft_consensus.cc:2468] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 2.
I20260709 13:17:06.960510 18930 catalog_manager.cc:5697] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee reported cstate change: term changed from 1 to 2, leader changed from 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129) to fbc16e1221514f298575c7b78608c5ee (127.17.251.130). New cstate: current_term: 2 leader_uuid: "fbc16e1221514f298575c7b78608c5ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:06.962126 18996 leader_election.cc:304] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7490b33c011e49fc8a864ef7362a2f8b, fbc16e1221514f298575c7b78608c5ee; no voters: 
I20260709 13:17:06.962947 19295 raft_consensus.cc:2804] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:06.963419 19295 raft_consensus.cc:697] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Becoming Leader. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:06.963666 19181 raft_consensus.cc:2468] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 2.
I20260709 13:17:06.964282 19295 consensus_queue.cc:237] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:06.971446 18930 catalog_manager.cc:5697] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b reported cstate change: term changed from 1 to 2, leader changed from fbc16e1221514f298575c7b78608c5ee (127.17.251.130) to 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129). New cstate: current_term: 2 leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:07.008548 19231 consensus_queue.cc:1048] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:07.019820 19279 consensus_queue.cc:1048] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:07.069710 19231 raft_consensus.cc:993] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508: : Instructing follower 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:07.070242 19231 raft_consensus.cc:1081] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 1 LEADER]: Signalling peer 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:07.071687 19033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfdc6a7f8213432197ec1a2f2c8b3789"
dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:57378
I20260709 13:17:07.072162 19033 raft_consensus.cc:493] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:07.072458 19033 raft_consensus.cc:3060] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:07.077193 19033 raft_consensus.cc:515] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:07.078778 19033 leader_election.cc:290] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 2 election: Requested vote from peers fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:07.079787 19106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdc6a7f8213432197ec1a2f2c8b3789" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
I20260709 13:17:07.079908 19181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdc6a7f8213432197ec1a2f2c8b3789" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:07.080324 19106 raft_consensus.cc:3060] T dfdc6a7f8213432197ec1a2f2c8b3789 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:07.080462 19181 raft_consensus.cc:3055] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:07.080856 19181 raft_consensus.cc:740] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Running, Role: LEADER
I20260709 13:17:07.081511 19181 consensus_queue.cc:260] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:07.082502 19181 raft_consensus.cc:3060] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:07.085671 19106 raft_consensus.cc:2468] T dfdc6a7f8213432197ec1a2f2c8b3789 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 2.
I20260709 13:17:07.086890 18996 leader_election.cc:304] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7490b33c011e49fc8a864ef7362a2f8b, fbc16e1221514f298575c7b78608c5ee; no voters: 
I20260709 13:17:07.087522 19181 raft_consensus.cc:2468] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 2.
I20260709 13:17:07.087742 19295 raft_consensus.cc:2804] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:07.088279 19295 raft_consensus.cc:697] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Becoming Leader. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:07.089013 19295 consensus_queue.cc:237] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:07.095186 18931 catalog_manager.cc:5697] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b reported cstate change: term changed from 1 to 2, leader changed from 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131) to 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129). New cstate: current_term: 2 leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:07.110961 19231 consensus_queue.cc:1048] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:07.117646 19279 raft_consensus.cc:993] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508: : Instructing follower 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:07.118151 19242 raft_consensus.cc:1081] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 1 LEADER]: Signalling peer 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:07.120714 19032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "932c5a10652141c79949901aaef16b6e"
dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:57378
I20260709 13:17:07.121287 19032 raft_consensus.cc:493] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:07.121647 19032 raft_consensus.cc:3060] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:07.127202 19032 raft_consensus.cc:515] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:07.128180 19242 consensus_queue.cc:1048] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:07.129702 19032 leader_election.cc:290] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 2 election: Requested vote from peers fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:07.130293 19181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932c5a10652141c79949901aaef16b6e" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:07.130776 19106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932c5a10652141c79949901aaef16b6e" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
I20260709 13:17:07.131042 19181 raft_consensus.cc:3055] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:07.131502 19181 raft_consensus.cc:740] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Running, Role: LEADER
I20260709 13:17:07.133423 19181 consensus_queue.cc:260] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:07.134333 19181 raft_consensus.cc:3060] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:07.131531 19106 raft_consensus.cc:3060] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:07.139246 19181 raft_consensus.cc:2468] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 2.
I20260709 13:17:07.140445 18999 leader_election.cc:304] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, 7490b33c011e49fc8a864ef7362a2f8b; no voters: 
I20260709 13:17:07.141247 19295 raft_consensus.cc:2804] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:07.141774 19295 raft_consensus.cc:697] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Becoming Leader. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:07.142593 19295 consensus_queue.cc:237] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:07.143265 19106 raft_consensus.cc:2468] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 2.
I20260709 13:17:07.143994 19108 raft_consensus.cc:1240] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Rejecting Update request from peer 5c916045b6e34ed1b4c32953031b1508 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:17:07.149186 18931 catalog_manager.cc:5697] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b reported cstate change: term changed from 1 to 2, leader changed from 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131) to 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129). New cstate: current_term: 2 leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:07.156896 19250 consensus_queue.cc:1048] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:07.165164 19250 raft_consensus.cc:993] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee: : Instructing follower 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:07.165797 19267 raft_consensus.cc:1081] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 1 LEADER]: Signalling peer 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:07.168335 19032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fb65c3aedff40a599064479a7059a2d"
dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:57386
I20260709 13:17:07.168906 19032 raft_consensus.cc:493] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:07.169410 19250 consensus_queue.cc:1048] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:07.170147 19032 raft_consensus.cc:3060] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:07.178960 19242 consensus_queue.cc:1048] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:07.178762 19032 raft_consensus.cc:515] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:07.182458 19106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb65c3aedff40a599064479a7059a2d" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
I20260709 13:17:07.183089 19106 raft_consensus.cc:3055] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:07.183495 19106 raft_consensus.cc:740] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Running, Role: LEADER
I20260709 13:17:07.183552 19032 leader_election.cc:290] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 2 election: Requested vote from peers fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:07.182999 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb65c3aedff40a599064479a7059a2d" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:07.184666 19182 raft_consensus.cc:3060] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:07.185503 19106 consensus_queue.cc:260] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:07.187250 19106 raft_consensus.cc:3060] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:07.192201 19182 raft_consensus.cc:2468] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 2.
I20260709 13:17:07.193435 18999 leader_election.cc:304] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, 7490b33c011e49fc8a864ef7362a2f8b; no voters: 
I20260709 13:17:07.194361 19295 raft_consensus.cc:2804] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:07.194823 19295 raft_consensus.cc:697] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Becoming Leader. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:07.195714 19295 consensus_queue.cc:237] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:07.197274 19106 raft_consensus.cc:2468] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 2.
I20260709 13:17:07.205730 18930 catalog_manager.cc:5697] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b reported cstate change: term changed from 1 to 2, leader changed from fbc16e1221514f298575c7b78608c5ee (127.17.251.130) to 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129). New cstate: current_term: 2 leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:07.207425 19279 consensus_queue.cc:1048] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:07.217314 19242 raft_consensus.cc:993] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508: : Instructing follower 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:07.217818 19279 raft_consensus.cc:1081] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 1 LEADER]: Signalling peer 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:07.219671 19032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1bd7cd292db40bba4b1d1b4c3370280"
dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:57378
I20260709 13:17:07.220293 19032 raft_consensus.cc:493] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:07.220721 19032 raft_consensus.cc:3060] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:07.226583 19032 raft_consensus.cc:515] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:07.228240 19032 leader_election.cc:290] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 2 election: Requested vote from peers fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:07.229197 19108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bd7cd292db40bba4b1d1b4c3370280" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
I20260709 13:17:07.229317 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bd7cd292db40bba4b1d1b4c3370280" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:07.229836 19108 raft_consensus.cc:3060] T f1bd7cd292db40bba4b1d1b4c3370280 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:07.229941 19182 raft_consensus.cc:3055] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:07.230330 19182 raft_consensus.cc:740] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Running, Role: LEADER
I20260709 13:17:07.230991 19182 consensus_queue.cc:260] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:07.231933 19182 raft_consensus.cc:3060] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:07.234963 19108 raft_consensus.cc:2468] T f1bd7cd292db40bba4b1d1b4c3370280 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 2.
I20260709 13:17:07.236124 18996 leader_election.cc:304] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7490b33c011e49fc8a864ef7362a2f8b, fbc16e1221514f298575c7b78608c5ee; no voters: 
I20260709 13:17:07.236841 19295 raft_consensus.cc:2804] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:07.237228 19182 raft_consensus.cc:2468] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 2.
I20260709 13:17:07.237353 19295 raft_consensus.cc:697] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Becoming Leader. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:07.238241 19295 consensus_queue.cc:237] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:07.244652 18930 catalog_manager.cc:5697] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b reported cstate change: term changed from 1 to 2, leader changed from 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131) to 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129). New cstate: current_term: 2 leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:07.402704 19182 raft_consensus.cc:1275] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:07.404289 19295 consensus_queue.cc:1048] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.412675 19181 raft_consensus.cc:3060] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:07.415501 19108 raft_consensus.cc:1275] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:07.416935 19297 consensus_queue.cc:1048] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.420737 19181 raft_consensus.cc:1275] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Refusing update from remote peer fbc16e1221514f298575c7b78608c5ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:07.423516 19250 consensus_queue.cc:1048] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.431025 19032 raft_consensus.cc:1275] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Refusing update from remote peer fbc16e1221514f298575c7b78608c5ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:07.432390 19250 consensus_queue.cc:1048] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.533512 19108 raft_consensus.cc:1275] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:07.534811 19297 consensus_queue.cc:1048] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:07.540558 19032 raft_consensus.cc:1275] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Refusing update from remote peer fbc16e1221514f298575c7b78608c5ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:07.542245 19229 consensus_queue.cc:1048] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.546362 19181 raft_consensus.cc:1275] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:07.548103 19295 consensus_queue.cc:1048] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.555567 19181 raft_consensus.cc:3060] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:07.563441 19181 raft_consensus.cc:1275] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Refusing update from remote peer fbc16e1221514f298575c7b78608c5ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:07.565424 19264 consensus_queue.cc:1048] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:07.590466 19181 raft_consensus.cc:1275] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:07.591825 19295 consensus_queue.cc:1048] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.599938 19108 raft_consensus.cc:1275] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:07.601394 19298 consensus_queue.cc:1048] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.649132 19108 raft_consensus.cc:1275] T f1bd7cd292db40bba4b1d1b4c3370280 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:07.650374 19298 consensus_queue.cc:1048] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.653528 19181 raft_consensus.cc:1275] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:07.655169 19261 consensus_queue.cc:1048] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.664036 19181 raft_consensus.cc:1275] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:07.665477 19261 consensus_queue.cc:1048] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.669221 19108 raft_consensus.cc:1275] T dfdc6a7f8213432197ec1a2f2c8b3789 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:07.671960 19295 consensus_queue.cc:1048] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:09.831030 18414 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:17:09.831811 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:09.849035 19032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "932c5a10652141c79949901aaef16b6e"
dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
mode: GRACEFUL
new_leader_uuid: "5c916045b6e34ed1b4c32953031b1508"
 from {username='slave'} at 127.0.0.1:59042
I20260709 13:17:09.849643 19032 raft_consensus.cc:606] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Received request to transfer leadership to TS 5c916045b6e34ed1b4c32953031b1508
I20260709 13:17:09.852005 19032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98674cadcd8246e9aa0aa18e247cccb8"
dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
mode: GRACEFUL
new_leader_uuid: "5c916045b6e34ed1b4c32953031b1508"
 from {username='slave'} at 127.0.0.1:59042
I20260709 13:17:09.852550 19032 raft_consensus.cc:606] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Received request to transfer leadership to TS 5c916045b6e34ed1b4c32953031b1508
I20260709 13:17:09.853756 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:09.854225 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:09.863211 19261 raft_consensus.cc:993] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b: : Instructing follower 5c916045b6e34ed1b4c32953031b1508 to start an election
I20260709 13:17:09.863672 19317 raft_consensus.cc:1081] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Signalling peer 5c916045b6e34ed1b4c32953031b1508 to start an election
I20260709 13:17:09.865038 19182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98674cadcd8246e9aa0aa18e247cccb8"
dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
 from {username='slave'} at 127.0.0.1:59188
I20260709 13:17:09.865517 19182 raft_consensus.cc:493] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:09.865903 19182 raft_consensus.cc:3060] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:09.870539 19182 raft_consensus.cc:515] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:09.872511 19182 leader_election.cc:290] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 3 election: Requested vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869)
I20260709 13:17:09.873390 19032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98674cadcd8246e9aa0aa18e247cccb8" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
I20260709 13:17:09.873826 19108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98674cadcd8246e9aa0aa18e247cccb8" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
I20260709 13:17:09.874061 19032 raft_consensus.cc:3055] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:09.874382 19108 raft_consensus.cc:3060] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:09.874436 19032 raft_consensus.cc:740] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:09.875345 19032 consensus_queue.cc:260] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:09.876597 19032 raft_consensus.cc:3060] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:09.881731 19108 raft_consensus.cc:2468] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 3.
I20260709 13:17:09.883087 19145 leader_election.cc:304] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, fbc16e1221514f298575c7b78608c5ee; no voters: 
I20260709 13:17:09.883596 19032 raft_consensus.cc:2468] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 3.
I20260709 13:17:09.884014 19279 raft_consensus.cc:2804] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:09.885226 19279 raft_consensus.cc:697] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 3 LEADER]: Becoming Leader. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Running, Role: LEADER
I20260709 13:17:09.886080 19279 consensus_queue.cc:237] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:09.893257 18930 catalog_manager.cc:5697] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 reported cstate change: term changed from 2 to 3, leader changed from 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129) to 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131). New cstate: current_term: 3 leader_uuid: "5c916045b6e34ed1b4c32953031b1508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:10.565337 19032 raft_consensus.cc:1275] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Refusing update from remote peer 5c916045b6e34ed1b4c32953031b1508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:10.567417 19327 consensus_queue.cc:1048] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:10.572568 19108 raft_consensus.cc:1275] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Refusing update from remote peer 5c916045b6e34ed1b4c32953031b1508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:10.581427 19318 consensus_queue.cc:1048] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:10.582988 19324 raft_consensus.cc:993] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b: : Instructing follower 5c916045b6e34ed1b4c32953031b1508 to start an election
I20260709 13:17:10.583496 19317 raft_consensus.cc:1081] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Signalling peer 5c916045b6e34ed1b4c32953031b1508 to start an election
I20260709 13:17:10.596836 19181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "932c5a10652141c79949901aaef16b6e"
dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
 from {username='slave'} at 127.0.0.1:59188
I20260709 13:17:10.597776 19181 raft_consensus.cc:493] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:10.598388 19181 raft_consensus.cc:3060] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:10.611140 19181 raft_consensus.cc:515] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:10.615669 19032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932c5a10652141c79949901aaef16b6e" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
I20260709 13:17:10.616640 19032 raft_consensus.cc:3055] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:10.617122 19032 raft_consensus.cc:740] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:10.618760 19032 consensus_queue.cc:260] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:10.622198 19032 raft_consensus.cc:3060] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:10.623021 19106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932c5a10652141c79949901aaef16b6e" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
I20260709 13:17:10.623642 19181 leader_election.cc:290] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 3 election: Requested vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869)
I20260709 13:17:10.623677 19106 raft_consensus.cc:3060] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:10.647609 19032 raft_consensus.cc:2468] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 3.
I20260709 13:17:10.647606 19106 raft_consensus.cc:2468] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 3.
I20260709 13:17:10.648968 19105 raft_consensus.cc:1240] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Rejecting Update request from peer 7490b33c011e49fc8a864ef7362a2f8b for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:10.648931 19145 leader_election.cc:304] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, 7490b33c011e49fc8a864ef7362a2f8b; no voters: 
I20260709 13:17:10.649966 19279 raft_consensus.cc:2804] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:10.650465 19279 raft_consensus.cc:697] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 3 LEADER]: Becoming Leader. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Running, Role: LEADER
I20260709 13:17:10.651315 19279 consensus_queue.cc:237] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:10.658608 18930 catalog_manager.cc:5697] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 reported cstate change: term changed from 2 to 3, leader changed from 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129) to 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131). New cstate: current_term: 3 leader_uuid: "5c916045b6e34ed1b4c32953031b1508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:10.890901 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:10.902161 19181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "932c5a10652141c79949901aaef16b6e"
dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
mode: GRACEFUL
new_leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:59190
I20260709 13:17:10.902698 19181 raft_consensus.cc:606] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 3 LEADER]: Received request to transfer leadership to TS 7490b33c011e49fc8a864ef7362a2f8b
I20260709 13:17:10.913018 19181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98674cadcd8246e9aa0aa18e247cccb8"
dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
mode: GRACEFUL
new_leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:59190
I20260709 13:17:10.913570 19181 raft_consensus.cc:606] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 3 LEADER]: Received request to transfer leadership to TS 7490b33c011e49fc8a864ef7362a2f8b
I20260709 13:17:10.921124 19106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10c18565d8e24ff0b77593a18bbc17a5"
dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
mode: GRACEFUL
new_leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:54918
I20260709 13:17:10.921697 19106 raft_consensus.cc:606] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 2 LEADER]: Received request to transfer leadership to TS 7490b33c011e49fc8a864ef7362a2f8b
I20260709 13:17:10.926551 19106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aed23ed153d54327a682e9b52fb09145"
dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
mode: GRACEFUL
new_leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:54918
I20260709 13:17:10.927012 19106 raft_consensus.cc:606] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 1 LEADER]: Received request to transfer leadership to TS 7490b33c011e49fc8a864ef7362a2f8b
I20260709 13:17:10.931772 19106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82d295c9661748e489115d29f9988159"
dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
mode: GRACEFUL
new_leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:54918
I20260709 13:17:10.932262 19106 raft_consensus.cc:606] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 2 LEADER]: Received request to transfer leadership to TS 7490b33c011e49fc8a864ef7362a2f8b
I20260709 13:17:10.997023 19314 raft_consensus.cc:993] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee: : Instructing follower 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:10.997458 19329 raft_consensus.cc:1081] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 2 LEADER]: Signalling peer 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:10.999022 19032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10c18565d8e24ff0b77593a18bbc17a5"
dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:57386
I20260709 13:17:10.999464 19032 raft_consensus.cc:493] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:10.999707 19032 raft_consensus.cc:3060] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:11.004333 19032 raft_consensus.cc:515] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:11.005964 19032 leader_election.cc:290] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 3 election: Requested vote from peers fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:11.007056 19181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c18565d8e24ff0b77593a18bbc17a5" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:11.007056 19106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c18565d8e24ff0b77593a18bbc17a5" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
I20260709 13:17:11.007892 19181 raft_consensus.cc:3060] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:11.007917 19106 raft_consensus.cc:3055] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:11.008440 19106 raft_consensus.cc:740] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Running, Role: LEADER
I20260709 13:17:11.009675 19314 raft_consensus.cc:993] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee: : Instructing follower 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:11.009296 19106 consensus_queue.cc:260] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:11.010139 19314 raft_consensus.cc:1081] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 2 LEADER]: Signalling peer 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:11.010596 19106 raft_consensus.cc:3060] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:11.011993 19032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82d295c9661748e489115d29f9988159"
dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:57386
I20260709 13:17:11.012586 19032 raft_consensus.cc:493] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:11.012957 19032 raft_consensus.cc:3060] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:11.014164 19181 raft_consensus.cc:2468] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 3.
I20260709 13:17:11.015268 18999 leader_election.cc:304] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, 7490b33c011e49fc8a864ef7362a2f8b; no voters: 
I20260709 13:17:11.015960 19317 raft_consensus.cc:2804] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:11.016400 19317 raft_consensus.cc:697] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 LEADER]: Becoming Leader. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:11.017153 19317 consensus_queue.cc:237] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:11.018262 19106 raft_consensus.cc:2468] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 3.
I20260709 13:17:11.019495 19032 raft_consensus.cc:515] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:11.021965 19032 leader_election.cc:290] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 3 election: Requested vote from peers fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:11.022557 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d295c9661748e489115d29f9988159" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:11.023147 19182 raft_consensus.cc:3060] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:11.024104 19106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d295c9661748e489115d29f9988159" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
I20260709 13:17:11.024658 19106 raft_consensus.cc:3055] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:11.024923 19106 raft_consensus.cc:740] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Running, Role: LEADER
I20260709 13:17:11.025692 19106 consensus_queue.cc:260] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:11.026616 19106 raft_consensus.cc:3060] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:11.026059 18930 catalog_manager.cc:5697] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b reported cstate change: term changed from 2 to 3, leader changed from fbc16e1221514f298575c7b78608c5ee (127.17.251.130) to 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129). New cstate: current_term: 3 leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.030011 19182 raft_consensus.cc:2468] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 3.
I20260709 13:17:11.033388 19106 raft_consensus.cc:2468] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 3.
I20260709 13:17:11.033514 18999 leader_election.cc:304] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, 7490b33c011e49fc8a864ef7362a2f8b; no voters: 
I20260709 13:17:11.034477 19317 raft_consensus.cc:2804] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:11.035228 19317 raft_consensus.cc:697] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 LEADER]: Becoming Leader. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:11.036396 19317 consensus_queue.cc:237] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:11.042852 18930 catalog_manager.cc:5697] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b reported cstate change: term changed from 2 to 3, leader changed from fbc16e1221514f298575c7b78608c5ee (127.17.251.130) to 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129). New cstate: current_term: 3 leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.049685 19032 raft_consensus.cc:1275] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Refusing update from remote peer 5c916045b6e34ed1b4c32953031b1508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:11.050992 19279 consensus_queue.cc:1048] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:11.056581 19327 raft_consensus.cc:993] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508: : Instructing follower 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:11.057032 19318 raft_consensus.cc:1081] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 3 LEADER]: Signalling peer 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:11.061972 19106 raft_consensus.cc:1275] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Refusing update from remote peer 5c916045b6e34ed1b4c32953031b1508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:11.062579 19032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "932c5a10652141c79949901aaef16b6e"
dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:57378
I20260709 13:17:11.063064 19032 raft_consensus.cc:493] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:11.063457 19032 raft_consensus.cc:3060] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:11.063827 19279 consensus_queue.cc:1048] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:11.071894 19032 raft_consensus.cc:515] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:11.074494 19032 leader_election.cc:290] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 4 election: Requested vote from peers fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:11.075630 19181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932c5a10652141c79949901aaef16b6e" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:11.076224 19181 raft_consensus.cc:3055] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:11.075692 19106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932c5a10652141c79949901aaef16b6e" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
I20260709 13:17:11.078007 19181 raft_consensus.cc:740] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Running, Role: LEADER
I20260709 13:17:11.078207 19106 raft_consensus.cc:3060] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:11.078771 19181 consensus_queue.cc:260] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:11.079943 19181 raft_consensus.cc:3060] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:11.083868 19314 raft_consensus.cc:993] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee: : Instructing follower 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:11.084419 19329 raft_consensus.cc:1081] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 1 LEADER]: Signalling peer 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:11.086356 19032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aed23ed153d54327a682e9b52fb09145"
dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:57386
I20260709 13:17:11.086835 19032 raft_consensus.cc:493] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:11.087137 19032 raft_consensus.cc:3060] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.087020 19106 raft_consensus.cc:2468] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 4.
I20260709 13:17:11.088021 19181 raft_consensus.cc:2468] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 4.
I20260709 13:17:11.088266 18996 leader_election.cc:304] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7490b33c011e49fc8a864ef7362a2f8b, fbc16e1221514f298575c7b78608c5ee; no voters: 
I20260709 13:17:11.089403 19317 raft_consensus.cc:2804] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:11.089856 19317 raft_consensus.cc:697] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 4 LEADER]: Becoming Leader. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:11.090579 19317 consensus_queue.cc:237] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:11.092368 19032 raft_consensus.cc:515] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:11.094184 19032 leader_election.cc:290] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 2 election: Requested vote from peers fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:11.095929 19181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed23ed153d54327a682e9b52fb09145" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:11.096730 19106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed23ed153d54327a682e9b52fb09145" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
I20260709 13:17:11.097921 19181 raft_consensus.cc:3060] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.097981 19106 raft_consensus.cc:3055] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:11.098459 19106 raft_consensus.cc:740] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Running, Role: LEADER
I20260709 13:17:11.098371 18929 catalog_manager.cc:5697] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b reported cstate change: term changed from 3 to 4, leader changed from 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131) to 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129). New cstate: current_term: 4 leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.099423 19106 consensus_queue.cc:260] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:11.100787 19106 raft_consensus.cc:3060] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.106609 19181 raft_consensus.cc:2468] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 2.
I20260709 13:17:11.107887 18999 leader_election.cc:304] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, 7490b33c011e49fc8a864ef7362a2f8b; no voters: 
I20260709 13:17:11.107987 19106 raft_consensus.cc:2468] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 2.
I20260709 13:17:11.108681 19317 raft_consensus.cc:2804] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:11.109083 19317 raft_consensus.cc:697] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Becoming Leader. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:11.109838 19317 consensus_queue.cc:237] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:11.116091 18929 catalog_manager.cc:5697] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b reported cstate change: term changed from 1 to 2, leader changed from fbc16e1221514f298575c7b78608c5ee (127.17.251.130) to 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129). New cstate: current_term: 2 leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.135609 19341 raft_consensus.cc:993] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508: : Instructing follower 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:11.136059 19327 raft_consensus.cc:1081] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 3 LEADER]: Signalling peer 7490b33c011e49fc8a864ef7362a2f8b to start an election
I20260709 13:17:11.137475 19032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98674cadcd8246e9aa0aa18e247cccb8"
dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
 from {username='slave'} at 127.0.0.1:57378
I20260709 13:17:11.137933 19032 raft_consensus.cc:493] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:11.138159 19032 raft_consensus.cc:3060] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:11.142354 19032 raft_consensus.cc:515] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
W20260709 13:17:11.142773 19054 debug-util.cc:398] Leaking SignalData structure 0x7b0800155fa0 after lost signal to thread 18417
W20260709 13:17:11.143675 19054 debug-util.cc:398] Leaking SignalData structure 0x7b0800150680 after lost signal to thread 18965
I20260709 13:17:11.144327 19032 leader_election.cc:290] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 4 election: Requested vote from peers fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
W20260709 13:17:11.144766 19054 debug-util.cc:398] Leaking SignalData structure 0x7b080010b4e0 after lost signal to thread 19057
I20260709 13:17:11.145439 19106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98674cadcd8246e9aa0aa18e247cccb8" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
W20260709 13:17:11.145823 19054 debug-util.cc:398] Leaking SignalData structure 0x7b080010bc60 after lost signal to thread 19132
I20260709 13:17:11.145463 19181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98674cadcd8246e9aa0aa18e247cccb8" candidate_uuid: "7490b33c011e49fc8a864ef7362a2f8b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:11.146176 19106 raft_consensus.cc:3060] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:11.146607 19181 raft_consensus.cc:3055] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:17:11.146950 19054 debug-util.cc:398] Leaking SignalData structure 0x7b0800102d20 after lost signal to thread 19206
I20260709 13:17:11.146958 19181 raft_consensus.cc:740] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Running, Role: LEADER
I20260709 13:17:11.147960 19181 consensus_queue.cc:260] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:11.148882 19181 raft_consensus.cc:3060] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:11.153924 19181 raft_consensus.cc:2468] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 4.
I20260709 13:17:11.154758 19106 raft_consensus.cc:2468] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7490b33c011e49fc8a864ef7362a2f8b in term 4.
I20260709 13:17:11.155112 18999 leader_election.cc:304] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, 7490b33c011e49fc8a864ef7362a2f8b; no voters: 
I20260709 13:17:11.156188 19317 raft_consensus.cc:2804] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:11.156747 19317 raft_consensus.cc:697] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 4 LEADER]: Becoming Leader. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:11.157280 19105 raft_consensus.cc:1240] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 4 FOLLOWER]: Rejecting Update request from peer 5c916045b6e34ed1b4c32953031b1508 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:11.157728 19317 consensus_queue.cc:237] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:11.165473 18929 catalog_manager.cc:5697] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b reported cstate change: term changed from 3 to 4, leader changed from 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131) to 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129). New cstate: current_term: 4 leader_uuid: "7490b33c011e49fc8a864ef7362a2f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.450788 19181 raft_consensus.cc:1275] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:11.451102 19105 raft_consensus.cc:1275] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:11.452064 19317 consensus_queue.cc:1048] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:11.452901 19325 consensus_queue.cc:1048] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:11.482049 19105 raft_consensus.cc:1275] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:11.485855 19346 consensus_queue.cc:1048] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:11.503424 19182 raft_consensus.cc:1275] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:11.505365 19348 consensus_queue.cc:1048] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:11.548463 19182 raft_consensus.cc:1275] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 4 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:11.549947 19348 consensus_queue.cc:1048] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:11.560870 19105 raft_consensus.cc:1275] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 4 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:11.562944 19317 consensus_queue.cc:1048] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:11.600224 19105 raft_consensus.cc:1275] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:11.601821 19317 consensus_queue.cc:1048] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:11.615746 19182 raft_consensus.cc:1275] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:11.618125 19347 consensus_queue.cc:1048] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:11.620764 19105 raft_consensus.cc:1275] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 4 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:11.622180 19346 consensus_queue.cc:1048] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:11.633378 19181 raft_consensus.cc:1275] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 4 FOLLOWER]: Refusing update from remote peer 7490b33c011e49fc8a864ef7362a2f8b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:11.635135 19346 consensus_queue.cc:1048] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:13.939435 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:13.947212 19032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10c18565d8e24ff0b77593a18bbc17a5"
dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
mode: GRACEFUL
new_leader_uuid: "5c916045b6e34ed1b4c32953031b1508"
 from {username='slave'} at 127.0.0.1:59042
I20260709 13:17:13.947914 19032 raft_consensus.cc:606] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 LEADER]: Received request to transfer leadership to TS 5c916045b6e34ed1b4c32953031b1508
I20260709 13:17:13.950587 19032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fb65c3aedff40a599064479a7059a2d"
dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
mode: GRACEFUL
new_leader_uuid: "fbc16e1221514f298575c7b78608c5ee"
 from {username='slave'} at 127.0.0.1:59042
I20260709 13:17:13.951050 19032 raft_consensus.cc:606] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Received request to transfer leadership to TS fbc16e1221514f298575c7b78608c5ee
I20260709 13:17:13.953224 19032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82d295c9661748e489115d29f9988159"
dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
mode: GRACEFUL
new_leader_uuid: "5c916045b6e34ed1b4c32953031b1508"
 from {username='slave'} at 127.0.0.1:59042
I20260709 13:17:13.953697 19032 raft_consensus.cc:606] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 LEADER]: Received request to transfer leadership to TS 5c916045b6e34ed1b4c32953031b1508
I20260709 13:17:13.956395 19032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aed23ed153d54327a682e9b52fb09145"
dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
mode: GRACEFUL
new_leader_uuid: "fbc16e1221514f298575c7b78608c5ee"
 from {username='slave'} at 127.0.0.1:59042
I20260709 13:17:13.956995 19032 raft_consensus.cc:606] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Received request to transfer leadership to TS fbc16e1221514f298575c7b78608c5ee
I20260709 13:17:13.958323 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:17:13.959012 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:13.977701 19356 raft_consensus.cc:993] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b: : Instructing follower fbc16e1221514f298575c7b78608c5ee to start an election
I20260709 13:17:13.978255 19346 raft_consensus.cc:1081] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Signalling peer fbc16e1221514f298575c7b78608c5ee to start an election
I20260709 13:17:13.979769 19106 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aed23ed153d54327a682e9b52fb09145"
dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
 from {username='slave'} at 127.0.0.1:54912
I20260709 13:17:13.980239 19106 raft_consensus.cc:493] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:13.980561 19106 raft_consensus.cc:3060] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:13.986099 19106 raft_consensus.cc:515] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:13.987882 19106 leader_election.cc:290] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 3 election: Requested vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:13.988785 19032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed23ed153d54327a682e9b52fb09145" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
I20260709 13:17:13.989118 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed23ed153d54327a682e9b52fb09145" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:13.989404 19032 raft_consensus.cc:3055] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:13.989759 19182 raft_consensus.cc:3060] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:13.989770 19032 raft_consensus.cc:740] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:13.990705 19032 consensus_queue.cc:260] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:13.991618 19032 raft_consensus.cc:3060] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:13.994597 19182 raft_consensus.cc:2468] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 3.
I20260709 13:17:13.995850 19074 leader_election.cc:304] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, fbc16e1221514f298575c7b78608c5ee; no voters: 
I20260709 13:17:13.996646 19032 raft_consensus.cc:2468] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 3.
I20260709 13:17:13.996698 19351 raft_consensus.cc:2804] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:13.998236 19351 raft_consensus.cc:697] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 3 LEADER]: Becoming Leader. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Running, Role: LEADER
I20260709 13:17:13.999289 19351 consensus_queue.cc:237] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:14.001199 19356 raft_consensus.cc:993] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b: : Instructing follower 5c916045b6e34ed1b4c32953031b1508 to start an election
I20260709 13:17:14.001708 19346 raft_consensus.cc:1081] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 LEADER]: Signalling peer 5c916045b6e34ed1b4c32953031b1508 to start an election
I20260709 13:17:14.003723 19182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10c18565d8e24ff0b77593a18bbc17a5"
dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
 from {username='slave'} at 127.0.0.1:59188
I20260709 13:17:14.004364 19182 raft_consensus.cc:493] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:14.004734 19182 raft_consensus.cc:3060] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:14.007534 18929 catalog_manager.cc:5697] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee reported cstate change: term changed from 2 to 3, leader changed from 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129) to fbc16e1221514f298575c7b78608c5ee (127.17.251.130). New cstate: current_term: 3 leader_uuid: "fbc16e1221514f298575c7b78608c5ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.009277 19182 raft_consensus.cc:515] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:14.011379 19182 leader_election.cc:290] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 4 election: Requested vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869)
I20260709 13:17:14.012161 19032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c18565d8e24ff0b77593a18bbc17a5" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
I20260709 13:17:14.012779 19032 raft_consensus.cc:3055] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:14.012974 19106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c18565d8e24ff0b77593a18bbc17a5" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
I20260709 13:17:14.013094 19032 raft_consensus.cc:740] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:14.013585 19106 raft_consensus.cc:3060] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:14.014183 19032 consensus_queue.cc:260] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:14.015426 19032 raft_consensus.cc:3060] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:14.021447 19106 raft_consensus.cc:2468] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 4.
I20260709 13:17:14.022260 19032 raft_consensus.cc:2468] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 4.
I20260709 13:17:14.023435 19145 leader_election.cc:304] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, fbc16e1221514f298575c7b78608c5ee; no voters: 
I20260709 13:17:14.024405 19354 raft_consensus.cc:2804] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:14.025851 19354 raft_consensus.cc:697] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 4 LEADER]: Becoming Leader. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Running, Role: LEADER
I20260709 13:17:14.026889 19354 consensus_queue.cc:237] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:14.034446 18929 catalog_manager.cc:5697] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 reported cstate change: term changed from 3 to 4, leader changed from 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129) to 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131). New cstate: current_term: 4 leader_uuid: "5c916045b6e34ed1b4c32953031b1508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:14.058487 19356 raft_consensus.cc:993] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b: : Instructing follower fbc16e1221514f298575c7b78608c5ee to start an election
I20260709 13:17:14.058898 19346 raft_consensus.cc:1081] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Signalling peer fbc16e1221514f298575c7b78608c5ee to start an election
I20260709 13:17:14.060356 19106 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fb65c3aedff40a599064479a7059a2d"
dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
 from {username='slave'} at 127.0.0.1:54912
I20260709 13:17:14.060732 19106 raft_consensus.cc:493] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:14.061024 19106 raft_consensus.cc:3060] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:14.065490 19106 raft_consensus.cc:515] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:14.066830 19106 leader_election.cc:290] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 3 election: Requested vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131:40741)
I20260709 13:17:14.067765 19032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb65c3aedff40a599064479a7059a2d" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
I20260709 13:17:14.067983 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb65c3aedff40a599064479a7059a2d" candidate_uuid: "fbc16e1221514f298575c7b78608c5ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
I20260709 13:17:14.068262 19032 raft_consensus.cc:3055] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:14.068491 19182 raft_consensus.cc:3060] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:14.068593 19032 raft_consensus.cc:740] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:14.069419 19032 consensus_queue.cc:260] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:14.070389 19032 raft_consensus.cc:3060] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:14.073277 19182 raft_consensus.cc:2468] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 3.
I20260709 13:17:14.074321 19074 leader_election.cc:304] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, fbc16e1221514f298575c7b78608c5ee; no voters: 
I20260709 13:17:14.075060 19351 raft_consensus.cc:2804] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:14.075060 19032 raft_consensus.cc:2468] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbc16e1221514f298575c7b78608c5ee in term 3.
I20260709 13:17:14.075754 19351 raft_consensus.cc:697] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 3 LEADER]: Becoming Leader. State: Replica: fbc16e1221514f298575c7b78608c5ee, State: Running, Role: LEADER
I20260709 13:17:14.076541 19351 consensus_queue.cc:237] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:14.083235 18929 catalog_manager.cc:5697] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee reported cstate change: term changed from 2 to 3, leader changed from 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129) to fbc16e1221514f298575c7b78608c5ee (127.17.251.130). New cstate: current_term: 3 leader_uuid: "fbc16e1221514f298575c7b78608c5ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.142587 19356 raft_consensus.cc:993] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b: : Instructing follower 5c916045b6e34ed1b4c32953031b1508 to start an election
I20260709 13:17:14.143007 19346 raft_consensus.cc:1081] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 LEADER]: Signalling peer 5c916045b6e34ed1b4c32953031b1508 to start an election
I20260709 13:17:14.144436 19182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82d295c9661748e489115d29f9988159"
dest_uuid: "5c916045b6e34ed1b4c32953031b1508"
 from {username='slave'} at 127.0.0.1:59188
I20260709 13:17:14.144830 19182 raft_consensus.cc:493] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:14.145047 19182 raft_consensus.cc:3060] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:14.149112 19182 raft_consensus.cc:515] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:14.150497 19182 leader_election.cc:290] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 4 election: Requested vote from peers 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771), fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869)
I20260709 13:17:14.151400 19032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d295c9661748e489115d29f9988159" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7490b33c011e49fc8a864ef7362a2f8b"
I20260709 13:17:14.151667 19106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d295c9661748e489115d29f9988159" candidate_uuid: "5c916045b6e34ed1b4c32953031b1508" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fbc16e1221514f298575c7b78608c5ee"
I20260709 13:17:14.152001 19032 raft_consensus.cc:3055] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:14.152141 19106 raft_consensus.cc:3060] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:14.152346 19032 raft_consensus.cc:740] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7490b33c011e49fc8a864ef7362a2f8b, State: Running, Role: LEADER
I20260709 13:17:14.153113 19032 consensus_queue.cc:260] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:14.154271 19032 raft_consensus.cc:3060] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:14.158918 19106 raft_consensus.cc:2468] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 4.
I20260709 13:17:14.160295 19145 leader_election.cc:304] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c916045b6e34ed1b4c32953031b1508, fbc16e1221514f298575c7b78608c5ee; no voters: 
I20260709 13:17:14.161228 19354 raft_consensus.cc:2804] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:14.161314 19032 raft_consensus.cc:2468] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c916045b6e34ed1b4c32953031b1508 in term 4.
I20260709 13:17:14.161734 19354 raft_consensus.cc:697] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [term 4 LEADER]: Becoming Leader. State: Replica: 5c916045b6e34ed1b4c32953031b1508, State: Running, Role: LEADER
I20260709 13:17:14.162638 19354 consensus_queue.cc:237] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } }
I20260709 13:17:14.170382 18929 catalog_manager.cc:5697] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 reported cstate change: term changed from 3 to 4, leader changed from 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129) to 5c916045b6e34ed1b4c32953031b1508 (127.17.251.131). New cstate: current_term: 4 leader_uuid: "5c916045b6e34ed1b4c32953031b1508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:14.523905 19182 raft_consensus.cc:1275] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Refusing update from remote peer fbc16e1221514f298575c7b78608c5ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:14.525151 19351 consensus_queue.cc:1048] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.539217 19032 raft_consensus.cc:1275] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Refusing update from remote peer fbc16e1221514f298575c7b78608c5ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:14.540968 19369 consensus_queue.cc:1048] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:14.575879 19106 raft_consensus.cc:1275] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 4 FOLLOWER]: Refusing update from remote peer 5c916045b6e34ed1b4c32953031b1508: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:14.577103 19032 raft_consensus.cc:1275] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 4 FOLLOWER]: Refusing update from remote peer 5c916045b6e34ed1b4c32953031b1508: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:14.577309 19354 consensus_queue.cc:1048] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:14.578589 19363 consensus_queue.cc:1048] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:14.613582 19182 raft_consensus.cc:1275] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Refusing update from remote peer fbc16e1221514f298575c7b78608c5ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:14.614832 19369 consensus_queue.cc:1048] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c916045b6e34ed1b4c32953031b1508" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.624784 19032 raft_consensus.cc:1275] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Refusing update from remote peer fbc16e1221514f298575c7b78608c5ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:14.626658 19357 consensus_queue.cc:1048] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:14.660485 19106 raft_consensus.cc:1275] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 4 FOLLOWER]: Refusing update from remote peer 5c916045b6e34ed1b4c32953031b1508: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:14.661934 19375 consensus_queue.cc:1048] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbc16e1221514f298575c7b78608c5ee" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:14.671252 19032 raft_consensus.cc:1275] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 4 FOLLOWER]: Refusing update from remote peer 5c916045b6e34ed1b4c32953031b1508: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:14.672632 19354 consensus_queue.cc:1048] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7490b33c011e49fc8a864ef7362a2f8b" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 41771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:14.959961 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:14.966485 18414 tablet_server.cc:179] TabletServer@127.17.251.129:0 shutting down...
I20260709 13:17:14.991115 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:14.991989 18414 tablet_replica.cc:333] T 6372bcfc73b241e2b94661027aaa5771 P 7490b33c011e49fc8a864ef7362a2f8b: stopping tablet replica
I20260709 13:17:14.992642 18414 raft_consensus.cc:2243] T 6372bcfc73b241e2b94661027aaa5771 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:14.993136 18414 raft_consensus.cc:2272] T 6372bcfc73b241e2b94661027aaa5771 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:14.995223 18414 tablet_replica.cc:333] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b: stopping tablet replica
I20260709 13:17:14.995836 18414 raft_consensus.cc:2243] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:14.996269 18414 raft_consensus.cc:2272] T aed23ed153d54327a682e9b52fb09145 P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:14.998639 18414 tablet_replica.cc:333] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b: stopping tablet replica
I20260709 13:17:14.999338 18414 raft_consensus.cc:2243] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:14.999783 18414 raft_consensus.cc:2272] T 10c18565d8e24ff0b77593a18bbc17a5 P 7490b33c011e49fc8a864ef7362a2f8b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.002590 18414 tablet_replica.cc:333] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b: stopping tablet replica
I20260709 13:17:15.003209 18414 raft_consensus.cc:2243] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.003654 18414 raft_consensus.cc:2272] T 82d295c9661748e489115d29f9988159 P 7490b33c011e49fc8a864ef7362a2f8b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.005717 18414 tablet_replica.cc:333] T d518696ecaa246959a1f91c778cc2238 P 7490b33c011e49fc8a864ef7362a2f8b: stopping tablet replica
I20260709 13:17:15.006251 18414 raft_consensus.cc:2243] T d518696ecaa246959a1f91c778cc2238 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.006659 18414 raft_consensus.cc:2272] T d518696ecaa246959a1f91c778cc2238 P 7490b33c011e49fc8a864ef7362a2f8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.008471 18414 tablet_replica.cc:333] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b: stopping tablet replica
I20260709 13:17:15.008970 18414 raft_consensus.cc:2243] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.009773 18414 raft_consensus.cc:2272] T dfdc6a7f8213432197ec1a2f2c8b3789 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.011477 18414 tablet_replica.cc:333] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b: stopping tablet replica
I20260709 13:17:15.011971 18414 raft_consensus.cc:2243] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.012758 18414 raft_consensus.cc:2272] T f1bd7cd292db40bba4b1d1b4c3370280 P 7490b33c011e49fc8a864ef7362a2f8b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.014557 18414 tablet_replica.cc:333] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b: stopping tablet replica
I20260709 13:17:15.015044 18414 raft_consensus.cc:2243] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.015431 18414 raft_consensus.cc:2272] T 3fb65c3aedff40a599064479a7059a2d P 7490b33c011e49fc8a864ef7362a2f8b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.017794 18414 tablet_replica.cc:333] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b: stopping tablet replica
I20260709 13:17:15.018271 18414 raft_consensus.cc:2243] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.018997 18414 raft_consensus.cc:2272] T 98674cadcd8246e9aa0aa18e247cccb8 P 7490b33c011e49fc8a864ef7362a2f8b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.020593 18414 tablet_replica.cc:333] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b: stopping tablet replica
I20260709 13:17:15.021050 18414 raft_consensus.cc:2243] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.021857 18414 raft_consensus.cc:2272] T 932c5a10652141c79949901aaef16b6e P 7490b33c011e49fc8a864ef7362a2f8b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.069130 18414 tablet_server.cc:196] TabletServer@127.17.251.129:0 shutdown complete.
I20260709 13:17:15.091584 18414 tablet_server.cc:179] TabletServer@127.17.251.130:0 shutting down...
I20260709 13:17:15.120821 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:15.121546 18414 tablet_replica.cc:333] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee: stopping tablet replica
I20260709 13:17:15.122174 18414 raft_consensus.cc:2243] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.122686 18414 raft_consensus.cc:2272] T 82d295c9661748e489115d29f9988159 P fbc16e1221514f298575c7b78608c5ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.124852 18414 tablet_replica.cc:333] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee: stopping tablet replica
I20260709 13:17:15.125388 18414 raft_consensus.cc:2243] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.126459 18414 raft_consensus.cc:2272] T 6372bcfc73b241e2b94661027aaa5771 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.128473 18414 tablet_replica.cc:333] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee: stopping tablet replica
I20260709 13:17:15.129078 18414 raft_consensus.cc:2243] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.129544 18414 raft_consensus.cc:2272] T 10c18565d8e24ff0b77593a18bbc17a5 P fbc16e1221514f298575c7b78608c5ee [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:15.129725 19071 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.251.129:41771: connect: Connection refused (error 111) [suppressed 5 similar messages]
I20260709 13:17:15.132732 18414 tablet_replica.cc:333] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee: stopping tablet replica
I20260709 13:17:15.133285 18414 raft_consensus.cc:2243] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.133837 18414 raft_consensus.cc:2272] T 932c5a10652141c79949901aaef16b6e P fbc16e1221514f298575c7b78608c5ee [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:15.134341 19071 consensus_peers.cc:597] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee -> Peer 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771): Couldn't send request to peer 7490b33c011e49fc8a864ef7362a2f8b. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:41771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.135733 18414 tablet_replica.cc:333] T f1bd7cd292db40bba4b1d1b4c3370280 P fbc16e1221514f298575c7b78608c5ee: stopping tablet replica
I20260709 13:17:15.136286 18414 raft_consensus.cc:2243] T f1bd7cd292db40bba4b1d1b4c3370280 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.136686 18414 raft_consensus.cc:2272] T f1bd7cd292db40bba4b1d1b4c3370280 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.138387 18414 tablet_replica.cc:333] T d518696ecaa246959a1f91c778cc2238 P fbc16e1221514f298575c7b78608c5ee: stopping tablet replica
I20260709 13:17:15.138897 18414 raft_consensus.cc:2243] T d518696ecaa246959a1f91c778cc2238 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.139322 18414 raft_consensus.cc:2272] T d518696ecaa246959a1f91c778cc2238 P fbc16e1221514f298575c7b78608c5ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.141057 18414 tablet_replica.cc:333] T dfdc6a7f8213432197ec1a2f2c8b3789 P fbc16e1221514f298575c7b78608c5ee: stopping tablet replica
I20260709 13:17:15.141578 18414 raft_consensus.cc:2243] T dfdc6a7f8213432197ec1a2f2c8b3789 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.142066 18414 raft_consensus.cc:2272] T dfdc6a7f8213432197ec1a2f2c8b3789 P fbc16e1221514f298575c7b78608c5ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.143802 18414 tablet_replica.cc:333] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee: stopping tablet replica
I20260709 13:17:15.144486 18414 raft_consensus.cc:2243] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.144996 18414 raft_consensus.cc:2272] T 98674cadcd8246e9aa0aa18e247cccb8 P fbc16e1221514f298575c7b78608c5ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.147605 18414 tablet_replica.cc:333] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee: stopping tablet replica
I20260709 13:17:15.148128 18414 raft_consensus.cc:2243] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.149184 18414 raft_consensus.cc:2272] T aed23ed153d54327a682e9b52fb09145 P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:15.150091 19145 consensus_peers.cc:597] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 -> Peer fbc16e1221514f298575c7b78608c5ee (127.17.251.130:33869): Couldn't send request to peer fbc16e1221514f298575c7b78608c5ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.152416 18414 tablet_replica.cc:333] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee: stopping tablet replica
I20260709 13:17:15.152927 18414 raft_consensus.cc:2243] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.153825 18414 raft_consensus.cc:2272] T 3fb65c3aedff40a599064479a7059a2d P fbc16e1221514f298575c7b78608c5ee [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:15.159368 19145 consensus_peers.cc:597] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 -> Peer 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771): Couldn't send request to peer 7490b33c011e49fc8a864ef7362a2f8b. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:41771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.184419 18414 tablet_server.cc:196] TabletServer@127.17.251.130:0 shutdown complete.
I20260709 13:17:15.205770 18414 tablet_server.cc:179] TabletServer@127.17.251.131:0 shutting down...
W20260709 13:17:15.212304 19145 consensus_peers.cc:597] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 -> Peer 7490b33c011e49fc8a864ef7362a2f8b (127.17.251.129:41771): Couldn't send request to peer 7490b33c011e49fc8a864ef7362a2f8b. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:41771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.238148 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:15.238880 18414 tablet_replica.cc:333] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508: stopping tablet replica
I20260709 13:17:15.239497 18414 raft_consensus.cc:2243] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.239957 18414 raft_consensus.cc:2272] T 3fb65c3aedff40a599064479a7059a2d P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.242784 18414 tablet_replica.cc:333] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508: stopping tablet replica
I20260709 13:17:15.243346 18414 raft_consensus.cc:2243] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.243795 18414 raft_consensus.cc:2272] T 98674cadcd8246e9aa0aa18e247cccb8 P 5c916045b6e34ed1b4c32953031b1508 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.245463 18414 tablet_replica.cc:333] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508: stopping tablet replica
I20260709 13:17:15.246066 18414 raft_consensus.cc:2243] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.246843 18414 raft_consensus.cc:2272] T 82d295c9661748e489115d29f9988159 P 5c916045b6e34ed1b4c32953031b1508 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.248951 18414 tablet_replica.cc:333] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508: stopping tablet replica
I20260709 13:17:15.249469 18414 raft_consensus.cc:2243] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.249984 18414 raft_consensus.cc:2272] T 6372bcfc73b241e2b94661027aaa5771 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.251688 18414 tablet_replica.cc:333] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508: stopping tablet replica
I20260709 13:17:15.252179 18414 raft_consensus.cc:2243] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.252594 18414 raft_consensus.cc:2272] T aed23ed153d54327a682e9b52fb09145 P 5c916045b6e34ed1b4c32953031b1508 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.254769 18414 tablet_replica.cc:333] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508: stopping tablet replica
I20260709 13:17:15.255316 18414 raft_consensus.cc:2243] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.255828 18414 raft_consensus.cc:2272] T 932c5a10652141c79949901aaef16b6e P 5c916045b6e34ed1b4c32953031b1508 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.257505 18414 tablet_replica.cc:333] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508: stopping tablet replica
I20260709 13:17:15.258061 18414 raft_consensus.cc:2243] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.258502 18414 raft_consensus.cc:2272] T f1bd7cd292db40bba4b1d1b4c3370280 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.260203 18414 tablet_replica.cc:333] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508: stopping tablet replica
I20260709 13:17:15.260695 18414 raft_consensus.cc:2243] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.261420 18414 raft_consensus.cc:2272] T d518696ecaa246959a1f91c778cc2238 P 5c916045b6e34ed1b4c32953031b1508 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.263290 18414 tablet_replica.cc:333] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508: stopping tablet replica
I20260709 13:17:15.263788 18414 raft_consensus.cc:2243] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.264230 18414 raft_consensus.cc:2272] T dfdc6a7f8213432197ec1a2f2c8b3789 P 5c916045b6e34ed1b4c32953031b1508 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.266011 18414 tablet_replica.cc:333] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508: stopping tablet replica
I20260709 13:17:15.266455 18414 raft_consensus.cc:2243] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.267185 18414 raft_consensus.cc:2272] T 10c18565d8e24ff0b77593a18bbc17a5 P 5c916045b6e34ed1b4c32953031b1508 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.296125 18414 tablet_server.cc:196] TabletServer@127.17.251.131:0 shutdown complete.
I20260709 13:17:15.314759 18414 master.cc:562] Master@127.17.251.190:34067 shutting down...
I20260709 13:17:15.334774 18414 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.335314 18414 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.335597 18414 tablet_replica.cc:333] T 00000000000000000000000000000000 P 06cde7260ac24cb9aad19e818f13aa11: stopping tablet replica
I20260709 13:17:15.355786 18414 master.cc:584] Master@127.17.251.190:34067 shutdown complete.
5c916045b6e34ed1b4c32953031b1508  1
7490b33c011e49fc8a864ef7362a2f8b  5
fbc16e1221514f298575c7b78608c5ee  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10423 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:17:15.398298 18414 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.251.190:33289
I20260709 13:17:15.399497 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:15.405741 19386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:15.405917 19385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:15.406874 19388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:15.407169 18414 server_base.cc:1061] running on GCE node
I20260709 13:17:15.409327 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:15.409579 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:15.409790 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603035409771 us; error 0 us; skew 500 ppm
I20260709 13:17:15.410332 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:15.412735 18414 webserver.cc:533] Webserver started at http://127.17.251.190:45257/ using document root <none> and password file <none>
I20260709 13:17:15.413234 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:15.413445 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:15.413971 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:15.415164 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/master-0-root/instance:
uuid: "5aff2c187289436a846acba13255b21f"
format_stamp: "Formatted at 2026-07-09 13:17:15 on dist-test-slave-7f95"
I20260709 13:17:15.419755 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:17:15.423296 19393 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:15.424209 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:17:15.424465 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/master-0-root
uuid: "5aff2c187289436a846acba13255b21f"
format_stamp: "Formatted at 2026-07-09 13:17:15 on dist-test-slave-7f95"
I20260709 13:17:15.424738 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:15.454285 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:15.455564 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:15.496345 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.190:33289
I20260709 13:17:15.496441 19444 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.190:33289 every 8 connection(s)
I20260709 13:17:15.500824 19445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:15.511503 19445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Bootstrap starting.
I20260709 13:17:15.516276 19445 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.520848 19445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: No bootstrap required, opened a new log
I20260709 13:17:15.523151 19445 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5aff2c187289436a846acba13255b21f" member_type: VOTER }
I20260709 13:17:15.523531 19445 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.523705 19445 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5aff2c187289436a846acba13255b21f, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.524295 19445 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5aff2c187289436a846acba13255b21f" member_type: VOTER }
I20260709 13:17:15.524708 19445 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:15.524889 19445 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:15.525106 19445 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.529592 19445 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5aff2c187289436a846acba13255b21f" member_type: VOTER }
I20260709 13:17:15.530356 19445 leader_election.cc:304] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5aff2c187289436a846acba13255b21f; no voters: 
I20260709 13:17:15.531512 19445 leader_election.cc:290] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:15.531905 19448 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:15.533434 19448 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [term 1 LEADER]: Becoming Leader. State: Replica: 5aff2c187289436a846acba13255b21f, State: Running, Role: LEADER
I20260709 13:17:15.534291 19448 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5aff2c187289436a846acba13255b21f" member_type: VOTER }
I20260709 13:17:15.534621 19445 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:15.540169 19450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5aff2c187289436a846acba13255b21f. Latest consensus state: current_term: 1 leader_uuid: "5aff2c187289436a846acba13255b21f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5aff2c187289436a846acba13255b21f" member_type: VOTER } }
I20260709 13:17:15.540387 19449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5aff2c187289436a846acba13255b21f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5aff2c187289436a846acba13255b21f" member_type: VOTER } }
I20260709 13:17:15.541198 19450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:15.541275 19449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:15.544967 19456 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:15.550300 19456 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:15.553087 18414 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:15.559140 19456 catalog_manager.cc:1383] Generated new cluster ID: c95fcff974e74759b8f6bc7a4d0e998b
I20260709 13:17:15.559432 19456 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:15.579175 19456 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:15.580426 19456 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:15.593501 19456 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Generated new TSK 0
I20260709 13:17:15.594154 19456 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:15.620229 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:15.626240 19466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:15.627437 19467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:15.628720 19469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:15.629408 18414 server_base.cc:1061] running on GCE node
I20260709 13:17:15.630268 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:15.630481 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:15.630621 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603035630608 us; error 0 us; skew 500 ppm
I20260709 13:17:15.631135 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:15.633589 18414 webserver.cc:533] Webserver started at http://127.17.251.129:43345/ using document root <none> and password file <none>
I20260709 13:17:15.634158 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:15.634377 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:15.634630 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:15.635756 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-0-root/instance:
uuid: "d56df3728fc04e37b2d29a3bcd91d167"
format_stamp: "Formatted at 2026-07-09 13:17:15 on dist-test-slave-7f95"
I20260709 13:17:15.640642 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:17:15.644129 19474 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:15.644876 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:15.645190 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-0-root
uuid: "d56df3728fc04e37b2d29a3bcd91d167"
format_stamp: "Formatted at 2026-07-09 13:17:15 on dist-test-slave-7f95"
I20260709 13:17:15.645489 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:15.663045 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:15.664292 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:15.665807 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:15.668072 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:15.668290 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:15.668545 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:15.668735 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:15.709452 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.129:38645
I20260709 13:17:15.709560 19536 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.129:38645 every 8 connection(s)
I20260709 13:17:15.714617 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:15.721698 19541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:15.722067 19542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:15.725934 18414 server_base.cc:1061] running on GCE node
W20260709 13:17:15.725960 19544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:15.727298 19537 heartbeater.cc:344] Connected to a master server at 127.17.251.190:33289
I20260709 13:17:15.727734 19537 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:15.727875 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:15.728137 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:15.728335 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603035728316 us; error 0 us; skew 500 ppm
I20260709 13:17:15.728626 19537 heartbeater.cc:507] Master 127.17.251.190:33289 requested a full tablet report, sending...
I20260709 13:17:15.729092 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:15.731060 19410 ts_manager.cc:194] Registered new tserver with Master: d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645)
I20260709 13:17:15.731809 18414 webserver.cc:533] Webserver started at http://127.17.251.130:40193/ using document root <none> and password file <none>
I20260709 13:17:15.732312 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:15.732532 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:15.732800 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:15.733098 19410 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48826
I20260709 13:17:15.734127 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-1-root/instance:
uuid: "2cfd02601ea44976833027665abc93bf"
format_stamp: "Formatted at 2026-07-09 13:17:15 on dist-test-slave-7f95"
I20260709 13:17:15.739218 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:17:15.742554 19549 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:15.743335 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:15.743659 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-1-root
uuid: "2cfd02601ea44976833027665abc93bf"
format_stamp: "Formatted at 2026-07-09 13:17:15 on dist-test-slave-7f95"
I20260709 13:17:15.743937 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:15.778139 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:15.779371 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:15.780925 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:15.783200 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:15.783439 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:15.783689 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:15.783865 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:15.823673 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.130:36471
I20260709 13:17:15.823792 19611 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.130:36471 every 8 connection(s)
I20260709 13:17:15.828833 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:15.836582 19615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:15.838081 19616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:15.840109 19618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:15.840574 18414 server_base.cc:1061] running on GCE node
I20260709 13:17:15.841060 19612 heartbeater.cc:344] Connected to a master server at 127.17.251.190:33289
I20260709 13:17:15.841459 19612 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:15.841704 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:15.841933 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:15.842109 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603035842073 us; error 0 us; skew 500 ppm
I20260709 13:17:15.842305 19612 heartbeater.cc:507] Master 127.17.251.190:33289 requested a full tablet report, sending...
I20260709 13:17:15.842753 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:15.844591 19410 ts_manager.cc:194] Registered new tserver with Master: 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:15.845461 18414 webserver.cc:533] Webserver started at http://127.17.251.131:44449/ using document root <none> and password file <none>
I20260709 13:17:15.846040 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:15.846232 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:15.846252 19410 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48840
I20260709 13:17:15.846609 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:15.848019 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-2-root/instance:
uuid: "e19c80e9149b4b8d88ae13bde8e43864"
format_stamp: "Formatted at 2026-07-09 13:17:15 on dist-test-slave-7f95"
I20260709 13:17:15.852448 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:15.855716 19623 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:15.856482 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:15.856802 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-2-root
uuid: "e19c80e9149b4b8d88ae13bde8e43864"
format_stamp: "Formatted at 2026-07-09 13:17:15 on dist-test-slave-7f95"
I20260709 13:17:15.857178 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:15.889886 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:15.891185 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:15.892894 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:15.895702 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:15.895972 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:15.896265 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:15.896481 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:15.939267 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.131:33295
I20260709 13:17:15.939353 19685 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.131:33295 every 8 connection(s)
I20260709 13:17:15.953696 19686 heartbeater.cc:344] Connected to a master server at 127.17.251.190:33289
I20260709 13:17:15.954080 19686 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:15.955005 19686 heartbeater.cc:507] Master 127.17.251.190:33289 requested a full tablet report, sending...
I20260709 13:17:15.957893 19410 ts_manager.cc:194] Registered new tserver with Master: e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:15.958561 18414 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016040136s
I20260709 13:17:15.960299 19410 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48852
I20260709 13:17:15.994285 19410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48858:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:16.001026 19410 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:16.211220 19502 tablet_service.cc:1511] Processing CreateTablet for tablet e40c25a076fd424281aab1a64f5a1498 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:16.212729 19502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e40c25a076fd424281aab1a64f5a1498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.219697 19501 tablet_service.cc:1511] Processing CreateTablet for tablet db4589d6497c49308384eacc43241a32 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:16.220162 19577 tablet_service.cc:1511] Processing CreateTablet for tablet e40c25a076fd424281aab1a64f5a1498 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:16.221256 19501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4589d6497c49308384eacc43241a32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.222761 19500 tablet_service.cc:1511] Processing CreateTablet for tablet df137c733a0a470c9e35fa2b09c6c619 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:16.222857 19576 tablet_service.cc:1511] Processing CreateTablet for tablet db4589d6497c49308384eacc43241a32 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:16.224100 19500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df137c733a0a470c9e35fa2b09c6c619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.221517 19577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e40c25a076fd424281aab1a64f5a1498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.225252 19651 tablet_service.cc:1511] Processing CreateTablet for tablet e40c25a076fd424281aab1a64f5a1498 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:16.225252 19575 tablet_service.cc:1511] Processing CreateTablet for tablet df137c733a0a470c9e35fa2b09c6c619 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:16.229146 19569 tablet_service.cc:1511] Processing CreateTablet for tablet 9116dce1321e475194eeaa1705fd6ac0 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:16.229218 19496 tablet_service.cc:1511] Processing CreateTablet for tablet d9242425d3a744c3b8742c30995129f4 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:16.230132 19572 tablet_service.cc:1511] Processing CreateTablet for tablet 03f9956d44294112accb74ea1a18065b (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:16.230610 19569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9116dce1321e475194eeaa1705fd6ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.231491 19572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f9956d44294112accb74ea1a18065b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.229146 19494 tablet_service.cc:1511] Processing CreateTablet for tablet 9116dce1321e475194eeaa1705fd6ac0 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:16.231953 19570 tablet_service.cc:1511] Processing CreateTablet for tablet ed30843c798c4e38898b991bd1ecf1f6 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:16.232656 19575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df137c733a0a470c9e35fa2b09c6c619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.230696 19496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9242425d3a744c3b8742c30995129f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.233312 19570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed30843c798c4e38898b991bd1ecf1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.233394 19499 tablet_service.cc:1511] Processing CreateTablet for tablet d073a31754234c93b24b8ffbc9f8fb3b (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:16.234488 19494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9116dce1321e475194eeaa1705fd6ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.234650 19571 tablet_service.cc:1511] Processing CreateTablet for tablet d9242425d3a744c3b8742c30995129f4 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:16.235512 19497 tablet_service.cc:1511] Processing CreateTablet for tablet 03f9956d44294112accb74ea1a18065b (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:16.236827 19497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f9956d44294112accb74ea1a18065b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.238370 19498 tablet_service.cc:1511] Processing CreateTablet for tablet c62f6690c8e840638906e0b59d2ae71d (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:16.238627 19573 tablet_service.cc:1511] Processing CreateTablet for tablet c62f6690c8e840638906e0b59d2ae71d (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:16.239701 19498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c62f6690c8e840638906e0b59d2ae71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.239878 19573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c62f6690c8e840638906e0b59d2ae71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.240795 19499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d073a31754234c93b24b8ffbc9f8fb3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.243408 19574 tablet_service.cc:1511] Processing CreateTablet for tablet d073a31754234c93b24b8ffbc9f8fb3b (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:16.243466 19650 tablet_service.cc:1511] Processing CreateTablet for tablet db4589d6497c49308384eacc43241a32 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:16.241672 19495 tablet_service.cc:1511] Processing CreateTablet for tablet ed30843c798c4e38898b991bd1ecf1f6 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:16.246766 19568 tablet_service.cc:1511] Processing CreateTablet for tablet d05498e224814b9b8f31e3f965ab2583 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:16.248260 19495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed30843c798c4e38898b991bd1ecf1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.229254 19651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e40c25a076fd424281aab1a64f5a1498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.254037 19650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4589d6497c49308384eacc43241a32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.258229 19576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4589d6497c49308384eacc43241a32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.259441 19649 tablet_service.cc:1511] Processing CreateTablet for tablet df137c733a0a470c9e35fa2b09c6c619 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:16.260489 19646 tablet_service.cc:1511] Processing CreateTablet for tablet 03f9956d44294112accb74ea1a18065b (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:16.261025 19649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df137c733a0a470c9e35fa2b09c6c619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.261508 19493 tablet_service.cc:1511] Processing CreateTablet for tablet d05498e224814b9b8f31e3f965ab2583 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:16.263062 19493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05498e224814b9b8f31e3f965ab2583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.262959 19648 tablet_service.cc:1511] Processing CreateTablet for tablet d073a31754234c93b24b8ffbc9f8fb3b (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:16.264326 19646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f9956d44294112accb74ea1a18065b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.265416 19647 tablet_service.cc:1511] Processing CreateTablet for tablet c62f6690c8e840638906e0b59d2ae71d (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:16.266006 19568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05498e224814b9b8f31e3f965ab2583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.267388 19648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d073a31754234c93b24b8ffbc9f8fb3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.267669 19571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9242425d3a744c3b8742c30995129f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.274051 19574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d073a31754234c93b24b8ffbc9f8fb3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.274042 19647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c62f6690c8e840638906e0b59d2ae71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.315665 19645 tablet_service.cc:1511] Processing CreateTablet for tablet d9242425d3a744c3b8742c30995129f4 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:16.326920 19701 tablet_bootstrap.cc:492] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:16.328158 19502 tablet_service.cc:1511] Processing CreateTablet for tablet 56b49831037b480f8eda4069cf653878 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:16.329583 19502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b49831037b480f8eda4069cf653878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.332862 19642 tablet_service.cc:1511] Processing CreateTablet for tablet d05498e224814b9b8f31e3f965ab2583 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:16.320706 19643 tablet_service.cc:1511] Processing CreateTablet for tablet 9116dce1321e475194eeaa1705fd6ac0 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:16.319140 19644 tablet_service.cc:1511] Processing CreateTablet for tablet ed30843c798c4e38898b991bd1ecf1f6 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:16.317566 19645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9242425d3a744c3b8742c30995129f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.346323 19643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9116dce1321e475194eeaa1705fd6ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.358690 19644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed30843c798c4e38898b991bd1ecf1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.362135 19642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05498e224814b9b8f31e3f965ab2583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.367038 19649 tablet_service.cc:1511] Processing CreateTablet for tablet 56b49831037b480f8eda4069cf653878 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:16.368487 19649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b49831037b480f8eda4069cf653878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.378907 19499 tablet_service.cc:1511] Processing CreateTablet for tablet 556595dcbb8644d2a073cbc04a679832 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:16.380312 19499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556595dcbb8644d2a073cbc04a679832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.381351 19702 tablet_bootstrap.cc:492] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:16.380419 19493 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd800f2a6b149a5b3ab177899d5f6bf (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:16.382452 19493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd800f2a6b149a5b3ab177899d5f6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.388289 19577 tablet_service.cc:1511] Processing CreateTablet for tablet 56b49831037b480f8eda4069cf653878 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:16.392508 19572 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd800f2a6b149a5b3ab177899d5f6bf (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:16.399165 19648 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd800f2a6b149a5b3ab177899d5f6bf (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:16.388942 19651 tablet_service.cc:1511] Processing CreateTablet for tablet 556595dcbb8644d2a073cbc04a679832 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:16.414790 19500 tablet_service.cc:1511] Processing CreateTablet for tablet 61d4aaf446674d6ab6bbc9a3aae5af92 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:16.418335 19495 tablet_service.cc:1511] Processing CreateTablet for tablet 80abeb366b70484a8b8df5a0575643e7 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:16.419658 19577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b49831037b480f8eda4069cf653878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.419322 19571 tablet_service.cc:1511] Processing CreateTablet for tablet 61d4aaf446674d6ab6bbc9a3aae5af92 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:16.425997 19494 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9a4266bc2b4d15ac7862c48149bb66 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:16.432050 19574 tablet_service.cc:1511] Processing CreateTablet for tablet 556595dcbb8644d2a073cbc04a679832 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:16.475703 19575 tablet_service.cc:1511] Processing CreateTablet for tablet 904d960364024273a420111ec6233e84 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:16.521380 19703 tablet_bootstrap.cc:492] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:16.495502 19570 tablet_service.cc:1511] Processing CreateTablet for tablet 80abeb366b70484a8b8df5a0575643e7 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:16.539621 19502 tablet_service.cc:1511] Processing CreateTablet for tablet 904d960364024273a420111ec6233e84 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
W20260709 13:17:16.548100 19458 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:16.607347 19495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80abeb366b70484a8b8df5a0575643e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.713496 19494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9a4266bc2b4d15ac7862c48149bb66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.609936 19572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd800f2a6b149a5b3ab177899d5f6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.714776 19500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d4aaf446674d6ab6bbc9a3aae5af92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.715468 19649 tablet_service.cc:1511] Processing CreateTablet for tablet 0e5f26f686634d4ab47c02b7a00ba584 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:16.615433 19569 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9a4266bc2b4d15ac7862c48149bb66 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:16.628381 19501 tablet_service.cc:1511] Processing CreateTablet for tablet 911988cab3914bb19f77d4d3e24a31f4 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:16.491559 19643 tablet_service.cc:1511] Processing CreateTablet for tablet 904d960364024273a420111ec6233e84 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:16.430328 19650 tablet_service.cc:1511] Processing CreateTablet for tablet 61d4aaf446674d6ab6bbc9a3aae5af92 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:16.636106 19499 tablet_service.cc:1511] Processing CreateTablet for tablet 2c1d08b75392466298c02ea9d4d765dd (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:16.482923 19651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556595dcbb8644d2a073cbc04a679832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.746506 19643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904d960364024273a420111ec6233e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.430974 19647 tablet_service.cc:1511] Processing CreateTablet for tablet 80abeb366b70484a8b8df5a0575643e7 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:16.489506 19646 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9a4266bc2b4d15ac7862c48149bb66 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:16.748375 19647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80abeb366b70484a8b8df5a0575643e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.630950 19645 tablet_service.cc:1511] Processing CreateTablet for tablet 911988cab3914bb19f77d4d3e24a31f4 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:16.507016 19702 tablet_bootstrap.cc:654] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.494424 19701 tablet_bootstrap.cc:700] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Time spent opening tablet: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:17:16.755654 19701 tablet_bootstrap.cc:654] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.643426 19493 tablet_service.cc:1511] Processing CreateTablet for tablet 0e5f26f686634d4ab47c02b7a00ba584 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:16.654539 19497 tablet_service.cc:1511] Processing CreateTablet for tablet 9807bdebbbd742009e4a329706a92790 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:16.659242 19498 tablet_service.cc:1511] Processing CreateTablet for tablet 3bb3362944f5459e982bd278a6a4c561 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:16.674677 19496 tablet_service.cc:1511] Processing CreateTablet for tablet b28ba556d85a4d61bf15492b88b280d9 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:16.688460 19568 tablet_service.cc:1511] Processing CreateTablet for tablet 911988cab3914bb19f77d4d3e24a31f4 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:16.691859 19573 tablet_service.cc:1511] Processing CreateTablet for tablet 2c1d08b75392466298c02ea9d4d765dd (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:16.692414 19576 tablet_service.cc:1511] Processing CreateTablet for tablet 0e5f26f686634d4ab47c02b7a00ba584 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:16.696224 19577 tablet_service.cc:1511] Processing CreateTablet for tablet 9807bdebbbd742009e4a329706a92790 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:16.636096 19644 tablet_service.cc:1511] Processing CreateTablet for tablet 2c1d08b75392466298c02ea9d4d765dd (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:16.724114 19642 tablet_service.cc:1511] Processing CreateTablet for tablet 9807bdebbbd742009e4a329706a92790 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:16.722317 19502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904d960364024273a420111ec6233e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.722987 19571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d4aaf446674d6ab6bbc9a3aae5af92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.736230 19537 heartbeater.cc:499] Master 127.17.251.190:33289 was elected leader, sending a full tablet report...
I20260709 13:17:16.762373 19570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80abeb366b70484a8b8df5a0575643e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.749045 19648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd800f2a6b149a5b3ab177899d5f6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.764549 19646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9a4266bc2b4d15ac7862c48149bb66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.774106 19642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9807bdebbbd742009e4a329706a92790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.776669 19644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c1d08b75392466298c02ea9d4d765dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.778120 19645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911988cab3914bb19f77d4d3e24a31f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.788301 19703 tablet_bootstrap.cc:654] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.789583 19650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d4aaf446674d6ab6bbc9a3aae5af92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.793661 19644 tablet_service.cc:1511] Processing CreateTablet for tablet 3bb3362944f5459e982bd278a6a4c561 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:16.794262 19569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9a4266bc2b4d15ac7862c48149bb66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.794899 19574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556595dcbb8644d2a073cbc04a679832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.795039 19644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bb3362944f5459e982bd278a6a4c561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.796227 19493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e5f26f686634d4ab47c02b7a00ba584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.801936 19575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904d960364024273a420111ec6233e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.801393 19500 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4c20e4aab6496cb949c1fad0dbcc66 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:16.805435 19494 tablet_service.cc:1511] Processing CreateTablet for tablet deb2be7d455242c08b014289ea6b1347 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:16.810444 19568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911988cab3914bb19f77d4d3e24a31f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.814052 19577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9807bdebbbd742009e4a329706a92790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.817988 19573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c1d08b75392466298c02ea9d4d765dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.820410 19576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e5f26f686634d4ab47c02b7a00ba584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.809947 19649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e5f26f686634d4ab47c02b7a00ba584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.802048 19499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c1d08b75392466298c02ea9d4d765dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.845531 19498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bb3362944f5459e982bd278a6a4c561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.846356 19494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb2be7d455242c08b014289ea6b1347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.846980 19497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9807bdebbbd742009e4a329706a92790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.848781 19496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b28ba556d85a4d61bf15492b88b280d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.849005 19612 heartbeater.cc:499] Master 127.17.251.190:33289 was elected leader, sending a full tablet report...
I20260709 13:17:16.851389 19500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4c20e4aab6496cb949c1fad0dbcc66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.854513 19501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911988cab3914bb19f77d4d3e24a31f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.866958 19702 tablet_bootstrap.cc:492] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:16.867547 19702 ts_tablet_manager.cc:1403] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.487s	user 0.009s	sys 0.010s
I20260709 13:17:16.899327 19702 raft_consensus.cc:359] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:16.900068 19702 raft_consensus.cc:385] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.900398 19702 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.907760 19701 tablet_bootstrap.cc:492] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:16.908322 19701 ts_tablet_manager.cc:1403] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.582s	user 0.013s	sys 0.007s
I20260709 13:17:16.927075 19572 tablet_service.cc:1511] Processing CreateTablet for tablet 3bb3362944f5459e982bd278a6a4c561 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:16.929461 19572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bb3362944f5459e982bd278a6a4c561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.930380 19645 tablet_service.cc:1511] Processing CreateTablet for tablet b28ba556d85a4d61bf15492b88b280d9 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:16.932705 19648 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4c20e4aab6496cb949c1fad0dbcc66 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:16.934006 19648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4c20e4aab6496cb949c1fad0dbcc66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.945748 19703 tablet_bootstrap.cc:492] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:16.946417 19703 ts_tablet_manager.cc:1403] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.425s	user 0.013s	sys 0.009s
I20260709 13:17:16.946894 19702 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:16.948920 19577 tablet_service.cc:1511] Processing CreateTablet for tablet b28ba556d85a4d61bf15492b88b280d9 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:16.950244 19577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b28ba556d85a4d61bf15492b88b280d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.950136 19703 raft_consensus.cc:359] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:16.950892 19703 raft_consensus.cc:385] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.951195 19703 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.953722 19701 raft_consensus.cc:359] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:16.954463 19701 raft_consensus.cc:385] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.955295 19495 tablet_service.cc:1511] Processing CreateTablet for tablet 1a54cd81e4a54059a10f1f9e291c49d0 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:16.956600 19495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a54cd81e4a54059a10f1f9e291c49d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.954756 19701 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.958683 19701 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:16.962219 19645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b28ba556d85a4d61bf15492b88b280d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.962093 19499 tablet_service.cc:1511] Processing CreateTablet for tablet c47cfd5bbfb1407c879f892f35cc1502 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:16.963356 19499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47cfd5bbfb1407c879f892f35cc1502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.965672 19686 heartbeater.cc:499] Master 127.17.251.190:33289 was elected leader, sending a full tablet report...
I20260709 13:17:16.966207 19703 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:16.937170 19642 tablet_service.cc:1511] Processing CreateTablet for tablet deb2be7d455242c08b014289ea6b1347 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:16.978014 19702 ts_tablet_manager.cc:1434] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.110s	user 0.013s	sys 0.005s
I20260709 13:17:16.977788 19502 tablet_service.cc:1511] Processing CreateTablet for tablet dff318d429f74439a25e68f54950fb36 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:16.978905 19502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff318d429f74439a25e68f54950fb36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.990813 19572 tablet_service.cc:1511] Processing CreateTablet for tablet c47cfd5bbfb1407c879f892f35cc1502 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:16.992286 19572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47cfd5bbfb1407c879f892f35cc1502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.965728 19571 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4c20e4aab6496cb949c1fad0dbcc66 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:16.995042 19571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4c20e4aab6496cb949c1fad0dbcc66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.015628 19577 tablet_service.cc:1511] Processing CreateTablet for tablet deb2be7d455242c08b014289ea6b1347 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:17.023852 19497 tablet_service.cc:1511] Processing CreateTablet for tablet e6c8f93967114cebaf0e506a31814929 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:17.026621 19497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c8f93967114cebaf0e506a31814929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.030054 19702 tablet_bootstrap.cc:492] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:17.032873 19650 tablet_service.cc:1511] Processing CreateTablet for tablet c47cfd5bbfb1407c879f892f35cc1502 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:17.035187 19646 tablet_service.cc:1511] Processing CreateTablet for tablet 1a54cd81e4a54059a10f1f9e291c49d0 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:17.036577 19646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a54cd81e4a54059a10f1f9e291c49d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.037889 19574 tablet_service.cc:1511] Processing CreateTablet for tablet dff318d429f74439a25e68f54950fb36 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:17.039944 19651 tablet_service.cc:1511] Processing CreateTablet for tablet dff318d429f74439a25e68f54950fb36 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:17.041267 19651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff318d429f74439a25e68f54950fb36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.043327 19643 tablet_service.cc:1511] Processing CreateTablet for tablet e6c8f93967114cebaf0e506a31814929 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:17.046144 19642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb2be7d455242c08b014289ea6b1347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.049434 19568 tablet_service.cc:1511] Processing CreateTablet for tablet e6c8f93967114cebaf0e506a31814929 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:17.054301 19643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c8f93967114cebaf0e506a31814929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.017552 19577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb2be7d455242c08b014289ea6b1347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.029264 19573 tablet_service.cc:1511] Processing CreateTablet for tablet 1a54cd81e4a54059a10f1f9e291c49d0 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:17.063908 19573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a54cd81e4a54059a10f1f9e291c49d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.064013 19650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47cfd5bbfb1407c879f892f35cc1502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.066170 19574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff318d429f74439a25e68f54950fb36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.045337 19493 tablet_service.cc:1511] Processing CreateTablet for tablet daee81c3dc8c4dc4b735d1643829fe76 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:17.080183 19575 tablet_service.cc:1511] Processing CreateTablet for tablet daee81c3dc8c4dc4b735d1643829fe76 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260709 13:17:17.095535 19395 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 76999.1us
W20260709 13:17:17.095742 19397 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 67157.6us
I20260709 13:17:17.100503 19570 tablet_service.cc:1511] Processing CreateTablet for tablet 386001789c264ef8b0ac13cf938a8390 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:17.060906 19647 tablet_service.cc:1511] Processing CreateTablet for tablet daee81c3dc8c4dc4b735d1643829fe76 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:17.104142 19647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daee81c3dc8c4dc4b735d1643829fe76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.084178 19648 tablet_service.cc:1511] Processing CreateTablet for tablet 6b53fc6e49df441b959a20ab5dd387dd (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:17.105024 19495 tablet_service.cc:1511] Processing CreateTablet for tablet c656f1e9148d4056945c02ce537d8b12 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:17.088265 19498 tablet_service.cc:1511] Processing CreateTablet for tablet 6b53fc6e49df441b959a20ab5dd387dd (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:17.088742 19649 tablet_service.cc:1511] Processing CreateTablet for tablet 313f9daf7de442378ef2abf1f4a4e665 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:17.108256 19649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 313f9daf7de442378ef2abf1f4a4e665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.109728 19501 tablet_service.cc:1511] Processing CreateTablet for tablet 52f31f753f7c4508a56dd7bb7648615b (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:17.091275 19572 tablet_service.cc:1511] Processing CreateTablet for tablet 6b53fc6e49df441b959a20ab5dd387dd (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:17.089846 19703 ts_tablet_manager.cc:1434] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.143s	user 0.008s	sys 0.007s
I20260709 13:17:17.111735 19703 tablet_bootstrap.cc:492] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:17.073568 19493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daee81c3dc8c4dc4b735d1643829fe76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.114949 19495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c656f1e9148d4056945c02ce537d8b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.093246 19497 tablet_service.cc:1511] Processing CreateTablet for tablet 386001789c264ef8b0ac13cf938a8390 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:17.075109 19568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c8f93967114cebaf0e506a31814929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.100677 19496 tablet_service.cc:1511] Processing CreateTablet for tablet 313f9daf7de442378ef2abf1f4a4e665 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:17.122045 19572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b53fc6e49df441b959a20ab5dd387dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.121985 19494 tablet_service.cc:1511] Processing CreateTablet for tablet 2c83387a56274f46bd5795b3376741c9 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:17.125983 19575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daee81c3dc8c4dc4b735d1643829fe76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.127305 19570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386001789c264ef8b0ac13cf938a8390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.091444 19644 tablet_service.cc:1511] Processing CreateTablet for tablet 386001789c264ef8b0ac13cf938a8390 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:17.131333 19644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386001789c264ef8b0ac13cf938a8390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.133476 19648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b53fc6e49df441b959a20ab5dd387dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.137144 19701 ts_tablet_manager.cc:1434] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.229s	user 0.012s	sys 0.005s
I20260709 13:17:17.144860 19701 tablet_bootstrap.cc:492] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:17.150820 19500 tablet_service.cc:1511] Processing CreateTablet for tablet a944fb0aa87a4a33a0dc2975f4a306dd (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:17.152217 19703 tablet_bootstrap.cc:654] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.117322 19501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52f31f753f7c4508a56dd7bb7648615b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.152791 19499 tablet_service.cc:1511] Processing CreateTablet for tablet 7bbfe9942c714d1295ec8011ab27a574 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:17.160401 19576 tablet_service.cc:1511] Processing CreateTablet for tablet c656f1e9148d4056945c02ce537d8b12 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:17.117409 19702 tablet_bootstrap.cc:654] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.160405 19569 tablet_service.cc:1511] Processing CreateTablet for tablet 313f9daf7de442378ef2abf1f4a4e665 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:17.176153 19502 tablet_service.cc:1511] Processing CreateTablet for tablet 8c3672e496ae4c7ab924bee7e50ecf70 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:17.181949 19569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 313f9daf7de442378ef2abf1f4a4e665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.196295 19571 tablet_service.cc:1511] Processing CreateTablet for tablet 52f31f753f7c4508a56dd7bb7648615b (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:17.200326 19642 tablet_service.cc:1511] Processing CreateTablet for tablet c656f1e9148d4056945c02ce537d8b12 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:17.200929 19707 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.201435 19707 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:17.211321 19576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c656f1e9148d4056945c02ce537d8b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.214629 19571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52f31f753f7c4508a56dd7bb7648615b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.230333 19645 tablet_service.cc:1511] Processing CreateTablet for tablet 52f31f753f7c4508a56dd7bb7648615b (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:17.233479 19649 tablet_service.cc:1511] Processing CreateTablet for tablet 2c83387a56274f46bd5795b3376741c9 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:17.237768 19496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 313f9daf7de442378ef2abf1f4a4e665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.238631 19500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a944fb0aa87a4a33a0dc2975f4a306dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.238574 19577 tablet_service.cc:1511] Processing CreateTablet for tablet a944fb0aa87a4a33a0dc2975f4a306dd (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:17.239996 19577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a944fb0aa87a4a33a0dc2975f4a306dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.240381 19499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bbfe9942c714d1295ec8011ab27a574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.226094 19642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c656f1e9148d4056945c02ce537d8b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.207473 19707 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:17.252713 19708 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.253270 19708 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:17.260743 19498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b53fc6e49df441b959a20ab5dd387dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.212494 19575 tablet_service.cc:1511] Processing CreateTablet for tablet 2c83387a56274f46bd5795b3376741c9 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:17.272567 19647 tablet_service.cc:1511] Processing CreateTablet for tablet a944fb0aa87a4a33a0dc2975f4a306dd (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:17.259016 19708 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:17.294901 19701 tablet_bootstrap.cc:654] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.276407 19649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c83387a56274f46bd5795b3376741c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.302840 19702 tablet_bootstrap.cc:492] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:17.279139 19648 tablet_service.cc:1511] Processing CreateTablet for tablet 8c3672e496ae4c7ab924bee7e50ecf70 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:17.305791 19702 ts_tablet_manager.cc:1403] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.276s	user 0.013s	sys 0.020s
I20260709 13:17:17.305907 19650 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd2e208ec7f47bb80deb85a455f2b16 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:17.311647 19648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3672e496ae4c7ab924bee7e50ecf70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.315562 19575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c83387a56274f46bd5795b3376741c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.319028 19651 tablet_service.cc:1511] Processing CreateTablet for tablet 88c0e3535ed14c77bc069b999fbb18bc (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:17.320232 19702 raft_consensus.cc:359] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:17.321175 19645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52f31f753f7c4508a56dd7bb7648615b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.308140 19703 tablet_bootstrap.cc:492] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:17.307651 19502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3672e496ae4c7ab924bee7e50ecf70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.321355 19702 raft_consensus.cc:385] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.338284 19573 tablet_service.cc:1511] Processing CreateTablet for tablet 7bbfe9942c714d1295ec8011ab27a574 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:17.342345 19573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bbfe9942c714d1295ec8011ab27a574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.344056 19647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a944fb0aa87a4a33a0dc2975f4a306dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.338223 19574 tablet_service.cc:1511] Processing CreateTablet for tablet 8c3672e496ae4c7ab924bee7e50ecf70 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:17.352116 19574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3672e496ae4c7ab924bee7e50ecf70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.354249 19703 ts_tablet_manager.cc:1403] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.243s	user 0.028s	sys 0.010s
I20260709 13:17:17.359193 19572 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd2e208ec7f47bb80deb85a455f2b16 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:17.361145 19572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd2e208ec7f47bb80deb85a455f2b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.352555 19494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c83387a56274f46bd5795b3376741c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.329936 19702 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.368700 19702 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:17.375847 19707 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.376058 19649 tablet_service.cc:1511] Processing CreateTablet for tablet d5f9fbdbd620463b9c81f3c5c92b40f4 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:17.376384 19707 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:17.366068 19568 tablet_service.cc:1511] Processing CreateTablet for tablet f516f797b78848a5825878b37c422f07 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:17.382527 19707 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:17.311020 19646 tablet_service.cc:1511] Processing CreateTablet for tablet 7bbfe9942c714d1295ec8011ab27a574 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:17.384182 19568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f516f797b78848a5825878b37c422f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.387017 19576 tablet_service.cc:1511] Processing CreateTablet for tablet d5f9fbdbd620463b9c81f3c5c92b40f4 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:17.389416 19650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd2e208ec7f47bb80deb85a455f2b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.390209 19644 tablet_service.cc:1511] Processing CreateTablet for tablet f516f797b78848a5825878b37c422f07 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:17.390780 19646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bbfe9942c714d1295ec8011ab27a574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.391554 19649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f9fbdbd620463b9c81f3c5c92b40f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.392160 19644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f516f797b78848a5825878b37c422f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.400729 19643 tablet_service.cc:1511] Processing CreateTablet for tablet b91cdbdc59c54db98e6692ac65df1b3b (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:17.402799 19576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f9fbdbd620463b9c81f3c5c92b40f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.420078 19709 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.420935 19709 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:17.422209 19703 raft_consensus.cc:359] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:17.423112 19703 raft_consensus.cc:385] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.423502 19703 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.414492 19497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386001789c264ef8b0ac13cf938a8390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.426539 19703 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:17.429659 19570 tablet_service.cc:1511] Processing CreateTablet for tablet 88c0e3535ed14c77bc069b999fbb18bc (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:17.430493 19569 tablet_service.cc:1511] Processing CreateTablet for tablet b0ac31068f224487a102689bcb76cc21 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:17.431097 19570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88c0e3535ed14c77bc069b999fbb18bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.431852 19569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ac31068f224487a102689bcb76cc21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.440145 19649 tablet_service.cc:1511] Processing CreateTablet for tablet b0ac31068f224487a102689bcb76cc21 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:17.427942 19651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88c0e3535ed14c77bc069b999fbb18bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.458595 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:17.458946 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:17.459726 19586 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
W20260709 13:17:17.460531 19627 leader_election.cc:343] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.461333 19709 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:17.461576 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:17.464833 19643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91cdbdc59c54db98e6692ac65df1b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.470366 19707 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:17.470781 19707 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.471138 19707 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.480430 19642 tablet_service.cc:1511] Processing CreateTablet for tablet ea04cb0adf2c4607846aba51fc4960f1 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:17.482860 19702 ts_tablet_manager.cc:1434] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.173s	user 0.004s	sys 0.006s
I20260709 13:17:17.484536 19702 tablet_bootstrap.cc:492] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:17.492242 19707 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:17.519023 19500 tablet_service.cc:1511] Processing CreateTablet for tablet f516f797b78848a5825878b37c422f07 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:17.520414 19500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f516f797b78848a5825878b37c422f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.533938 19707 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:17.534192 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:17.534847 19586 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.535190 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:17:17.536908 19476 leader_election.cc:343] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.539907 19494 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd2e208ec7f47bb80deb85a455f2b16 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:17.545956 19494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd2e208ec7f47bb80deb85a455f2b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.544293 19702 tablet_bootstrap.cc:654] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.543510 19649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ac31068f224487a102689bcb76cc21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.553946 19495 tablet_service.cc:1511] Processing CreateTablet for tablet 88c0e3535ed14c77bc069b999fbb18bc (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:17.555361 19495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88c0e3535ed14c77bc069b999fbb18bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.555514 19647 tablet_service.cc:1511] Processing CreateTablet for tablet 2b601da83bfc46088ab1ec232133b605 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:17.558670 19571 tablet_service.cc:1511] Processing CreateTablet for tablet b91cdbdc59c54db98e6692ac65df1b3b (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:17.559664 19701 tablet_bootstrap.cc:492] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:17.559959 19571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91cdbdc59c54db98e6692ac65df1b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.560176 19701 ts_tablet_manager.cc:1403] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.416s	user 0.035s	sys 0.005s
I20260709 13:17:17.560076 19645 tablet_service.cc:1511] Processing CreateTablet for tablet 6eb38e2ac9064d3286fe2f20aeb2381c (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:17.568832 19573 tablet_service.cc:1511] Processing CreateTablet for tablet ea04cb0adf2c4607846aba51fc4960f1 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:17.570051 19647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b601da83bfc46088ab1ec232133b605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.572132 19573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea04cb0adf2c4607846aba51fc4960f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.563462 19701 raft_consensus.cc:359] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:17.547573 19586 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:17.610169 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:17.610332 19577 tablet_service.cc:1511] Processing CreateTablet for tablet 6eb38e2ac9064d3286fe2f20aeb2381c (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:17.611217 19707 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:17.583607 19499 tablet_service.cc:1511] Processing CreateTablet for tablet d5f9fbdbd620463b9c81f3c5c92b40f4 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:17.607283 19701 raft_consensus.cc:385] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.611790 19577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb38e2ac9064d3286fe2f20aeb2381c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.613466 19701 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.619900 19645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb38e2ac9064d3286fe2f20aeb2381c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.620116 19701 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:17.623087 19701 ts_tablet_manager.cc:1434] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.062s	user 0.003s	sys 0.006s
I20260709 13:17:17.634291 19701 tablet_bootstrap.cc:492] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:17.636209 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:17.637769 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:17.638089 19499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f9fbdbd620463b9c81f3c5c92b40f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.638456 19511 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
W20260709 13:17:17.639736 19608 debug-util.cc:398] Leaking SignalData structure 0x7b08000e2ea0 after lost signal to thread 18417
I20260709 13:17:17.639642 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:17.640332 19510 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:17.640724 19608 debug-util.cc:398] Leaking SignalData structure 0x7b08001cc300 after lost signal to thread 19444
W20260709 13:17:17.644194 19625 leader_election.cc:343] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.644734 19625 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:17.598305 19496 tablet_service.cc:1511] Processing CreateTablet for tablet b91cdbdc59c54db98e6692ac65df1b3b (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:17.650660 19496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91cdbdc59c54db98e6692ac65df1b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.648099 19642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea04cb0adf2c4607846aba51fc4960f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.626088 19568 tablet_service.cc:1511] Processing CreateTablet for tablet 5456af6e274a4116a91b4bc0e326ca5f (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:17.669409 19568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5456af6e274a4116a91b4bc0e326ca5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.671243 19574 tablet_service.cc:1511] Processing CreateTablet for tablet 1a8709264e614e01ad899bfabc6c04f7 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:17.672717 19574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a8709264e614e01ad899bfabc6c04f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.686794 19570 tablet_service.cc:1511] Processing CreateTablet for tablet 38e3a22b2b34405ebc267cd44391da92 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:17.687515 19501 tablet_service.cc:1511] Processing CreateTablet for tablet 6eb38e2ac9064d3286fe2f20aeb2381c (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:17.688213 19570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e3a22b2b34405ebc267cd44391da92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.689301 19501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb38e2ac9064d3286fe2f20aeb2381c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.689199 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:17.690016 19586 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:17.694550 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:17.695772 19708 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:17.696122 19708 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.696439 19708 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.702243 19569 tablet_service.cc:1511] Processing CreateTablet for tablet 2b601da83bfc46088ab1ec232133b605 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:17.703754 19569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b601da83bfc46088ab1ec232133b605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.707473 19644 tablet_service.cc:1511] Processing CreateTablet for tablet 167513761bee46908eb48f5cad0c0a7f (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:17.711491 19701 tablet_bootstrap.cc:654] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:17.715703 19458 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:17.663761 19707 raft_consensus.cc:697] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:17.697165 19648 tablet_service.cc:1511] Processing CreateTablet for tablet 5456af6e274a4116a91b4bc0e326ca5f (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:17.725417 19501 tablet_service.cc:1511] Processing CreateTablet for tablet b0ac31068f224487a102689bcb76cc21 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:17.728036 19575 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60798 (request call id 35) took 1002 ms. Trace:
I20260709 13:17:17.735432 19510 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:17.743396 19725 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:17.744089 19651 tablet_service.cc:1511] Processing CreateTablet for tablet 1a8709264e614e01ad899bfabc6c04f7 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:17.749259 19707 consensus_queue.cc:237] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:17.748063 19575 rpcz_store.cc:276] 0709 13:17:16.725341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.211422 (+486081us) service_pool.cc:224] Handling call
0709 13:17:17.280976 (+ 69554us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.298233 (+ 17257us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.486605 (+188372us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:17.727303 (+240698us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:17.727947 (+   644us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:17.755278 19703 ts_tablet_manager.cc:1434] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.401s	user 0.019s	sys 0.002s
I20260709 13:17:17.755877 19572 tablet_service.cc:1511] Processing CreateTablet for tablet 167513761bee46908eb48f5cad0c0a7f (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:17.770854 19572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 167513761bee46908eb48f5cad0c0a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.770478 19502 tablet_service.cc:1511] Processing CreateTablet for tablet ea04cb0adf2c4607846aba51fc4960f1 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:17.771828 19502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea04cb0adf2c4607846aba51fc4960f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.772596 19703 tablet_bootstrap.cc:492] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:17.778318 19648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5456af6e274a4116a91b4bc0e326ca5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.783200 19702 tablet_bootstrap.cc:492] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:17.783774 19702 ts_tablet_manager.cc:1403] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.300s	user 0.008s	sys 0.007s
I20260709 13:17:17.745247 19708 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:17.747550 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 103554us
I20260709 13:17:17.793202 19651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a8709264e614e01ad899bfabc6c04f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.797855 19501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ac31068f224487a102689bcb76cc21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.774849 19493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 29) took 1069 ms. Trace:
I20260709 13:17:17.801537 19493 rpcz_store.cc:276] 0709 13:17:16.699574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.044379 (+344805us) service_pool.cc:224] Handling call
0709 13:17:17.072948 (+ 28569us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.073086 (+   138us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.620453 (+547367us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:17.752465 (+132012us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:17.769096 (+ 16631us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:17.803776 19493 tablet_service.cc:1511] Processing CreateTablet for tablet 2b601da83bfc46088ab1ec232133b605 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:17.805135 19493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b601da83bfc46088ab1ec232133b605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.807646 19498 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 30) took 1107 ms. Trace:
I20260709 13:17:17.808054 19498 rpcz_store.cc:276] 0709 13:17:16.699935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.087169 (+387234us) service_pool.cc:224] Handling call
0709 13:17:17.106579 (+ 19410us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.106674 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.547053 (+440379us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:17.807112 (+260059us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:17.807581 (+   469us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:17.808151 19702 raft_consensus.cc:359] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:17.809356 19702 raft_consensus.cc:385] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.809855 19702 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.811393 19644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 167513761bee46908eb48f5cad0c0a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.820004 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:17.820897 19510 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 1: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:17.827687 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:17.832587 19650 tablet_service.cc:1511] Processing CreateTablet for tablet 38e3a22b2b34405ebc267cd44391da92 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:17.767843 19497 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 31) took 1061 ms. Trace:
I20260709 13:17:17.842428 19410 catalog_manager.cc:5697] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:17.847450 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:17.847741 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:17.848170 19586 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.852634 19649 tablet_service.cc:1511] Processing CreateTablet for tablet ef314c9487594fb2a581796b86eb958e (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:17.761204 19575 tablet_service.cc:1511] Processing CreateTablet for tablet ef314c9487594fb2a581796b86eb958e (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:17.854434 19575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef314c9487594fb2a581796b86eb958e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.855794 19701 tablet_bootstrap.cc:492] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:17.856410 19701 ts_tablet_manager.cc:1403] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.222s	user 0.005s	sys 0.023s
I20260709 13:17:17.856912 19498 tablet_service.cc:1511] Processing CreateTablet for tablet 5456af6e274a4116a91b4bc0e326ca5f (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:17.856422 19703 tablet_bootstrap.cc:654] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.835225 19497 rpcz_store.cc:276] 0709 13:17:16.706134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.092326 (+386192us) service_pool.cc:224] Handling call
0709 13:17:17.118916 (+ 26590us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.119024 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.605205 (+486181us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:17.733528 (+128323us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:17.765259 (+ 31731us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:17.858278 19498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5456af6e274a4116a91b4bc0e326ca5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.847500 19708 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:17.859157 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:17.859740 19497 tablet_service.cc:1511] Processing CreateTablet for tablet 1a8709264e614e01ad899bfabc6c04f7 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:17.861159 19497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a8709264e614e01ad899bfabc6c04f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.863747 19724 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:17.868216 19573 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60798 (request call id 45) took 1074 ms. Trace:
I20260709 13:17:17.855721 19586 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:17.868666 19573 rpcz_store.cc:276] 0709 13:17:16.794083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.567766 (+773683us) service_pool.cc:224] Handling call
0709 13:17:17.570619 (+  2853us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.571718 (+  1099us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.637028 (+ 65310us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:17.867676 (+230648us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:17.868148 (+   472us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:17.870083 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:17.870995 19708 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:17.825299 19576 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60798 (request call id 42) took 1044 ms. Trace:
I20260709 13:17:17.876250 19701 raft_consensus.cc:359] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:17.871929 19576 rpcz_store.cc:276] 0709 13:17:16.780853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.386044 (+605191us) service_pool.cc:224] Handling call
0709 13:17:17.387859 (+  1815us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.387983 (+   124us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.570222 (+182239us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:17.818116 (+247894us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:17.824956 (+  6840us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:17.822881 19702 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:17.882050 19661 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.877125 19701 raft_consensus.cc:385] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.884994 19701 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.890038 19701 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:17.890481 19496 tablet_service.cc:1511] Processing CreateTablet for tablet 167513761bee46908eb48f5cad0c0a7f (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:17.873473 19650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e3a22b2b34405ebc267cd44391da92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.897578 19495 tablet_service.cc:1511] Processing CreateTablet for tablet 38e3a22b2b34405ebc267cd44391da92 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:17.906575 19574 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60798 (request call id 50) took 1028 ms. Trace:
I20260709 13:17:17.908532 19496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 167513761bee46908eb48f5cad0c0a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.908490 19574 rpcz_store.cc:276] 0709 13:17:16.877948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.670295 (+792347us) service_pool.cc:224] Handling call
0709 13:17:17.672128 (+  1833us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.672324 (+   196us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.861916 (+189592us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:17.901178 (+ 39262us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:17.906504 (+  5326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:17.911561 19574 tablet_service.cc:1511] Processing CreateTablet for tablet 46d39387ed0c44978cdb2b736f9c1ccf (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:17.912845 19574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d39387ed0c44978cdb2b736f9c1ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.913956 19646 tablet_service.cc:1511] Processing CreateTablet for tablet 6c89dfa6a61346148bb8520ed4d0ecd9 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:17.919116 19645 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff6b515c02d4d26bc1bc2a7b2a9a794 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:17.920289 19647 tablet_service.cc:1511] Processing CreateTablet for tablet 46d39387ed0c44978cdb2b736f9c1ccf (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:17.922375 19643 tablet_service.cc:1511] Processing CreateTablet for tablet 4a2800ca4ded4227b5bb5e48f0572eaa (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:17.934078 19645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff6b515c02d4d26bc1bc2a7b2a9a794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.938160 19646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c89dfa6a61346148bb8520ed4d0ecd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.938585 19648 tablet_service.cc:1511] Processing CreateTablet for tablet 6f949ff511e844749624dedf436dff50 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:17.939910 19648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f949ff511e844749624dedf436dff50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.913141 19568 tablet_service.cc:1511] Processing CreateTablet for tablet 6c89dfa6a61346148bb8520ed4d0ecd9 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:17.942155 19643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a2800ca4ded4227b5bb5e48f0572eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.889520 19661 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:17.947841 19500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 39) took 1062 ms. Trace:
I20260709 13:17:17.948820 19493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 46) took 1021 ms. Trace:
I20260709 13:17:17.949416 19499 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 42) took 1060 ms. Trace:
I20260709 13:17:17.950129 19649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef314c9487594fb2a581796b86eb958e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.950717 19494 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 40) took 1064 ms. Trace:
I20260709 13:17:17.951577 19495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e3a22b2b34405ebc267cd44391da92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.951992 19501 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 44) took 1033 ms. Trace:
I20260709 13:17:17.953850 19644 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56808 (request call id 49) took 1020 ms. Trace:
I20260709 13:17:17.955057 19568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c89dfa6a61346148bb8520ed4d0ecd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.973950 19494 rpcz_store.cc:276] 0709 13:17:16.886764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.538906 (+652142us) service_pool.cc:224] Handling call
0709 13:17:17.540766 (+  1860us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.540869 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.727643 (+186774us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:17.937190 (+209547us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:17.950658 (+ 13468us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:17.972581 19500 rpcz_store.cc:276] 0709 13:17:16.885857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.518021 (+632164us) service_pool.cc:224] Handling call
0709 13:17:17.519893 (+  1872us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.520012 (+   119us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.738555 (+218543us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:17.908607 (+170052us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:17.947772 (+ 39165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:17.979161 19501 rpcz_store.cc:276] 0709 13:17:16.918534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.724383 (+805849us) service_pool.cc:224] Handling call
0709 13:17:17.763606 (+ 39223us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.769053 (+  5447us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.873915 (+104862us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:17.913378 (+ 39463us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:17.951936 (+ 38558us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4480}
I20260709 13:17:17.982939 19500 tablet_service.cc:1511] Processing CreateTablet for tablet 6c89dfa6a61346148bb8520ed4d0ecd9 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:17.983682 19501 tablet_service.cc:1511] Processing CreateTablet for tablet 6f949ff511e844749624dedf436dff50 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:17.984302 19500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c89dfa6a61346148bb8520ed4d0ecd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.984921 19501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f949ff511e844749624dedf436dff50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.987850 19703 tablet_bootstrap.cc:492] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:17.988349 19703 ts_tablet_manager.cc:1403] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.216s	user 0.024s	sys 0.017s
I20260709 13:17:17.991115 19651 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56808 (request call id 50) took 1056 ms. Trace:
I20260709 13:17:17.991534 19651 rpcz_store.cc:276] 0709 13:17:16.934484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.735032 (+800548us) service_pool.cc:224] Handling call
0709 13:17:17.768938 (+ 33906us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.770080 (+  1142us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.870947 (+100867us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:17.990533 (+119586us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:17.991046 (+   513us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:17.994043 19647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d39387ed0c44978cdb2b736f9c1ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.973712 19499 rpcz_store.cc:276] 0709 13:17:16.888536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.552497 (+663961us) service_pool.cc:224] Handling call
0709 13:17:17.626803 (+ 74306us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.631993 (+  5190us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.847850 (+215857us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:17.910100 (+ 62250us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:17.949357 (+ 39257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:17.995672 19499 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff6b515c02d4d26bc1bc2a7b2a9a794 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:17.995976 19703 raft_consensus.cc:359] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:17.996676 19703 raft_consensus.cc:385] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.972793 19493 rpcz_store.cc:276] 0709 13:17:16.927018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.802731 (+875713us) service_pool.cc:224] Handling call
0709 13:17:17.804644 (+  1913us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.804743 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.887073 (+ 82330us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:17.911737 (+ 24664us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:17.948758 (+ 37021us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:17.998554 19573 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff6b515c02d4d26bc1bc2a7b2a9a794 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:17.999851 19573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff6b515c02d4d26bc1bc2a7b2a9a794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.999900 19493 tablet_service.cc:1511] Processing CreateTablet for tablet 46d39387ed0c44978cdb2b736f9c1ccf (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:17.998274 19703 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.979784 19569 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60798 (request call id 46) took 1181 ms. Trace:
I20260709 13:17:17.903539 19576 tablet_service.cc:1511] Processing CreateTablet for tablet 6f949ff511e844749624dedf436dff50 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:18.008965 19575 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60798 (request call id 52) took 1122 ms. Trace:
I20260709 13:17:18.006160 19708 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:18.017725 19570 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60798 (request call id 51) took 1135 ms. Trace:
I20260709 13:17:17.993471 19651 tablet_service.cc:1511] Processing CreateTablet for tablet e2c677be72b048b0a9bc9b5c175d6738 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:18.019711 19651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2c677be72b048b0a9bc9b5c175d6738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.018929 19570 rpcz_store.cc:276] 0709 13:17:16.882273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.685774 (+803501us) service_pool.cc:224] Handling call
0709 13:17:17.687701 (+  1927us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.687802 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.861364 (+173562us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.015680 (+154316us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.017609 (+  1929us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.011988 19569 rpcz_store.cc:276] 0709 13:17:16.798319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.592492 (+794173us) service_pool.cc:224] Handling call
0709 13:17:17.703241 (+110749us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.703337 (+    96us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.876004 (+172667us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:17.933358 (+ 57354us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:17.978732 (+ 45374us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:17.980381 19572 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60798 (request call id 49) took 1108 ms. Trace:
I20260709 13:17:18.021826 19572 rpcz_store.cc:276] 0709 13:17:16.872160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.625253 (+753093us) service_pool.cc:224] Handling call
0709 13:17:17.770377 (+145124us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.770478 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.814373 (+ 43895us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:17.971505 (+157132us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:17.979522 (+  8017us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1412}
I20260709 13:17:18.023300 19571 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60798 (request call id 43) took 1238 ms. Trace:
I20260709 13:17:18.018021 19708 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.017366 19575 rpcz_store.cc:276] 0709 13:17:16.886398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.760204 (+873806us) service_pool.cc:224] Handling call
0709 13:17:17.853953 (+ 93749us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.854047 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.916603 (+ 62556us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.008415 (+ 91812us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.008875 (+   460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.023713 19571 rpcz_store.cc:276] 0709 13:17:16.785265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.414877 (+629612us) service_pool.cc:224] Handling call
0709 13:17:17.559481 (+144604us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.559587 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.843194 (+283607us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.022785 (+179591us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.023240 (+   455us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:17.982946 19494 tablet_service.cc:1511] Processing CreateTablet for tablet ef314c9487594fb2a581796b86eb958e (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:18.023963 19650 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56808 (request call id 51) took 1082 ms. Trace:
I20260709 13:17:17.979326 19644 rpcz_store.cc:276] 0709 13:17:16.933190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.706484 (+773294us) service_pool.cc:224] Handling call
0709 13:17:17.756916 (+ 50432us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.758626 (+  1710us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.946015 (+187389us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:17.953311 (+  7296us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:17.953789 (+   478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.027150 19499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff6b515c02d4d26bc1bc2a7b2a9a794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.026373 19650 rpcz_store.cc:276] 0709 13:17:16.941500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.831599 (+890099us) service_pool.cc:224] Handling call
0709 13:17:17.833441 (+  1842us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.833538 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.008524 (+174986us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.023237 (+ 14713us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.023877 (+   640us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.010834 19702 ts_tablet_manager.cc:1434] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.227s	user 0.008s	sys 0.004s
I20260709 13:17:18.031530 19493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d39387ed0c44978cdb2b736f9c1ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.032344 19702 tablet_bootstrap.cc:492] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:18.037698 19571 tablet_service.cc:1511] Processing CreateTablet for tablet 4a2800ca4ded4227b5bb5e48f0572eaa (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:18.038471 19494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef314c9487594fb2a581796b86eb958e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.039032 19571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a2800ca4ded4227b5bb5e48f0572eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.044078 19570 tablet_service.cc:1511] Processing CreateTablet for tablet e2c677be72b048b0a9bc9b5c175d6738 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:18.054370 19733 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.054920 19733 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.060990 19645 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56808 (request call id 55) took 1039 ms. Trace:
I20260709 13:17:18.061861 19733 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:18.062196 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:18.063067 19661 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:18.066190 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:18.061421 19645 rpcz_store.cc:276] 0709 13:17:17.021176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.918180 (+897004us) service_pool.cc:224] Handling call
0709 13:17:17.920015 (+  1835us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.920134 (+   119us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.052662 (+132528us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.060489 (+  7827us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.060927 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.075347 19649 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56808 (request call id 52) took 1113 ms. Trace:
I20260709 13:17:18.076848 19649 rpcz_store.cc:276] 0709 13:17:16.962054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.851629 (+889575us) service_pool.cc:224] Handling call
0709 13:17:17.853567 (+  1938us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.873991 (+ 20424us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.016334 (+142343us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.074002 (+ 57668us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.075294 (+  1292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.078444 19576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f949ff511e844749624dedf436dff50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.075796 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:18.088944 19498 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 48) took 1159 ms. Trace:
I20260709 13:17:18.092760 19499 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 55) took 1092 ms. Trace:
I20260709 13:17:18.093483 19570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2c677be72b048b0a9bc9b5c175d6738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.108109 19497 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 50) took 1175 ms. Trace:
I20260709 13:17:18.108661 19497 rpcz_store.cc:276] 0709 13:17:16.932804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.858763 (+925959us) service_pool.cc:224] Handling call
0709 13:17:17.860589 (+  1826us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.860798 (+   209us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.947617 (+ 86819us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.073709 (+126092us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.108017 (+ 34308us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.104084 19568 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60798 (request call id 53) took 1213 ms. Trace:
I20260709 13:17:18.105983 19735 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.135542 19735 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.135999 19735 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.136438 19497 tablet_service.cc:1511] Processing CreateTablet for tablet 4a2800ca4ded4227b5bb5e48f0572eaa (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:18.138230 19497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a2800ca4ded4227b5bb5e48f0572eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.090404 19500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 53) took 1130 ms. Trace:
I20260709 13:17:18.107430 19574 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60798 (request call id 56) took 1203 ms. Trace:
I20260709 13:17:18.140657 19574 rpcz_store.cc:276] 0709 13:17:16.903854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.910562 (+1006708us) service_pool.cc:224] Handling call
0709 13:17:17.912380 (+  1818us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.912470 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.960538 (+ 48068us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.069763 (+109225us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.106570 (+ 36807us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.068653 19703 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.094581 19643 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56808 (request call id 57) took 1072 ms. Trace:
I20260709 13:17:18.144282 19643 rpcz_store.cc:276] 0709 13:17:17.021810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.921393 (+899583us) service_pool.cc:224] Handling call
0709 13:17:17.929774 (+  8381us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.929913 (+   139us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.053324 (+123411us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.094102 (+ 40778us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.094520 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.104081 19496 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 49) took 1172 ms. Trace:
I20260709 13:17:18.126269 19702 tablet_bootstrap.cc:654] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.131454 19651 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56808 (request call id 58) took 1109 ms. Trace:
I20260709 13:17:18.133219 19502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 45) took 1206 ms. Trace:
I20260709 13:17:18.106571 19498 rpcz_store.cc:276] 0709 13:17:16.929779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.809188 (+879409us) service_pool.cc:224] Handling call
0709 13:17:17.857814 (+ 48626us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.857916 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.078334 (+220418us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.088271 (+  9937us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.088876 (+   605us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.107511 19499 rpcz_store.cc:276] 0709 13:17:17.000695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.994731 (+994036us) service_pool.cc:224] Handling call
0709 13:17:17.996476 (+  1745us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.996573 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.085758 (+ 89185us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.092278 (+  6520us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.092697 (+   419us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.074971 19577 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60798 (request call id 47) took 1256 ms. Trace:
I20260709 13:17:18.115481 19501 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 54) took 1119 ms. Trace:
I20260709 13:17:18.166481 19577 rpcz_store.cc:276] 0709 13:17:16.818037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.609171 (+791134us) service_pool.cc:224] Handling call
0709 13:17:17.611256 (+  2085us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.611367 (+   111us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.876767 (+265400us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.054115 (+177348us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.074265 (+ 20150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.147776 19496 rpcz_store.cc:276] 0709 13:17:16.931273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.838223 (+906950us) service_pool.cc:224] Handling call
0709 13:17:17.895958 (+ 57735us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.902890 (+  6932us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.968020 (+ 65130us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.103575 (+135555us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.104013 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.165047 19586 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:18.169710 19724 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.170184 19724 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.172077 19498 tablet_service.cc:1511] Processing CreateTablet for tablet e2c677be72b048b0a9bc9b5c175d6738 (DEFAULT_TABLE table=test-workload [id=aed62f436c1a475c9621b6aef3f2a036]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:18.173389 19498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2c677be72b048b0a9bc9b5c175d6738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.174194 19501 rpcz_store.cc:276] 0709 13:17:16.996506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.982778 (+986272us) service_pool.cc:224] Handling call
0709 13:17:17.984453 (+  1675us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.984540 (+    87us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.045827 (+ 61287us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.075185 (+ 29358us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.115393 (+ 40208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8056}
I20260709 13:17:18.181317 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:18.165047 19502 rpcz_store.cc:276] 0709 13:17:16.926395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.739614 (+813219us) service_pool.cc:224] Handling call
0709 13:17:17.771347 (+ 31733us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.771455 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.094013 (+322558us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.132656 (+ 38643us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.133151 (+   495us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.164872 19651 rpcz_store.cc:276] 0709 13:17:17.022104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.992526 (+970422us) service_pool.cc:224] Handling call
0709 13:17:18.019230 (+ 26704us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:18.019331 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.098665 (+ 79334us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.130855 (+ 32190us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.131378 (+   523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.182678 19735 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.183965 19511 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 1: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:18.183769 19707 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:18.174319 19701 ts_tablet_manager.cc:1434] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.318s	user 0.005s	sys 0.039s
I20260709 13:17:18.135785 19568 rpcz_store.cc:276] 0709 13:17:16.890825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.839195 (+948370us) service_pool.cc:224] Handling call
0709 13:17:17.954570 (+115375us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.954671 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.097891 (+143220us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.103575 (+  5684us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.104016 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.173432 19495 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 51) took 1239 ms. Trace:
I20260709 13:17:18.188149 19647 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56808 (request call id 56) took 1166 ms. Trace:
I20260709 13:17:18.188529 19647 rpcz_store.cc:276] 0709 13:17:17.021513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.918876 (+897363us) service_pool.cc:224] Handling call
0709 13:17:17.953784 (+ 34908us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.953881 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.097152 (+143271us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.178590 (+ 81438us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.188088 (+  9498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.189301 19495 rpcz_store.cc:276] 0709 13:17:16.934097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.896605 (+962508us) service_pool.cc:224] Handling call
0709 13:17:17.951066 (+ 54461us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.951194 (+   128us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.061031 (+109837us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.172921 (+111890us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.173375 (+   454us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2944}
I20260709 13:17:18.194052 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:18.194689 19586 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.174014 19570 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60798 (request call id 58) took 1261 ms. Trace:
I20260709 13:17:18.195230 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:18.153753 19500 rpcz_store.cc:276] 0709 13:17:16.961595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.981994 (+1020399us) service_pool.cc:224] Handling call
0709 13:17:17.983811 (+  1817us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.983915 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.083308 (+ 99393us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.089899 (+  6591us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.090343 (+   444us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.200115 19661 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.201907 19701 tablet_bootstrap.cc:492] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:18.196539 19735 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:18.208288 19724 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:18.213503 19701 tablet_bootstrap.cc:654] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.223591 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:18.227499 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:18.196578 19570 rpcz_store.cc:276] 0709 13:17:16.913145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.043141 (+1129996us) service_pool.cc:224] Handling call
0709 13:17:18.092927 (+ 49786us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e6361a2 00007f6c37577bb9 00007f6c366a8d88 00007f6c3676bb80 00007f6c3671a400 00007f6c2fb9faf4 00007f6c2fb9fa82 00007f6c2fb9f9b1 00007f6c2fb9f92c
0709 13:17:18.092994 (+    67us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:18.093095 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.128803 (+ 35708us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.173473 (+ 44670us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.173951 (+   478us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3142016}
I20260709 13:17:18.248116 19648 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56808 (request call id 54) took 1250 ms. Trace:
I20260709 13:17:18.253085 19648 rpcz_store.cc:276] 0709 13:17:17.020709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.902735 (+882026us) service_pool.cc:224] Handling call
0709 13:17:17.939452 (+ 36717us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.939552 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.112294 (+172742us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.247132 (+134838us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.248022 (+   890us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.249481 19493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 56) took 1246 ms. Trace:
I20260709 13:17:18.262270 19493 rpcz_store.cc:276] 0709 13:17:17.002697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.999017 (+996320us) service_pool.cc:224] Handling call
0709 13:17:18.005595 (+  6578us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:18.026912 (+ 21317us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.100432 (+ 73520us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.204470 (+104038us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.249392 (+ 44922us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:18.248818 19397 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 49559.4us
I20260709 13:17:18.264840 19571 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60798 (request call id 57) took 1356 ms. Trace:
I20260709 13:17:18.268399 19576 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60798 (request call id 54) took 1373 ms. Trace:
I20260709 13:17:18.269572 19576 rpcz_store.cc:276] 0709 13:17:16.895121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.879155 (+984034us) service_pool.cc:224] Handling call
0709 13:17:18.063312 (+184157us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:18.067406 (+  4094us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.131899 (+ 64493us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.256623 (+124724us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.268053 (+ 11430us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.273550 19703 ts_tablet_manager.cc:1434] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.285s	user 0.023s	sys 0.051s
I20260709 13:17:18.283803 19661 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:18.285715 19573 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60798 (request call id 55) took 1386 ms. Trace:
I20260709 13:17:18.288343 19573 rpcz_store.cc:276] 0709 13:17:16.899444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.898135 (+998691us) service_pool.cc:224] Handling call
0709 13:17:17.999379 (+101244us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.999493 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.126961 (+127468us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.285139 (+158178us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.285650 (+   511us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.288894 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:18.286659 19703 tablet_bootstrap.cc:492] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:18.293159 19497 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 57) took 1286 ms. Trace:
I20260709 13:17:18.281929 19494 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 52) took 1340 ms. Trace:
I20260709 13:17:18.287257 19646 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56808 (request call id 53) took 1300 ms. Trace:
I20260709 13:17:18.287673 19586 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:18.293540 19497 rpcz_store.cc:276] 0709 13:17:17.006385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.134945 (+1128560us) service_pool.cc:224] Handling call
0709 13:17:18.137588 (+  2643us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:18.137734 (+   146us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.274347 (+136613us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.292762 (+ 18415us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.293108 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.294524 19724 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.293795 19646 rpcz_store.cc:276] 0709 13:17:16.987055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.877768 (+890713us) service_pool.cc:224] Handling call
0709 13:17:17.915188 (+ 37420us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.915321 (+   133us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:17.989208 (+ 73887us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.286725 (+297517us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.287194 (+   469us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.295358 19735 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.300719 19735 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:18.301221 19702 tablet_bootstrap.cc:492] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:18.301868 19702 ts_tablet_manager.cc:1403] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.270s	user 0.055s	sys 0.036s
I20260709 13:17:18.301751 19735 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.302836 19703 tablet_bootstrap.cc:654] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.305531 19707 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:17:18.295452 19494 rpcz_store.cc:276] 0709 13:17:16.941114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.981971 (+1040857us) service_pool.cc:224] Handling call
0709 13:17:18.025949 (+ 43978us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:18.026047 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.234915 (+208868us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.276756 (+ 41841us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.280948 (+  4192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.311810 19409 catalog_manager.cc:5697] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 0 to 1, leader changed from <none> to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.328486 19498 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50816 (request call id 58) took 1308 ms. Trace:
I20260709 13:17:18.329123 19498 rpcz_store.cc:276] 0709 13:17:17.020267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.171047 (+1150780us) service_pool.cc:224] Handling call
0709 13:17:18.172902 (+  1855us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:18.173002 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.311050 (+138048us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.327682 (+ 16632us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.328391 (+   709us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.265515 19571 rpcz_store.cc:276] 0709 13:17:16.908158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.036702 (+1128544us) service_pool.cc:224] Handling call
0709 13:17:18.038554 (+  1852us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:18.038649 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.129897 (+ 91248us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.264023 (+134126us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.264748 (+   725us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.311270 19702 raft_consensus.cc:359] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.341446 19702 raft_consensus.cc:385] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.340957 19701 tablet_bootstrap.cc:492] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:18.344763 19701 ts_tablet_manager.cc:1403] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.143s	user 0.016s	sys 0.007s
I20260709 13:17:18.342020 19702 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.349192 19702 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.357895 19702 ts_tablet_manager.cc:1434] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.056s	user 0.010s	sys 0.000s
I20260709 13:17:18.358878 19701 raft_consensus.cc:359] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.360085 19701 raft_consensus.cc:385] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.360441 19701 raft_consensus.cc:740] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.361652 19701 consensus_queue.cc:260] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.365126 19701 ts_tablet_manager.cc:1434] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:17:18.370100 19703 tablet_bootstrap.cc:492] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:18.370580 19703 ts_tablet_manager.cc:1403] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.022s
I20260709 13:17:18.372701 19703 raft_consensus.cc:359] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.373256 19703 raft_consensus.cc:385] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.373507 19703 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.374639 19701 tablet_bootstrap.cc:492] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:18.374951 19703 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.377245 19703 ts_tablet_manager.cc:1434] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:18.378285 19703 tablet_bootstrap.cc:492] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:18.384243 19701 tablet_bootstrap.cc:654] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.393296 19703 tablet_bootstrap.cc:654] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.405689 19702 tablet_bootstrap.cc:492] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:18.415958 19702 tablet_bootstrap.cc:654] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.422729 19701 tablet_bootstrap.cc:492] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:18.423889 19701 ts_tablet_manager.cc:1403] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.050s	user 0.027s	sys 0.011s
I20260709 13:17:18.428153 19703 tablet_bootstrap.cc:492] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:18.428759 19703 ts_tablet_manager.cc:1403] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.003s
I20260709 13:17:18.428037 19410 catalog_manager.cc:5697] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 0 to 1, leader changed from <none> to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.429289 19701 raft_consensus.cc:359] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.430176 19701 raft_consensus.cc:385] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.430495 19701 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.431429 19701 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.431788 19703 raft_consensus.cc:359] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.432471 19703 raft_consensus.cc:385] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.432778 19703 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.433921 19701 ts_tablet_manager.cc:1434] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:17:18.433558 19703 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.435796 19703 ts_tablet_manager.cc:1434] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:18.436889 19701 tablet_bootstrap.cc:492] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:18.442545 19703 tablet_bootstrap.cc:492] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:18.446991 19701 tablet_bootstrap.cc:654] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.453528 19703 tablet_bootstrap.cc:654] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.462569 19701 tablet_bootstrap.cc:492] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:18.463227 19701 ts_tablet_manager.cc:1403] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.008s
I20260709 13:17:18.466853 19701 raft_consensus.cc:359] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.467774 19701 raft_consensus.cc:385] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.468128 19701 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.468670 19735 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:18.470736 19701 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.482012 19701 ts_tablet_manager.cc:1434] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 13:17:18.483160 19703 tablet_bootstrap.cc:492] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:18.483397 19701 tablet_bootstrap.cc:492] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:18.483738 19703 ts_tablet_manager.cc:1403] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.002s
I20260709 13:17:18.499151 19702 tablet_bootstrap.cc:492] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:18.499692 19702 ts_tablet_manager.cc:1403] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.094s	user 0.034s	sys 0.015s
I20260709 13:17:18.500931 19703 raft_consensus.cc:359] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.501734 19703 raft_consensus.cc:385] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.502033 19703 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.502715 19702 raft_consensus.cc:359] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.503474 19702 raft_consensus.cc:385] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.503765 19702 raft_consensus.cc:740] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.504588 19702 consensus_queue.cc:260] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.506024 19733 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:18.507978 19702 ts_tablet_manager.cc:1434] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:17:18.509143 19702 tablet_bootstrap.cc:492] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:18.506639 19703 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.512629 19703 ts_tablet_manager.cc:1434] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:17:18.513056 19701 tablet_bootstrap.cc:654] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.513864 19703 tablet_bootstrap.cc:492] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:18.519850 19735 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.520431 19735 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.524466 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:18.524680 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:18.526355 19478 leader_election.cc:343] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.527712 19702 tablet_bootstrap.cc:654] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.529763 19703 tablet_bootstrap.cc:654] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:18.530309 19476 leader_election.cc:343] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.530840 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:18.532043 19733 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.534085 19735 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:18.542802 19703 tablet_bootstrap.cc:492] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:18.543386 19703 ts_tablet_manager.cc:1403] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.000s
I20260709 13:17:18.547056 19703 raft_consensus.cc:359] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.547932 19703 raft_consensus.cc:385] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.553522 19724 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.553828 19703 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.552124 19702 tablet_bootstrap.cc:492] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:18.554208 19724 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.554950 19702 ts_tablet_manager.cc:1403] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.007s
I20260709 13:17:18.555472 19701 tablet_bootstrap.cc:492] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:18.555872 19701 ts_tablet_manager.cc:1403] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.012s
I20260709 13:17:18.558548 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:18.558564 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:18.559494 19511 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:18.559103 19701 raft_consensus.cc:359] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.560225 19703 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.560911 19701 raft_consensus.cc:385] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.557235 19724 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:18.561779 19701 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.562758 19703 ts_tablet_manager.cc:1434] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:17:18.560930 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:18.562887 19701 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:18.564152 19551 leader_election.cc:343] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.563963 19702 raft_consensus.cc:359] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.564721 19702 raft_consensus.cc:385] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.565032 19702 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.565862 19701 ts_tablet_manager.cc:1434] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 13:17:18.565824 19702 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.566752 19724 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.567174 19724 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.567581 19724 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.572738 19701 tablet_bootstrap.cc:492] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:18.573873 19703 tablet_bootstrap.cc:492] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:18.584721 19703 tablet_bootstrap.cc:654] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.586463 19707 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.588428 19707 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.589939 19702 ts_tablet_manager.cc:1434] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.004s
I20260709 13:17:18.592669 19707 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:18.592911 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:18.593569 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:18.594866 19627 leader_election.cc:343] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:18.596477 19625 leader_election.cc:343] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.596971 19625 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:18.587494 19724 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.599396 19702 tablet_bootstrap.cc:492] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:18.599833 19707 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.600783 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:18.601398 19511 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.604393 19701 tablet_bootstrap.cc:654] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.606587 19702 tablet_bootstrap.cc:654] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.609915 19511 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:18.613050 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:17:18.615937 19551 leader_election.cc:343] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.613755 19724 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:18.616706 19701 tablet_bootstrap.cc:492] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:18.617260 19701 ts_tablet_manager.cc:1403] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.006s
I20260709 13:17:18.618340 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:18.620147 19724 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.620217 19701 raft_consensus.cc:359] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.621392 19724 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:18.621160 19701 raft_consensus.cc:385] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.622279 19701 raft_consensus.cc:740] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.623133 19701 consensus_queue.cc:260] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.623016 19724 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.630071 19701 ts_tablet_manager.cc:1434] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.002s
I20260709 13:17:18.630507 19703 tablet_bootstrap.cc:492] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:18.631036 19703 ts_tablet_manager.cc:1403] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.004s
I20260709 13:17:18.631158 19701 tablet_bootstrap.cc:492] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:18.633898 19703 raft_consensus.cc:359] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.635989 19703 raft_consensus.cc:385] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.636438 19703 raft_consensus.cc:740] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.637253 19703 consensus_queue.cc:260] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.638056 19701 tablet_bootstrap.cc:654] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.640493 19703 ts_tablet_manager.cc:1434] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:17:18.641554 19703 tablet_bootstrap.cc:492] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:18.643970 19702 tablet_bootstrap.cc:492] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:18.644548 19702 ts_tablet_manager.cc:1403] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.019s
I20260709 13:17:18.648654 19703 tablet_bootstrap.cc:654] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.655093 19407 catalog_manager.cc:5697] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.655516 19702 raft_consensus.cc:359] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.656781 19702 raft_consensus.cc:385] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.657248 19702 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.658257 19702 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.660429 19703 tablet_bootstrap.cc:492] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:18.660573 19702 ts_tablet_manager.cc:1434] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.007s
I20260709 13:17:18.660919 19703 ts_tablet_manager.cc:1403] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.010s
I20260709 13:17:18.661787 19702 tablet_bootstrap.cc:492] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:18.663728 19703 raft_consensus.cc:359] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.664528 19703 raft_consensus.cc:385] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.664798 19703 raft_consensus.cc:740] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.665674 19703 consensus_queue.cc:260] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.668212 19703 ts_tablet_manager.cc:1434] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:17:18.669466 19703 tablet_bootstrap.cc:492] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:18.674300 19702 tablet_bootstrap.cc:654] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.678282 19703 tablet_bootstrap.cc:654] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.681144 19701 tablet_bootstrap.cc:492] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:18.681785 19701 ts_tablet_manager.cc:1403] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.003s
I20260709 13:17:18.684798 19701 raft_consensus.cc:359] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.685712 19701 raft_consensus.cc:385] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.686082 19701 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.687077 19701 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.689929 19701 ts_tablet_manager.cc:1434] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:18.691392 19701 tablet_bootstrap.cc:492] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:18.695734 19724 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.696334 19724 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.698836 19724 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:18.701184 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:18.701894 19511 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:18.702960 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:18.703275 19701 tablet_bootstrap.cc:654] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.704123 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:18.705138 19724 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.706579 19739 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.708163 19739 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.710323 19702 tablet_bootstrap.cc:492] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
W20260709 13:17:18.707494 19551 leader_election.cc:343] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.710511 19739 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:18.710816 19702 ts_tablet_manager.cc:1403] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.010s
I20260709 13:17:18.710479 19701 tablet_bootstrap.cc:492] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:18.711537 19701 ts_tablet_manager.cc:1403] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 13:17:18.713119 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:18.713807 19702 raft_consensus.cc:359] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.714226 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:18.714509 19701 raft_consensus.cc:359] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.714915 19511 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:18.714522 19702 raft_consensus.cc:385] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.715346 19701 raft_consensus.cc:385] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.715637 19702 raft_consensus.cc:740] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.715759 19701 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.716526 19702 consensus_queue.cc:260] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.716550 19701 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.716974 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:18.720844 19724 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.721285 19707 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.722162 19707 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.722748 19702 ts_tablet_manager.cc:1434] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:17:18.723714 19702 tablet_bootstrap.cc:492] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:18.725652 19707 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:18.727001 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:18.721436 19739 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.728117 19739 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.728487 19739 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.719435 19701 ts_tablet_manager.cc:1434] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:18.731359 19701 tablet_bootstrap.cc:492] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
W20260709 13:17:18.737818 19627 leader_election.cc:343] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.743053 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:18.744552 19625 leader_election.cc:343] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.745026 19625 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:18.746347 19707 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.747278 19724 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:18.749166 19458 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:18.713799 19661 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:18.752540 19739 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.760738 19703 tablet_bootstrap.cc:492] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:18.760600 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:18.761214 19703 ts_tablet_manager.cc:1403] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.007s
I20260709 13:17:18.761549 19511 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.764487 19703 raft_consensus.cc:359] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.765201 19703 raft_consensus.cc:385] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.765825 19701 tablet_bootstrap.cc:654] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.768546 19724 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.769104 19735 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:18.771133 19702 tablet_bootstrap.cc:654] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.765486 19703 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.771353 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:18.774570 19511 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:18.784858 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:18.778151 19703 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.785673 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:18.788340 19703 ts_tablet_manager.cc:1434] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:17:18.776008 19739 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:18.784080 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:18.777923 19661 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.776319 19770 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.788982 19510 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.789963 19770 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.790961 19773 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.789423 19703 tablet_bootstrap.cc:492] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:18.791471 19773 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:18.792353 19773 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.800351 19770 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:18.782179 19724 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:18.805076 19703 tablet_bootstrap.cc:654] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.807371 19510 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:18.809803 19702 tablet_bootstrap.cc:492] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:18.816058 19702 ts_tablet_manager.cc:1403] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.000s
I20260709 13:17:18.813596 19661 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
W20260709 13:17:18.823554 19551 leader_election.cc:343] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.825198 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:18.826974 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:18.829039 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:18.829988 19661 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:18.833920 19735 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.834534 19735 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.838451 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:18.838960 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:18.839102 19661 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:18.839565 19587 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:18.840418 19735 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:18.841572 19478 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:18.843851 19735 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.844398 19735 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.844882 19735 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.854681 19774 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.855913 19774 raft_consensus.cc:697] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:18.833401 19702 raft_consensus.cc:359] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.858824 19702 raft_consensus.cc:385] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.859185 19702 raft_consensus.cc:740] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.859736 19771 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.860080 19702 consensus_queue.cc:260] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.862519 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:18.863955 19739 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.864332 19739 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.864758 19739 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.870467 19735 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.872306 19739 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.873858 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:18.857175 19774 consensus_queue.cc:237] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.874349 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:18.874565 19587 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.875020 19661 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.860440 19771 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.882592 19661 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:18.883644 19701 tablet_bootstrap.cc:492] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:18.883718 19771 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:18.883911 19476 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:17:18.874022 19551 leader_election.cc:343] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.884274 19701 ts_tablet_manager.cc:1403] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.153s	user 0.028s	sys 0.020s
I20260709 13:17:18.884794 19733 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.885277 19733 raft_consensus.cc:697] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:18.886020 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:18.886137 19733 consensus_queue.cc:237] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.886751 19511 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:18.887534 19739 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:18.888902 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:18.886371 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:18.889032 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:18.889452 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:18.889659 19660 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:18.890093 19659 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.890761 19739 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.891145 19739 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.891598 19739 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.895041 19703 tablet_bootstrap.cc:492] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:18.895634 19703 ts_tablet_manager.cc:1403] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.106s	user 0.023s	sys 0.017s
I20260709 13:17:18.897665 19701 raft_consensus.cc:359] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.898473 19701 raft_consensus.cc:385] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.898756 19701 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.901770 19702 ts_tablet_manager.cc:1434] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.000s
W20260709 13:17:18.902467 19551 leader_election.cc:343] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.904443 19734 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.915931 19702 tablet_bootstrap.cc:492] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:18.907809 19701 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.912815 19587 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:18.921108 19701 ts_tablet_manager.cc:1434] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 13:17:18.915051 19659 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:18.917037 19735 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:18.922274 19701 tablet_bootstrap.cc:492] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:18.923108 19410 catalog_manager.cc:5697] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 0 to 1, leader changed from <none> to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.915668 19734 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.905684 19703 raft_consensus.cc:359] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.925316 19703 raft_consensus.cc:385] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.925828 19703 raft_consensus.cc:740] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.924830 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:18.930895 19703 consensus_queue.cc:260] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.899241 19739 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.938297 19734 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:18.946614 19774 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.972892 19734 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:17:18.974818 19701 tablet_bootstrap.cc:654] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.973496 19774 raft_consensus.cc:697] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:18.973273 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:18.976197 19661 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:18.976456 19774 consensus_queue.cc:237] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:18.966308 19739 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:18.978317 19476 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:18.979292 19734 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.979650 19734 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.965490 19703 ts_tablet_manager.cc:1434] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.069s	user 0.014s	sys 0.000s
I20260709 13:17:18.980317 19702 tablet_bootstrap.cc:654] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.981264 19703 tablet_bootstrap.cc:492] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:18.979976 19734 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.949116 19735 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.983420 19410 catalog_manager.cc:5697] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.987623 19410 catalog_manager.cc:5697] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.990038 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:18.990688 19511 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.999140 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:18.999788 19659 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:18.974181 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 62000.8us
I20260709 13:17:19.004607 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:19.005506 19587 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:19.001938 19739 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.997162 19735 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.007056 19739 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.017896 19659 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:19.019922 19739 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:19.020205 19734 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.022639 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:19.013782 19511 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:19.023490 19659 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:19.023379 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:19.025767 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:19.026733 19510 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:19.028138 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:19.029256 19774 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.030956 19774 raft_consensus.cc:697] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:19.031872 19774 consensus_queue.cc:237] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.029877 19739 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.044389 19703 tablet_bootstrap.cc:654] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.041841 19739 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.045208 19739 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:19.053362 19551 consensus_peers.cc:597] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf -> Peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Couldn't send request to peer e19c80e9149b4b8d88ae13bde8e43864. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.056561 19702 tablet_bootstrap.cc:492] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:19.057101 19702 ts_tablet_manager.cc:1403] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.141s	user 0.010s	sys 0.014s
I20260709 13:17:19.062602 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:19.063371 19701 tablet_bootstrap.cc:492] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:19.063973 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:19.064663 19586 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.064728 19702 raft_consensus.cc:359] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.068742 19739 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.065495 19702 raft_consensus.cc:385] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.070779 19702 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.071018 19735 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:19.072539 19586 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:19.073333 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:19.075403 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:19.075933 19511 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.076048 19659 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.076007 19702 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.076920 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:17:19.073570 19478 leader_election.cc:343] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.063988 19701 ts_tablet_manager.cc:1403] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.142s	user 0.022s	sys 0.008s
I20260709 13:17:19.074152 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:19.078672 19702 ts_tablet_manager.cc:1434] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:17:19.078459 19660 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.078203 19739 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:19.079697 19702 tablet_bootstrap.cc:492] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:19.074810 19407 catalog_manager.cc:5697] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:19.082398 19476 leader_election.cc:343] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.083622 19478 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:19.084429 19476 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:19.084829 19735 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.085450 19735 raft_consensus.cc:697] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:19.085603 19733 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.083065 19703 tablet_bootstrap.cc:492] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:19.086467 19735 consensus_queue.cc:237] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.087220 19703 ts_tablet_manager.cc:1403] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.106s	user 0.009s	sys 0.006s
I20260709 13:17:19.087234 19702 tablet_bootstrap.cc:654] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.090698 19703 raft_consensus.cc:359] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.091355 19703 raft_consensus.cc:385] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.091652 19703 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.092412 19703 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.094386 19660 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:19.095010 19703 ts_tablet_manager.cc:1434] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:19.078258 19734 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:19.097995 19703 tablet_bootstrap.cc:492] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:19.102603 19701 raft_consensus.cc:359] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.104224 19701 raft_consensus.cc:385] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.108649 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:19.110080 19774 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.110591 19774 raft_consensus.cc:697] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:19.111486 19774 consensus_queue.cc:237] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.107867 19701 raft_consensus.cc:740] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.113379 19701 consensus_queue.cc:260] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.116739 19739 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.118578 19701 ts_tablet_manager.cc:1434] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:17:19.123770 19701 tablet_bootstrap.cc:492] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:19.125907 19702 tablet_bootstrap.cc:492] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:19.126581 19702 ts_tablet_manager.cc:1403] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.008s
I20260709 13:17:19.120139 19511 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:19.133399 19407 catalog_manager.cc:5697] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.116591 19408 catalog_manager.cc:5697] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 0 to 1, leader changed from <none> to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.143743 19703 tablet_bootstrap.cc:654] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.147483 19659 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:19.170692 19703 tablet_bootstrap.cc:492] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:19.171259 19703 ts_tablet_manager.cc:1403] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.074s	user 0.022s	sys 0.008s
I20260709 13:17:19.172664 19701 tablet_bootstrap.cc:654] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.174507 19702 raft_consensus.cc:359] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.175345 19702 raft_consensus.cc:385] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.175668 19702 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.176461 19702 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.177688 19703 raft_consensus.cc:359] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.178424 19703 raft_consensus.cc:385] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.178732 19703 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.179565 19703 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.181519 19407 catalog_manager.cc:5697] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.184077 19703 ts_tablet_manager.cc:1434] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:17:19.185286 19703 tablet_bootstrap.cc:492] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:19.191772 19703 tablet_bootstrap.cc:654] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.192929 19702 ts_tablet_manager.cc:1434] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.003s
I20260709 13:17:19.197192 19702 tablet_bootstrap.cc:492] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:19.198810 19701 tablet_bootstrap.cc:492] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:19.199357 19701 ts_tablet_manager.cc:1403] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.013s
I20260709 13:17:19.202167 19701 raft_consensus.cc:359] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.202878 19701 raft_consensus.cc:385] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.203179 19701 raft_consensus.cc:740] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.203383 19702 tablet_bootstrap.cc:654] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.204098 19701 consensus_queue.cc:260] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.206431 19701 ts_tablet_manager.cc:1434] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:19.207334 19701 tablet_bootstrap.cc:492] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:19.209877 19707 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.210788 19707 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.213155 19707 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:19.214222 19701 tablet_bootstrap.cc:654] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.215991 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:19.216982 19510 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 1: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:19.215984 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:19.221692 19625 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:19.222951 19707 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.223273 19703 tablet_bootstrap.cc:492] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:19.223760 19703 ts_tablet_manager.cc:1403] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.005s
I20260709 13:17:19.233287 19707 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.237435 19703 raft_consensus.cc:359] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.238330 19703 raft_consensus.cc:385] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.238655 19703 raft_consensus.cc:740] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.238879 19702 tablet_bootstrap.cc:492] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:19.239137 19701 tablet_bootstrap.cc:492] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:19.239432 19702 ts_tablet_manager.cc:1403] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.001s
I20260709 13:17:19.239578 19701 ts_tablet_manager.cc:1403] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.014s
I20260709 13:17:19.239588 19703 consensus_queue.cc:260] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.242470 19702 raft_consensus.cc:359] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.243080 19703 ts_tablet_manager.cc:1434] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 13:17:19.243256 19702 raft_consensus.cc:385] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.243549 19702 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.244422 19703 tablet_bootstrap.cc:492] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:19.244297 19702 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.246137 19701 raft_consensus.cc:359] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.246946 19701 raft_consensus.cc:385] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.247258 19701 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.251072 19702 ts_tablet_manager.cc:1434] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:17:19.248482 19701 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.256372 19703 tablet_bootstrap.cc:654] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.257839 19702 tablet_bootstrap.cc:492] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:19.262862 19701 ts_tablet_manager.cc:1434] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.002s
I20260709 13:17:19.262938 19735 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.263769 19735 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.264742 19701 tablet_bootstrap.cc:492] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:19.266031 19774 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.267310 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:19.271904 19478 leader_election.cc:343] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.272215 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:19.273288 19735 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:19.274150 19476 leader_election.cc:343] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.274619 19476 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:19.275964 19735 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.289742 19739 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.292095 19724 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.294802 19724 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.298235 19724 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.302299 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:19.305222 19510 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:19.304409 19701 tablet_bootstrap.cc:654] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.314502 19702 tablet_bootstrap.cc:654] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.320793 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:19.322153 19739 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.323086 19739 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.323442 19739 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.326424 19724 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:19.327482 19703 tablet_bootstrap.cc:492] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:19.328013 19703 ts_tablet_manager.cc:1403] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.084s	user 0.034s	sys 0.013s
I20260709 13:17:19.329540 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:17:19.331756 19551 leader_election.cc:343] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.332234 19703 raft_consensus.cc:359] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.332949 19703 raft_consensus.cc:385] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.333226 19703 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.333932 19703 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.336887 19703 ts_tablet_manager.cc:1434] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:17:19.341706 19771 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.343242 19739 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.347060 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:19.347741 19511 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.350934 19703 tablet_bootstrap.cc:492] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:19.363622 19701 tablet_bootstrap.cc:492] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:19.363842 19511 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:19.364596 19701 ts_tablet_manager.cc:1403] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.008s
I20260709 13:17:19.365213 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:19.365217 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:19.365834 19739 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:19.366895 19551 leader_election.cc:343] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.371166 19701 raft_consensus.cc:359] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.366258 19724 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.373081 19724 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:19.374070 19724 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.374888 19703 tablet_bootstrap.cc:654] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.371974 19701 raft_consensus.cc:385] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.376657 19701 raft_consensus.cc:740] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.377740 19701 consensus_queue.cc:260] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.384368 19701 ts_tablet_manager.cc:1434] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:17:19.385447 19701 tablet_bootstrap.cc:492] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:19.391731 19739 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.406087 19702 tablet_bootstrap.cc:492] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:19.406603 19702 ts_tablet_manager.cc:1403] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.149s	user 0.022s	sys 0.007s
I20260709 13:17:19.416698 19781 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.422545 19724 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.423221 19724 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.422842 19408 catalog_manager.cc:5697] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.428529 19702 raft_consensus.cc:359] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.429490 19702 raft_consensus.cc:385] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.429852 19702 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.430557 19702 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.432206 19702 ts_tablet_manager.cc:1434] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:17:19.433116 19702 tablet_bootstrap.cc:492] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:19.439960 19707 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.440487 19707 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.442813 19703 tablet_bootstrap.cc:492] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:19.443280 19703 ts_tablet_manager.cc:1403] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.093s	user 0.017s	sys 0.010s
I20260709 13:17:19.442688 19707 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:19.445814 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:19.445202 19701 tablet_bootstrap.cc:654] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.445312 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:19.448066 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:19.447536 19703 raft_consensus.cc:359] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.449357 19703 raft_consensus.cc:385] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.449702 19703 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.450601 19703 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.454551 19703 ts_tablet_manager.cc:1434] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:17:19.456143 19703 tablet_bootstrap.cc:492] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:19.457144 19625 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:17:19.457875 19551 leader_election.cc:343] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.459097 19707 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.460943 19511 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.470388 19781 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.477661 19702 tablet_bootstrap.cc:654] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.488021 19773 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.491236 19701 tablet_bootstrap.cc:492] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:19.491766 19701 ts_tablet_manager.cc:1403] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.107s	user 0.016s	sys 0.017s
I20260709 13:17:19.486819 19724 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:19.495951 19703 tablet_bootstrap.cc:654] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.492861 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:17:19.508140 19551 leader_election.cc:343] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.508677 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:19.519894 19702 tablet_bootstrap.cc:492] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:19.524770 19702 ts_tablet_manager.cc:1403] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.092s	user 0.016s	sys 0.019s
I20260709 13:17:19.527660 19702 raft_consensus.cc:359] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.528411 19702 raft_consensus.cc:385] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.510188 19724 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.511771 19701 raft_consensus.cc:359] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.528756 19702 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.529199 19701 raft_consensus.cc:385] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.529788 19701 raft_consensus.cc:740] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.531003 19701 consensus_queue.cc:260] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.531365 19702 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.535247 19702 ts_tablet_manager.cc:1434] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:17:19.536814 19702 tablet_bootstrap.cc:492] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:19.537673 19701 ts_tablet_manager.cc:1434] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.011s
I20260709 13:17:19.538848 19701 tablet_bootstrap.cc:492] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:19.545634 19702 tablet_bootstrap.cc:654] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.551086 19701 tablet_bootstrap.cc:654] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.552305 19702 tablet_bootstrap.cc:492] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:19.552752 19702 ts_tablet_manager.cc:1403] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:17:19.555248 19702 raft_consensus.cc:359] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.555976 19702 raft_consensus.cc:385] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.556269 19702 raft_consensus.cc:740] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.557080 19702 consensus_queue.cc:260] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.558972 19703 tablet_bootstrap.cc:492] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:19.559484 19703 ts_tablet_manager.cc:1403] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.104s	user 0.016s	sys 0.002s
I20260709 13:17:19.559937 19702 ts_tablet_manager.cc:1434] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:19.560948 19702 tablet_bootstrap.cc:492] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:19.562268 19703 raft_consensus.cc:359] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.562988 19703 raft_consensus.cc:385] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.563282 19703 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.564160 19703 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.567685 19702 tablet_bootstrap.cc:654] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.576251 19703 ts_tablet_manager.cc:1434] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:17:19.577219 19724 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.579895 19702 tablet_bootstrap.cc:492] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:19.581017 19702 ts_tablet_manager.cc:1403] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.014s
I20260709 13:17:19.584242 19702 raft_consensus.cc:359] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.585672 19702 raft_consensus.cc:385] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.586082 19702 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.587019 19702 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.584285 19724 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.588794 19724 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.589831 19702 ts_tablet_manager.cc:1434] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:17:19.590961 19702 tablet_bootstrap.cc:492] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:19.591915 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:19.592768 19724 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:19.592978 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:17:19.593358 19551 leader_election.cc:343] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.593765 19660 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:19.594938 19707 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.595450 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:19.595733 19707 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.596653 19724 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.597111 19724 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.597518 19724 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.600222 19702 tablet_bootstrap.cc:654] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.600073 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:19.601163 19511 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:19.603152 19625 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:19.604550 19798 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.605156 19798 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.605677 19798 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.606969 19724 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.610574 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:19.611887 19702 tablet_bootstrap.cc:492] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
W20260709 13:17:19.611964 19551 leader_election.cc:343] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.612486 19702 ts_tablet_manager.cc:1403] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.005s
I20260709 13:17:19.613585 19707 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:19.615706 19702 raft_consensus.cc:359] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.616413 19702 raft_consensus.cc:385] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.616688 19702 raft_consensus.cc:740] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.617561 19702 consensus_queue.cc:260] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.619488 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:19.619765 19702 ts_tablet_manager.cc:1434] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:19.620139 19586 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:19.620661 19702 tablet_bootstrap.cc:492] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:19.628398 19660 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.629163 19707 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.629669 19707 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.631122 19734 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.631592 19734 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.632107 19707 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:19.632704 19701 tablet_bootstrap.cc:492] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:19.633158 19701 ts_tablet_manager.cc:1403] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.004s
I20260709 13:17:19.634019 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:19.634783 19511 raft_consensus.cc:2393] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 1: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:19.636219 19702 tablet_bootstrap.cc:654] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.638000 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:19.638705 19658 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.636328 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:19.643005 19661 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:19.644696 19476 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:19.645659 19735 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.637357 19701 raft_consensus.cc:359] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.646013 19735 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.646118 19701 raft_consensus.cc:385] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.646420 19701 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.647156 19701 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.647997 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:19.646400 19735 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.649577 19701 ts_tablet_manager.cc:1434] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:17:19.650646 19701 tablet_bootstrap.cc:492] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:19.594905 19703 tablet_bootstrap.cc:492] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:19.657678 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:19.653573 19734 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:19.654278 19724 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:19.670089 19478 leader_election.cc:343] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.683634 19798 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.666618 19707 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.687824 19625 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:19.689491 19707 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.721606 19734 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.724460 19774 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.727006 19707 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:19.732693 19774 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.733052 19735 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.733243 19774 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.735848 19781 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.735970 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:19.736413 19781 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:19.740798 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:19.741686 19586 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:19.753298 19627 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:19.690155 19658 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:19.772202 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:19.778167 19707 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.783893 19773 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.785441 19701 tablet_bootstrap.cc:654] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.785372 19773 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:20.064687 19773 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.070156 19735 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:20.071884 19822 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:20.084555 19781 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:20.085856 19702 tablet_bootstrap.cc:492] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:20.086272 19702 ts_tablet_manager.cc:1403] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.466s	user 0.023s	sys 0.019s
I20260709 13:17:20.080511 19822 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.091840 19822 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.095777 19774 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:20.109874 19822 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:20.113135 19478 leader_election.cc:343] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.114583 19822 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:20.206800 19703 tablet_bootstrap.cc:700] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf: Time spent opening tablet: real 0.105s	user 0.003s	sys 0.000s
I20260709 13:17:20.207726 19703 tablet_bootstrap.cc:654] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:20.223400 19660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.011s	sys 0.013s
W20260709 13:17:20.223791 19660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.011s	sys 0.013s
I20260709 13:17:20.225100 19703 tablet_bootstrap.cc:492] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:20.225761 19703 ts_tablet_manager.cc:1403] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.631s	user 0.027s	sys 0.009s
I20260709 13:17:20.234905 19707 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:20.251739 19734 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.252513 19734 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.255014 19734 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:20.255682 19734 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:20.081455 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 405209us
I20260709 13:17:20.289650 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:20.290335 19510 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.298524 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:20.301141 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:20.303712 19510 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:20.305908 19707 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.306499 19707 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.308811 19707 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:17:20.310271 19625 leader_election.cc:343] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:20.312208 19625 leader_election.cc:343] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.315831 19625 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:20.317026 19707 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:20.317812 19798 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:20.317838 19707 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:20.319281 19707 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.323107 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:20.324906 19625 leader_election.cc:343] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.325822 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:20.326458 19660 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.333995 19660 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:20.335216 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:20.335443 19476 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:20.336032 19657 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 1: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:20.336632 19734 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:20.337121 19734 raft_consensus.cc:697] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:20.338003 19734 consensus_queue.cc:237] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.358311 19724 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.358781 19703 raft_consensus.cc:359] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.359800 19703 raft_consensus.cc:385] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.360204 19703 raft_consensus.cc:740] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.358946 19724 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.333269 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:20.364238 19724 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:20.364805 19476 leader_election.cc:343] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.361007 19703 consensus_queue.cc:260] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.368856 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:20.376040 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:20.401038 19702 raft_consensus.cc:359] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.403290 19702 raft_consensus.cc:385] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.403688 19702 raft_consensus.cc:740] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.404709 19702 consensus_queue.cc:260] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.423763 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:20.424041 19702 ts_tablet_manager.cc:1434] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.338s	user 0.010s	sys 0.000s
I20260709 13:17:20.424505 19586 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.425429 19702 tablet_bootstrap.cc:492] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:20.428927 19701 tablet_bootstrap.cc:492] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:20.429543 19701 ts_tablet_manager.cc:1403] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.779s	user 0.024s	sys 0.004s
W20260709 13:17:20.431866 19458 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:20.432790 19701 raft_consensus.cc:359] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.437879 19701 raft_consensus.cc:385] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.438217 19701 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.439149 19701 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.436975 19703 ts_tablet_manager.cc:1434] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.211s	user 0.011s	sys 0.003s
I20260709 13:17:20.440845 19702 tablet_bootstrap.cc:654] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.442955 19701 ts_tablet_manager.cc:1434] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:17:20.444051 19701 tablet_bootstrap.cc:492] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:20.440927 19703 tablet_bootstrap.cc:492] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:20.448752 19586 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
W20260709 13:17:20.449260 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 86916.4us
I20260709 13:17:20.469671 19836 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:17:20.474926 19407 catalog_manager.cc:5697] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 0 to 1, leader changed from <none> to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.474766 19408 catalog_manager.cc:5697] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.480149 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:20.481695 19586 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.487648 19702 tablet_bootstrap.cc:492] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:20.486183 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:20.488142 19702 ts_tablet_manager.cc:1403] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.063s	user 0.022s	sys 0.023s
I20260709 13:17:20.488178 19585 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:20.484620 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:20.490833 19702 raft_consensus.cc:359] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.491485 19702 raft_consensus.cc:385] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.491763 19702 raft_consensus.cc:740] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
W20260709 13:17:20.485360 19551 leader_election.cc:343] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.494735 19702 consensus_queue.cc:260] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.499470 19702 ts_tablet_manager.cc:1434] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:17:20.500555 19702 tablet_bootstrap.cc:492] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:20.503239 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:20.509097 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:20.513134 19586 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:20.515462 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:20.517329 19703 tablet_bootstrap.cc:654] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.517023 19478 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:17:20.519711 19551 leader_election.cc:343] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:20.522987 19627 leader_election.cc:343] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.524210 19627 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:20.521317 19836 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:17:20.520195 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:20.529963 19837 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:20.532064 19551 leader_election.cc:343] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.529052 19798 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:20.540956 19835 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:17:20.545840 19701 tablet_bootstrap.cc:654] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.549891 19627 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:20.550783 19838 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:20.551345 19838 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.551760 19838 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.552024 19798 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:20.552618 19798 raft_consensus.cc:697] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:20.553865 19798 consensus_queue.cc:237] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.554481 19478 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:20.557276 19832 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.562798 19703 tablet_bootstrap.cc:492] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:20.563340 19703 ts_tablet_manager.cc:1403] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.123s	user 0.018s	sys 0.010s
W20260709 13:17:20.560989 19551 leader_election.cc:343] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.570997 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:20.571171 19703 raft_consensus.cc:359] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.571939 19703 raft_consensus.cc:385] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.572283 19703 raft_consensus.cc:740] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.559665 19707 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.572929 19707 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.573030 19703 consensus_queue.cc:260] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.575174 19703 ts_tablet_manager.cc:1434] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:17:20.576275 19703 tablet_bootstrap.cc:492] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:20.576660 19833 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:20.578442 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:20.582741 19707 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:20.583442 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:20.584296 19583 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:20.585933 19627 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:20.587740 19707 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:20.588440 19707 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.584837 19835 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.589206 19707 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.607301 19832 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:20.607592 19822 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.608053 19822 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.651821 19701 tablet_bootstrap.cc:492] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:20.655908 19701 ts_tablet_manager.cc:1403] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.212s	user 0.011s	sys 0.028s
I20260709 13:17:20.667889 19707 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.671782 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:20.672422 19587 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.672957 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:20.675918 19822 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:20.676664 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:20.676968 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:20.677300 19510 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:20.677541 19583 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:20.679436 19625 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:20.679975 19707 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:20.680532 19822 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:20.680907 19822 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.681288 19822 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.681854 19703 tablet_bootstrap.cc:654] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.682301 19702 tablet_bootstrap.cc:654] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.689374 19587 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:20.691114 19627 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:20.691452 19833 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.692901 19707 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:20.694047 19707 raft_consensus.cc:697] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:20.695019 19707 consensus_queue.cc:237] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.702039 19822 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.706331 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:20.706952 19511 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.707700 19703 tablet_bootstrap.cc:492] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:20.708190 19703 ts_tablet_manager.cc:1403] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.132s	user 0.013s	sys 0.004s
I20260709 13:17:20.711580 19701 raft_consensus.cc:359] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.713979 19701 raft_consensus.cc:385] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.714267 19701 raft_consensus.cc:740] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.715188 19701 consensus_queue.cc:260] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.717765 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:20.718357 19587 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.718999 19701 ts_tablet_manager.cc:1434] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.001s
I20260709 13:17:20.719801 19701 tablet_bootstrap.cc:492] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:20.717799 19838 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.715318 19822 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:20.725077 19703 raft_consensus.cc:359] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.725584 19703 raft_consensus.cc:385] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.725945 19703 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.731516 19703 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.729894 19781 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.732805 19509 raft_consensus.cc:2393] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 1: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:20.732587 19781 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.738894 19781 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:20.738554 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:20.738617 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:20.741133 19587 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
W20260709 13:17:20.741762 19476 leader_election.cc:343] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:20.742604 19478 leader_election.cc:343] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.743046 19478 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:20.744674 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:20.747370 19703 ts_tablet_manager.cc:1434] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:17:20.747579 19707 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:20.748062 19707 raft_consensus.cc:697] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:20.748342 19703 tablet_bootstrap.cc:492] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:20.749671 19781 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:20.748875 19707 consensus_queue.cc:237] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.755821 19511 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:20.757355 19798 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.758245 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:20.761191 19838 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:20.761782 19587 raft_consensus.cc:2393] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 1: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:20.762804 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:20.768788 19478 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:20.770942 19781 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:20.787442 19703 tablet_bootstrap.cc:654] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.787442 19701 tablet_bootstrap.cc:654] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.789089 19833 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.797204 19409 catalog_manager.cc:5697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:20.801435 19702 tablet_bootstrap.cc:492] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:20.802166 19702 ts_tablet_manager.cc:1403] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.302s	user 0.031s	sys 0.023s
I20260709 13:17:20.805918 19702 raft_consensus.cc:359] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.806612 19702 raft_consensus.cc:385] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.806862 19702 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.807765 19702 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.810201 19702 ts_tablet_manager.cc:1434] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:20.811654 19702 tablet_bootstrap.cc:492] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:20.824642 19822 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:17:20.840811 19478 consensus_peers.cc:597] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:20.859776 19703 tablet_bootstrap.cc:492] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:20.860530 19703 ts_tablet_manager.cc:1403] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.112s	user 0.015s	sys 0.024s
I20260709 13:17:20.880631 19701 tablet_bootstrap.cc:492] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:20.881148 19701 ts_tablet_manager.cc:1403] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.161s	user 0.015s	sys 0.000s
I20260709 13:17:20.882248 19838 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:20.884037 19701 raft_consensus.cc:359] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.884712 19701 raft_consensus.cc:385] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.884974 19701 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.885661 19701 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.888365 19703 raft_consensus.cc:359] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.894317 19703 raft_consensus.cc:385] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.894728 19703 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.897714 19701 ts_tablet_manager.cc:1434] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:17:20.899739 19701 tablet_bootstrap.cc:492] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:20.905859 19703 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.912181 19838 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.912786 19701 tablet_bootstrap.cc:654] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.912724 19838 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.920306 19703 ts_tablet_manager.cc:1434] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.059s	user 0.010s	sys 0.001s
I20260709 13:17:20.921739 19703 tablet_bootstrap.cc:492] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:20.940081 19702 tablet_bootstrap.cc:654] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.958611 19832 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.959358 19836 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.959172 19832 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.962834 19836 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:20.964998 19836 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:20.984393 19838 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:20.984620 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:20.987962 19478 leader_election.cc:343] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.988771 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:20.989876 19587 raft_consensus.cc:2393] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 1: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:17:20.980852 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 47751.8us
I20260709 13:17:20.996235 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:20.996260 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:20.998075 19476 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:20.999090 19734 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.004397 19407 catalog_manager.cc:5697] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:21.007318 19407 catalog_manager.cc:5697] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:21.008425 19551 leader_election.cc:343] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:21.008973 19407 catalog_manager.cc:5697] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:21.008064 19703 tablet_bootstrap.cc:654] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.011248 19832 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:21.006088 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:21.014369 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:17:21.018959 19551 leader_election.cc:343] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:21.019451 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:21.020331 19836 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:21.017515 19734 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:21.021546 19476 leader_election.cc:343] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:21.022085 19476 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:21.023141 19701 tablet_bootstrap.cc:492] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:21.023221 19734 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:21.023728 19701 ts_tablet_manager.cc:1403] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.124s	user 0.010s	sys 0.005s
I20260709 13:17:21.031129 19702 tablet_bootstrap.cc:492] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:21.031675 19702 ts_tablet_manager.cc:1403] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.220s	user 0.007s	sys 0.020s
I20260709 13:17:21.030207 19701 raft_consensus.cc:359] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.033051 19701 raft_consensus.cc:385] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.033344 19701 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.034035 19701 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.039606 19701 ts_tablet_manager.cc:1434] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:17:21.041785 19702 raft_consensus.cc:359] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.042537 19702 raft_consensus.cc:385] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.042814 19702 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.041139 19701 tablet_bootstrap.cc:492] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:21.044281 19702 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.044283 19870 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:21.047240 19703 tablet_bootstrap.cc:492] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:21.048593 19703 ts_tablet_manager.cc:1403] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.127s	user 0.022s	sys 0.007s
I20260709 13:17:21.054201 19701 tablet_bootstrap.cc:654] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.056350 19703 raft_consensus.cc:359] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.057876 19703 raft_consensus.cc:385] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.056398 19702 ts_tablet_manager.cc:1434] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 13:17:21.058279 19703 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.059064 19702 tablet_bootstrap.cc:492] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:21.059000 19703 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.061972 19836 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.062418 19836 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.063411 19703 ts_tablet_manager.cc:1434] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:17:21.064429 19836 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:21.064857 19703 tablet_bootstrap.cc:492] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:21.066414 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:21.066948 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:21.067060 19661 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:21.068306 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:17:21.069175 19551 leader_election.cc:343] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:21.070080 19836 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:21.070605 19836 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.071008 19836 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.073330 19703 tablet_bootstrap.cc:654] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.079258 19836 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.081976 19701 tablet_bootstrap.cc:492] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:21.095781 19701 ts_tablet_manager.cc:1403] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.000s
I20260709 13:17:21.098520 19701 raft_consensus.cc:359] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.099225 19701 raft_consensus.cc:385] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.099481 19701 raft_consensus.cc:740] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.100139 19701 consensus_queue.cc:260] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.085453 19703 tablet_bootstrap.cc:492] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:21.101922 19703 ts_tablet_manager.cc:1403] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 13:17:21.104553 19703 raft_consensus.cc:359] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.105227 19703 raft_consensus.cc:385] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.106284 19701 ts_tablet_manager.cc:1434] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:21.107208 19701 tablet_bootstrap.cc:492] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
W20260709 13:17:21.113073 19441 debug-util.cc:398] Leaking SignalData structure 0x7b0800064380 after lost signal to thread 18417
W20260709 13:17:21.114110 19441 debug-util.cc:398] Leaking SignalData structure 0x7b0800064a60 after lost signal to thread 19444
I20260709 13:17:21.114579 19836 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:21.105496 19703 raft_consensus.cc:740] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
W20260709 13:17:21.115267 19441 debug-util.cc:398] Leaking SignalData structure 0x7b0800221400 after lost signal to thread 19536
I20260709 13:17:21.115721 19703 consensus_queue.cc:260] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:21.116396 19441 debug-util.cc:398] Leaking SignalData structure 0x7b0800220b60 after lost signal to thread 19611
W20260709 13:17:21.117511 19441 debug-util.cc:398] Leaking SignalData structure 0x7b0800029980 after lost signal to thread 19685
I20260709 13:17:21.118184 19703 ts_tablet_manager.cc:1434] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:17:21.119196 19703 tablet_bootstrap.cc:492] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:21.113071 19701 tablet_bootstrap.cc:654] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.119676 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:21.122368 19661 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.127192 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:21.130154 19661 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:21.131637 19702 tablet_bootstrap.cc:654] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:21.130147 19551 leader_election.cc:343] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:21.134047 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:21.137288 19833 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:21.137817 19833 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:21.138633 19833 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.148837 19822 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:21.153565 19703 tablet_bootstrap.cc:654] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.163407 19836 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.164124 19836 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.166426 19836 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:21.167280 19701 tablet_bootstrap.cc:492] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:21.167984 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:21.168259 19701 ts_tablet_manager.cc:1403] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.005s
I20260709 13:17:21.168720 19661 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:21.169134 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:21.170140 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:21.170212 19510 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:21.171592 19836 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:21.175554 19822 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:21.181984 19701 raft_consensus.cc:359] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.174458 19836 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.185765 19701 raft_consensus.cc:385] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.186321 19701 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.187718 19836 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.211140 19702 tablet_bootstrap.cc:492] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:21.212116 19702 ts_tablet_manager.cc:1403] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.153s	user 0.016s	sys 0.002s
I20260709 13:17:21.212612 19822 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:21.217212 19822 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:21.218271 19701 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.221885 19703 tablet_bootstrap.cc:492] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:21.216956 19702 raft_consensus.cc:359] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.222718 19702 raft_consensus.cc:385] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.222815 19703 ts_tablet_manager.cc:1403] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.104s	user 0.022s	sys 0.028s
I20260709 13:17:21.223382 19702 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.228981 19702 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.237990 19701 ts_tablet_manager.cc:1434] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.003s
I20260709 13:17:21.239086 19701 tablet_bootstrap.cc:492] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:21.240852 19409 catalog_manager.cc:5697] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:21.246318 19702 ts_tablet_manager.cc:1434] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.004s
I20260709 13:17:21.248121 19702 tablet_bootstrap.cc:492] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:21.263680 19836 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.266645 19703 raft_consensus.cc:359] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.267386 19703 raft_consensus.cc:385] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.267660 19703 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.268334 19703 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.277072 19836 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:21.279032 19701 tablet_bootstrap.cc:654] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.279554 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:21.281376 19661 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.282490 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:21.283118 19511 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.286495 19703 ts_tablet_manager.cc:1434] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 13:17:21.287339 19703 tablet_bootstrap.cc:492] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:21.306087 19661 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:21.307389 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:21.308265 19836 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:21.308949 19836 raft_consensus.cc:697] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:21.310765 19836 consensus_queue.cc:237] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.313057 19511 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:21.313422 19870 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:21.330327 19702 tablet_bootstrap.cc:654] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.331745 19703 tablet_bootstrap.cc:654] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.355795 19838 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.356346 19838 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.359647 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:21.361223 19409 catalog_manager.cc:5697] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:21.364010 19476 leader_election.cc:343] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:21.362113 19838 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:21.366238 19583 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.372889 19701 tablet_bootstrap.cc:492] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:21.377345 19701 ts_tablet_manager.cc:1403] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.135s	user 0.018s	sys 0.006s
I20260709 13:17:21.382088 19701 raft_consensus.cc:359] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.382849 19701 raft_consensus.cc:385] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.383141 19701 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.383817 19701 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.398144 19701 ts_tablet_manager.cc:1434] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:17:21.399106 19701 tablet_bootstrap.cc:492] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:21.414968 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:21.415673 19587 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:21.418998 19478 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:21.420106 19838 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:21.420485 19838 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.420815 19838 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.428378 19832 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.428897 19832 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.429738 19702 tablet_bootstrap.cc:492] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:21.430294 19702 ts_tablet_manager.cc:1403] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.182s	user 0.025s	sys 0.022s
I20260709 13:17:21.431447 19701 tablet_bootstrap.cc:654] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.432399 19703 tablet_bootstrap.cc:492] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:21.432968 19703 ts_tablet_manager.cc:1403] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.146s	user 0.019s	sys 0.023s
I20260709 13:17:21.433775 19832 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:21.436151 19703 raft_consensus.cc:359] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.436816 19703 raft_consensus.cc:385] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.436967 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:17:21.438261 19476 leader_election.cc:343] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:21.439250 19838 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.441260 19838 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:21.441118 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:21.443495 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:17:21.444731 19476 leader_election.cc:343] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:21.437124 19703 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
W20260709 13:17:21.445884 19478 leader_election.cc:343] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:21.446321 19478 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:21.446125 19703 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.447122 19838 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:21.449060 19703 ts_tablet_manager.cc:1434] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 13:17:21.449971 19703 tablet_bootstrap.cc:492] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:21.453248 19702 raft_consensus.cc:359] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.454247 19702 raft_consensus.cc:385] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.454586 19702 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.456053 19702 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.462085 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:21.462749 19587 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:21.472563 19458 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:21.462090 19838 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.480019 19838 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.483723 19702 ts_tablet_manager.cc:1434] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:17:21.491631 19587 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:21.493429 19478 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:21.494074 19838 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:21.494568 19832 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:21.495780 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:21.496084 19702 tablet_bootstrap.cc:492] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:21.496394 19661 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:21.497601 19870 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.498039 19870 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.500312 19870 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:21.501386 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:21.502270 19832 raft_consensus.cc:697] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:21.501349 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:21.503074 19625 leader_election.cc:343] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:21.503343 19586 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:21.503173 19832 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.503906 19703 tablet_bootstrap.cc:654] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.504570 19627 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:21.501698 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:21.505946 19838 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:21.506510 19838 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.506609 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:21.507261 19838 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.507936 19870 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:21.510565 19870 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.510751 19587 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:21.510983 19870 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.522550 19701 tablet_bootstrap.cc:492] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:21.523128 19701 ts_tablet_manager.cc:1403] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.124s	user 0.027s	sys 0.032s
I20260709 13:17:21.522696 19838 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.524070 19707 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.530234 19707 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.532903 19707 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:21.535141 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:21.536127 19658 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.538069 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:21.537678 19701 raft_consensus.cc:359] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.538667 19586 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.538671 19701 raft_consensus.cc:385] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.539240 19701 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.540321 19701 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.543241 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:21.543905 19511 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:21.544950 19658 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:21.546092 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:21.546255 19833 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:21.546926 19734 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.546363 19407 catalog_manager.cc:5697] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 0 to 1, leader changed from <none> to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:21.547341 19734 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.549413 19734 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:21.550506 19625 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:21.534588 19838 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:21.551777 19707 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:21.551925 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:21.552183 19707 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.552124 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:21.552575 19587 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:21.552707 19707 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:21.556205 19476 leader_election.cc:343] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:21.550927 19734 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:21.557526 19734 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:21.558724 19734 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.566785 19701 ts_tablet_manager.cc:1434] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:17:21.563817 19870 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.568288 19701 tablet_bootstrap.cc:492] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:21.573408 19703 tablet_bootstrap.cc:492] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:21.573894 19703 ts_tablet_manager.cc:1403] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.124s	user 0.026s	sys 0.022s
I20260709 13:17:21.566780 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:21.586480 19478 leader_election.cc:343] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:21.586939 19478 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:21.595731 19511 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.590214 19832 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:21.597581 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:17:21.599150 19625 leader_election.cc:343] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:21.601318 19702 tablet_bootstrap.cc:654] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.601084 19707 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.602815 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:21.604243 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:21.607944 19510 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.601105 19870 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:21.614142 19587 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.607005 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:21.614970 19583 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.605532 19707 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:21.626132 19703 raft_consensus.cc:359] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.627383 19703 raft_consensus.cc:385] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.627660 19703 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.621582 19510 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:21.624972 19586 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:21.628451 19703 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.629743 19625 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:21.632716 19870 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:21.633196 19870 raft_consensus.cc:697] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:21.633994 19870 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.634923 19583 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:21.641561 19703 ts_tablet_manager.cc:1434] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.067s	user 0.003s	sys 0.004s
I20260709 13:17:21.643455 19703 tablet_bootstrap.cc:492] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:21.644238 19701 tablet_bootstrap.cc:654] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.645658 19836 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:21.653460 19407 catalog_manager.cc:5697] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 0 to 1, leader changed from <none> to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:21.665678 19836 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.666193 19836 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.673043 19587 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:21.674535 19627 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:21.674197 19409 catalog_manager.cc:5697] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:21.675966 19707 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:21.676575 19707 raft_consensus.cc:697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:21.677078 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:21.677563 19707 consensus_queue.cc:237] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.677129 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:21.679721 19551 leader_election.cc:343] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:21.680518 19551 leader_election.cc:343] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:21.680933 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:21.681712 19833 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:21.668551 19836 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:21.714131 19702 tablet_bootstrap.cc:492] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:21.717787 19703 tablet_bootstrap.cc:654] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.718556 19702 ts_tablet_manager.cc:1403] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.223s	user 0.017s	sys 0.024s
I20260709 13:17:21.734015 19702 raft_consensus.cc:359] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.737249 19702 raft_consensus.cc:385] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.738122 19702 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.739806 19409 catalog_manager.cc:5697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:21.740999 19835 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:21.746129 19702 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.752960 19701 tablet_bootstrap.cc:492] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:21.753468 19701 ts_tablet_manager.cc:1403] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.185s	user 0.019s	sys 0.005s
I20260709 13:17:21.754220 19702 ts_tablet_manager.cc:1434] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:17:21.755635 19702 tablet_bootstrap.cc:492] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:21.756595 19703 tablet_bootstrap.cc:492] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:21.757046 19703 ts_tablet_manager.cc:1403] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.114s	user 0.004s	sys 0.014s
I20260709 13:17:21.759758 19703 raft_consensus.cc:359] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.760447 19703 raft_consensus.cc:385] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.760752 19703 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.763687 19703 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.766489 19703 ts_tablet_manager.cc:1434] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:17:21.767470 19703 tablet_bootstrap.cc:492] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:21.774308 19702 tablet_bootstrap.cc:654] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.771746 19701 raft_consensus.cc:359] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.781303 19701 raft_consensus.cc:385] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.781649 19701 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.782289 19701 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.786751 19701 ts_tablet_manager.cc:1434] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:17:21.787665 19701 tablet_bootstrap.cc:492] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:21.787429 19835 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:21.799089 19701 tablet_bootstrap.cc:654] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.806134 19703 tablet_bootstrap.cc:654] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.810909 19701 tablet_bootstrap.cc:492] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:21.811409 19701 ts_tablet_manager.cc:1403] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.003s
I20260709 13:17:21.814041 19701 raft_consensus.cc:359] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.814682 19701 raft_consensus.cc:385] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.815099 19701 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.815737 19701 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.823786 19701 ts_tablet_manager.cc:1434] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:17:21.824797 19701 tablet_bootstrap.cc:492] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:21.825415 19835 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.842038 19835 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.845794 19835 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:21.846712 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:21.847822 19510 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:21.851532 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:21.851951 19703 tablet_bootstrap.cc:492] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:21.852420 19703 ts_tablet_manager.cc:1403] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.004s
I20260709 13:17:21.852398 19835 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:21.852963 19835 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.853497 19835 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.855469 19702 tablet_bootstrap.cc:492] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:21.852732 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:21.855955 19702 ts_tablet_manager.cc:1403] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.101s	user 0.020s	sys 0.040s
W20260709 13:17:21.857604 19551 leader_election.cc:343] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:21.857990 19703 raft_consensus.cc:359] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.858677 19703 raft_consensus.cc:385] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.858959 19703 raft_consensus.cc:740] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.858850 19702 raft_consensus.cc:359] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.859637 19702 raft_consensus.cc:385] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.859965 19702 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.859767 19703 consensus_queue.cc:260] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.861857 19703 ts_tablet_manager.cc:1434] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:21.862463 19701 tablet_bootstrap.cc:654] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.863153 19703 tablet_bootstrap.cc:492] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:21.865365 19702 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.870839 19702 ts_tablet_manager.cc:1434] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:17:21.873157 19798 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.873894 19798 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.888275 19702 tablet_bootstrap.cc:492] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:21.891906 19701 tablet_bootstrap.cc:492] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:21.894556 19702 tablet_bootstrap.cc:654] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.895737 19701 ts_tablet_manager.cc:1403] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.002s
I20260709 13:17:21.899780 19703 tablet_bootstrap.cc:654] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.904131 19701 raft_consensus.cc:359] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.905386 19701 raft_consensus.cc:385] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.905731 19701 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.906523 19701 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.909041 19701 ts_tablet_manager.cc:1434] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:17:21.910166 19701 tablet_bootstrap.cc:492] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:21.915005 19661 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.922139 19701 tablet_bootstrap.cc:654] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.924665 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:21.925804 19798 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:21.926151 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:21.927241 19587 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 1: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:21.927349 19734 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.928037 19734 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.929533 19627 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:21.932358 19734 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:21.932647 19701 tablet_bootstrap.cc:492] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:21.934192 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:21.934544 19701 ts_tablet_manager.cc:1403] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 13:17:21.934192 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:21.935745 19587 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:21.936913 19478 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:21.937816 19701 raft_consensus.cc:359] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:21.938223 19476 leader_election.cc:343] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:21.938527 19701 raft_consensus.cc:385] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.938791 19701 raft_consensus.cc:740] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.939486 19734 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:21.939441 19701 consensus_queue.cc:260] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.939909 19734 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.940325 19734 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.942843 19838 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:21.951568 19702 tablet_bootstrap.cc:492] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:21.952358 19702 ts_tablet_manager.cc:1403] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.064s	user 0.024s	sys 0.030s
I20260709 13:17:21.953447 19734 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.958251 19734 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:21.959678 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:21.960366 19583 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.961117 19702 raft_consensus.cc:359] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.962332 19702 raft_consensus.cc:385] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.962613 19702 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.963376 19702 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.963635 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:21.965312 19702 ts_tablet_manager.cc:1434] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
W20260709 13:17:21.965432 19476 leader_election.cc:343] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:21.966224 19702 tablet_bootstrap.cc:492] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:21.967574 19583 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:21.968595 19478 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:21.969403 19838 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:21.970252 19838 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:21.971376 19838 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:21.972886 19702 tablet_bootstrap.cc:654] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.974291 19701 ts_tablet_manager.cc:1434] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:17:21.975325 19701 tablet_bootstrap.cc:492] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:21.982302 19798 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:21.893433 19835 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.094354 19701 tablet_bootstrap.cc:700] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Time spent opening tablet: real 0.104s	user 0.010s	sys 0.012s
I20260709 13:17:22.097232 19701 tablet_bootstrap.cc:654] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.100844 19832 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.101385 19832 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.114452 19832 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:22.124856 19703 tablet_bootstrap.cc:492] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:22.125361 19703 ts_tablet_manager.cc:1403] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.262s	user 0.042s	sys 0.027s
I20260709 13:17:22.126941 19409 catalog_manager.cc:5697] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 0 to 1, leader changed from <none> to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:22.134397 19832 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.144084 19832 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.155452 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:22.156370 19510 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:22.158140 19734 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:22.159621 19835 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:22.159668 19734 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:22.165952 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:22.166594 19661 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:22.167549 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:22.168359 19583 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 1: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:22.170043 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:22.171018 19587 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:22.194190 19707 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.198812 19707 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.211609 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:22.215195 19832 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:22.221586 19478 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:22.234912 19734 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:22.235473 19734 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.235935 19734 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:22.243000 19702 tablet_bootstrap.cc:492] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:22.243096 19703 raft_consensus.cc:359] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.252907 19703 raft_consensus.cc:385] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:22.255306 19701 tablet_bootstrap.cc:492] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:22.253262 19703 raft_consensus.cc:740] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.256374 19703 consensus_queue.cc:260] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.257184 19701 ts_tablet_manager.cc:1403] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.282s	user 0.029s	sys 0.016s
I20260709 13:17:22.253154 19702 ts_tablet_manager.cc:1403] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.287s	user 0.029s	sys 0.060s
I20260709 13:17:22.261374 19703 ts_tablet_manager.cc:1434] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.136s	user 0.014s	sys 0.011s
I20260709 13:17:22.262706 19707 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:22.266373 19870 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:22.266901 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:22.267886 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:22.270783 19510 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:22.273742 19916 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:22.274701 19661 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:22.277205 19703 tablet_bootstrap.cc:492] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:22.278715 19917 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:17:22.295228 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:22.281394 19587 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:22.303310 19701 raft_consensus.cc:359] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.304068 19701 raft_consensus.cc:385] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:22.304327 19701 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.304935 19701 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.306967 19627 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:22.307828 19707 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:22.308167 19707 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.308331 19703 tablet_bootstrap.cc:654] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.308555 19707 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:22.317365 19701 ts_tablet_manager.cc:1434] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.007s
I20260709 13:17:22.323661 19915 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:22.327389 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:22.329805 19915 raft_consensus.cc:697] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:22.330940 19702 raft_consensus.cc:359] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.331961 19702 raft_consensus.cc:385] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:22.332259 19702 raft_consensus.cc:740] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
W20260709 13:17:22.310720 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 44016.1us
I20260709 13:17:22.338224 19702 consensus_queue.cc:260] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.330850 19915 consensus_queue.cc:237] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.340721 19707 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.344106 19707 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:22.346124 19702 ts_tablet_manager.cc:1434] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
W20260709 13:17:22.347572 19625 leader_election.cc:343] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.349892 19511 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:22.351034 19734 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.353109 19734 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:22.353190 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:22.355645 19702 tablet_bootstrap.cc:492] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:22.373334 19476 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:22.364133 19924 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:22.387984 19476 leader_election.cc:343] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.389597 19832 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:17:22.392066 19625 leader_election.cc:343] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.393198 19920 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:22.386508 19924 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.397171 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:22.397867 19584 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:22.397686 19917 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:22.400877 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:22.407724 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:22.410353 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:22.412741 19701 tablet_bootstrap.cc:492] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:22.406090 19924 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:22.421895 19582 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:22.439708 19625 leader_election.cc:343] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:22.454205 19476 leader_election.cc:343] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.456941 19702 tablet_bootstrap.cc:654] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.463915 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:22.475932 19627 leader_election.cc:343] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.476490 19627 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:22.480379 19917 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:22.489044 19407 catalog_manager.cc:5697] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:22.497365 19703 tablet_bootstrap.cc:492] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:22.497957 19703 ts_tablet_manager.cc:1403] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.221s	user 0.034s	sys 0.041s
W20260709 13:17:22.490417 19476 consensus_peers.cc:597] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 -> Peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Couldn't send request to peer e19c80e9149b4b8d88ae13bde8e43864. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:22.527293 19582 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:22.527443 19703 raft_consensus.cc:359] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.528059 19702 tablet_bootstrap.cc:492] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:22.528213 19703 raft_consensus.cc:385] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:22.532866 19703 raft_consensus.cc:740] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.532975 19702 ts_tablet_manager.cc:1403] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.178s	user 0.010s	sys 0.013s
I20260709 13:17:22.533604 19703 consensus_queue.cc:260] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.534902 19584 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:22.536118 19703 ts_tablet_manager.cc:1434] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:17:22.537101 19703 tablet_bootstrap.cc:492] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:22.536989 19478 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:22.537950 19627 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:22.539332 19917 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:22.539805 19917 raft_consensus.cc:697] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:22.540443 19917 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.541055 19734 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:22.542484 19734 raft_consensus.cc:697] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:22.545356 19832 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:22.547953 19931 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:17:22.543412 19734 consensus_queue.cc:237] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:22.625921 19458 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:22.635577 19703 tablet_bootstrap.cc:654] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.553073 19702 raft_consensus.cc:359] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.638181 19702 raft_consensus.cc:385] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:22.640182 19701 tablet_bootstrap.cc:654] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.640482 19702 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.645305 19833 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.646318 19833 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.649358 19833 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:22.642052 19702 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.656055 19836 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.656710 19836 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.670056 19702 ts_tablet_manager.cc:1434] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.137s	user 0.010s	sys 0.012s
I20260709 13:17:22.699499 19836 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:22.704774 19702 tablet_bootstrap.cc:492] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:22.711310 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:22.695964 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:22.683408 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:22.714258 19509 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:22.725005 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:17:22.742230 19551 leader_election.cc:343] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:22.743039 19551 leader_election.cc:343] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.743573 19701 tablet_bootstrap.cc:492] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:22.744181 19701 ts_tablet_manager.cc:1403] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.332s	user 0.013s	sys 0.007s
I20260709 13:17:22.742419 19703 tablet_bootstrap.cc:492] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:22.745215 19734 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.745975 19734 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:22.748224 19551 leader_election.cc:343] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.748699 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:22.748507 19701 raft_consensus.cc:359] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.749352 19701 raft_consensus.cc:385] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:22.749686 19701 raft_consensus.cc:740] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.749696 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:22.750583 19701 consensus_queue.cc:260] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:22.751718 19478 leader_election.cc:343] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.745394 19703 ts_tablet_manager.cc:1403] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.208s	user 0.021s	sys 0.012s
I20260709 13:17:22.752260 19701 ts_tablet_manager.cc:1434] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:17:22.754812 19836 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:22.757398 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:17:22.759469 19476 leader_election.cc:343] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.760071 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:22.761050 19734 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:22.761909 19922 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:22.762290 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:22.769228 19409 catalog_manager.cc:5697] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:22.763881 19703 raft_consensus.cc:359] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.771181 19703 raft_consensus.cc:385] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:22.771498 19703 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.772284 19835 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:22.772780 19835 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.773322 19835 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:22.773744 19701 tablet_bootstrap.cc:492] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:22.788009 19703 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.797044 19407 catalog_manager.cc:5697] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 0 to 1, leader changed from <none> to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:22.803071 19835 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.817055 19836 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:22.820129 19701 tablet_bootstrap.cc:654] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.823848 19702 tablet_bootstrap.cc:654] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.848249 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:22.848914 19511 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:22.846786 19835 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:22.854658 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:22.857903 19511 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:22.861135 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:22.862370 19835 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:22.862509 19551 leader_election.cc:343] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.862937 19835 raft_consensus.cc:697] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:22.863977 19835 consensus_queue.cc:237] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.867882 19940 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.868402 19940 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.871296 19940 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:22.874327 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:22.875159 19660 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:22.876289 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:22.876924 19511 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:22.876871 19940 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:22.879135 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:22.882105 19940 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:22.882318 19703 ts_tablet_manager.cc:1434] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.130s	user 0.004s	sys 0.020s
I20260709 13:17:22.882638 19940 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.883093 19940 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:22.884753 19701 tablet_bootstrap.cc:492] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:22.885269 19701 ts_tablet_manager.cc:1403] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.112s	user 0.016s	sys 0.004s
I20260709 13:17:22.888294 19701 raft_consensus.cc:359] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.889024 19701 raft_consensus.cc:385] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:22.889294 19701 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.892412 19701 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.895051 19701 ts_tablet_manager.cc:1434] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:17:22.896287 19701 tablet_bootstrap.cc:492] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:22.898324 19703 tablet_bootstrap.cc:492] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:22.900331 19408 catalog_manager.cc:5697] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:22.901877 19940 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.914673 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:22.915344 19507 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:22.907176 19702 tablet_bootstrap.cc:492] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:22.921188 19702 ts_tablet_manager.cc:1403] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.217s	user 0.013s	sys 0.010s
I20260709 13:17:22.922613 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:22.923331 19657 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:22.933568 19832 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.934098 19832 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.934283 19702 raft_consensus.cc:359] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.935343 19702 raft_consensus.cc:385] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:22.935670 19702 raft_consensus.cc:740] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.936324 19832 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:22.936437 19702 consensus_queue.cc:260] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:22.938355 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:22.940043 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:22.940313 19476 leader_election.cc:343] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:22.942035 19478 leader_election.cc:343] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.941906 19734 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:22.942504 19478 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:22.943310 19734 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:22.944284 19940 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:22.946408 19702 ts_tablet_manager.cc:1434] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:17:22.946357 19657 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:22.946707 19507 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:22.947767 19702 tablet_bootstrap.cc:492] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:22.947772 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:22.949913 19943 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:22.950424 19943 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:22.953197 19701 tablet_bootstrap.cc:654] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.979254 19702 tablet_bootstrap.cc:654] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.951753 19943 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:22.986027 19625 consensus_peers.cc:597] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:22.989884 19703 tablet_bootstrap.cc:654] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:23.013909 19476 consensus_peers.cc:597] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 -> Peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Couldn't send request to peer e19c80e9149b4b8d88ae13bde8e43864. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:23.029064 19701 tablet_bootstrap.cc:492] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:23.029573 19701 ts_tablet_manager.cc:1403] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.134s	user 0.016s	sys 0.007s
I20260709 13:17:23.033160 19701 raft_consensus.cc:359] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.033905 19701 raft_consensus.cc:385] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.034166 19701 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.034813 19701 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.034744 19407 catalog_manager.cc:5697] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:23.041302 19870 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.041790 19870 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.043912 19870 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:23.048828 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:23.050463 19625 leader_election.cc:343] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.051944 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:23.052644 19584 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:23.040827 19701 ts_tablet_manager.cc:1434] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:17:23.057363 19701 tablet_bootstrap.cc:492] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:23.055570 19702 tablet_bootstrap.cc:492] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:23.059350 19702 ts_tablet_manager.cc:1403] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.112s	user 0.022s	sys 0.015s
I20260709 13:17:23.061228 19627 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:23.062613 19870 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:23.063005 19870 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.063369 19870 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.065582 19702 raft_consensus.cc:359] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.069129 19702 raft_consensus.cc:385] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.069485 19702 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.070286 19702 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.072531 19702 ts_tablet_manager.cc:1434] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:17:23.073518 19702 tablet_bootstrap.cc:492] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:23.068835 19701 tablet_bootstrap.cc:654] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.088258 19870 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.091071 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:17:23.092475 19625 leader_election.cc:343] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.093081 19870 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:23.097640 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:23.098276 19584 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.098608 19702 tablet_bootstrap.cc:654] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.101325 19703 tablet_bootstrap.cc:492] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:23.101883 19703 ts_tablet_manager.cc:1403] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.204s	user 0.011s	sys 0.023s
I20260709 13:17:23.105321 19703 raft_consensus.cc:359] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.106206 19703 raft_consensus.cc:385] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.106489 19703 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.107197 19703 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.112660 19703 ts_tablet_manager.cc:1434] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:17:23.125344 19832 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.126266 19701 tablet_bootstrap.cc:492] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:23.125893 19832 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.126757 19701 ts_tablet_manager.cc:1403] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.003s
I20260709 13:17:23.128233 19702 tablet_bootstrap.cc:492] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:23.128705 19702 ts_tablet_manager.cc:1403] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.000s
I20260709 13:17:23.129601 19832 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:23.130257 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:23.130831 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:23.131680 19476 leader_election.cc:343] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.132117 19584 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
W20260709 13:17:23.132285 19478 leader_election.cc:343] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.141907 19478 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:23.133641 19870 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:23.135468 19703 tablet_bootstrap.cc:492] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:23.143016 19627 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:23.144063 19870 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:23.144632 19870 raft_consensus.cc:697] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:23.145515 19870 consensus_queue.cc:237] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.138135 19701 raft_consensus.cc:359] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.147876 19701 raft_consensus.cc:385] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.148056 19832 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:23.148278 19701 raft_consensus.cc:740] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.149235 19701 consensus_queue.cc:260] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.151525 19701 ts_tablet_manager.cc:1434] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:17:23.138983 19702 raft_consensus.cc:359] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.152931 19702 raft_consensus.cc:385] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.153231 19702 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.153996 19702 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.158512 19701 tablet_bootstrap.cc:492] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:23.163393 19703 tablet_bootstrap.cc:654] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.157406 19702 ts_tablet_manager.cc:1434] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:17:23.166970 19702 tablet_bootstrap.cc:492] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:23.171826 19408 catalog_manager.cc:5697] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:23.173147 19701 tablet_bootstrap.cc:654] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.173482 19702 tablet_bootstrap.cc:654] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.191565 19701 tablet_bootstrap.cc:492] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:23.192085 19701 ts_tablet_manager.cc:1403] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.004s
I20260709 13:17:23.194939 19701 raft_consensus.cc:359] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.195761 19701 raft_consensus.cc:385] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.196084 19701 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.196599 19702 tablet_bootstrap.cc:492] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:23.197207 19702 ts_tablet_manager.cc:1403] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.009s
I20260709 13:17:23.196839 19701 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.200630 19702 raft_consensus.cc:359] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.206243 19702 raft_consensus.cc:385] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.206646 19702 raft_consensus.cc:740] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.207449 19702 consensus_queue.cc:260] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.212033 19701 ts_tablet_manager.cc:1434] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:17:23.218080 19702 ts_tablet_manager.cc:1434] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 13:17:23.219090 19703 tablet_bootstrap.cc:492] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:23.219602 19702 tablet_bootstrap.cc:492] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:23.219630 19703 ts_tablet_manager.cc:1403] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.098s	user 0.016s	sys 0.004s
I20260709 13:17:23.222867 19703 raft_consensus.cc:359] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.223645 19703 raft_consensus.cc:385] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.223958 19703 raft_consensus.cc:740] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.224798 19703 consensus_queue.cc:260] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.225844 19701 tablet_bootstrap.cc:492] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:23.238274 19703 ts_tablet_manager.cc:1434] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:17:23.239492 19703 tablet_bootstrap.cc:492] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:23.240775 19701 tablet_bootstrap.cc:654] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.244370 19702 tablet_bootstrap.cc:654] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.245673 19703 tablet_bootstrap.cc:654] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.255102 19702 tablet_bootstrap.cc:492] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:23.255645 19702 ts_tablet_manager.cc:1403] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.036s	user 0.005s	sys 0.008s
I20260709 13:17:23.258625 19702 raft_consensus.cc:359] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.259433 19702 raft_consensus.cc:385] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.259716 19702 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.260967 19702 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.267105 19703 tablet_bootstrap.cc:492] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:23.267535 19702 ts_tablet_manager.cc:1434] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:17:23.267592 19703 ts_tablet_manager.cc:1403] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.011s
I20260709 13:17:23.271636 19702 tablet_bootstrap.cc:492] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:23.271997 19703 raft_consensus.cc:359] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.272735 19703 raft_consensus.cc:385] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.273021 19703 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.274125 19701 tablet_bootstrap.cc:492] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:23.273725 19703 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.274582 19701 ts_tablet_manager.cc:1403] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.003s
I20260709 13:17:23.276065 19703 ts_tablet_manager.cc:1434] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:23.277501 19703 tablet_bootstrap.cc:492] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:23.277259 19701 raft_consensus.cc:359] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.279037 19701 raft_consensus.cc:385] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.279330 19701 raft_consensus.cc:740] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.279994 19701 consensus_queue.cc:260] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.283420 19701 ts_tablet_manager.cc:1434] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:23.283916 19703 tablet_bootstrap.cc:654] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.285027 19701 tablet_bootstrap.cc:492] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:23.302109 19702 tablet_bootstrap.cc:654] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.324662 19703 tablet_bootstrap.cc:492] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:23.325165 19703 ts_tablet_manager.cc:1403] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.007s
I20260709 13:17:23.328058 19701 tablet_bootstrap.cc:654] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.328090 19703 raft_consensus.cc:359] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.328936 19703 raft_consensus.cc:385] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.329209 19703 raft_consensus.cc:740] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.329900 19703 consensus_queue.cc:260] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.332173 19703 ts_tablet_manager.cc:1434] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:17:23.333149 19703 tablet_bootstrap.cc:492] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
W20260709 13:17:23.334210 19551 consensus_peers.cc:597] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf -> Peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Couldn't send request to peer e19c80e9149b4b8d88ae13bde8e43864. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:23.335352 19940 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.335794 19940 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.339288 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:23.339983 19511 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:23.342432 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:23.346354 19943 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:23.346741 19940 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:23.346771 19943 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.347638 19943 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.350417 19832 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.351052 19832 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.353686 19832 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:23.356413 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:23.357132 19584 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:23.358947 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:23.366111 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:23.367552 19701 tablet_bootstrap.cc:492] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:23.367945 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:23.363700 19920 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:23.368254 19701 ts_tablet_manager.cc:1403] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.083s	user 0.019s	sys 0.004s
I20260709 13:17:23.368587 19703 tablet_bootstrap.cc:654] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:23.371114 19551 leader_election.cc:343] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:23.370864 19476 leader_election.cc:343] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.370183 19920 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.374019 19920 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.381705 19657 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.382362 19701 raft_consensus.cc:359] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.383673 19701 raft_consensus.cc:385] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.383989 19701 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.369354 19943 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.391520 19943 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:23.396303 19701 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.397269 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:23.397835 19832 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.398582 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:23.398402 19832 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:23.399986 19551 leader_election.cc:343] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.399811 19920 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.397970 19507 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.402333 19832 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:23.403337 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:23.425107 19920 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:23.404332 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:23.422335 19832 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.447870 19835 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:23.426715 19701 ts_tablet_manager.cc:1434] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.002s
I20260709 13:17:23.424480 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:23.458374 19832 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.463043 19940 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.463642 19832 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:23.463546 19940 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.444768 19507 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:23.467020 19924 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.467527 19924 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.468755 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:23.470580 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:23.471101 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:23.471356 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:23.471995 19659 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:23.472165 19835 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:23.472611 19625 leader_election.cc:343] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.414052 19943 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.472647 19835 raft_consensus.cc:697] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:17:23.450060 19476 leader_election.cc:343] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.450208 19703 tablet_bootstrap.cc:492] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:23.459677 19701 tablet_bootstrap.cc:492] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:23.438097 19702 tablet_bootstrap.cc:492] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:23.486642 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:23.487035 19702 ts_tablet_manager.cc:1403] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.219s	user 0.016s	sys 0.037s
I20260709 13:17:23.487365 19661 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:23.458393 19582 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.486677 19703 ts_tablet_manager.cc:1403] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.154s	user 0.013s	sys 0.003s
I20260709 13:17:23.489861 19702 raft_consensus.cc:359] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.490533 19702 raft_consensus.cc:385] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.490834 19702 raft_consensus.cc:740] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.491554 19702 consensus_queue.cc:260] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.492772 19703 raft_consensus.cc:359] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.493649 19702 ts_tablet_manager.cc:1434] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:17:23.473650 19943 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:23.493819 19478 leader_election.cc:343] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.465512 19940 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:23.476624 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:23.495642 19943 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:23.496376 19584 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:23.496822 19476 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:23.479854 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:23.501854 19943 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:17:23.502233 19551 leader_election.cc:343] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.502256 19943 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.503108 19943 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.504412 19701 tablet_bootstrap.cc:654] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.505208 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:23.505910 19661 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:23.507352 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:23.508070 19509 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:23.509539 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:23.510443 19940 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:23.510823 19940 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.511199 19940 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.514205 19832 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:23.514703 19832 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.515152 19832 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.515316 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:23.516363 19920 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:23.517916 19943 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.477085 19924 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:23.424854 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:23.497289 19702 tablet_bootstrap.cc:492] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
W20260709 13:17:23.517307 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 60693.4us
I20260709 13:17:23.520718 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:23.498180 19627 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:23.522012 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:23.522149 19551 leader_election.cc:343] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.522377 19870 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:23.522779 19870 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.523173 19870 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.525350 19920 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.525875 19920 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.527755 19940 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.528482 19920 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:23.528991 19584 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 1: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:23.533233 19702 tablet_bootstrap.cc:654] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.535650 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:23.538338 19478 leader_election.cc:343] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.539408 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:23.493408 19703 raft_consensus.cc:385] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.540198 19703 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.540280 19943 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:23.541191 19703 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.544085 19703 ts_tablet_manager.cc:1434] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 13:17:23.484468 19835 consensus_queue.cc:237] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.552838 19703 tablet_bootstrap.cc:492] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:23.531785 19870 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:23.549847 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51742.2us
I20260709 13:17:23.555361 19582 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
W20260709 13:17:23.567036 19476 leader_election.cc:343] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.569832 19970 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:23.570776 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:23.571483 19659 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:23.572218 19832 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.576207 19660 raft_consensus.cc:2393] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 1: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:23.576452 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:23.577224 19509 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 1: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:23.574594 19940 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:23.592876 19476 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:23.595274 19734 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:23.595654 19734 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.601452 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:23.602160 19659 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.602982 19701 tablet_bootstrap.cc:492] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:23.603487 19701 ts_tablet_manager.cc:1403] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.144s	user 0.009s	sys 0.013s
I20260709 13:17:23.603921 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:23.595983 19734 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.600843 19870 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:23.584218 19973 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:17:23.610961 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:23.611889 19583 raft_consensus.cc:2393] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 1: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:23.612370 19702 tablet_bootstrap.cc:492] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:23.612849 19702 ts_tablet_manager.cc:1403] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.116s	user 0.008s	sys 0.008s
I20260709 13:17:23.627135 19702 raft_consensus.cc:359] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.627866 19702 raft_consensus.cc:385] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.628139 19702 raft_consensus.cc:740] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.614044 19832 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:23.633009 19702 consensus_queue.cc:260] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.618639 19659 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:23.645116 19924 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.643474 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:23.649098 19924 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.649933 19658 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 1: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:23.651175 19656 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.652174 19409 catalog_manager.cc:5697] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:23.651226 19924 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:23.656199 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:23.657783 19832 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.658365 19832 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.660475 19832 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:23.660609 19968 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.202s	user 0.005s	sys 0.000s
I20260709 13:17:23.661712 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:23.666972 19703 tablet_bootstrap.cc:654] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.669064 19920 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:23.670409 19920 raft_consensus.cc:697] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:23.670977 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:23.671226 19920 consensus_queue.cc:237] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.672170 19973 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:23.672813 19973 raft_consensus.cc:697] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:23.675074 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:23.673650 19973 consensus_queue.cc:237] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.686156 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:23.681066 19943 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:23.689997 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:23.690311 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:23.692175 19702 ts_tablet_manager.cc:1434] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.079s	user 0.010s	sys 0.005s
I20260709 13:17:23.691784 19734 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.716192 19707 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.716696 19707 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.720352 19707 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:23.727821 19702 tablet_bootstrap.cc:492] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:23.728780 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:23.730188 19701 raft_consensus.cc:359] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.730823 19701 raft_consensus.cc:385] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.731092 19701 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.733835 19701 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.746071 19701 ts_tablet_manager.cc:1434] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.142s	user 0.007s	sys 0.002s
I20260709 13:17:23.763123 19701 tablet_bootstrap.cc:492] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:23.764855 19734 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:23.770814 19512 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.771096 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:23.751423 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 58714.3us
W20260709 13:17:23.775597 19476 leader_election.cc:343] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.783270 19703 tablet_bootstrap.cc:492] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:23.786864 19703 ts_tablet_manager.cc:1403] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.236s	user 0.014s	sys 0.029s
W20260709 13:17:23.788328 19975 log.cc:927] Time spent T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:17:23.795415 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:23.796027 19660 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.800727 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:23.803325 19625 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:23.805737 19870 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:23.810498 19660 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:23.822881 19409 catalog_manager.cc:5697] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:23.824844 19512 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:23.810710 19627 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:23.799099 19478 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:23.826495 19920 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:17:23.832497 19478 leader_election.cc:343] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.831314 19410 catalog_manager.cc:5697] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 0 to 1, leader changed from <none> to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:23.833741 19478 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:23.837352 19870 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:17:23.837500 19920 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:23.840619 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:23.836194 19701 tablet_bootstrap.cc:654] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.847899 19476 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:23.849747 19920 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:23.850186 19920 raft_consensus.cc:697] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:23.850941 19920 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:23.857712 19478 leader_election.cc:343] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.901588 19970 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.902426 19970 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.904881 19970 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:23.922302 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:23.923192 19507 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:23.923341 19661 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.905442 19625 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
W20260709 13:17:23.931699 19625 consensus_peers.cc:597] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:23.932909 19870 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:23.936805 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:23.933578 19870 raft_consensus.cc:697] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:23.951454 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:23.973044 19707 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.973824 19707 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:23.981921 19707 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:23.990868 19970 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:23.991978 19970 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.993713 19970 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.940742 19870 consensus_queue.cc:237] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.079288 19703 raft_consensus.cc:359] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.079772 19703 raft_consensus.cc:385] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.080016 19703 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.085495 19703 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:24.087095 19551 leader_election.cc:343] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.089308 19703 ts_tablet_manager.cc:1434] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.302s	user 0.024s	sys 0.016s
I20260709 13:17:24.090405 19703 tablet_bootstrap.cc:492] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:24.090653 19702 tablet_bootstrap.cc:654] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:24.078893 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 223065us
I20260709 13:17:24.102872 19409 catalog_manager.cc:5697] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 0 to 1, leader changed from <none> to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.104621 19924 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:24.119283 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:24.122964 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:24.135066 19703 tablet_bootstrap.cc:654] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:24.148716 19458 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:17:24.149186 19625 leader_election.cc:343] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.156629 19702 tablet_bootstrap.cc:492] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:24.157577 19701 tablet_bootstrap.cc:492] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:24.159379 19986 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:24.163101 19701 ts_tablet_manager.cc:1403] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.402s	user 0.007s	sys 0.016s
W20260709 13:17:24.175199 19990 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:17:24.198378 19627 leader_election.cc:343] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.198966 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:24.235311 19702 ts_tablet_manager.cc:1403] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.508s	user 0.028s	sys 0.066s
I20260709 13:17:24.237861 19970 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.239758 19970 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:24.236150 19924 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:24.243860 19551 consensus_peers.cc:597] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf -> Peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Couldn't send request to peer e19c80e9149b4b8d88ae13bde8e43864. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:24.246670 19986 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:24.250609 19701 raft_consensus.cc:359] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.251217 19701 raft_consensus.cc:385] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.251387 19701 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.254922 19701 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.257840 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:17:24.263298 19551 leader_election.cc:343] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.269809 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:24.270432 19511 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.263670 19702 raft_consensus.cc:359] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.280553 19702 raft_consensus.cc:385] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.280807 19409 catalog_manager.cc:5697] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:24.285161 19476 consensus_peers.cc:597] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 -> Peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Couldn't send request to peer e19c80e9149b4b8d88ae13bde8e43864. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:24.288467 19701 ts_tablet_manager.cc:1434] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.125s	user 0.002s	sys 0.008s
I20260709 13:17:24.279619 19511 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:24.281267 19702 raft_consensus.cc:740] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.291334 19702 consensus_queue.cc:260] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.297544 19970 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:24.304487 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:24.309240 19701 tablet_bootstrap.cc:492] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:24.310024 19702 ts_tablet_manager.cc:1434] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.002s
I20260709 13:17:24.314500 19702 tablet_bootstrap.cc:492] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:24.309314 19973 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:24.315941 19973 raft_consensus.cc:697] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:24.316792 19973 consensus_queue.cc:237] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.325488 19703 tablet_bootstrap.cc:492] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:24.326332 19703 ts_tablet_manager.cc:1403] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.236s	user 0.011s	sys 0.013s
I20260709 13:17:24.331941 19703 raft_consensus.cc:359] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.332716 19703 raft_consensus.cc:385] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.333045 19703 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.333961 19703 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.364530 19703 ts_tablet_manager.cc:1434] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:17:24.374301 19703 tablet_bootstrap.cc:492] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:24.376814 19702 tablet_bootstrap.cc:654] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.378886 19983 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:24.396252 19701 tablet_bootstrap.cc:654] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.418828 19410 catalog_manager.cc:5697] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.440449 19703 tablet_bootstrap.cc:654] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.447042 19832 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:24.455554 19701 tablet_bootstrap.cc:492] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:24.458007 19701 ts_tablet_manager.cc:1403] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.154s	user 0.015s	sys 0.006s
I20260709 13:17:24.476374 19976 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.478117 19976 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.481091 19976 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:24.483882 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:24.498730 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:24.508551 19702 tablet_bootstrap.cc:492] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:24.509145 19702 ts_tablet_manager.cc:1403] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.195s	user 0.014s	sys 0.021s
W20260709 13:17:24.514269 19478 consensus_peers.cc:597] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:24.522702 19478 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:24.531816 19992 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:24.531029 19701 raft_consensus.cc:359] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.534014 19701 raft_consensus.cc:385] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.534201 19701 raft_consensus.cc:740] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.531829 19832 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:24.536525 19701 consensus_queue.cc:260] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.539424 19661 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.542797 19702 raft_consensus.cc:359] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.543282 19702 raft_consensus.cc:385] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.543534 19702 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.548182 19702 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.560791 20006 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.561551 20006 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.567001 19701 ts_tablet_manager.cc:1434] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.109s	user 0.011s	sys 0.003s
I20260709 13:17:24.570494 19703 tablet_bootstrap.cc:492] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:24.572973 20006 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:24.574414 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:24.577066 19703 ts_tablet_manager.cc:1403] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.203s	user 0.010s	sys 0.011s
I20260709 13:17:24.577932 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:24.577980 19551 leader_election.cc:343] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:24.579305 19551 leader_election.cc:343] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.579834 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:24.584252 20006 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:24.585323 20005 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.585965 20005 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.586491 19703 raft_consensus.cc:359] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.587708 19703 raft_consensus.cc:385] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.588466 20005 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:24.590456 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:24.591010 19703 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.591212 19657 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:24.589159 19701 tablet_bootstrap.cc:492] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:24.590204 19702 ts_tablet_manager.cc:1434] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.007s
I20260709 13:17:24.593549 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:24.593967 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:24.594671 19512 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:24.595019 20005 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:24.595504 20005 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.595960 20005 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.599911 19992 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:24.600476 19992 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.605497 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:24.592113 19703 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.611163 19703 ts_tablet_manager.cc:1434] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:17:24.608853 19992 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:24.606777 19702 tablet_bootstrap.cc:492] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:24.611364 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:24.616833 19625 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:24.618330 19991 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:24.612810 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 77634.8us
I20260709 13:17:24.632611 20005 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.635651 20005 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:24.633498 19703 tablet_bootstrap.cc:492] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:24.636982 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:24.637606 19661 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.637028 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:24.639789 19512 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.642520 19701 tablet_bootstrap.cc:654] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.645605 19661 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:24.648265 19703 tablet_bootstrap.cc:654] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.649538 19702 tablet_bootstrap.cc:654] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.650301 19512 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:24.651764 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:24.652695 20005 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:24.653494 20005 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:24.665069 20005 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.671912 19992 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:24.704149 19702 tablet_bootstrap.cc:492] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:24.703519 19410 catalog_manager.cc:5697] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.704766 19702 ts_tablet_manager.cc:1403] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.098s	user 0.015s	sys 0.006s
I20260709 13:17:24.712184 19511 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.711691 19702 raft_consensus.cc:359] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.712831 19702 raft_consensus.cc:385] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.713227 19702 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.714587 19702 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.716763 19702 ts_tablet_manager.cc:1434] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:17:24.717093 20006 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.717665 20006 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.719713 20006 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:24.721993 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:24.723526 19551 leader_election.cc:343] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.726339 19702 tablet_bootstrap.cc:492] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:24.742993 19702 tablet_bootstrap.cc:654] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.743685 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:24.747040 19703 tablet_bootstrap.cc:492] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:24.780884 19703 ts_tablet_manager.cc:1403] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.149s	user 0.013s	sys 0.018s
W20260709 13:17:24.782176 19551 leader_election.cc:343] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.782742 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:24.783488 20006 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:24.783860 19703 raft_consensus.cc:359] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.784614 19703 raft_consensus.cc:385] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.784947 19703 raft_consensus.cc:740] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.785758 19703 consensus_queue.cc:260] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.787938 19703 ts_tablet_manager.cc:1434] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:17:24.771937 19701 tablet_bootstrap.cc:492] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:24.788538 19701 ts_tablet_manager.cc:1403] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.200s	user 0.010s	sys 0.005s
I20260709 13:17:24.790723 19701 raft_consensus.cc:359] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.791282 19701 raft_consensus.cc:385] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.791546 19701 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.792372 19701 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.794499 19701 ts_tablet_manager.cc:1434] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:24.795672 19701 tablet_bootstrap.cc:492] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:24.797044 19702 tablet_bootstrap.cc:492] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:24.797531 19702 ts_tablet_manager.cc:1403] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.001s
I20260709 13:17:24.800218 19702 raft_consensus.cc:359] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.800904 19702 raft_consensus.cc:385] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.801174 19702 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.802069 19702 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.802575 19701 tablet_bootstrap.cc:654] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.806454 19702 ts_tablet_manager.cc:1434] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:24.807490 19702 tablet_bootstrap.cc:492] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:24.810146 19703 tablet_bootstrap.cc:492] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:24.815088 19701 tablet_bootstrap.cc:492] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
W20260709 13:17:24.816519 19551 consensus_peers.cc:597] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf -> Peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Couldn't send request to peer e19c80e9149b4b8d88ae13bde8e43864. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:24.820711 19657 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.817221 20020 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.822186 20020 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.824558 20020 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:24.825891 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:17:24.827437 19476 leader_election.cc:343] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.827739 19702 tablet_bootstrap.cc:654] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.827593 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:24.829021 19478 leader_election.cc:343] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.829478 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:24.830509 20020 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:24.831375 19701 ts_tablet_manager.cc:1403] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.003s
I20260709 13:17:24.832001 19703 tablet_bootstrap.cc:654] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.834434 19701 raft_consensus.cc:359] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.835202 19701 raft_consensus.cc:385] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.835496 19701 raft_consensus.cc:740] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.841156 19701 consensus_queue.cc:260] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.845469 19701 ts_tablet_manager.cc:1434] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:17:24.846508 19701 tablet_bootstrap.cc:492] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:24.855840 19702 tablet_bootstrap.cc:492] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:24.856325 19702 ts_tablet_manager.cc:1403] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.001s
I20260709 13:17:24.858443 19701 tablet_bootstrap.cc:654] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.859405 19702 raft_consensus.cc:359] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.860198 19702 raft_consensus.cc:385] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.860463 19702 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.861527 19703 tablet_bootstrap.cc:492] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:24.862126 19703 ts_tablet_manager.cc:1403] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.006s
I20260709 13:17:24.865445 19703 raft_consensus.cc:359] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.866554 19703 raft_consensus.cc:385] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.861146 19702 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.869462 20005 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:24.870949 19702 ts_tablet_manager.cc:1434] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.005s
I20260709 13:17:24.872092 19702 tablet_bootstrap.cc:492] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:24.872859 19701 tablet_bootstrap.cc:492] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:24.873687 19701 ts_tablet_manager.cc:1403] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.002s
I20260709 13:17:24.866851 19703 raft_consensus.cc:740] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.876773 19701 raft_consensus.cc:359] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.877503 19701 raft_consensus.cc:385] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.877820 19701 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.878649 19702 tablet_bootstrap.cc:654] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.878711 19701 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.879325 19703 consensus_queue.cc:260] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.880708 19870 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.881677 19701 ts_tablet_manager.cc:1434] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:24.882712 19701 tablet_bootstrap.cc:492] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:24.881193 19870 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.885329 19870 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:24.888298 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:24.889012 19583 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:24.894122 19702 tablet_bootstrap.cc:492] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:24.894634 19702 ts_tablet_manager.cc:1403] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.004s
I20260709 13:17:24.895961 19627 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:24.898510 19703 ts_tablet_manager.cc:1434] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:17:24.900542 19870 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:24.904898 19870 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.905480 19870 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.906296 19702 raft_consensus.cc:359] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.907066 19702 raft_consensus.cc:385] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.899011 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:24.907434 19702 raft_consensus.cc:740] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.907711 19512 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:24.908106 19702 consensus_queue.cc:260] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.911466 19702 ts_tablet_manager.cc:1434] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 13:17:24.912509 19702 tablet_bootstrap.cc:492] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:24.915045 19512 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.918710 19702 tablet_bootstrap.cc:654] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.930338 19702 tablet_bootstrap.cc:492] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:24.930825 19702 ts_tablet_manager.cc:1403] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:17:24.933367 19702 raft_consensus.cc:359] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.934041 19702 raft_consensus.cc:385] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.934309 19702 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.934419 19703 tablet_bootstrap.cc:492] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:24.934978 19702 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.937006 19702 ts_tablet_manager.cc:1434] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:24.942807 19702 tablet_bootstrap.cc:492] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:24.946870 19870 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:24.952788 19701 tablet_bootstrap.cc:654] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.953078 19870 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:24.956769 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:24.962445 19583 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.974982 19702 tablet_bootstrap.cc:654] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.975780 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:24.998103 19509 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.997550 19583 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:25.009003 19627 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:25.009770 19870 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:25.010243 19870 raft_consensus.cc:697] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:25.012707 19509 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:25.016849 19870 consensus_queue.cc:237] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.017408 19702 tablet_bootstrap.cc:492] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:25.018988 19702 ts_tablet_manager.cc:1403] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.002s
I20260709 13:17:25.042052 19702 raft_consensus.cc:359] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.042802 19702 raft_consensus.cc:385] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.043094 19702 raft_consensus.cc:740] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.045181 19701 tablet_bootstrap.cc:492] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:25.045737 19701 ts_tablet_manager.cc:1403] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.163s	user 0.013s	sys 0.008s
I20260709 13:17:25.048571 19701 raft_consensus.cc:359] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.049392 19701 raft_consensus.cc:385] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.048604 19410 catalog_manager.cc:5697] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.049700 19701 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.051201 19702 consensus_queue.cc:260] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.052042 19870 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.052570 19870 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.053973 19702 ts_tablet_manager.cc:1434] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:17:25.054785 19703 tablet_bootstrap.cc:654] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.055160 19702 tablet_bootstrap.cc:492] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:25.056543 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:25.050429 19701 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:25.058365 19625 leader_election.cc:343] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.059614 19701 ts_tablet_manager.cc:1434] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.014s	user 0.000s	sys 0.006s
I20260709 13:17:25.066488 19701 tablet_bootstrap.cc:492] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:25.069506 19702 tablet_bootstrap.cc:654] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.069787 19703 tablet_bootstrap.cc:492] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:25.070210 19703 ts_tablet_manager.cc:1403] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.136s	user 0.016s	sys 0.002s
I20260709 13:17:25.074702 19703 raft_consensus.cc:359] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.075747 19703 raft_consensus.cc:385] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.075970 19703 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.076800 19703 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.078624 19870 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:25.079944 19703 ts_tablet_manager.cc:1434] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:17:25.081405 19703 tablet_bootstrap.cc:492] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:25.081758 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:25.082847 19587 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:25.084144 19627 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:25.085243 19992 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:25.085606 19992 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.086038 19992 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.089143 19701 tablet_bootstrap.cc:654] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.095101 20005 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.107916 19992 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.129189 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:25.129456 19702 tablet_bootstrap.cc:492] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:25.130386 19702 ts_tablet_manager.cc:1403] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.011s
W20260709 13:17:25.130999 19625 leader_election.cc:343] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.133903 20005 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.134181 19702 raft_consensus.cc:359] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.134958 19702 raft_consensus.cc:385] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.135243 19702 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.136042 19870 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.136790 19702 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.136482 19870 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.140265 19992 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:25.141455 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:25.142040 19587 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.142117 19870 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:25.144524 19703 tablet_bootstrap.cc:654] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.144990 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:25.147480 19587 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:25.149049 19627 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:25.150291 19583 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:25.152447 19701 tablet_bootstrap.cc:492] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:25.152895 19701 ts_tablet_manager.cc:1403] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.087s	user 0.020s	sys 0.004s
I20260709 13:17:25.154065 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:25.154745 19512 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:25.155488 19702 ts_tablet_manager.cc:1434] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:17:25.156447 19702 tablet_bootstrap.cc:492] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:25.158320 19988 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:25.158994 19988 raft_consensus.cc:697] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:25.160082 19988 consensus_queue.cc:237] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.157577 19701 raft_consensus.cc:359] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.161288 19701 raft_consensus.cc:385] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.161589 19701 raft_consensus.cc:740] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.162472 19701 consensus_queue.cc:260] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.176025 19702 tablet_bootstrap.cc:654] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.178429 19627 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:25.180212 19701 ts_tablet_manager.cc:1434] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260709 13:17:25.185294 19701 tablet_bootstrap.cc:492] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:25.189801 19992 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:25.197242 19992 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:25.197446 19538 tablet.cc:2406] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:17:25.197746 19992 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.216924 19656 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.217484 19992 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.219877 19992 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:25.214380 19986 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:25.234601 19458 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:25.232980 19986 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.236030 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:25.238184 19509 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.242970 19703 tablet_bootstrap.cc:492] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:25.243563 19703 ts_tablet_manager.cc:1403] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.162s	user 0.028s	sys 0.006s
I20260709 13:17:25.249830 19703 raft_consensus.cc:359] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.250590 19703 raft_consensus.cc:385] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.250870 19703 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.252007 19703 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.255302 20014 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.259626 19703 ts_tablet_manager.cc:1434] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.004s
I20260709 13:17:25.266185 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:25.267578 19583 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.268754 19701 tablet_bootstrap.cc:654] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.269341 19509 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:25.271129 19625 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:25.276773 19924 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:25.278771 19924 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:25.284626 19986 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:25.285271 19924 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.258646 20014 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.291182 20014 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:25.294555 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:25.295316 19509 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:25.296168 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:25.296986 19587 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:25.299237 19478 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:25.309338 19702 tablet_bootstrap.cc:492] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:25.310031 19702 ts_tablet_manager.cc:1403] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.154s	user 0.009s	sys 0.014s
I20260709 13:17:25.305549 20014 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:25.319902 19703 tablet_bootstrap.cc:492] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:25.319268 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:25.324209 19702 raft_consensus.cc:359] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.326808 19702 raft_consensus.cc:385] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.327205 19702 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.328055 19702 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.320640 20014 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.332329 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:25.335237 19702 ts_tablet_manager.cc:1434] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260709 13:17:25.333709 20014 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.334008 19660 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:25.347955 19702 tablet_bootstrap.cc:492] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:25.360704 20050 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:25.370728 19701 tablet_bootstrap.cc:492] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:25.372543 19701 ts_tablet_manager.cc:1403] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.187s	user 0.017s	sys 0.011s
I20260709 13:17:25.377779 19707 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.378360 19707 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.361030 19583 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:25.372290 20050 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.391346 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:25.392097 19660 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:25.393932 19703 tablet_bootstrap.cc:654] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.393811 19701 raft_consensus.cc:359] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.398422 19701 raft_consensus.cc:385] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.398854 19701 raft_consensus.cc:740] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.402890 19701 consensus_queue.cc:260] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.388682 20050 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.407560 20049 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.414310 20049 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.454646 20049 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:25.458376 19707 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:25.469362 19701 ts_tablet_manager.cc:1434] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.096s	user 0.017s	sys 0.016s
I20260709 13:17:25.473802 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:25.474776 19583 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:25.475582 19702 tablet_bootstrap.cc:654] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.468240 20056 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.484401 19627 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:25.487972 19991 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:25.488394 19991 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.486858 20014 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.488727 19991 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.491775 20014 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:25.488409 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:25.488003 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:25.498617 19701 tablet_bootstrap.cc:492] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:25.523945 19408 catalog_manager.cc:5697] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:25.530992 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 198703us
I20260709 13:17:25.521639 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:25.494192 20056 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.532130 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:25.554777 19587 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.569027 20064 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.569587 20064 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.577054 20056 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:25.577683 20050 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.578701 19703 tablet_bootstrap.cc:492] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:25.579169 19703 ts_tablet_manager.cc:1403] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.263s	user 0.031s	sys 0.009s
I20260709 13:17:25.581488 19582 raft_consensus.cc:2393] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 1: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:25.577385 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:25.585171 19478 leader_election.cc:343] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.587466 19703 raft_consensus.cc:359] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.588244 19703 raft_consensus.cc:385] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.588552 19703 raft_consensus.cc:740] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.589737 19703 consensus_queue.cc:260] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.579720 20050 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:25.566440 20049 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:17:25.597884 19991 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.600809 19703 ts_tablet_manager.cc:1434] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:17:25.607488 19707 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:25.594673 19625 leader_election.cc:343] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.608801 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:25.602662 20064 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:25.616456 19703 tablet_bootstrap.cc:492] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:25.621961 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:25.622718 19653 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:25.614017 19627 leader_election.cc:343] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:25.631928 19625 leader_election.cc:343] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.643519 19701 tablet_bootstrap.cc:654] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.644265 19702 tablet_bootstrap.cc:492] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:25.644752 19702 ts_tablet_manager.cc:1403] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.297s	user 0.008s	sys 0.022s
I20260709 13:17:25.648829 19991 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:25.645371 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:25.676436 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:25.677089 19702 raft_consensus.cc:359] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.677881 19702 raft_consensus.cc:385] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.678162 19702 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.678869 19702 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:25.679231 19476 leader_election.cc:343] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.679764 19476 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:25.681569 20059 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:25.681985 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:25.682619 19702 ts_tablet_manager.cc:1434] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:17:25.682749 19509 raft_consensus.cc:2393] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 1: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:25.673575 20063 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.687614 20063 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.691504 19476 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:25.696923 20066 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:25.697953 19627 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:25.698843 19992 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:25.702715 19653 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
W20260709 13:17:25.698951 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 93415.2us
I20260709 13:17:25.729847 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:25.730574 19584 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:25.732190 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:25.733510 20066 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:25.734098 20066 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.734913 20066 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.735832 19702 tablet_bootstrap.cc:492] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:25.743492 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:17:25.742249 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 50836.8us
I20260709 13:17:25.751379 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:25.750545 20063 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:25.754761 20071 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:17:25.746380 20056 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:25.758637 20056 raft_consensus.cc:697] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:25.759478 20056 consensus_queue.cc:237] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.757539 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:25.762780 19584 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.802832 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:25.821553 19707 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:25.809971 20005 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:25.844839 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:25.847024 19701 tablet_bootstrap.cc:492] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:25.847548 19701 ts_tablet_manager.cc:1403] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.367s	user 0.034s	sys 0.034s
I20260709 13:17:25.850567 19707 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.848075 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:25.851138 19707 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.852941 19507 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.853901 19707 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:17:25.853999 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 47891.9us
I20260709 13:17:25.860821 19707 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.865967 19703 tablet_bootstrap.cc:654] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.867211 19584 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:25.875605 19702 tablet_bootstrap.cc:654] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:25.876369 19625 leader_election.cc:343] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.877946 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:25.855669 19654 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:25.894465 19707 consensus_queue.cc:1048] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.904979 19627 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:17:25.906329 19627 leader_election.cc:343] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.909487 20049 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:25.944329 19701 raft_consensus.cc:359] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.948081 19701 raft_consensus.cc:385] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.948489 19701 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.950136 19701 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:25.945974 20049 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:25.947350 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:25.946211 20063 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.973191 19506 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
W20260709 13:17:26.007491 20075 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:17:25.974931 19924 consensus_queue.cc:1048] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:17:26.015234 19703 tablet_bootstrap.cc:492] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:26.018505 19703 ts_tablet_manager.cc:1403] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.408s	user 0.025s	sys 0.003s
I20260709 13:17:26.015570 19701 ts_tablet_manager.cc:1434] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.168s	user 0.025s	sys 0.025s
I20260709 13:17:25.973336 20063 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.010330 20066 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.028795 19701 tablet_bootstrap.cc:492] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:26.029197 20020 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.029716 20020 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.031761 20020 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:26.039188 20066 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:26.011180 20049 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.046962 20066 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.047509 20066 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.041580 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:26.048511 19582 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.023307 19625 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:26.055228 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:26.057365 19581 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 1: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:26.057880 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:26.058665 20066 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:26.060380 19870 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.060792 19870 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.061133 19870 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.061507 19703 raft_consensus.cc:359] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.062227 19703 raft_consensus.cc:385] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.062448 19703 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.063000 19703 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.066496 19410 catalog_manager.cc:5697] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:26.068404 19478 leader_election.cc:343] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.080962 19703 ts_tablet_manager.cc:1434] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.000s
I20260709 13:17:26.106011 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:26.106720 19657 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.107503 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:26.121153 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:26.125813 19703 tablet_bootstrap.cc:492] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:26.126732 19702 tablet_bootstrap.cc:492] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:26.127269 19702 ts_tablet_manager.cc:1403] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.436s	user 0.024s	sys 0.017s
W20260709 13:17:26.104213 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 46585.6us
I20260709 13:17:26.112298 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:26.153769 20063 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:26.168668 19870 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.171798 19870 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:26.220299 19476 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:26.225072 19657 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:26.228140 19582 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:26.228760 19701 tablet_bootstrap.cc:654] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:26.236232 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 72133us
I20260709 13:17:26.240757 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:26.249764 20066 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.250422 20066 raft_consensus.cc:697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:26.251223 20066 consensus_queue.cc:237] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.235446 20063 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:26.261418 19476 leader_election.cc:343] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.262890 19476 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:26.274968 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:26.275637 19503 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.276783 19702 raft_consensus.cc:359] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.278980 19702 raft_consensus.cc:385] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.279253 19702 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.284835 19702 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.311879 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:26.278468 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:26.318219 20019 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:26.318866 19476 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:26.319934 19703 tablet_bootstrap.cc:654] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.320472 19702 ts_tablet_manager.cc:1434] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.193s	user 0.010s	sys 0.006s
I20260709 13:17:26.327436 19702 tablet_bootstrap.cc:492] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:26.327868 20055 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:17:26.358398 19627 leader_election.cc:343] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.366773 20063 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:26.413482 19702 tablet_bootstrap.cc:654] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:26.455461 20093 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:17:26.474368 19701 tablet_bootstrap.cc:492] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:26.474918 19701 ts_tablet_manager.cc:1403] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.451s	user 0.013s	sys 0.004s
I20260709 13:17:26.477348 19503 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:26.466306 20059 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:26.491972 19703 tablet_bootstrap.cc:492] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:26.495812 19703 ts_tablet_manager.cc:1403] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.387s	user 0.042s	sys 0.046s
I20260709 13:17:26.502238 19701 raft_consensus.cc:359] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.503163 19701 raft_consensus.cc:385] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.503536 19701 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.510710 19625 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:26.512710 19924 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.513757 19924 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:26.515051 19924 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.516175 19703 raft_consensus.cc:359] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:26.504371 19458 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:26.504415 19701 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.527853 19701 ts_tablet_manager.cc:1434] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:17:26.528745 19701 tablet_bootstrap.cc:492] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:26.531129 19702 tablet_bootstrap.cc:492] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:26.531700 19702 ts_tablet_manager.cc:1403] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.207s	user 0.012s	sys 0.015s
I20260709 13:17:26.534679 19702 raft_consensus.cc:359] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.535971 19702 raft_consensus.cc:385] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.536302 19702 raft_consensus.cc:740] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.537086 19702 consensus_queue.cc:260] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:26.538704 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 81402us
I20260709 13:17:26.539438 19702 ts_tablet_manager.cc:1434] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:26.540536 19702 tablet_bootstrap.cc:492] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:26.541401 20050 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.541968 20050 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.517064 19703 raft_consensus.cc:385] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.542754 19703 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.543406 19703 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.544169 20050 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:26.552212 19986 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:26.553941 19703 ts_tablet_manager.cc:1434] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.002s
I20260709 13:17:26.560264 19701 tablet_bootstrap.cc:654] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:26.562114 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 51580.8us
I20260709 13:17:26.562536 19703 tablet_bootstrap.cc:492] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:26.594341 19408 catalog_manager.cc:5697] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.599908 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:26.600577 19509 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:26.601670 19702 tablet_bootstrap.cc:654] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.598392 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:26.602186 19653 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:26.608799 19870 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:17:26.605687 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:26.616896 20062 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.617377 20062 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.617765 20062 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.628149 19703 tablet_bootstrap.cc:654] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.632583 19701 tablet_bootstrap.cc:492] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:26.633035 19701 ts_tablet_manager.cc:1403] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.004s
I20260709 13:17:26.639916 19924 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:26.644019 20095 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:26.655567 19702 tablet_bootstrap.cc:492] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:26.656097 19702 ts_tablet_manager.cc:1403] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.116s	user 0.011s	sys 0.002s
I20260709 13:17:26.656337 20005 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.656847 20005 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.658849 20005 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:26.658869 19702 raft_consensus.cc:359] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.659740 19702 raft_consensus.cc:385] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.660116 19702 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.661007 19702 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.660290 20062 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.662087 19701 raft_consensus.cc:359] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.662751 19701 raft_consensus.cc:385] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.663024 19701 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.663715 19702 ts_tablet_manager.cc:1434] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:26.665099 19702 tablet_bootstrap.cc:492] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:26.666164 19870 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.667563 19870 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.667937 19701 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.672350 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:26.672927 19657 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.674165 19701 ts_tablet_manager.cc:1434] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.001s
I20260709 13:17:26.668503 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:26.669592 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:26.670956 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:26.675005 19507 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.676823 19870 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:26.678026 19653 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:26.680622 19701 tablet_bootstrap.cc:492] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
W20260709 13:17:26.679528 19551 leader_election.cc:343] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.682382 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:26.686046 20067 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.686465 20067 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.686244 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:26.686842 20067 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.687325 20095 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:17:26.663887 20062 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:26.690076 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:26.698601 19507 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:26.711162 19702 tablet_bootstrap.cc:654] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.712144 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:17:26.714051 19625 leader_election.cc:343] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.716475 20005 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.711925 19657 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:26.717519 20005 raft_consensus.cc:697] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:26.722675 20067 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.722496 20005 consensus_queue.cc:237] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.729403 19703 tablet_bootstrap.cc:492] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:26.729854 19703 ts_tablet_manager.cc:1403] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.168s	user 0.013s	sys 0.010s
I20260709 13:17:26.732378 19583 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 1: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:26.735939 20067 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:26.736697 19701 tablet_bootstrap.cc:654] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.737649 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:26.745224 19657 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.736726 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:26.750522 19992 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.751133 19992 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.755299 19627 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:26.760373 19409 catalog_manager.cc:5697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 0 to 1, leader changed from <none> to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.755468 19992 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:17:26.766268 19551 leader_election.cc:343] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.767527 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:26.773073 19627 leader_election.cc:343] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.778870 19702 tablet_bootstrap.cc:492] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:26.779446 19702 ts_tablet_manager.cc:1403] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.115s	user 0.019s	sys 0.000s
I20260709 13:17:26.768229 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:26.783864 19507 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:26.784413 19702 raft_consensus.cc:359] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.785080 19702 raft_consensus.cc:385] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.785117 19625 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:26.785377 19702 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.793258 19703 raft_consensus.cc:359] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.794494 19703 raft_consensus.cc:385] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.794942 19703 raft_consensus.cc:740] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.800040 19702 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.795835 19657 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:26.797123 19703 consensus_queue.cc:260] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.795627 19924 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.805424 19924 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.805833 19924 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.806416 19702 ts_tablet_manager.cc:1434] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.004s
I20260709 13:17:26.807610 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:26.806731 20088 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:26.810591 19703 ts_tablet_manager.cc:1434] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 13:17:26.810810 20100 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.811784 19702 tablet_bootstrap.cc:492] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:26.815106 20100 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:26.816383 19703 tablet_bootstrap.cc:492] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:26.816112 20100 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.843075 19924 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.843665 19701 tablet_bootstrap.cc:492] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:26.844254 19701 ts_tablet_manager.cc:1403] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.164s	user 0.017s	sys 0.004s
I20260709 13:17:26.851292 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:26.846225 19410 catalog_manager.cc:5697] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:26.853323 19627 leader_election.cc:343] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.854485 19410 catalog_manager.cc:5697] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:26.846621 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:26.858300 19507 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.850039 19924 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:26.862046 19701 raft_consensus.cc:359] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.866600 19701 raft_consensus.cc:385] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.866887 19701 raft_consensus.cc:740] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.867532 19701 consensus_queue.cc:260] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.872611 19703 tablet_bootstrap.cc:654] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.874399 19701 ts_tablet_manager.cc:1434] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.030s	user 0.001s	sys 0.006s
I20260709 13:17:26.875417 19701 tablet_bootstrap.cc:492] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:26.876101 19702 tablet_bootstrap.cc:654] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.882234 20059 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.882797 20059 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.882377 19409 catalog_manager.cc:5697] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.884953 20059 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:26.886073 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:26.887486 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:26.887455 19476 leader_election.cc:343] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.896286 20059 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:26.898149 19478 leader_election.cc:343] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.898789 19478 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:26.900692 20066 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:26.897004 20059 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.903362 19507 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:26.904496 19625 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:26.908020 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:26.911345 19701 tablet_bootstrap.cc:654] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.911950 20088 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.913373 20088 raft_consensus.cc:697] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:17:26.914569 19478 leader_election.cc:343] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.917099 20059 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:26.918082 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:17:26.919418 19476 leader_election.cc:343] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.919909 19476 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:26.924612 19703 tablet_bootstrap.cc:492] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:26.925249 19703 ts_tablet_manager.cc:1403] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.111s	user 0.025s	sys 0.008s
I20260709 13:17:26.927505 20066 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:26.929764 19703 raft_consensus.cc:359] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.930512 19703 raft_consensus.cc:385] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.930776 19703 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.931463 19703 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.933597 19703 ts_tablet_manager.cc:1434] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:17:26.918726 20088 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.936314 19703 tablet_bootstrap.cc:492] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:26.942947 19703 tablet_bootstrap.cc:654] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.942773 19408 catalog_manager.cc:5697] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.944726 19992 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.945214 19992 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.948731 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:26.949245 19992 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:26.949347 19507 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:26.951197 19625 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:26.952163 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:26.953261 19587 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:26.952744 19992 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.954735 19992 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.955331 19992 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.956837 19701 tablet_bootstrap.cc:492] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:26.957484 19701 ts_tablet_manager.cc:1403] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.082s	user 0.007s	sys 0.004s
I20260709 13:17:26.960428 20100 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.960954 20100 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:26.963763 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:26.965402 19551 leader_election.cc:343] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.967389 19702 tablet_bootstrap.cc:492] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:26.969096 19701 raft_consensus.cc:359] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.012835 19701 raft_consensus.cc:385] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.013269 19701 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.013491 20100 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:27.014249 19702 ts_tablet_manager.cc:1403] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.203s	user 0.009s	sys 0.005s
I20260709 13:17:27.014459 19701 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.020942 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:27.027063 19870 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.027706 19870 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.017189 19702 raft_consensus.cc:359] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.031605 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:27.031920 19870 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:27.032270 19507 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:27.034557 19625 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:27.035562 19870 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:27.037164 19870 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.040772 19870 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.037317 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:27.038283 19627 consensus_peers.cc:597] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:27.045650 19627 leader_election.cc:343] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.048216 19701 ts_tablet_manager.cc:1434] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.090s	user 0.014s	sys 0.006s
I20260709 13:17:27.049154 19701 tablet_bootstrap.cc:492] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:27.030282 19702 raft_consensus.cc:385] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.049774 19702 raft_consensus.cc:740] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.052455 19992 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.058840 19702 consensus_queue.cc:260] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.059796 19657 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:27.062541 19707 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.062990 19707 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.065964 19702 ts_tablet_manager.cc:1434] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.003s
I20260709 13:17:27.066984 19702 tablet_bootstrap.cc:492] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:27.067571 19707 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:27.070878 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:27.071467 19503 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.074034 19992 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:27.082109 19870 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.081576 19408 catalog_manager.cc:5697] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.086697 19870 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:27.088871 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:27.089453 19587 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.095099 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:27.096625 19506 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.099602 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:27.099936 19503 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:27.100288 19581 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:27.103812 19627 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:27.104084 19702 tablet_bootstrap.cc:654] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.105602 19870 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:27.106181 19870 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.106669 19870 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.115801 19551 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:27.117100 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:27.120527 20062 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:27.132277 19870 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.134754 19625 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:27.135830 19707 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:27.136245 19707 raft_consensus.cc:697] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:27.136902 19707 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.139218 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:27.140581 19587 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:27.130044 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:27.133867 20062 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.150571 19703 tablet_bootstrap.cc:492] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:27.150992 19703 ts_tablet_manager.cc:1403] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.217s	user 0.062s	sys 0.088s
W20260709 13:17:27.156490 19625 leader_election.cc:343] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:27.157294 19625 leader_election.cc:343] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.162556 19870 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:27.164011 20062 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:27.171000 19627 leader_election.cc:343] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.174819 19701 tablet_bootstrap.cc:654] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.148093 19992 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:17:27.176432 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:27.181334 19703 raft_consensus.cc:359] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.182660 19703 raft_consensus.cc:385] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.182977 19703 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.183633 19703 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.189406 19703 ts_tablet_manager.cc:1434] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 13:17:27.190507 19703 tablet_bootstrap.cc:492] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:27.181872 20055 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:17:27.195444 19506 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:27.206315 19625 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:27.207036 19707 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:27.207544 19707 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:27.208402 19707 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.216630 19702 tablet_bootstrap.cc:492] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:27.217170 19702 ts_tablet_manager.cc:1403] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.150s	user 0.016s	sys 0.005s
W20260709 13:17:27.218278 19551 consensus_peers.cc:597] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:27.221134 19701 tablet_bootstrap.cc:492] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:27.221587 19701 ts_tablet_manager.cc:1403] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.173s	user 0.014s	sys 0.005s
I20260709 13:17:27.221536 19702 raft_consensus.cc:359] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.222998 19702 raft_consensus.cc:385] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.223382 19702 raft_consensus.cc:740] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.217804 20062 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.225549 19702 consensus_queue.cc:260] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.228312 19702 ts_tablet_manager.cc:1434] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:17:27.254074 19701 raft_consensus.cc:359] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.254913 19701 raft_consensus.cc:385] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.255214 19701 raft_consensus.cc:740] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.258016 19703 tablet_bootstrap.cc:654] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.255892 19701 consensus_queue.cc:260] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.266362 19701 ts_tablet_manager.cc:1434] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.044s	user 0.001s	sys 0.006s
I20260709 13:17:27.265873 19582 raft_consensus.cc:2393] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 1: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:27.267376 19702 tablet_bootstrap.cc:492] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:27.267700 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:27.269395 19509 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.276791 19627 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:27.277695 19707 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:27.287608 20062 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:27.292680 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:27.293855 19653 raft_consensus.cc:2393] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 1: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:27.294571 20062 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:27.297578 19702 tablet_bootstrap.cc:654] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.305516 19701 tablet_bootstrap.cc:492] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:27.307891 19410 catalog_manager.cc:5697] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.312110 19509 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:27.313555 19551 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:27.317174 20050 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:27.317744 20050 raft_consensus.cc:697] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:27.318814 20050 consensus_queue.cc:237] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.309502 19410 catalog_manager.cc:5697] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.324307 19703 tablet_bootstrap.cc:492] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:27.324812 19703 ts_tablet_manager.cc:1403] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.135s	user 0.017s	sys 0.006s
I20260709 13:17:27.332283 19703 raft_consensus.cc:359] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.332976 19703 raft_consensus.cc:385] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.333246 19703 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.338711 19992 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:27.342590 19701 tablet_bootstrap.cc:654] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.344013 19703 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.350066 19703 ts_tablet_manager.cc:1434] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:17:27.351081 19703 tablet_bootstrap.cc:492] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
W20260709 13:17:27.369649 19627 consensus_peers.cc:597] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:27.383366 19703 tablet_bootstrap.cc:654] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.397002 19408 catalog_manager.cc:5697] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.401367 20062 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:27.437013 19701 tablet_bootstrap.cc:492] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:27.439440 19701 ts_tablet_manager.cc:1403] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.134s	user 0.018s	sys 0.008s
I20260709 13:17:27.441847 19702 tablet_bootstrap.cc:492] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:27.442366 19702 ts_tablet_manager.cc:1403] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.176s	user 0.021s	sys 0.037s
I20260709 13:17:27.442713 19701 raft_consensus.cc:359] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.443514 19701 raft_consensus.cc:385] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.443801 19701 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.444531 19701 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.445202 19702 raft_consensus.cc:359] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.447973 19702 raft_consensus.cc:385] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.448323 19702 raft_consensus.cc:740] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.449057 19702 consensus_queue.cc:260] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.451399 19702 ts_tablet_manager.cc:1434] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:27.452854 20062 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.453248 19701 ts_tablet_manager.cc:1434] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:17:27.453394 20062 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.454339 19701 tablet_bootstrap.cc:492] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:27.455555 19702 tablet_bootstrap.cc:492] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:27.455619 20062 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:27.457098 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:17:27.461215 19551 leader_election.cc:343] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.462857 19702 tablet_bootstrap.cc:654] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.464341 20067 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.464897 20067 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.466977 19992 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.467183 20067 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:27.467779 19703 tablet_bootstrap.cc:492] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:27.467455 19992 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.468230 19703 ts_tablet_manager.cc:1403] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.117s	user 0.008s	sys 0.016s
I20260709 13:17:27.470158 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:27.470340 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:27.470835 19506 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
W20260709 13:17:27.471549 19551 leader_election.cc:343] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.471792 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:27.471983 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:27.472580 19509 raft_consensus.cc:2393] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 1: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:27.473253 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:27.473663 19625 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:27.474395 19870 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:27.474463 20062 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:27.474854 19870 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.475224 19870 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.476291 19992 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:27.479391 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:27.481917 19703 raft_consensus.cc:359] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.482622 19703 raft_consensus.cc:385] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.482874 19703 raft_consensus.cc:740] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
W20260709 13:17:27.483405 19627 leader_election.cc:343] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.483507 19703 consensus_queue.cc:260] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.485967 19703 ts_tablet_manager.cc:1434] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 13:17:27.487195 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:27.487673 19701 tablet_bootstrap.cc:654] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.488075 20050 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.495232 20050 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:27.495790 19702 tablet_bootstrap.cc:492] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:27.496047 19703 tablet_bootstrap.cc:492] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:27.496265 19702 ts_tablet_manager.cc:1403] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.005s
I20260709 13:17:27.496580 19870 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.499398 19702 raft_consensus.cc:359] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.500173 19702 raft_consensus.cc:385] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.500460 19702 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.501120 19702 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.503247 19702 ts_tablet_manager.cc:1434] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:27.504140 19702 tablet_bootstrap.cc:492] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:27.510867 19702 tablet_bootstrap.cc:654] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.513054 19703 tablet_bootstrap.cc:654] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.518525 19870 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:27.524644 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:17:27.530073 19627 leader_election.cc:343] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.545862 19870 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.546330 19870 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.548185 19870 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:27.550302 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:27.551625 19625 leader_election.cc:343] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.555330 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:27.556229 19582 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:27.557374 19627 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:27.558383 19870 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:27.558723 19870 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.559021 19870 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.569545 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:27.570240 19504 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.570717 19702 tablet_bootstrap.cc:492] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:27.571194 19702 ts_tablet_manager.cc:1403] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.067s	user 0.031s	sys 0.033s
I20260709 13:17:27.568121 19870 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.573920 19702 raft_consensus.cc:359] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.574577 19702 raft_consensus.cc:385] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.574882 19702 raft_consensus.cc:740] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.575507 19702 consensus_queue.cc:260] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.576265 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:27.577538 19702 ts_tablet_manager.cc:1434] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:27.578604 19702 tablet_bootstrap.cc:492] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
W20260709 13:17:27.578713 19625 leader_election.cc:343] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.580963 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:27.581499 19582 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.583377 19870 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:27.584755 19702 tablet_bootstrap.cc:654] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.586252 19870 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:27.602309 19701 tablet_bootstrap.cc:492] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:27.602948 19701 ts_tablet_manager.cc:1403] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.149s	user 0.010s	sys 0.000s
I20260709 13:17:27.605940 19702 tablet_bootstrap.cc:492] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:27.606415 19702 ts_tablet_manager.cc:1403] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.006s
I20260709 13:17:27.607060 19701 raft_consensus.cc:359] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.607060 19582 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:27.607748 19701 raft_consensus.cc:385] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.608610 19627 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:27.609100 19702 raft_consensus.cc:359] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.609683 19992 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:27.609783 19702 raft_consensus.cc:385] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.610162 19702 raft_consensus.cc:740] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.610248 19992 raft_consensus.cc:697] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:27.611824 19992 consensus_queue.cc:237] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.618386 19504 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:27.619539 19625 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:27.620533 19870 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:27.620976 19870 raft_consensus.cc:697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:27.621765 19870 consensus_queue.cc:237] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.623358 19701 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.624850 20128 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:27.634238 19701 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.610913 19702 consensus_queue.cc:260] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.641877 19702 ts_tablet_manager.cc:1434] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:17:27.642923 19702 tablet_bootstrap.cc:492] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:27.655272 19701 ts_tablet_manager.cc:1434] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 13:17:27.656855 19701 tablet_bootstrap.cc:492] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:27.675743 19702 tablet_bootstrap.cc:654] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.677278 19992 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.716214 19409 catalog_manager.cc:5697] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.716027 19992 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.721314 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:27.722718 19625 leader_election.cc:343] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.765468 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:27.768666 19870 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.769160 19870 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:27.776029 19627 leader_election.cc:343] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.776669 19627 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:27.784787 19870 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:27.762355 19992 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:27.769979 20059 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.819521 19701 tablet_bootstrap.cc:654] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.779829 19924 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:27.847476 20059 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:27.876125 20059 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:28.020725 19703 tablet_bootstrap.cc:492] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:28.021327 19703 ts_tablet_manager.cc:1403] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.535s	user 0.021s	sys 0.016s
I20260709 13:17:28.022015 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:28.022710 19587 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:28.049058 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:28.090646 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 64363.8us
I20260709 13:17:28.098974 19703 raft_consensus.cc:359] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:28.099975 19703 raft_consensus.cc:385] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:28.100301 19703 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:28.101107 19703 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:28.127120 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 363479us
I20260709 13:17:28.138676 19703 ts_tablet_manager.cc:1434] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.117s	user 0.009s	sys 0.000s
I20260709 13:17:28.140043 19703 tablet_bootstrap.cc:492] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:28.104297 20155 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.136293 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:17:28.157384 20153 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.393s	user 0.013s	sys 0.010s
I20260709 13:17:28.170123 19703 tablet_bootstrap.cc:654] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:28.179210 19702 tablet_bootstrap.cc:492] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:28.179726 19702 ts_tablet_manager.cc:1403] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 0.537s	user 0.011s	sys 0.021s
I20260709 13:17:28.194131 19509 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:28.213739 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 122128us
I20260709 13:17:28.241451 19702 raft_consensus.cc:359] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:28.242511 19702 raft_consensus.cc:385] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:28.242851 19702 raft_consensus.cc:740] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:28.152827 20155 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:28.246447 19702 consensus_queue.cc:260] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:28.211249 20126 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 13:17:28.266507 20167 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.267014 20167 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:28.269030 20167 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:28.282250 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:28.350463 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:28.356961 20165 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:28.394074 19702 ts_tablet_manager.cc:1434] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.214s	user 0.010s	sys 0.009s
I20260709 13:17:28.394582 20158 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:28.395009 20158 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.395268 19702 tablet_bootstrap.cc:492] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
I20260709 13:17:28.395352 20158 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:28.397671 19625 leader_election.cc:343] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.505029 20155 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:28.516018 19701 tablet_bootstrap.cc:492] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:28.519637 19701 ts_tablet_manager.cc:1403] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.863s	user 0.011s	sys 0.031s
I20260709 13:17:28.565709 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:28.704285 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:28.787734 20170 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:28.788499 20170 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:28.823294 19707 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:28.823884 19707 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:28.843582 20126 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:28.844417 20126 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:28.847179 20126 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:28.848037 20169 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:28.848541 20169 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:28.850661 20169 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:28.825898 19707 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:28.853497 19707 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.792444 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:28.801924 20162 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.854117 19707 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:28.863816 20185 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:28.866743 20185 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:28.868153 20183 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:28.868726 20183 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:28.869153 20185 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:28.896782 20186 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:28.907397 19707 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:28.928617 20095 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:17:28.946975 20158 consensus_meta.cc:287] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.003s
I20260709 13:17:28.929453 20095 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:28.954453 20173 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:28.955271 20173 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:28.960058 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:28.960283 20173 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:28.930604 20183 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:28.935088 20170 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:28.899197 20162 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:28.977449 19707 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:28.978129 19707 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:28.987634 20174 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.988351 20174 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:28.991219 20174 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:28.897420 20186 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:28.947714 20158 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.000368 20175 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:29.001111 19701 raft_consensus.cc:359] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.003958 19701 raft_consensus.cc:385] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.004380 19701 raft_consensus.cc:740] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
W20260709 13:17:29.006726 19458 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:29.013331 19707 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:28.977272 20185 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:17:29.023025 19476 leader_election.cc:343] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.018803 19701 consensus_queue.cc:260] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.018452 20170 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:29.049849 20191 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:29.028906 20194 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:29.050443 20191 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.034781 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:29.054388 19701 ts_tablet_manager.cc:1434] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.534s	user 0.019s	sys 0.015s
I20260709 13:17:29.059360 20187 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:29.060070 20187 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.063540 20187 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:29.039698 20059 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:29.058882 19701 ts_tablet_manager.cc:1467] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167: Tablet startup took 538ms
I20260709 13:17:29.030282 20185 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.027562 20175 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:29.066982 19701 ts_tablet_manager.cc:1469] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167: Trace:
0709 13:17:16.934097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.896605 (+962508us) service_pool.cc:224] Handling call
0709 13:17:17.951066 (+ 54461us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:17.951194 (+   128us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.061031 (+109837us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.172921 (+111890us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.173375 (+   454us) inbound_call.cc:177] Queueing success response
0709 13:17:27.656489 (+9483114us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:17:28.520019 (+863530us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:17:28.928547 (+408528us) tablet_replica.cc:261] Starting instrumentation
0709 13:17:28.929242 (+   695us) tablet_replica.cc:280] Starting consensus
Metrics: {"spinlock_wait_cycles":2944,"tablet-open.queue_time_us":9483163}
I20260709 13:17:29.039422 20183 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:17:29.080972 20158 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:29.051651 20170 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.070711 19579 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
W20260709 13:17:29.090399 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 113440us
I20260709 13:17:29.069407 20059 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.105263 20059 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.084369 20175 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.083216 20158 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:29.078315 20194 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.190021 20194 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.195504 19703 tablet_bootstrap.cc:492] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:29.196143 19703 ts_tablet_manager.cc:1403] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 1.056s	user 0.021s	sys 0.030s
I20260709 13:17:29.217557 19701 tablet_bootstrap.cc:492] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
W20260709 13:17:29.217653 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 191403us
I20260709 13:17:29.218532 19707 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:29.110152 20162 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.222229 20195 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:29.223059 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:29.223869 20190 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:29.201177 20194 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:29.088701 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:29.191074 20059 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:29.196718 20175 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:29.225723 19707 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.208743 20191 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.192406 20158 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.215524 20130 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:29.281783 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:29.282264 20198 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:29.291671 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:29.299415 20170 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.299638 20095 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.307703 20095 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:29.326031 20095 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.330017 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:29.331390 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:29.332619 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:29.329907 20196 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:29.333889 19707 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:29.264114 20175 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.267040 20059 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.265743 20194 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.277292 20190 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.234671 20162 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:29.364962 19703 raft_consensus.cc:359] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.368662 19703 raft_consensus.cc:385] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.369086 19703 raft_consensus.cc:740] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.294582 20130 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.413785 20197 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.419342 19703 consensus_queue.cc:260] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.333411 20196 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:29.433547 20188 log.cc:927] Time spent T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:17:29.356959 20186 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:29.275034 20195 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.425096 20190 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:29.410727 20162 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.447925 20095 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.414583 20197 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.458994 20095 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:29.459569 20095 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.469077 19703 ts_tablet_manager.cc:1434] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.272s	user 0.012s	sys 0.002s
W20260709 13:17:29.447646 19509 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.007s	sys 0.017s
I20260709 13:17:29.450024 20186 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:29.452615 20190 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:29.304862 20198 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:29.480888 19509 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.008s	sys 0.018s
I20260709 13:17:29.487145 20200 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:29.484050 20190 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.505544 20207 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:29.503228 20200 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.486328 20067 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:29.484354 20203 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:29.487711 20158 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:29.514930 20200 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.515661 20200 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:29.516224 20200 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.506224 20207 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.519770 20207 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.524398 20200 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.500236 20130 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.540302 20162 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.536913 20067 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.543630 20067 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.544256 19701 tablet_bootstrap.cc:654] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.508028 20190 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:29.483186 20186 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.546767 20203 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.557411 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 207) took 1204 ms. Trace:
I20260709 13:17:29.557858 20195 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:29.557932 19581 rpcz_store.cc:276] 0709 13:17:28.353012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.353908 (+   896us) service_pool.cc:224] Handling call
0709 13:17:29.050191 (+696283us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635eee 0000000000375939 00007f6c366a91e0 00007f6c367720c4 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:29.050414 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.196868 (+146454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.200358 (+  3490us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:29.209610 (+  9252us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:29.214214 (+  4604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.557089 (+342875us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b54002fbf54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:17:29.557157 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.557321 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236197376}
I20260709 13:17:29.509608 20202 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:29.558933 20208 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:29.554102 20175 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.556530 20194 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.563450 20208 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.570663 20206 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:29.571979 19702 tablet_bootstrap.cc:654] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.573171 20206 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.585268 20182 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:29.590646 20198 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.584334 20190 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.574465 20202 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.592571 20190 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.600921 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 294) took 1451 ms. Trace:
I20260709 13:17:29.601334 20208 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.606379 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:29.624047 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:29.586086 20182 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.600222 20203 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.600245 20190 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:29.630939 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:17:29.660574 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 197619us
W20260709 13:17:29.826169 19625 leader_election.cc:343] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.601408 19512 rpcz_store.cc:276] 0709 13:17:28.149812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.152104 (+  2292us) service_pool.cc:224] Handling call
0709 13:17:29.599705 (+1447601us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:29.599971 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.600200 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.600239 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:29.600294 (+    55us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:29.600343 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.600653 (+   310us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.600820 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9330944}
I20260709 13:17:29.824458 19657 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:29.841228 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:29.841509 19870 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:29.842224 19870 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.825882 20186 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:17:29.850198 19476 leader_election.cc:343] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.822204 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:29.852180 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:29.672465 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 295) took 1522 ms. Trace:
I20260709 13:17:29.672094 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 206) took 1319 ms. Trace:
I20260709 13:17:29.855723 19870 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:29.719496 20208 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:29.811685 20202 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:29.856240 19625 consensus_peers.cc:597] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:29.689736 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:29.859210 19476 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:29.875854 19701 tablet_bootstrap.cc:492] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:29.673895 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:29.851800 20194 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.638629 20206 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:29.862907 19870 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:29.852039 20130 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:29.860621 20157 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:29.649694 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:29.893170 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 297) took 1301 ms. Trace:
I20260709 13:17:29.882663 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:29.857810 20211 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.875120 20128 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:17:29.876480 19701 ts_tablet_manager.cc:1403] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.677s	user 0.015s	sys 0.011s
I20260709 13:17:29.896217 19657 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:29.877223 20050 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:29.884271 20202 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:29.860780 19507 rpcz_store.cc:276] 0709 13:17:28.150214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.152184 (+  1970us) service_pool.cc:224] Handling call
0709 13:17:29.638711 (+1486527us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:29.638997 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.639288 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.639325 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:29.648242 (+  8917us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:29.658953 (+ 10711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.672269 (+ 13316us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.672397 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9437440}
I20260709 13:17:29.876807 20208 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.903723 20173 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:29.891083 20194 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.903962 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:30.019694 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 49596.4us
I20260709 13:17:29.895931 19510 rpcz_store.cc:276] 0709 13:17:28.591831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.592699 (+   868us) service_pool.cc:224] Handling call
0709 13:17:29.890746 (+1298047us) spinlock_profiling.cc:243] Waited 7.98 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:29.892594 (+  1848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.892793 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.892825 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:29.892872 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:29.892910 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.892988 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.893109 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18364672}
I20260709 13:17:29.894444 20130 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.907495 20202 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:29.975747 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 292) took 1836 ms. Trace:
I20260709 13:17:29.969237 20197 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:29.964813 20211 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:29.861806 19584 rpcz_store.cc:276] 0709 13:17:28.352696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.386667 (+ 33971us) service_pool.cc:224] Handling call
0709 13:17:29.671239 (+1284572us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635e9c 00007f6c2e635a5b 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:29.671479 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.671690 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.671723 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:29.671771 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:29.671814 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.671898 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.672025 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79499776}
I20260709 13:17:30.044713 20202 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.053507 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:30.103224 20204 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:29.901146 20157 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.113221 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:29.950994 20050 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:30.118074 19583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.031s	sys 0.125s
I20260709 13:17:30.131161 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 207) took 1777 ms. Trace:
I20260709 13:17:30.104650 20182 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:30.133687 19661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 302) took 1310 ms. Trace:
I20260709 13:17:30.137336 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 313) took 1289 ms. Trace:
W20260709 13:17:30.139885 19551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.104s	user 0.088s	sys 0.180s
I20260709 13:17:30.103761 20214 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:17:30.145924 19551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.110s	user 0.088s	sys 0.180s
W20260709 13:17:30.157246 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 1.12186e+06us
I20260709 13:17:30.157689 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.159183 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.160501 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.148932 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.163564 19701 raft_consensus.cc:359] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.164353 19701 raft_consensus.cc:385] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.164917 19701 raft_consensus.cc:740] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.167567 19701 consensus_queue.cc:260] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:30.145393 19583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.032s	sys 0.125s
I20260709 13:17:30.145671 19661 rpcz_store.cc:276] 0709 13:17:28.823231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.826360 (+  3129us) service_pool.cc:224] Handling call
0709 13:17:29.328007 (+501647us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b58000e1c98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:29.328206 (+   199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.351949 (+ 23743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.351994 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:29.352049 (+    55us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:29.352094 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.133324 (+781230us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b54000e7ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:17:30.133391 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:30.133582 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67431040}
I20260709 13:17:30.154417 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.153851 20214 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.147944 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 210) took 1791 ms. Trace:
I20260709 13:17:30.174319 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.147811 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.155966 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:30.178930 19702 tablet_bootstrap.cc:492] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:30.179514 19702 ts_tablet_manager.cc:1403] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 1.784s	user 0.047s	sys 0.082s
I20260709 13:17:30.180591 19701 ts_tablet_manager.cc:1434] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.284s	user 0.012s	sys 0.001s
I20260709 13:17:30.184453 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.145241 19656 rpcz_store.cc:276] 0709 13:17:28.353313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.353575 (+   262us) service_pool.cc:224] Handling call
0709 13:17:28.944769 (+591194us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b58000e1c98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:30.129824 (+1185055us) spinlock_profiling.cc:243] Waited 9.04 ms on lock 0x7b58000e1c98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635e9c 00007f6c2e635a5b 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:30.130124 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:30.130412 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:30.130475 (+    63us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:30.130657 (+   182us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:30.130712 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.130810 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:30.131025 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25098880}
I20260709 13:17:30.189494 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 219) took 1680 ms. Trace:
I20260709 13:17:30.144870 20204 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.197721 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.206118 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 232) took 1363 ms. Trace:
I20260709 13:17:30.206331 20176 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:30.189934 19587 rpcz_store.cc:276] 0709 13:17:28.509057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.509214 (+   157us) service_pool.cc:224] Handling call
0709 13:17:30.188830 (+1679616us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:30.189021 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:30.189215 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:30.189239 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:30.189280 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:30.189307 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.189350 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:30.189435 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101566720}
I20260709 13:17:30.173439 19586 rpcz_store.cc:276] 0709 13:17:28.354046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.354526 (+   480us) service_pool.cc:224] Handling call
0709 13:17:30.138998 (+1784472us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:30.139257 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:30.139489 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:30.139527 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:30.139582 (+    55us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:30.139631 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.139707 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:30.144544 (+  4837us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103793024}
I20260709 13:17:30.210417 19701 tablet_bootstrap.cc:492] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:30.212191 19703 tablet_bootstrap.cc:492] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:30.184062 20211 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.214147 20214 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:30.191205 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.206398 19652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 299) took 1408 ms. Trace:
W20260709 13:17:30.222375 19625 leader_election.cc:343] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:30.222945 19625 leader_election.cc:343] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.194963 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.219480 19652 rpcz_store.cc:276] 0709 13:17:28.798489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.801807 (+  3318us) service_pool.cc:224] Handling call
0709 13:17:30.175541 (+1373734us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b58000e1c98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:30.181494 (+  5953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:30.186827 (+  5333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:30.188692 (+  1865us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:30.193599 (+  4907us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:30.206139 (+ 12540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.206220 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:30.206342 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5252864}
I20260709 13:17:30.226092 20164 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:17:30.230230 19625 leader_election.cc:343] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.146070 19654 rpcz_store.cc:276] 0709 13:17:28.847661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.905592 (+ 57931us) service_pool.cc:224] Handling call
0709 13:17:30.136194 (+1230602us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b58000e1c98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:30.136515 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:30.136817 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:30.136870 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:30.136933 (+    63us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:30.136992 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.137082 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:30.137256 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17993600}
I20260709 13:17:30.206615 19583 rpcz_store.cc:276] 0709 13:17:28.842738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.356335 (+513597us) service_pool.cc:224] Handling call
0709 13:17:29.569633 (+213298us) spinlock_profiling.cc:243] Waited 894 us on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635e9c 00007f6c2e635a5b 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:29.569828 (+   195us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:29.570230 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.570274 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:29.570781 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:17:30.177418 (+606637us) raft_consensus.cc:1645] Marking committed up to 0
0709 13:17:30.179063 (+  1645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.182953 (+  3890us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:30.184797 (+  1844us) raft_consensus.cc:1685] finished
0709 13:17:30.186009 (+  1212us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:30.206020 (+ 20011us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1207,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":2310,"spinlock_wait_cycles":2071552,"thread_start_us":600063,"threads_started":1,"wal-append.queue_time_us":577301}
I20260709 13:17:30.212755 20176 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.216634 20208 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.238997 20202 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.239471 20157 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.240895 20202 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.229106 20172 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:30.224196 20130 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.044100 19509 rpcz_store.cc:276] 0709 13:17:28.135163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.147315 (+ 12152us) service_pool.cc:224] Handling call
0709 13:17:28.193887 (+ 46572us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.556742 (+362855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.565345 (+  8603us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:28.712036 (+146691us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.910227 (+198191us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:29.507416 (+597189us) log.cc:844] Serialized 14 byte log entry
0709 13:17:29.891266 (+383850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.901028 (+  9762us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.903767 (+  2739us) raft_consensus.cc:1685] finished
0709 13:17:29.950182 (+ 46415us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.970162 (+ 19980us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30219,"prepare.queue_time_us":586888,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":105136,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":17921,"thread_start_us":1054376,"threads_started":3,"wal-append.queue_time_us":332107}
I20260709 13:17:30.247522 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.248230 19509 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:30.251700 19625 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:30.243834 20172 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.254246 19702 raft_consensus.cc:359] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.254959 19702 raft_consensus.cc:385] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.255215 19702 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.255810 19702 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.259763 20172 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.262909 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:30.263847 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 312) took 1416 ms. Trace:
I20260709 13:17:30.226852 20164 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.268888 20204 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.270864 19702 ts_tablet_manager.cc:1434] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.091s	user 0.011s	sys 0.000s
I20260709 13:17:30.272800 20176 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.256119 20214 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:30.274549 20185 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.274492 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:30.277824 19652 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:30.275350 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:30.256982 20050 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.280167 19701 tablet_bootstrap.cc:654] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.284189 20050 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:30.277051 20214 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:30.285351 20050 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.287040 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:30.285352 20214 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.288364 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:30.291841 19702 tablet_bootstrap.cc:492] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: Bootstrap starting.
W20260709 13:17:30.292881 19478 leader_election.cc:343] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.269675 19658 rpcz_store.cc:276] 0709 13:17:28.847364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.851364 (+  4000us) service_pool.cc:224] Handling call
0709 13:17:30.263154 (+1411790us) spinlock_profiling.cc:243] Waited 8.98 ms on lock 0x7b58000e1c98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:30.263342 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:30.263529 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:30.263558 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:30.263605 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:30.263633 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.263695 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:30.263796 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20664704}
I20260709 13:17:30.293382 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:30.293521 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:30.294114 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:30.294759 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:30.295413 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:30.282856 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:30.298646 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:30.297446 20185 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:30.300257 19703 tablet_bootstrap.cc:654] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.297900 20176 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:30.301965 20164 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.301980 20176 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.300889 20219 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:30.474479 20176 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.304083 20219 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.455003 20128 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:30.478672 20202 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:30.554481 20219 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.532177 20222 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:30.556613 20222 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.559088 20222 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:30.567245 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 267591us
W20260709 13:17:30.569103 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 270071us
I20260709 13:17:30.545969 20050 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.532513 20202 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.515180 20128 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.566870 20212 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:30.574039 20088 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:30.576819 20181 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:30.578658 20178 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:30.585383 20156 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:30.597896 20185 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:30.596822 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:30.598171 20130 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:17:30.706676 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 131976us
I20260709 13:17:30.600471 20212 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.610363 20172 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:30.598920 20088 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.705650 20165 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:30.708995 20194 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.709054 20220 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:30.712009 20164 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:30.752767 20226 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:30.606267 20181 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.759950 20228 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:30.760560 20228 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.611871 20178 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.706284 20185 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.766599 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:30.711081 20130 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.769420 20128 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:30.764487 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:30.770725 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:30.782061 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:30.782855 19586 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:30.784909 20157 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:30.762943 20228 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.785663 20157 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.786589 20174 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:30.787086 20174 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:30.790369 20214 consensus_meta.cc:287] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.004s
I20260709 13:17:30.790135 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.790944 19511 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:30.790752 20214 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.754675 20088 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:30.792943 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.704691 20156 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.770674 20196 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.748471 20172 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.750089 20165 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.807950 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.808729 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.774240 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:30.809819 19627 leader_election.cc:343] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.799651 19409 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48852 (request call id 109) took 3083 ms. Trace:
I20260709 13:17:30.815358 19409 rpcz_store.cc:276] 0709 13:17:27.712223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.712947 (+   724us) service_pool.cc:224] Handling call
0709 13:17:30.795313 (+3082366us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:27.721356 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:27.721905 (+   549us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:27.721943 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:17:27.721959 (+    16us) tablet.cc:662] Decoding operations
0709 13:17:27.722265 (+   306us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:27.722324 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:27.722354 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:27.728099 (+  5745us) tablet.cc:701] Row locks acquired
0709 13:17:27.728114 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:17:27.728244 (+   130us) write_op.cc:270] Start()
0709 13:17:27.728345 (+   101us) write_op.cc:276] Timestamp: P: 1783603047728207 usec, L: 0
0709 13:17:27.728365 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:17:27.728942 (+   577us) log.cc:844] Serialized 543 byte log entry
0709 13:17:28.868589 (+1139647us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b54002ec628. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37b169e1 00007f6c37b1564c 00007f6c351913bb 00007f6c3519371a 00007f6c351936a8 00007f6c35193628 00007f6c351935e3 00007f6c351927fc 00007f6c375c5626 00007f6c375bfdd8 00007f6c31766310
0709 13:17:28.868751 (+   162us) op_driver.cc:464] REPLICATION: finished
0709 13:17:29.191924 (+323173us) write_op.cc:301] APPLY: starting
0709 13:17:29.200020 (+  8096us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:29.214106 (+ 14086us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:29.216830 (+  2724us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:29.274019 (+ 57189us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:29.294350 (+ 20331us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:29.304690 (+ 10340us) write_op.cc:312] APPLY: finished
0709 13:17:29.333938 (+ 29248us) log.cc:844] Serialized 22 byte log entry
0709 13:17:29.659169 (+325231us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:29.677895 (+ 18726us) write_op.cc:454] Released schema lock
0709 13:17:29.686567 (+  8672us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:29.840226 (+153659us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:29.845777 (+  5551us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4030,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":229124,"apply.run_cpu_time_us":51891,"apply.run_wall_time_us":688198,"num_ops":1,"prepare.queue_time_us":153,"prepare.run_cpu_time_us":2400,"prepare.run_wall_time_us":9100,"replication_time_us":121360,"spinlock_wait_cycles":4507392,"thread_start_us":281714,"threads_started":2,"wal-append.queue_time_us":501965}]]}
I20260709 13:17:30.808355 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:30.819307 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.811607 19924 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:30.820006 19924 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.820583 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.820981 20095 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.822077 19924 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:30.815358 19627 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:30.798346 20214 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:30.826680 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:30.765972 20164 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.805037 20208 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:30.801550 20178 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:30.802789 20228 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:30.802083 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:30.830382 19627 leader_election.cc:343] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.833210 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.837536 19627 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:30.802109 20229 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.828722 19924 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:30.847822 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:30.757288 20220 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.830946 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.825830 20165 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:30.833199 20202 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:30.855909 19627 consensus_peers.cc:597] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.855672 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:30.838973 20214 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:30.839957 20182 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:30.860112 20212 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.773855 20226 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.832607 20208 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.866789 19703 tablet_bootstrap.cc:492] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:30.870510 19703 ts_tablet_manager.cc:1403] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.659s	user 0.020s	sys 0.009s
I20260709 13:17:30.860743 19924 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:30.867930 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:30.858969 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:30.861152 20214 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:30.860134 20130 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.886874 19702 tablet_bootstrap.cc:654] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.883296 20220 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.865330 20202 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:30.849934 20228 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.891337 19581 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:30.898700 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.899268 20088 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:30.899626 19510 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:30.899863 20088 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.901021 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.906184 19703 raft_consensus.cc:359] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.917768 19703 raft_consensus.cc:385] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.918200 19703 raft_consensus.cc:740] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.926028 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:30.946126 20171 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:30.894631 20214 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:30.949803 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 90492.8us
I20260709 13:17:30.947763 19703 consensus_queue.cc:260] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.896193 20202 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:30.893221 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:30.869181 20182 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:30.858170 20229 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:30.958287 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 248159us
I20260709 13:17:30.907740 20164 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:30.967726 20231 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:17:30.972756 20181 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:30.972919 19407 rpcz_store.cc:275] Call kudu.master.MasterService.IsCreateTableDone from 127.0.0.1:48858 (request call id 38) took 1767 ms. Trace:
I20260709 13:17:30.956750 20202 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.954077 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.993351 19551 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:30.994416 19703 ts_tablet_manager.cc:1434] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.124s	user 0.008s	sys 0.000s
W20260709 13:17:30.953886 19478 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.841s (SENT) [suppressed 3 similar messages]
I20260709 13:17:30.995407 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:30.956133 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.012679 20229 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:31.017081 19701 tablet_bootstrap.cc:492] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:30.958920 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:30.961321 19505 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.975229 19407 rpcz_store.cc:276] 0709 13:17:29.204097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.204284 (+   187us) service_pool.cc:224] Handling call
0709 13:17:29.204658 (+   374us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0709 13:17:29.204885 (+   227us) catalog_manager.cc:2317] Verify if the table creation is in progress for test-workload [id=aed62f436c1a475c9621b6aef3f2a036]
0709 13:17:30.970491 (+1765606us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1764034}
I20260709 13:17:30.969187 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:31.020740 19703 tablet_bootstrap.cc:492] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:31.017804 19701 ts_tablet_manager.cc:1403] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.829s	user 0.015s	sys 0.026s
I20260709 13:17:30.971553 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:30.990414 20161 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:30.996470 20088 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:30.996162 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.015576 20185 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:31.028052 20225 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:31.018551 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.038249 20128 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:31.038354 19924 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:31.038460 20239 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:31.051767 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.037808 20095 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.946708 20171 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:31.026185 19581 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:31.032290 20231 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:31.041380 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.042467 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:31.052536 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.061532 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.062604 19587 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:31.051666 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.063445 20192 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:31.050158 20225 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:31.069062 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.069779 19587 raft_consensus.cc:2393] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 1: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:31.064807 20226 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:31.064456 20239 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:31.067435 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.042121 20161 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:31.054611 20128 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:31.064993 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.055804 19924 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:31.060494 20095 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:31.062130 20231 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:31.064821 19509 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:31.223675 19410 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48840 (request call id 104) took 3428 ms. Trace:
I20260709 13:17:31.064924 19583 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:31.218375 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.248413 19410 rpcz_store.cc:276] 0709 13:17:27.795080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.795258 (+   178us) service_pool.cc:224] Handling call
0709 13:17:28.948121 (+1152863us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b54002ec7d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c4090 00007f6c31762f3a 00007f6c375191cc 00007f6c3761737e 00007f6c35ad82a4 00007f6c35ad8232 00007f6c35ad8161 00007f6c35ad80dc 00007f6c35ad7392 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:17:31.223581 (+2275460us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":2083935616}
I20260709 13:17:31.249976 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.228199 20228 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:31.162303 20059 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:31.229281 20157 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:31.126310 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.226781 20172 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:31.266966 19582 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:31.267424 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 233) took 2424 ms. Trace:
W20260709 13:17:31.130581 20235 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:17:31.070674 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 231) took 1187 ms. Trace:
I20260709 13:17:31.268301 19924 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:31.127110 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.068143 20225 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.316540 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.070556 20208 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:31.219708 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:31.330080 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:31.331647 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:31.112810 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:31.076565 20195 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:31.090067 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.148532 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:31.340277 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.216125 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.077514 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:31.070922 20156 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:31.355834 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.164150 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.130102 20180 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.078922 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.220126 20202 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:31.365198 19551 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:31.268340 19504 rpcz_store.cc:276] 0709 13:17:29.881816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.886084 (+  4268us) service_pool.cc:224] Handling call
0709 13:17:31.024385 (+1138301us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:31.041667 (+ 17282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:31.050344 (+  8677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:31.054118 (+  3774us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:31.056451 (+  2333us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:31.059995 (+  3544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.064234 (+  4239us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.068881 (+  4647us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35350272}
I20260709 13:17:31.371881 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.253186 20214 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:31.358047 20095 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:31.370522 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:31.353087 20050 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:31.356037 20174 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:31.355419 19506 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:31.382934 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 243) took 1330 ms. Trace:
I20260709 13:17:31.382989 20161 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:31.383251 20182 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:31.361783 19581 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:31.385188 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:31.383406 19506 rpcz_store.cc:276] 0709 13:17:30.052248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.219344 (+1167096us) service_pool.cc:224] Handling call
0709 13:17:31.382861 (+163517us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:31.353488 20195 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:31.267848 19579 rpcz_store.cc:276] 0709 13:17:28.842966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.410374 (+567408us) service_pool.cc:224] Handling call
0709 13:17:31.266638 (+1856264us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:31.266852 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:31.267069 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:31.267100 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:31.267141 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:31.267175 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.267235 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.267358 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45826304}
I20260709 13:17:31.367270 19510 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:31.373078 20175 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:31.088914 20192 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:31.401921 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:31.525555 20238 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:31.525919 19507 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:31.526145 20238 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:31.526680 20238 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:31.526775 19507 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 259) took 1306 ms (client timeout 1529 ms). Trace:
I20260709 13:17:31.402006 19924 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:31.360296 20171 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:31.403826 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.379144 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:31.404944 20183 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:31.514174 19707 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:31.535223 19707 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:31.516098 20220 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.539602 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:31.539822 20220 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:31.512261 20226 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.400188 20050 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:31.400516 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.535267 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:31.537886 20184 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:31.390093 20180 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:31.527421 19507 rpcz_store.cc:269] 0709 13:17:30.220404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.235394 (+ 14990us) service_pool.cc:224] Handling call
0709 13:17:31.401735 (+1166341us) spinlock_profiling.cc:243] Waited 912 us on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:17:31.526625 (+124890us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2097024}
I20260709 13:17:31.539155 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:31.517210 19701 raft_consensus.cc:359] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:31.539517 19924 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:31.562093 20128 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:31.562252 19707 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:31.564741 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:31.556427 19509 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.532578 20239 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:31.565959 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.559639 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:31.578387 19503 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:31.606137 19924 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:31.614241 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.606395 19701 raft_consensus.cc:385] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.618160 19701 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.618103 19580 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:31.619092 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:31.582827 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:31.618119 20181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.006s	sys 0.022s
W20260709 13:17:31.637604 19478 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.007s	sys 0.007s
I20260709 13:17:31.559744 20226 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:31.633846 19627 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.110s	sys 0.160s
W20260709 13:17:31.621809 19505 consensus_meta.cc:287] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.002s
I20260709 13:17:31.635996 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.629132 19701 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:31.638162 19478 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.007s	sys 0.007s
W20260709 13:17:31.639784 19627 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.110s	sys 0.160s
I20260709 13:17:31.639586 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:31.643018 19511 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
W20260709 13:17:31.645445 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 523507us
I20260709 13:17:31.629438 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:31.645445 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 688492us
W20260709 13:17:31.638077 20181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.006s	sys 0.022s
I20260709 13:17:31.655285 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.610797 20184 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:31.666003 19701 ts_tablet_manager.cc:1434] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.644s	user 0.017s	sys 0.009s
W20260709 13:17:31.668764 19701 ts_tablet_manager.cc:1467] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Tablet startup took 646ms
I20260709 13:17:31.646347 20202 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:31.670338 19701 ts_tablet_manager.cc:1469] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Trace:
0709 13:17:16.941114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.981971 (+1040857us) service_pool.cc:224] Handling call
0709 13:17:18.025949 (+ 43978us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:18.026047 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:18.234915 (+208868us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:18.276756 (+ 41841us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:18.280948 (+  4192us) inbound_call.cc:177] Queueing success response
0709 13:17:30.182746 (+11901798us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:17:31.022253 (+839507us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:17:31.131484 (+109231us) tablet_replica.cc:261] Starting instrumentation
0709 13:17:31.132207 (+   723us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":4464,"tablet-open.queue_time_us":11904191}
W20260709 13:17:31.685118 19702 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.026s	sys 0.031s
W20260709 13:17:31.687463 19702 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.027s	sys 0.031s
I20260709 13:17:31.660720 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:31.660280 19581 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:31.682359 20220 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:31.685673 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:31.684221 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.693291 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.689350 20214 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:31.704788 19703 tablet_bootstrap.cc:654] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.688481 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.694777 20195 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:31.699234 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.699903 20181 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:31.698959 19503 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:31.717932 20231 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:31.709707 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.707819 19584 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:31.711638 19583 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
W20260709 13:17:31.721733 19550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.051s	sys 0.091s
I20260709 13:17:31.716646 20226 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:31.721042 19660 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:31.721251 20181 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:31.734387 19550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.051s	sys 0.093s
I20260709 13:17:31.729558 19582 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
W20260709 13:17:31.737010 20241 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:17:31.733736 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.749769 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.742995 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:31.749393 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.735284 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:31.742910 20192 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:31.767129 19702 tablet_bootstrap.cc:492] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: No bootstrap required, opened a new log
I20260709 13:17:31.768227 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.771279 19657 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:31.771380 19702 ts_tablet_manager.cc:1403] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: Time spent bootstrapping tablet: real 1.490s	user 0.039s	sys 0.033s
I20260709 13:17:31.772075 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.752432 20184 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:31.763550 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.772739 20181 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:31.781865 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.788856 19657 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:31.772487 19507 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:31.782399 19924 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:31.860301 19924 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:31.860836 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.861809 19583 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:31.768033 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.863153 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.769078 19658 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:31.926605 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.928058 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.928988 19658 raft_consensus.cc:2393] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 1: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:31.783686 19660 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:31.923357 19578 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.925056 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.808732 20194 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:31.773068 19503 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:32.023139 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.025048 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.992769 20194 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.033818 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:31.790028 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:31.934538 20197 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.064097 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:32.004220 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:32.071846 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.036494 19654 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:32.079082 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:32.069108 19658 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:32.080091 19661 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.086724 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:32.084302 20192 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:32.087312 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:32.087477 19924 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:32.087675 20192 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.088140 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 280) took 1056 ms. Trace:
W20260709 13:17:32.086766 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 148900us
I20260709 13:17:32.059839 20197 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.088418 19702 raft_consensus.cc:359] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.091063 19657 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:32.092895 19702 raft_consensus.cc:385] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.093286 19702 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Initialized, Role: FOLLOWER
I20260709 13:17:32.093989 19702 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.098485 19661 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:32.099529 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:32.082998 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:32.088567 19504 rpcz_store.cc:276] 0709 13:17:31.032130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.073476 (+1041346us) service_pool.cc:224] Handling call
0709 13:17:32.088074 (+ 14598us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:32.102874 20180 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:32.103729 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:32.104303 19551 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:32.086138 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.105428 19661 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:32.088850 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:32.107177 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:32.108225 19702 ts_tablet_manager.cc:1434] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: Time spent starting tablet: real 0.336s	user 0.006s	sys 0.002s
I20260709 13:17:32.109221 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:32.109395 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:32.109916 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:32.115533 20180 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.115545 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.120632 19476 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:32.121803 19476 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:32.122493 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:32.099597 20181 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:32.125077 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:32.109722 20062 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:32.124709 20180 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:17:32.132052 19458 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:32.128175 19551 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:32.123723 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.119527 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:32.125995 20203 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.141786 20203 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:32.142216 20203 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.143821 19625 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:32.145136 20231 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.126577 20170 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.145556 20231 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:32.145991 20231 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.146298 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:32.147064 19508 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:32.147607 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 331) took 1113 ms. Trace:
I20260709 13:17:32.147948 19508 rpcz_store.cc:276] 0709 13:17:31.034348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.145958 (+1111610us) service_pool.cc:224] Handling call
0709 13:17:32.147544 (+  1586us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:32.149055 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:32.130216 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:32.136984 20222 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.150285 19504 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 1: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:32.126853 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:32.138230 19655 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:32.138324 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:32.172003 19653 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:32.127614 20181 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.175593 20181 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:32.176137 19657 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.177656 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.178876 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.179932 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.180466 19585 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:32.181274 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.182336 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 240) took 1277 ms. Trace:
I20260709 13:17:32.139894 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.128718 20062 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.130415 20226 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.187268 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.137588 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:32.124588 20174 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.188331 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.188803 20174 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:32.189203 20174 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.190476 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:32.190681 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.191223 19504 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
W20260709 13:17:32.193360 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 55873.6us
I20260709 13:17:32.192386 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.145277 19625 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:32.135617 20192 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:32.156402 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:32.161202 20238 consensus_meta.cc:287] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.634s	user 0.008s	sys 0.003s
I20260709 13:17:32.165764 19507 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:32.170339 20197 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:32.134491 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:32.186025 19657 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:32.134159 20180 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.182722 19655 rpcz_store.cc:276] 0709 13:17:30.904550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.906093 (+  1543us) service_pool.cc:224] Handling call
0709 13:17:32.134835 (+1228742us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b58000e1c98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:32.138026 (+  3191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.182073 (+ 44047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.182280 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55701888}
I20260709 13:17:32.186586 20062 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.194290 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:32.194469 19587 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
W20260709 13:17:32.194919 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 49688.1us
I20260709 13:17:32.192376 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:32.137694 20225 consensus_meta.cc:287] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.810s	user 0.016s	sys 0.020s
W20260709 13:17:32.196826 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 75103.9us
I20260709 13:17:32.205709 20180 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.208444 19625 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:32.208444 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:32.188426 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.209606 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:32.210438 19625 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:32.211378 19625 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:32.211550 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:32.212100 19625 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:32.195839 20226 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.212965 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:32.200464 20181 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.192989 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.214818 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:32.215893 19476 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:32.235515 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:32.210124 20222 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.216403 19585 raft_consensus.cc:2410] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:17:32.235162 19476 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:32.214433 20195 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.212847 20170 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:32.286828 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51787.8us
I20260709 13:17:32.213044 20186 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.200177 20238 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.287817 19476 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:32.199983 20203 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.214000 20184 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.212651 20220 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.214059 19924 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.244242 20197 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.217881 20228 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.217563 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:17:32.398927 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 163536us
I20260709 13:17:32.285883 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:32.242288 20211 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.288038 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:32.216800 20181 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:32.293576 20161 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.403151 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:32.411531 20161 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:32.412014 20161 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.288666 20195 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:32.292609 20186 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:17:32.319310 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 107257us
I20260709 13:17:32.213678 20225 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.244516 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:32.326072 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:32.400275 20170 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.400125 20168 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.410542 19703 tablet_bootstrap.cc:492] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:32.444918 19703 ts_tablet_manager.cc:1403] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 1.424s	user 0.029s	sys 0.066s
I20260709 13:17:32.444710 20168 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.412076 19508 raft_consensus.cc:2393] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 2: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:17:32.358801 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 71068.3us
I20260709 13:17:32.400496 20251 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.405884 19924 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:32.414045 19512 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
W20260709 13:17:32.411589 19659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 238) took 1507 ms (client timeout 1817 ms). Trace:
I20260709 13:17:32.417841 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.450809 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:32.451249 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.451674 19508 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 1: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:32.452477 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.419102 20238 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:32.413065 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:32.453591 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:32.420114 20254 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.454308 20254 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:32.454419 19508 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:32.454717 20254 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.404850 20197 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:32.422211 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.422384 19625 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:32.423116 20225 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:32.415198 20195 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.407270 20228 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:32.427281 20203 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:32.405603 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.409883 19582 raft_consensus.cc:2393] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:32.433032 19503 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:32.477033 19580 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:32.433878 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:32.467279 20197 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.478217 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.435133 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.437767 20226 consensus_queue.cc:1059] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.429576 20186 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.438968 19407 catalog_manager.cc:5697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.440049 20231 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.432278 19551 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:17:32.483894 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51745.4us
I20260709 13:17:32.441828 19510 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:32.441951 19661 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:32.443614 19509 consensus_meta.cc:287] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.827s	user 0.016s	sys 0.017s
I20260709 13:17:32.413769 20181 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.448572 19476 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:32.445662 20170 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:32.412777 19581 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.453591 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.468703 20168 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:32.447968 19924 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.447106 20251 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:32.507431 20251 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:32.449340 19659 rpcz_store.cc:269] 0709 13:17:30.903873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.906225 (+  2352us) service_pool.cc:224] Handling call
0709 13:17:32.212450 (+1306225us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b58000e1c98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:17:32.411487 (+199037us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53772160}
I20260709 13:17:32.481317 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:32.487550 20211 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.485100 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:32.470279 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:32.474431 20228 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.470399 19504 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:32.478880 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:32.490792 19476 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:32.491966 19703 raft_consensus.cc:359] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.503715 20257 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.505900 20192 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:32.506568 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:32.506649 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.481407 19580 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
W20260709 13:17:32.482462 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 60143.3us
W20260709 13:17:32.531877 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 46862.3us
I20260709 13:17:32.490424 20170 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.470439 20161 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.486038 19509 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:32.529422 20062 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.493904 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 284) took 1326 ms. Trace:
I20260709 13:17:32.537793 19703 raft_consensus.cc:385] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:32.538795 20257 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.547812 19625 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:32.553309 19703 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
W20260709 13:17:32.550347 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 60778.4us
I20260709 13:17:32.534303 20252 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.557531 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:32.556221 19625 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:32.543035 20159 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.545208 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:32.541936 19653 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:32.538826 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.576278 19476 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:32.540683 20192 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.545053 19512 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.544656 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 255) took 2344 ms. Trace:
W20260709 13:17:32.558065 19509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 269) took 1546 ms (client timeout 1708 ms). Trace:
I20260709 13:17:32.557556 19703 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.581085 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:32.582444 20161 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:32.587255 19511 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:32.587656 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 277) took 1575 ms. Trace:
I20260709 13:17:32.556090 20095 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:32.533954 20180 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:32.586591 19509 rpcz_store.cc:269] 0709 13:17:31.009734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.331740 (+322006us) service_pool.cc:224] Handling call
0709 13:17:32.556028 (+1224288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:32.587874 19511 rpcz_store.cc:276] 0709 13:17:31.012709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.644320 (+631611us) service_pool.cc:224] Handling call
0709 13:17:32.580934 (+936614us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:17:32.587596 (+  6662us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5354240}
I20260709 13:17:32.580847 20159 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:32.591539 20159 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.592048 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 328) took 1760 ms. Trace:
I20260709 13:17:32.592700 19511 rpcz_store.cc:276] 0709 13:17:30.831302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.591213 (+1759911us) service_pool.cc:224] Handling call
0709 13:17:32.591557 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.591717 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.591742 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:32.591781 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:32.591820 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.591893 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.592000 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:32.592083 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 326) took 1781 ms. Trace:
I20260709 13:17:32.550005 20226 consensus_queue.cc:1059] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:17:32.593734 19509 rpcz_store.cc:276] 0709 13:17:30.811019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.591253 (+1780234us) service_pool.cc:224] Handling call
0709 13:17:32.591636 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.591785 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.591812 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:32.591857 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:32.591885 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.591936 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.592032 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83328}
I20260709 13:17:32.578536 20255 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.619318 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:32.589442 20203 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.620689 20062 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:32.622220 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:32.626471 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.619318 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:32.627823 20181 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.586302 20192 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.619845 20166 consensus_queue.cc:1059] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.610008 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:32.586283 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 346) took 1068 ms. Trace:
I20260709 13:17:32.617372 20095 raft_consensus.cc:697] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:32.640550 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 264) took 1721 ms. Trace:
I20260709 13:17:32.646798 19509 rpcz_store.cc:276] 0709 13:17:30.918948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.639728 (+1720780us) service_pool.cc:224] Handling call
0709 13:17:32.640058 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.640233 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.640257 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:32.640299 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:32.640326 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.640381 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.640494 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:32.641752 19583 raft_consensus.cc:2393] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 1: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:32.584683 20253 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:32.642364 20252 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:32.553157 19510 rpcz_store.cc:276] 0709 13:17:31.160672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.553931 (+393259us) service_pool.cc:224] Handling call
0709 13:17:32.215996 (+662065us) spinlock_profiling.cc:243] Waited 4.99 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:17:32.487186 (+271190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11477248}
I20260709 13:17:32.649747 20253 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.650377 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 265) took 1731 ms. Trace:
I20260709 13:17:32.650735 19509 rpcz_store.cc:276] 0709 13:17:30.919198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.649541 (+1730343us) service_pool.cc:224] Handling call
0709 13:17:32.649886 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.650061 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.650093 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:32.650131 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:32.650159 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.650213 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.650320 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:32.651723 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 263) took 1733 ms. Trace:
I20260709 13:17:32.652146 19511 rpcz_store.cc:276] 0709 13:17:30.918491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.601021 (+1682530us) service_pool.cc:224] Handling call
0709 13:17:32.651246 (+ 50225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.651407 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.651431 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:32.651474 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:32.651505 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.651559 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.651664 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:32.670951 19701 tablet_bootstrap.cc:492] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:32.672468 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:32.673256 19657 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.670049 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.676043 19584 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:32.675890 20095 consensus_queue.cc:237] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.677184 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.637331 20203 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:32.630981 20255 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:32.643662 20231 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:32.612434 20254 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.696194 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.697666 19703 ts_tablet_manager.cc:1434] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.252s	user 0.027s	sys 0.054s
I20260709 13:17:32.646116 19658 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
W20260709 13:17:32.697961 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 140480us
I20260709 13:17:32.698592 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.698778 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:32.699651 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.670478 20184 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.636179 20174 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.711781 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:32.732211 19661 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.731572 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 273) took 1719 ms. Trace:
I20260709 13:17:32.732721 19509 rpcz_store.cc:276] 0709 13:17:31.011720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.686308 (+1674588us) service_pool.cc:224] Handling call
0709 13:17:32.731080 (+ 44772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.731252 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.731282 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:32.731321 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:32.731349 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.731402 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.731513 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:32.734493 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 274) took 1722 ms. Trace:
I20260709 13:17:32.662531 19507 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:32.689919 20203 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.735543 19509 rpcz_store.cc:276] 0709 13:17:31.011963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.733749 (+1721786us) service_pool.cc:224] Handling call
0709 13:17:32.734067 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.734216 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.734239 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:32.734274 (+    35us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:32.734299 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.734349 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.734440 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:32.689042 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:32.740644 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.689174 20255 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.691211 19581 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:32.731030 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.646557 19506 rpcz_store.cc:276] 0709 13:17:31.516257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.646722 (+130465us) service_pool.cc:224] Handling call
0709 13:17:32.506390 (+859668us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:17:32.584891 (+ 78501us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33586048}
I20260709 13:17:32.747175 19703 tablet_bootstrap.cc:492] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:32.737406 20231 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:17:32.752357 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 196202us
I20260709 13:17:32.730803 20195 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.735756 20184 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.796787 19661 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:32.753386 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.943173 19587 raft_consensus.cc:2393] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 2: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:32.833251 19657 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
W20260709 13:17:32.878386 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 116252us
I20260709 13:17:32.895881 20174 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:32.734576 20262 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.847295 20225 raft_consensus.cc:3055] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.793447 20211 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:32.795454 20253 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:32.919862 20257 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:32.837251 20254 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:32.901011 20181 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:32.756937 20180 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:32.943269 20231 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:32.871490 20194 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:32.867445 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 468140us
I20260709 13:17:33.083284 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:33.087639 20267 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:33.089820 20267 raft_consensus.cc:697] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:33.091387 20267 consensus_queue.cc:237] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.586517 19505 rpcz_store.cc:276] 0709 13:17:30.192172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.212979 (+ 20807us) service_pool.cc:224] Handling call
0709 13:17:30.920065 (+707086us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635eee 0000000000375939 00007f6c366a91e0 00007f6c367720c4 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:30.953091 (+ 33026us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:31.660525 (+707434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:31.681184 (+ 20659us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:31.702020 (+ 20836us) log.cc:844] Serialized 26 byte log entry
0709 13:17:32.049873 (+347853us) raft_consensus.cc:1645] Marking committed up to 0
0709 13:17:32.052288 (+  2415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.052374 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:32.486208 (+433834us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b54004c1ba0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316cfdbe 00007f6c316da930 00007f6c316da8d8 00007f6c316da858 00007f6c316da813 00007f6c316d9a9c 00007f6c375c5626 00007f6c375bfdd8 00007f6c317167cb 00007f6c317192c0
0709 13:17:32.508310 (+ 22102us) raft_consensus.cc:1685] finished
0709 13:17:32.508336 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.536188 (+ 27852us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2450,"raft.queue_time_us":1612,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":2556,"spinlock_wait_cycles":44526848,"thread_start_us":208191,"threads_started":1,"wal-append.queue_time_us":263923}
I20260709 13:17:33.098134 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:33.099207 19505 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.035440 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:32.841163 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 276) took 1828 ms. Trace:
I20260709 13:17:32.847759 19512 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:32.905730 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 278) took 1892 ms. Trace:
I20260709 13:17:32.872684 19551 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:33.043212 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 279) took 2029 ms. Trace:
I20260709 13:17:32.888450 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 231) took 4046 ms. Trace:
I20260709 13:17:33.046150 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.046978 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.103439 19511 rpcz_store.cc:276] 0709 13:17:31.012979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.874043 (+1861064us) service_pool.cc:224] Handling call
0709 13:17:32.905022 (+ 30979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.905251 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.905291 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:32.905348 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:32.905387 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.905458 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.905646 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1954560}
I20260709 13:17:33.048938 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:17:33.105469 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 232757us
I20260709 13:17:33.051337 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 249) took 1306 ms. Trace:
I20260709 13:17:32.947537 19625 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:33.054394 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.942736 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:32.755888 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:33.112226 19509 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.113132 19655 raft_consensus.cc:2393] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 1: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:33.056028 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.113328 19506 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:33.065582 19703 tablet_bootstrap.cc:654] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:32.982640 20192 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.117311 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.118875 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.119168 20192 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:32.971868 19924 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.119733 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 275) took 2107 ms. Trace:
I20260709 13:17:32.982461 20184 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:33.112221 19584 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:32.984109 20195 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:17:32.983108 20197 consensus_meta.cc:287] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.005s
I20260709 13:17:33.126545 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:33.110638 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:33.128845 19512 raft_consensus.cc:2393] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 1: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:33.112439 19507 rpcz_store.cc:276] 0709 13:17:31.012454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.754337 (+1741883us) service_pool.cc:224] Handling call
0709 13:17:32.826473 (+ 72136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.837181 (+ 10708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.837454 (+   273us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:32.840786 (+  3332us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:32.840849 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.840933 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.841089 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:32.985771 20203 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.130180 20180 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.972824 20262 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:17:33.131654 20170 consensus_meta.cc:287] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.582s	user 0.005s	sys 0.010s
I20260709 13:17:33.131762 20262 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.988481 20220 raft_consensus.cc:3055] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.134325 20220 raft_consensus.cc:740] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:32.977027 20225 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:32.984323 20228 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.137491 20225 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.141000 20225 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.984578 20231 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.143386 19587 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:33.144670 19586 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:32.989331 20251 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:32.864898 20159 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.146054 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.147882 20159 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:17:33.072026 20186 consensus_meta.cc:287] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.580s	user 0.006s	sys 0.006s
I20260709 13:17:33.148887 20186 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.147826 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.150372 19656 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.151576 20186 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:33.073334 20254 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.076824 20168 raft_consensus.cc:3055] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.150427 19587 raft_consensus.cc:2376] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1. Re-sending same reply.
I20260709 13:17:33.108568 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.108789 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:33.109683 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 167765us
I20260709 13:17:33.110535 20181 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:33.064442 19701 tablet_bootstrap.cc:654] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:33.116375 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.110479 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.120210 19509 rpcz_store.cc:276] 0709 13:17:31.012206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.741854 (+1729648us) service_pool.cc:224] Handling call
0709 13:17:33.111685 (+369831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.112819 (+  1134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.119451 (+  6632us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b540037c3d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:17:33.119642 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837636864}
I20260709 13:17:33.121996 19476 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:33.106982 19582 rpcz_store.cc:276] 0709 13:17:31.744762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.746462 (+  1700us) service_pool.cc:224] Handling call
0709 13:17:33.050724 (+1304262us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b540011dad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:17:33.051026 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1132303744}
I20260709 13:17:33.125737 19924 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:33.127239 20197 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.158202 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.158973 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:33.159191 20197 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:32.985520 20255 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.159719 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.161206 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 330) took 2127 ms. Trace:
I20260709 13:17:33.132628 20203 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:33.132244 20170 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.103333 19504 rpcz_store.cc:276] 0709 13:17:31.013504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.898114 (+1884610us) service_pool.cc:224] Handling call
0709 13:17:33.035765 (+137651us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:33.036359 (+   594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.036933 (+   574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.036986 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.042383 (+  5397us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:33.042477 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.042615 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.042901 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33176448}
I20260709 13:17:33.130175 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:33.107959 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:17:33.155123 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 53173.4us
I20260709 13:17:33.155308 19508 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.155033 20254 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.166589 19585 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:33.167697 20251 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:33.155440 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:33.156093 20174 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:33.152513 20168 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:33.156560 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.169890 19625 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:33.156764 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.172737 19625 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:33.158480 19506 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 2: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:33.173879 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 333) took 2138 ms. Trace:
I20260709 13:17:33.163244 20181 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:33.125185 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.174422 19504 rpcz_store.cc:276] 0709 13:17:31.035016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.172674 (+2137658us) service_pool.cc:224] Handling call
0709 13:17:33.173060 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.173367 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.173413 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.173482 (+    69us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:33.173529 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.173642 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.173801 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.175777 19584 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:33.176560 19504 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.176158 20181 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.176941 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.177258 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 334) took 2142 ms. Trace:
I20260709 13:17:33.158504 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.161242 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.136866 20220 consensus_queue.cc:260] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.156672 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.170257 20174 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.222285 20174 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.172580 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.222960 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 339) took 2182 ms. Trace:
I20260709 13:17:33.224061 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.224382 19625 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:33.172161 20168 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.226128 20168 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.227203 20195 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:33.227562 19476 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:33.227746 20195 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:33.228241 20195 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.229856 20251 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:33.230819 20251 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:33.231773 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 266) took 2134 ms. Trace:
I20260709 13:17:33.232023 20251 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.232239 19510 rpcz_store.cc:276] 0709 13:17:31.007913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.650207 (+1642294us) service_pool.cc:224] Handling call
0709 13:17:32.650515 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.650705 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:17:33.037865 (+387160us) log.cc:844] Serialized 14 byte log entry
0709 13:17:33.120043 (+ 82178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.120141 (+    98us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:33.120228 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.124726 (+  4498us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.129432 (+  4706us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b4800270258. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c36683aa1 00007f6c3667ab37 00007f6c3667a9ca 00007f6c3677226f 00007f6c36771f37 00007f6c3678655c 00007f6c36786508 00007f6c36786488 00007f6c36786443 00007f6c367856ec 00007f6c356afa96
0709 13:17:33.142454 (+ 13022us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":339133,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":188,"raft.run_cpu_time_us":3245,"raft.run_wall_time_us":9835,"spinlock_wait_cycles":6451968,"thread_start_us":459154,"threads_started":2,"wal-append.queue_time_us":110719}
I20260709 13:17:33.115434 19578 rpcz_store.cc:276] 0709 13:17:28.842455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.336145 (+493690us) service_pool.cc:224] Handling call
0709 13:17:31.024350 (+1688205us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:31.922850 (+898500us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635eee 0000000000375939 00007f6c366a91e0 00007f6c367720c4 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:31.923085 (+   235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:32.195304 (+272219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.197703 (+  2399us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:32.319983 (+122280us) log.cc:844] Serialized 26 byte log entry
0709 13:17:32.492556 (+172573us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:32.585898 (+ 93342us) log.cc:844] Serialized 14 byte log entry
0709 13:17:32.631440 (+ 45542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.641526 (+ 10086us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:32.887004 (+245478us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b2400099b48. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e4f39c4 00007f6c2e4f1acb 00007f6c2e6acdc9 00007f6c2e6b2d05 00007f6c2e6b2bd2 00007f6c2e6b2c5e 00007f6c2dfc727b 00007f6c367039ba 00007f6c2e6b2b6c 00007f6c2e6a611d
0709 13:17:32.888166 (+  1162us) raft_consensus.cc:1685] finished
0709 13:17:32.888200 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.888354 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18974,"prepare.queue_time_us":108020,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":13105,"raft.queue_time_us":59173,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":9480,"spinlock_wait_cycles":62521344,"thread_start_us":96165,"threads_started":2,"wal-append.queue_time_us":101780}
I20260709 13:17:33.209286 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.234891 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.236058 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.236398 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.237319 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.237998 19580 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:33.238830 19510 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.239037 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.239727 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 337) took 2203 ms. Trace:
I20260709 13:17:33.209286 19512 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:33.241914 19512 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:33.182053 19586 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 254) took 1426 ms (client timeout 1657 ms). Trace:
I20260709 13:17:33.201720 19551 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:33.204519 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 336) took 2168 ms. Trace:
I20260709 13:17:33.206081 20184 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:33.181231 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 335) took 2145 ms. Trace:
I20260709 13:17:33.209894 20220 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.211220 19655 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.215744 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.217072 20255 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:33.217754 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:33.223529 19656 rpcz_store.cc:276] 0709 13:17:31.040577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.563998 (+523421us) service_pool.cc:224] Handling call
0709 13:17:32.503876 (+939878us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b58000e1c98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:32.504206 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.150962 (+646756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.222491 (+ 71529us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b5400217fd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:17:33.222850 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1489647872}
I20260709 13:17:33.161602 19509 rpcz_store.cc:276] 0709 13:17:31.033821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.160066 (+2126245us) service_pool.cc:224] Handling call
0709 13:17:33.160548 (+   482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.160834 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.160868 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.160934 (+    66us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:33.160962 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.161027 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.161127 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:33.252163 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.173907 19581 raft_consensus.cc:2393] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 2: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:33.254521 19511 rpcz_store.cc:276] 0709 13:17:31.035626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.179950 (+2144324us) service_pool.cc:224] Handling call
0709 13:17:33.180501 (+   551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.180776 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.180809 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.180892 (+    83us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:33.180964 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.181050 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.181161 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.180912 20159 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:33.263286 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.184558 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 324) took 2377 ms. Trace:
I20260709 13:17:33.265909 19583 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.265798 19508 rpcz_store.cc:276] 0709 13:17:30.806858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.594400 (+1787542us) service_pool.cc:224] Handling call
0709 13:17:32.639878 (+ 45478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.169554 (+529676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.184192 (+ 14638us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b5400250654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:17:33.184473 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179574656}
I20260709 13:17:33.268338 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.269081 19581 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:33.270133 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.177888 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 281) took 1015 ms. Trace:
I20260709 13:17:33.181077 20228 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:33.183535 19924 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:33.184267 20254 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:33.240242 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.198616 19504 rpcz_store.cc:276] 0709 13:17:31.035319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.175810 (+2140491us) service_pool.cc:224] Handling call
0709 13:17:33.176297 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.176975 (+   678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.177207 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.279882 20238 raft_consensus.cc:3055] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.280494 19509 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.242537 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 340) took 2205 ms. Trace:
I20260709 13:17:33.281792 19701 tablet_bootstrap.cc:492] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:33.282616 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.271445 19585 rpcz_store.cc:276] 0709 13:17:32.162803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.453332 (+290529us) service_pool.cc:224] Handling call
0709 13:17:33.177588 (+724256us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b540011d5d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:17:33.177809 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1548142464}
I20260709 13:17:33.283833 19505 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:33.294312 19579 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:33.181560 20180 consensus_queue.cc:1059] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.113s
I20260709 13:17:33.240085 19510 rpcz_store.cc:276] 0709 13:17:31.036244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.238068 (+2201824us) service_pool.cc:224] Handling call
0709 13:17:33.238514 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.239418 (+   904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.239658 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.289995 19924 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:33.298346 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 96842.8us
W20260709 13:17:33.254040 19586 rpcz_store.cc:269] 0709 13:17:31.755170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.755321 (+   151us) service_pool.cc:224] Handling call
0709 13:17:32.422040 (+666719us) spinlock_profiling.cc:243] Waited 9.06 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:17:33.181768 (+759728us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b5400304154. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:17:33.181973 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1573236352}
I20260709 13:17:33.298125 19512 rpcz_store.cc:276] 0709 13:17:31.037237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.241229 (+2203992us) service_pool.cc:224] Handling call
0709 13:17:33.241699 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.242289 (+   590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.242481 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.254243 19506 rpcz_store.cc:276] 0709 13:17:31.035949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.203156 (+2167207us) service_pool.cc:224] Handling call
0709 13:17:33.203700 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.204017 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.204058 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.204135 (+    77us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:33.204188 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.204275 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.204435 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.301092 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 344) took 2256 ms. Trace:
I20260709 13:17:33.249126 20195 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.301545 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 341) took 2261 ms. Trace:
I20260709 13:17:33.296921 20238 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:33.329879 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 318) took 2533 ms. Trace:
I20260709 13:17:33.330065 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:33.326881 19504 rpcz_store.cc:276] 0709 13:17:31.045107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.299625 (+2254518us) service_pool.cc:224] Handling call
0709 13:17:33.300247 (+   622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.300591 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.300637 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.300732 (+    95us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:33.300788 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.300879 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.301027 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.330816 20238 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.301838 19583 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:33.302161 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:33.296658 20170 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:33.301029 19701 ts_tablet_manager.cc:1403] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.663s	user 0.026s	sys 0.030s
I20260709 13:17:33.272367 20159 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:33.313163 19924 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.313294 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.315606 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:33.315972 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.316694 20180 raft_consensus.cc:3055] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.317077 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.317816 20184 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:33.318625 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 282) took 2250 ms. Trace:
I20260709 13:17:33.320950 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.322132 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:33.322558 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.347188 19657 raft_consensus.cc:2393] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 1: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:33.347649 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.347931 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.329013 19509 rpcz_store.cc:276] 0709 13:17:31.037591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.279712 (+2242121us) service_pool.cc:224] Handling call
0709 13:17:33.280189 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.298326 (+ 18137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.298551 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.349472 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.351190 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.352146 20184 raft_consensus.cc:697] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:33.352608 19585 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:33.352890 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.353864 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.353650 20184 consensus_queue.cc:237] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.354300 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.354686 19585 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:33.355093 19586 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:33.355906 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.356138 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.333169 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:33.308668 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 84453.6us
I20260709 13:17:33.334415 19587 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:33.358422 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.358548 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.307402 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.359865 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.324878 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 283) took 2226 ms. Trace:
I20260709 13:17:33.363298 19508 rpcz_store.cc:276] 0709 13:17:31.098458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.323546 (+2225088us) service_pool.cc:224] Handling call
0709 13:17:33.324048 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.324376 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.324409 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.324485 (+    76us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:33.324531 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.324597 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.324788 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.336164 20195 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:33.341825 20180 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:33.369802 19504 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.370680 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 347) took 1810 ms. Trace:
I20260709 13:17:33.371165 19504 rpcz_store.cc:276] 0709 13:17:31.560177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.369064 (+1808887us) service_pool.cc:224] Handling call
0709 13:17:33.369545 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.370345 (+   800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.370609 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.371232 20180 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.339629 20159 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.376042 19407 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48852 (request call id 110) took 2134 ms. Trace:
I20260709 13:17:33.338335 19703 tablet_bootstrap.cc:492] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:33.346016 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.330565 19503 rpcz_store.cc:276] 0709 13:17:30.796425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.477499 (+1681074us) service_pool.cc:224] Handling call
0709 13:17:32.874822 (+397323us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:33.032263 (+157441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.033353 (+  1090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.033420 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:33.034755 (+  1335us) log.cc:844] Serialized 26 byte log entry
0709 13:17:33.104911 (+ 70156us) raft_consensus.cc:1645] Marking committed up to 0
0709 13:17:33.107745 (+  2834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.120996 (+ 13251us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.324897 (+203901us) raft_consensus.cc:1685] finished
0709 13:17:33.324926 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.329705 (+  4779us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123,"raft.queue_time_us":36563,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":18671,"spinlock_wait_cycles":3027456,"thread_start_us":66873,"threads_started":1,"wal-append.queue_time_us":103484}
I20260709 13:17:33.359901 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.281504 20231 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.357322 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.332479 20238 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.357338 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 285) took 1824 ms. Trace:
I20260709 13:17:33.345768 19510 rpcz_store.cc:276] 0709 13:17:31.068576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.317324 (+2248748us) service_pool.cc:224] Handling call
0709 13:17:33.317855 (+   531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.318176 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.318215 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.318291 (+    76us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:33.318336 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.318409 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.318567 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.379667 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:17:33.383592 19627 leader_election.cc:336] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.621s (SENT)
I20260709 13:17:33.384407 19581 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:33.386919 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 349) took 1761 ms. Trace:
I20260709 13:17:33.386879 19583 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:17:33.308676 20262 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.373458 20180 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.389328 19509 rpcz_store.cc:276] 0709 13:17:31.533322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.350091 (+1816769us) service_pool.cc:224] Handling call
0709 13:17:33.356655 (+  6564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.356959 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.356985 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.357051 (+    66us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:33.357086 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.357147 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.357257 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.392194 20181 consensus_queue.cc:1059] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:33.393877 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 350) took 1752 ms. Trace:
I20260709 13:17:33.399777 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:33.406004 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:33.382462 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.410092 19584 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:33.410435 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:33.411533 19587 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.423998 19657 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.425786 19578 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:33.428866 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45529.8us
I20260709 13:17:33.429497 20254 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:33.430229 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:33.430840 19625 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:33.430724 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:33.431417 19505 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.396509 19508 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.412719 19703 ts_tablet_manager.cc:1403] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.675s	user 0.020s	sys 0.021s
I20260709 13:17:33.450258 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 281) took 2395 ms. Trace:
I20260709 13:17:33.440498 19656 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:33.432049 19507 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 2: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:33.453258 19511 rpcz_store.cc:276] 0709 13:17:31.054916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.325771 (+2270855us) service_pool.cc:224] Handling call
0709 13:17:33.412448 (+ 86677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.440207 (+ 27759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.440240 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.449873 (+  9633us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:33.449945 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.450035 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.450187 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.456889 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 351) took 1798 ms. Trace:
I20260709 13:17:33.457084 19625 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:33.457365 19508 rpcz_store.cc:276] 0709 13:17:31.658053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.395774 (+1737721us) service_pool.cc:224] Handling call
0709 13:17:33.396260 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.455300 (+ 59040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.456801 (+  1501us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.459064 19508 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.459729 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 352) took 1546 ms. Trace:
I20260709 13:17:33.459877 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 289) took 1771 ms. Trace:
I20260709 13:17:33.460104 19508 rpcz_store.cc:276] 0709 13:17:31.913823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.458374 (+1544551us) service_pool.cc:224] Handling call
0709 13:17:33.458827 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.459489 (+   662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.459678 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.460254 19511 rpcz_store.cc:276] 0709 13:17:31.688515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.456219 (+1767704us) service_pool.cc:224] Handling call
0709 13:17:33.459327 (+  3108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.459558 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.459583 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.459640 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:33.459668 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.459721 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.459802 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.461912 19509 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.462196 20255 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:33.462710 20255 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.398402 20174 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.466097 19508 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:33.472482 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.473747 20186 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:33.475299 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 348) took 1860 ms. Trace:
I20260709 13:17:33.484527 20231 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:33.376507 19407 rpcz_store.cc:276] 0709 13:17:31.241100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.241327 (+   227us) service_pool.cc:224] Handling call
0709 13:17:33.375764 (+2134437us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:32.678153 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:32.848102 (+169949us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:32.848142 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:17:32.848163 (+    21us) tablet.cc:662] Decoding operations
0709 13:17:32.848549 (+   386us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:32.848607 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:32.848640 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:32.848841 (+   201us) tablet.cc:701] Row locks acquired
0709 13:17:32.848862 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:17:32.849012 (+   150us) write_op.cc:270] Start()
0709 13:17:32.849138 (+   126us) write_op.cc:276] Timestamp: P: 1783603052848970 usec, L: 0
0709 13:17:32.849164 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:17:32.860323 (+ 11159us) log.cc:844] Serialized 543 byte log entry
0709 13:17:32.991136 (+130813us) op_driver.cc:464] REPLICATION: finished
0709 13:17:33.071134 (+ 79998us) write_op.cc:301] APPLY: starting
0709 13:17:33.071342 (+   208us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:33.071578 (+   236us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:33.071795 (+   217us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:33.072193 (+   398us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:33.072633 (+   440us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:33.072750 (+   117us) write_op.cc:312] APPLY: finished
0709 13:17:33.073647 (+   897us) log.cc:844] Serialized 22 byte log entry
0709 13:17:33.075619 (+  1972us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:33.075753 (+   134us) write_op.cc:454] Released schema lock
0709 13:17:33.075812 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:33.076415 (+   603us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:33.076452 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":79521,"apply.run_cpu_time_us":3510,"apply.run_wall_time_us":5418,"num_ops":1,"prepare.queue_time_us":143535,"prepare.run_cpu_time_us":22493,"prepare.run_wall_time_us":325608,"raft.queue_time_us":1611,"raft.run_cpu_time_us":1796,"raft.run_wall_time_us":77843,"replication_time_us":141785,"thread_start_us":283343,"threads_started":4,"wal-append.queue_time_us":127487}]]}
I20260709 13:17:33.467296 20255 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.436688 19924 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.484488 19505 rpcz_store.cc:276] 0709 13:17:31.606580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.382371 (+1775791us) service_pool.cc:224] Handling call
0709 13:17:33.431172 (+ 48801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.451998 (+ 20826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.466743 (+ 14745us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.485531 20186 raft_consensus.cc:697] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:33.484339 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 357) took 1387 ms. Trace:
I20260709 13:17:33.494001 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 287) took 1873 ms. Trace:
I20260709 13:17:33.495669 19660 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.491633 19509 raft_consensus.cc:2410] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260709 13:17:33.497992 20279 log.cc:927] Time spent T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:17:33.527238 20186 consensus_queue.cc:237] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.528522 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:33.529417 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:33.497022 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:33.530786 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:33.530995 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:33.531442 19505 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.532167 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:33.484299 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:33.502400 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:33.534899 19924 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:33.536602 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:33.537472 19509 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 2: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:33.433954 19701 raft_consensus.cc:359] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.504508 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:33.509032 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:33.408360 19503 rpcz_store.cc:276] 0709 13:17:31.641139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.392485 (+1751346us) service_pool.cc:224] Handling call
0709 13:17:33.393001 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.393369 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.393402 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.393475 (+    73us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:33.393522 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.393606 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.393807 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.497326 20195 raft_consensus.cc:3055] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.398551 19506 rpcz_store.cc:276] 0709 13:17:31.625712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.385680 (+1759968us) service_pool.cc:224] Handling call
0709 13:17:33.386181 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.386497 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.386534 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.386603 (+    69us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:33.386665 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.386734 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.386860 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.523762 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:33.526558 19508 rpcz_store.cc:276] 0709 13:17:32.096703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.461073 (+1364370us) service_pool.cc:224] Handling call
0709 13:17:33.461503 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.484050 (+ 22547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.484273 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.540941 19701 raft_consensus.cc:385] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:33.547019 19511 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:33.550340 19701 raft_consensus.cc:740] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:33.529228 20159 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.557327 19509 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.558861 19701 consensus_queue.cc:260] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.564288 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:33.552711 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:33.565917 19658 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 1: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:33.565975 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:33.566895 19503 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 1: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:33.549237 20195 raft_consensus.cc:740] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:33.568445 20195 consensus_queue.cc:260] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.542255 20174 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:33.583267 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:33.587625 19661 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.588472 19507 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 0.
I20260709 13:17:33.589337 19584 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:33.598203 19627 leader_election.cc:336] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.529s (SENT)
I20260709 13:17:33.590441 20159 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:33.593125 20195 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.541038 19512 rpcz_store.cc:276] 0709 13:17:31.620358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.475494 (+1855136us) service_pool.cc:224] Handling call
0709 13:17:33.475931 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.486123 (+ 10192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.490219 (+  4096us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.490414 (+   195us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:33.490690 (+   276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.491369 (+   679us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.492496 (+  1127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.597078 20184 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:33.601106 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:33.543182 20255 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.600462 19586 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:33.610174 20184 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:33.614549 20280 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:17:33.615197 19659 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 1: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:33.619597 20184 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:33.607285 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 286) took 2028 ms. Trace:
I20260709 13:17:33.647029 20166 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:17:33.653992 19579 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:33.655546 19701 ts_tablet_manager.cc:1434] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.316s	user 0.007s	sys 0.005s
I20260709 13:17:33.656708 19701 tablet_bootstrap.cc:492] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167: Bootstrap starting.
I20260709 13:17:33.657703 19505 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:33.608907 20262 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:33.660555 19703 raft_consensus.cc:359] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.661314 19703 raft_consensus.cc:385] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:33.661595 19703 raft_consensus.cc:740] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
W20260709 13:17:33.661860 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.662248 19703 consensus_queue.cc:260] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.664523 19703 ts_tablet_manager.cc:1434] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.211s	user 0.000s	sys 0.004s
I20260709 13:17:33.664901 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:33.665768 20267 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:17:33.666003 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 105668us
I20260709 13:17:33.666221 20267 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:33.666671 20267 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.671180 20255 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:33.642028 19504 rpcz_store.cc:276] 0709 13:17:31.577251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.372241 (+1794990us) service_pool.cc:224] Handling call
0709 13:17:33.372769 (+   528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.373139 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:17:33.379917 (+  6778us) log.cc:844] Serialized 14 byte log entry
0709 13:17:33.559562 (+179645us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.594053 (+ 34491us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:33.595453 (+  1400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.598934 (+  3481us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.605082 (+  6148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9516,"prepare.queue_time_us":317,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":4248,"raft.run_cpu_time_us":2219,"raft.run_wall_time_us":28154,"thread_start_us":94046,"threads_started":1,"wal-append.queue_time_us":210621}
I20260709 13:17:33.675118 20267 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.669029 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:33.678376 20166 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:33.678777 20166 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:33.679129 20166 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:33.681425 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 43870.5us
I20260709 13:17:33.682250 20267 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:33.684909 20159 consensus_queue.cc:1059] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:33.687296 19458 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:33.688508 20159 raft_consensus.cc:3055] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.688975 20159 raft_consensus.cc:740] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:33.689922 20159 consensus_queue.cc:260] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.691077 20159 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.691205 20166 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.693259 20166 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:33.613834 20220 raft_consensus.cc:2764] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 13:17:33.711455 20284 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.114s	user 0.013s	sys 0.006s
I20260709 13:17:33.720166 19701 tablet_bootstrap.cc:654] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:33.698096 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 116004us
W20260709 13:17:33.693921 19627 leader_election.cc:336] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.621s (SENT)
I20260709 13:17:33.725699 19703 tablet_bootstrap.cc:492] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:33.727684 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:33.729813 19659 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.732508 19627 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:33.733505 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:33.734587 20220 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:33.734997 20220 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:33.735133 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:33.735392 20220 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.736414 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:33.737814 20262 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.738080 20159 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.738704 20262 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:33.739290 20262 raft_consensus.cc:697] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:33.740245 20262 consensus_queue.cc:237] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.741084 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.742273 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:33.743022 20283 log.cc:927] Time spent T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:17:33.742969 19584 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 0.
I20260709 13:17:33.745383 19478 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:33.746738 19478 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:33.747437 20166 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.748059 20166 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.749187 19478 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:33.752208 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:17:33.739286 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45402us
W20260709 13:17:33.778252 19627 leader_election.cc:336] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.622s (SENT)
I20260709 13:17:33.778609 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.779341 20180 consensus_queue.cc:1059] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.779995 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.780539 20170 raft_consensus.cc:3055] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.780886 20170 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:33.781128 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.782049 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.781745 20170 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.782718 19583 raft_consensus.cc:2393] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 1: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:33.783617 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.783739 20170 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.785120 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.786034 19584 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:33.753213 20220 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.755048 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.755766 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:33.787138 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.758113 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.763468 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.788157 20220 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:33.766505 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:33.767270 19625 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:33.770538 19703 tablet_bootstrap.cc:654] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:33.771154 19507 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.770339 20262 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:33.772481 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:33.778689 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:33.754251 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:33.787601 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.763726 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.788874 19581 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:33.790303 19625 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:33.794991 19924 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:33.801812 19924 raft_consensus.cc:697] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:33.802158 19583 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.802727 19924 consensus_queue.cc:237] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:33.803809 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.792501 20251 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.795442 20276 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.806964 20276 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:33.797597 19579 raft_consensus.cc:2368] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2.
I20260709 13:17:33.807518 20276 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.807965 20276 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.808365 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.809049 19582 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:33.795605 19504 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:33.798265 19627 leader_election.cc:336] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.627s (SENT)
I20260709 13:17:33.810104 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:33.810141 20254 consensus_queue.cc:1059] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:33.811429 20231 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.811774 20231 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:33.812157 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.812630 20231 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.815963 20184 consensus_queue.cc:1059] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:33.815367 19627 leader_election.cc:336] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.634s (SENT)
I20260709 13:17:33.816742 19627 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:33.798677 20180 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.817819 20180 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:33.818639 20180 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.819034 20184 raft_consensus.cc:3055] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.819257 20181 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.819496 20184 raft_consensus.cc:740] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:33.819793 20180 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.737892 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:33.817435 20255 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.820464 20184 consensus_queue.cc:260] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.822708 20262 consensus_queue.cc:1059] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:33.824160 20262 raft_consensus.cc:3055] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.824609 20262 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:33.822412 20184 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:33.806896 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57785.6us
I20260709 13:17:33.828919 20238 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:33.829144 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:17:33.830410 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.830641 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:33.831579 20168 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.834115 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.834481 19478 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:33.834415 20251 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:33.835551 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.842338 20174 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:33.842813 20174 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:33.842885 19658 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.843240 20174 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.844357 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.844584 20238 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.845050 20238 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:33.845677 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.846900 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.847561 19584 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.850255 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.851046 19582 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:33.852078 20170 consensus_queue.cc:1059] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.853235 20225 raft_consensus.cc:3055] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.853607 20225 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:33.853919 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.854518 20225 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.825508 20262 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.856874 20262 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.857954 19478 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:33.859506 20238 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.863741 19504 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:33.867683 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:33.871313 20225 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.876050 19507 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.875980 20238 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.884310 19585 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:33.885435 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:17:33.885773 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 62027.4us
I20260709 13:17:33.887817 20231 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.888701 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:33.889050 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:33.889420 19586 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:33.889863 20195 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.890293 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:33.891196 19582 raft_consensus.cc:2376] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2. Re-sending same reply.
I20260709 13:17:33.863790 20276 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.894484 20265 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:33.894779 19478 leader_election.cc:343] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:33.895192 19581 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.895241 19478 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:33.896200 20265 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.897199 20170 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:33.898348 19625 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:33.898442 19584 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:33.900410 20254 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:33.895357 20276 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:33.903287 20254 raft_consensus.cc:697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:33.904251 20254 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.907019 20265 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.901101 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:33.901255 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:33.901495 20257 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:33.919287 19627 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:33.914814 20220 raft_consensus.cc:2764] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:17:33.919430 19504 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.951082 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:33.953390 20276 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.970664 19478 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:33.981096 19627 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:17:33.990130 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 89099.3us
I20260709 13:17:33.978938 20254 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:33.953457 20174 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:33.994923 19924 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.989975 20265 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.001024 20170 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.997362 19407 catalog_manager.cc:5697] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.003574 20170 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.004051 20170 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:34.004626 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 52267.5us
I20260709 13:17:34.005510 19478 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.006145 19701 tablet_bootstrap.cc:492] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167: No bootstrap required, opened a new log
I20260709 13:17:34.006713 19701 ts_tablet_manager.cc:1403] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167: Time spent bootstrapping tablet: real 0.350s	user 0.035s	sys 0.052s
I20260709 13:17:34.006933 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:33.999569 19627 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.010787 19505 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.992959 20254 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:34.022058 19703 tablet_bootstrap.cc:492] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:34.022545 19703 ts_tablet_manager.cc:1403] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.297s	user 0.004s	sys 0.022s
I20260709 13:17:34.024503 20181 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.024932 20181 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:34.025336 20181 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.014175 20170 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.023197 20168 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.008440 20265 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:34.030123 20265 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.022959 20254 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.037578 20174 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.041915 19478 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.043255 19478 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.044023 20168 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.044521 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.045535 20168 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.046200 20168 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.048494 19703 raft_consensus.cc:359] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.049263 19703 raft_consensus.cc:385] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:34.051334 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.049556 19703 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
W20260709 13:17:34.053042 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 58564.9us
I20260709 13:17:34.053849 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.054740 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:34.061558 20180 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.062067 20180 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:34.062938 20180 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.071400 20257 consensus_queue.cc:1059] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.072530 20257 raft_consensus.cc:3055] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.072973 20257 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:34.073975 20257 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.073354 20276 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.081406 19924 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.083491 20203 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.085695 19478 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.085747 19701 raft_consensus.cc:359] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.086627 19701 raft_consensus.cc:385] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:34.086746 20251 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.087414 20251 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:34.087918 20251 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.088794 19627 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.088583 20254 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.089689 20257 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.090348 19924 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.090818 19924 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:34.091269 19924 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.086956 19701 raft_consensus.cc:740] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.093039 19703 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.053906 20166 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.085597 20181 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.097419 20180 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.085752 19504 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:34.126669 20262 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:34.127485 20262 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.129071 19701 consensus_queue.cc:260] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.129562 19625 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:34.133131 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:34.138123 19627 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.139528 19506 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.141774 20276 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:34.142479 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 56901.7us
I20260709 13:17:34.143455 19478 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.145175 20262 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.146570 20184 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:34.148146 19661 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.140518 20186 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.151904 19506 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.153729 20170 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:34.155433 19924 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.157939 19703 ts_tablet_manager.cc:1434] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.135s	user 0.011s	sys 0.000s
I20260709 13:17:34.130028 20254 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:34.164342 20168 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.158712 20174 consensus_queue.cc:1059] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:17:34.171571 20174 raft_consensus.cc:3055] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.172056 20174 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:34.174727 20174 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.175303 20231 consensus_queue.cc:1059] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.176373 20174 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.176505 20231 raft_consensus.cc:3055] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.177037 20231 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:34.154358 20170 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.178092 20231 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.176692 19657 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.179303 20231 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.179773 20170 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.162056 20186 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:17:34.147112 20184 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:34.182377 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.183029 20184 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.162477 19659 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:34.184033 20181 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:17:34.185881 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 55137us
I20260709 13:17:34.186818 19924 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:17:34.187649 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 44307us
I20260709 13:17:34.153999 20265 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.188786 19476 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:17:34.190076 19627 leader_election.cc:343] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:34.192718 19478 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:17:34.193527 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 202653us
I20260709 13:17:34.194633 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.195398 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:34.195770 20303 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.196321 20303 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:34.197263 20184 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.197249 20303 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.198751 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.199177 19627 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.200759 19703 tablet_bootstrap.cc:492] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:34.164096 20276 raft_consensus.cc:697] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:34.202567 19701 ts_tablet_manager.cc:1434] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167: Time spent starting tablet: real 0.196s	user 0.006s	sys 0.008s
I20260709 13:17:34.204427 19924 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.206687 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.187952 20168 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:17:34.210654 19478 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.205186 20166 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.208371 20184 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.209241 19512 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.209324 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:34.210425 20170 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.217036 19661 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.216853 20301 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:17:34.225421 19660 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.217757 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:34.217993 20168 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.219609 19478 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.219893 20267 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.220808 20276 consensus_queue.cc:237] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.221422 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:34.225169 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:34.228263 20301 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.225431 19652 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.228531 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:34.229171 20168 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:34.228289 19661 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.230805 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.231011 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:34.255402 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:34.256026 20168 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.231216 20174 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.256969 20174 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.233500 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:34.257417 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.257925 19503 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:34.234123 19511 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:34.258708 19478 leader_election.cc:343] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:34.235117 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:34.235806 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:34.259605 19478 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.237080 20265 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.260473 20265 raft_consensus.cc:2764] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:17:34.260548 20304 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.227010 20267 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:34.262089 19478 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.261966 20267 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.263386 20267 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.242111 19659 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.243830 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:34.267812 19506 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:34.269528 20166 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.246821 20301 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:34.255491 19656 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.270715 20301 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.271777 20301 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.254454 19924 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:17:34.266815 19478 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.269757 19625 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:17:34.273885 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.276471 19656 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.276710 19654 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.278327 20251 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.281160 19924 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.281778 19924 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:34.282260 19478 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:17:34.285099 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 77908.6us
I20260709 13:17:34.283500 20166 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.272549 20170 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:17:34.280939 20168 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.289745 20168 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.293063 19657 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:34.293300 19703 tablet_bootstrap.cc:654] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:34.296435 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:34.289738 20257 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.285820 19627 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.294648 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:34.300741 20166 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:34.301143 19659 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 0.
I20260709 13:17:34.302986 20180 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.284258 20251 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:34.305083 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.305476 19478 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.307644 20294 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:34.307473 20297 consensus_queue.cc:1059] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:17:34.309717 20170 raft_consensus.cc:3055] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.310063 20170 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:34.310875 20170 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.311585 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:34.311954 20170 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.303962 20180 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.312774 20180 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:34.313724 20180 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.314814 20180 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.314936 20294 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.315418 20294 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:34.308269 19924 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.317303 19478 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.304929 20257 raft_consensus.cc:697] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:34.320531 20168 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.321058 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.321311 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:34.321825 20255 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.322098 19659 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 2: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:34.323024 19627 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.323644 19924 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.326361 20255 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.326798 20255 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:34.327162 20255 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.329985 20168 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.332429 19478 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.314759 20174 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:34.334249 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 145611us
I20260709 13:17:34.335055 19478 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.338601 20265 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.319566 20231 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.319082 20257 consensus_queue.cc:237] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.339140 20231 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:34.339692 20231 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.333035 20166 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:34.346360 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:34.347055 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:34.346480 20265 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.350168 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:34.356073 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:34.358439 19658 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.360631 20255 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.364926 19659 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.365682 19654 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.367226 20301 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:34.347093 19657 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:34.368813 20301 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.375692 19478 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.375589 19506 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.370736 20170 consensus_queue.cc:1059] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:17:34.378437 20184 raft_consensus.cc:3055] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.378654 20255 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:34.378808 20184 raft_consensus.cc:740] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:34.381918 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.382330 20301 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.383193 20265 consensus_queue.cc:1059] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:34.383882 20184 consensus_queue.cc:260] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.383476 20297 consensus_queue.cc:1059] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:34.384452 20174 raft_consensus.cc:3055] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:17:34.384909 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.385035 20174 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:34.385217 20184 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.385737 19924 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.387705 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:17:34.387938 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.387595 20294 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.389041 20170 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.390808 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.391835 19478 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.392908 20297 raft_consensus.cc:3055] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.393733 20301 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.392285 20294 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.391505 20251 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:34.397750 20170 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:17:34.400774 20307 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.397581 20297 raft_consensus.cc:740] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:34.394876 20304 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.404207 19478 leader_election.cc:400] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2.
I20260709 13:17:34.413343 19478 leader_election.cc:403] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:34.404668 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.401916 20174 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.393085 19656 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:34.410045 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.415107 20301 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.415828 20301 raft_consensus.cc:697] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:34.416131 19703 tablet_bootstrap.cc:492] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:34.416734 19703 ts_tablet_manager.cc:1403] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.226s	user 0.015s	sys 0.003s
I20260709 13:17:34.419046 20307 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2.
I20260709 13:17:34.420691 20255 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.420840 20294 raft_consensus.cc:3055] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.421305 20294 raft_consensus.cc:740] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:34.419327 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.399699 20180 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:17:34.423291 20170 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.422240 20262 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:34.423717 20174 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.421825 20301 consensus_queue.cc:237] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.424541 20262 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.425303 20262 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.425488 20297 consensus_queue.cc:260] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.426870 20297 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.428105 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.430218 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.430199 19478 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.430440 19476 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:34.431298 19510 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:34.443460 19627 leader_election.cc:343] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:34.444727 19627 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.431325 20262 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.447963 20307 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.437491 20170 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:17:34.442297 20184 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.463796 19924 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.464587 20262 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.464898 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:34.465536 20302 consensus_queue.cc:1059] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:34.465978 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:34.464610 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:34.465001 20262 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:34.462842 20307 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:17:34.471199 20262 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.472014 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:34.472334 20225 raft_consensus.cc:3055] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.472740 20225 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:34.473681 20225 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.474221 20302 raft_consensus.cc:3055] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.474671 20302 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:34.475015 20225 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.475584 20302 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.476807 20302 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.476087 19510 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.445704 20303 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.479593 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:34.479864 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:34.480370 19509 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:34.480578 19657 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:34.481989 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:34.447235 20294 consensus_queue.cc:260] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.483626 20294 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.485602 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:34.486950 20231 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.489233 20231 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:34.489441 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:17:34.490720 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.494741 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:34.507105 19657 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:34.503508 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:34.504225 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:34.505898 19583 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:34.501304 20262 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.510361 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:34.511166 19584 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:34.522197 19581 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.522693 19659 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.512702 20255 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.513669 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:34.515300 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:34.526228 20262 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.526588 20255 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.516862 19627 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.519955 19587 raft_consensus.cc:1240] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.519268 19478 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.526736 19507 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 1: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:34.526175 19654 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 1: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:34.536644 19657 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:34.515343 20310 log.cc:927] Time spent T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:17:34.518129 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:34.536255 19924 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.540016 19587 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.540402 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.520978 20303 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:34.542057 20262 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:34.551002 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:34.553697 20297 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.553537 20186 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:34.527105 20255 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:17:34.555852 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 48525.1us
I20260709 13:17:34.556285 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:34.556589 19478 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:17:34.558802 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 60144.1us
I20260709 13:17:34.558830 19703 raft_consensus.cc:359] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:34.559610 19627 leader_election.cc:343] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:34.559880 19703 raft_consensus.cc:385] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:34.560302 19703 raft_consensus.cc:740] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.560194 19627 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.544163 19585 raft_consensus.cc:2393] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:34.553442 20262 raft_consensus.cc:697] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:34.538829 20307 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.575628 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.563467 19924 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:34.573331 19657 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:34.567875 20262 consensus_queue.cc:237] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.536383 20304 consensus_queue.cc:1059] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:17:34.563256 20251 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.570849 20255 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.558524 20267 consensus_queue.cc:1059] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:17:34.572592 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:34.574203 19584 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:34.566004 19478 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.580196 20303 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.584550 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:34.584583 19703 consensus_queue.cc:260] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.589180 19509 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:34.594147 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:34.595536 19510 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.583716 20297 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:34.600646 19924 consensus_queue.cc:1059] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.603533 20276 raft_consensus.cc:3055] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.588884 20225 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.601748 20265 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.606482 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:34.607033 20166 raft_consensus.cc:3055] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.607519 20166 raft_consensus.cc:740] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:34.604554 20255 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.608400 20166 consensus_queue.cc:260] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.609087 20174 raft_consensus.cc:3055] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.609479 20174 raft_consensus.cc:740] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:34.607149 19585 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.610304 20174 consensus_queue.cc:260] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.611559 20174 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.603963 20276 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:34.614861 20276 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.616257 20276 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.618209 19627 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.619261 20186 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.626500 19510 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.628144 20228 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.628666 20228 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.630934 20228 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.634099 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:34.634970 19506 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 1: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:34.635753 20228 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.589563 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:34.636909 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:34.627507 20166 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.645357 19703 ts_tablet_manager.cc:1434] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.228s	user 0.008s	sys 0.001s
I20260709 13:17:34.648201 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.655133 19478 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.642493 20225 raft_consensus.cc:697] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:34.659369 19410 catalog_manager.cc:5697] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 1 to 2, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.661250 19410 catalog_manager.cc:5697] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 1 to 2, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.663199 19478 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.663113 19410 catalog_manager.cc:5697] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 1 to 2, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.664041 20265 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.664399 20265 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:34.664752 20265 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.664851 20267 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.665136 20304 consensus_queue.cc:1059] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.653750 20228 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:34.666126 19478 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.667764 20294 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.668263 20294 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.669106 19585 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:34.669860 20251 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.670370 20294 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.671607 20304 raft_consensus.cc:3055] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.671957 20304 raft_consensus.cc:740] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:34.672712 20304 consensus_queue.cc:260] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.674031 20304 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.666595 20174 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.675812 20184 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.676178 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:34.680068 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.687865 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.689965 19703 tablet_bootstrap.cc:492] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf: Bootstrap starting.
I20260709 13:17:34.694142 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:34.695248 19924 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.695745 19627 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.698454 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.700361 19924 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:34.673385 20265 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.702306 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.686079 20251 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.706163 20168 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:34.693148 20303 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.698812 20174 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.710532 19924 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.709395 20168 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:34.707466 20231 raft_consensus.cc:2764] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:17:34.713771 19627 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.706827 20262 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:34.722496 19478 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.723429 20307 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:17:34.724643 20318 log.cc:927] Time spent T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:17:34.724493 20168 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.730630 19478 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.731509 20303 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.731961 20303 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:34.737666 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:34.738602 19656 raft_consensus.cc:2393] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:34.743842 20265 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.747465 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:34.753414 19627 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.757020 19409 catalog_manager.cc:5697] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 1 to 2, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 2 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:34.759117 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.759886 19409 catalog_manager.cc:5697] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 1 to 2, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 2 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:34.734334 20302 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.766191 20302 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:34.766618 20302 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.766448 19409 catalog_manager.cc:5697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:34.713258 20174 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.770870 20159 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.770577 19409 catalog_manager.cc:5697] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 1 to 2, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 2 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:34.771804 20174 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.773536 19582 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:34.777051 20186 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.732852 20303 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.771836 20262 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.785108 20262 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.721395 20225 consensus_queue.cc:237] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.784691 19703 tablet_bootstrap.cc:654] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:34.780030 20228 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:34.794404 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:34.795171 19509 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:34.785560 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:34.800349 19658 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:34.802906 19476 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:17:34.806764 19627 leader_election.cc:343] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:34.807225 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.808240 19627 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.779582 19578 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:34.815332 19627 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.816453 19627 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.809451 20304 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:34.787701 20302 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.818630 19478 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.820446 19627 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:17:34.824611 19458 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:34.812355 20231 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:34.826951 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.827564 20181 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.828486 20166 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.813505 20186 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.833930 20228 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:34.814272 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:34.817510 20159 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.818348 20304 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.845208 19924 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:34.821090 20254 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.837980 20181 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:34.845136 20304 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.842048 20186 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:34.842790 20262 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.846827 20255 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.846526 19582 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:34.845371 20166 raft_consensus.cc:697] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:34.850863 20181 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.845103 20228 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.862411 19551 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:17:34.863142 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 65808.9us
I20260709 13:17:34.852878 20186 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.865607 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:34.864253 20297 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:34.856725 20302 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:34.877446 19703 tablet_bootstrap.cc:492] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf: No bootstrap required, opened a new log
I20260709 13:17:34.878046 19703 ts_tablet_manager.cc:1403] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf: Time spent bootstrapping tablet: real 0.220s	user 0.021s	sys 0.012s
I20260709 13:17:34.862398 20228 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:34.879607 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 53933.9us
I20260709 13:17:34.864956 20255 raft_consensus.cc:697] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:34.884455 20255 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.886945 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:34.871342 20297 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:34.890511 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.890417 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.879762 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:34.891449 20297 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.880620 20332 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:17:34.894191 20262 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.906234 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:34.902071 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:34.903985 19583 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.908304 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:34.908396 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:34.909365 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:34.909747 19579 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.892644 20228 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:34.913900 20228 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.911533 19583 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.924997 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:34.925477 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:34.928331 19657 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.930200 19580 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.886948 20166 consensus_queue.cc:237] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.932396 20262 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.933926 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:34.935686 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:34.938361 19703 raft_consensus.cc:359] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.939083 19703 raft_consensus.cc:385] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:34.939337 19703 raft_consensus.cc:740] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.939379 19582 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.940052 19703 consensus_queue.cc:260] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.938387 19578 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.941944 19587 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:34.946180 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:34.946795 19581 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.949082 19583 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.932834 20228 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.950371 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.951555 20228 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.952296 20304 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.956161 20265 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.945938 20186 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.959816 20186 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:34.960806 20181 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.961769 20304 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.964212 20225 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:34.964864 19583 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.964815 20225 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.965379 20294 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:34.966864 20294 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.967585 19703 ts_tablet_manager.cc:1434] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.000s
I20260709 13:17:34.968281 19581 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:34.968873 20294 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.970562 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:34.971743 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:34.971828 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:34.972043 20297 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.974035 19551 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.974150 20297 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.975530 20294 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.979187 19627 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.979861 19509 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.980189 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:34.980314 19627 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:34.982645 20254 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.983507 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:34.983449 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:34.983930 19654 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.984549 20334 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:17:34.977916 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:34.985541 19506 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.986861 20294 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:34.987345 20294 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:34.989297 20294 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.989495 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:34.989929 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:34.990962 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:34.990988 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:34.990883 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:34.992060 19579 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.980366 20186 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.995325 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:34.998620 19551 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:34.999347 20225 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:34.999890 20225 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:35.000568 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:35.003540 19654 raft_consensus.cc:2393] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 2: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:35.004864 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:35.006108 20294 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.008337 19506 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:35.008615 20334 consensus_queue.cc:1059] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.981652 20181 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:35.012156 20181 raft_consensus.cc:3055] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:35.012250 19551 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:35.012655 20181 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:35.013720 20297 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:35.018872 20297 raft_consensus.cc:697] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:35.019295 19509 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.019972 20297 consensus_queue.cc:237] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.022850 20228 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.981751 19627 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:35.013597 20181 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.025854 20181 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.029068 19579 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:35.029541 20303 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:35.034364 19478 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:17:35.039013 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57218.9us
I20260709 13:17:35.043292 19924 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:35.036969 19410 catalog_manager.cc:5697] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 2, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 2 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.047472 19410 catalog_manager.cc:5697] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 2, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 2 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.048698 20333 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:35.051791 19627 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:35.053300 20159 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:35.041285 20303 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:35.057252 19657 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:35.043074 20255 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:35.060822 20166 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:35.060192 19410 catalog_manager.cc:5697] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.062009 20166 raft_consensus.cc:3055] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:35.062382 20166 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:35.063345 20166 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.065114 20166 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.062533 19410 catalog_manager.cc:5697] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 2, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 2 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.060120 20159 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.072314 20159 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.073390 20294 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:35.074304 19587 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.074399 20159 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:35.078250 20203 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:35.080302 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:35.081060 20254 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:35.082360 20254 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:35.084592 20257 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:35.085124 20257 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:35.086018 20257 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.092898 19627 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:35.071633 20303 raft_consensus.cc:697] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:35.100348 19627 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:35.100569 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:35.089118 19409 catalog_manager.cc:5697] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 1 to 2, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.101964 19507 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:35.104532 19625 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:35.108632 19924 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:35.108845 20332 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:35.109015 19924 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.109375 19924 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.103714 20159 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:35.112653 20294 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:35.117049 20294 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.117934 19409 catalog_manager.cc:5697] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 1 to 2, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.119937 19924 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.088881 20254 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:17:35.122466 19657 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:35.125113 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:35.125763 19506 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.120738 20303 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.125247 20254 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:35.127121 20166 consensus_queue.cc:1059] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:35.128165 20166 raft_consensus.cc:3055] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:35.128511 20166 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:35.124085 19409 catalog_manager.cc:5697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 1 to 2, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.127100 20254 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:35.129397 20166 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.117672 20294 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.138595 20166 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.147480 19409 catalog_manager.cc:5697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 0 to 1, leader changed from <none> to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.150547 19924 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:35.162909 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:35.163640 19580 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:35.134814 20297 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:17:35.171803 20228 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.184310 19658 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.186008 20228 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.173799 20254 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.198377 20254 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.200133 20294 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:35.201308 19506 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:35.205072 19625 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:35.205174 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:35.205932 19657 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:35.207250 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:35.208317 20262 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:35.208657 20262 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.209003 20262 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.210809 20332 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:35.211344 20332 raft_consensus.cc:697] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:35.212157 20332 consensus_queue.cc:237] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.196067 20170 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.214093 20170 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.219784 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:35.189043 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:17:35.230528 20348 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:17:35.197006 20203 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:17:35.229416 19586 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.223671 20304 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:17:35.235652 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:35.272509 19507 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.255462 20170 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:35.269187 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:35.274952 19924 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:35.256366 19506 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:35.283516 19659 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.272409 20265 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:17:35.300729 20228 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:35.303289 20345 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:17:35.305969 20344 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:17:35.306320 19652 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:35.307710 20262 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.309548 19582 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:35.309756 20262 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:35.312721 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:35.315232 19509 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.328086 20254 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 13:17:35.328671 20347 log.cc:927] Time spent T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:35.330839 20304 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:17:35.332203 20304 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:35.332552 20304 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:35.335322 19587 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.352015 20180 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.352782 20180 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.310976 20166 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:17:35.333539 20304 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.362793 20174 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:35.368582 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:35.372092 19511 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:35.372421 19654 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.371528 19586 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:35.372844 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:35.373528 19658 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:35.374665 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:35.375320 19652 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.361145 20225 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.377190 20225 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.378973 20180 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:35.379194 20225 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:35.381311 19587 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:35.381453 20304 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.385443 20254 consensus_queue.cc:1059] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:35.386411 20302 raft_consensus.cc:3055] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:35.386758 20302 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:35.389390 19587 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.389065 20302 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.390291 20302 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.390434 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:35.391103 19503 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.391232 20325 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:35.395431 19504 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.406227 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:35.414651 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:35.416039 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:35.416710 19508 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:35.418467 19661 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:17:35.386724 20356 log.cc:927] Time spent T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:17:35.431245 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:35.434509 19503 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:35.435293 19652 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:35.423942 20297 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:35.438923 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:35.420713 20180 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:17:35.438655 20228 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:35.442989 20228 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.436983 19579 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.443356 20228 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.438825 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:35.440461 20297 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.445770 20294 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:35.437242 20325 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:17:35.448824 20301 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:17:35.462947 20294 raft_consensus.cc:697] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:35.456319 20297 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.490101 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:35.480578 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:35.497098 20301 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.513921 20301 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.515998 20301 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:35.494031 20262 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:35.517110 19654 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
W20260709 13:17:35.508795 20349 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.320s	user 0.003s	sys 0.000s
I20260709 13:17:35.509222 19503 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:35.510277 20294 consensus_queue.cc:237] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.512094 20228 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.519286 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:35.519994 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:35.524881 19657 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:35.558784 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:35.565723 20170 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:35.568492 20225 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.580212 19924 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.582396 19924 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.577086 20170 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.570569 20180 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:17:35.589021 19924 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:35.590684 20170 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.579876 20225 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:35.634644 20352 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.322s	user 0.003s	sys 0.000s
I20260709 13:17:35.621737 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:35.623941 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:35.636577 20254 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:17:35.648023 19503 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.666857 20225 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:35.642596 20228 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:35.653844 19578 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:35.694185 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:35.694916 19652 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.696949 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:35.698719 20228 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.699270 20228 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.705210 19627 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:35.712464 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:35.714898 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:35.717430 19407 catalog_manager.cc:5697] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 1 to 2, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 2 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.728700 20255 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:35.729298 20255 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.730546 20170 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.731488 20255 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:35.732506 19924 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:35.732941 19924 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.733278 19924 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.733882 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:35.734606 19656 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
W20260709 13:17:35.734767 20366 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
I20260709 13:17:35.735538 20265 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:35.740723 19924 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.701568 20228 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:35.739686 20304 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:35.744207 20304 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.745026 19924 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:35.746734 20304 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:35.747470 20303 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:35.747542 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:35.748335 19587 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:35.748183 20303 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.736081 20265 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.752070 20265 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:35.752601 19587 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.755046 20303 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:35.755990 19580 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:35.757268 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:35.757948 19586 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:35.722390 19509 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:35.714269 19578 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:35.761041 19407 catalog_manager.cc:5697] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 1 to 2, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 2 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.759789 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:35.764343 19924 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.766422 19511 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.771944 19627 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:35.771351 19407 catalog_manager.cc:5697] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.775386 19407 catalog_manager.cc:5697] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 1 to 2, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 2 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.777763 19924 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.782430 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:35.783346 19581 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:35.785383 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:35.786158 19924 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:35.810901 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:35.811661 19657 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:35.828320 19657 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:17:35.828778 19657 pending_rounds.cc:85] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 1
I20260709 13:17:35.835400 19661 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.827144 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:35.770628 20174 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:35.850672 20184 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:35.856814 19657 pending_rounds.cc:107] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:17:35.859674 19657 raft_consensus.cc:2889] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:35.857546 20220 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:35.858385 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:35.854455 20174 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:35.847745 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:35.819130 20181 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:17:35.866267 19503 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:35.825758 20254 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.041s
I20260709 13:17:35.868069 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:35.895087 19657 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:35.834105 20372 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:35.829584 20370 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:35.864880 20220 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.903400 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:35.904265 19586 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.905941 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:35.906836 19655 raft_consensus.cc:2393] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:35.908667 20220 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.898752 20166 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:17:35.911886 20180 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.912436 20180 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.919087 19661 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:17:35.901324 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 116042us
I20260709 13:17:35.919544 20297 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.920306 19660 raft_consensus.cc:2368] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
I20260709 13:17:35.874140 20174 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.876956 20377 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.872611 20374 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.924178 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:35.872375 20303 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.905450 20170 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:35.939081 19586 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:35.897750 20372 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:35.927058 19511 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 2: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:35.922977 20370 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:35.949757 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51808us
W20260709 13:17:35.951525 19458 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:35.952656 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:35.953944 19586 raft_consensus.cc:2368] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
I20260709 13:17:35.951525 20370 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:35.944876 20375 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:35.953969 20374 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.924070 20203 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.974210 20375 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.974764 20375 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.975979 20374 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:35.974658 20203 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.990497 20297 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.048264 20203 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:35.974550 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:36.056773 20180 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.060370 19652 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:36.065297 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:36.066977 20180 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:35.925241 20267 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.144s
I20260709 13:17:35.953881 20372 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:36.084547 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:36.092443 20180 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:35.949087 20303 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.090695 19478 leader_election.cc:400] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
W20260709 13:17:36.115664 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 134747us
I20260709 13:17:36.099049 19478 leader_election.cc:403] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:36.134440 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 50020.2us
W20260709 13:17:36.141933 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 65350us
I20260709 13:17:36.083468 20370 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:36.143711 19476 leader_election.cc:400] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
I20260709 13:17:36.099063 20184 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:36.144761 20203 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.144833 20184 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.145148 20387 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.145471 20184 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.145751 20387 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.148221 20387 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.150447 19627 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:36.150725 20257 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.151336 20257 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.153276 20257 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:35.945856 20377 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.154937 20254 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:36.155447 19579 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:36.155687 20254 raft_consensus.cc:697] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:17:36.156268 20381 log.cc:927] Time spent T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:36.157155 20203 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
I20260709 13:17:36.156881 20254 consensus_queue.cc:237] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.157349 20370 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.164422 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:36.192545 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.193508 19657 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:36.194979 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:36.133293 20174 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.196183 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:36.173439 20387 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.197729 19657 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.172842 20325 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:36.170519 20297 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:36.201778 20170 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.203527 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.143030 20375 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.189899 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.198447 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:36.240756 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:36.241693 19657 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:36.248806 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:36.188503 20220 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.249464 19587 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
W20260709 13:17:36.248216 20378 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.113s	user 0.005s	sys 0.003s
I20260709 13:17:36.241629 19504 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.267040 19503 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:36.268349 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:36.269101 19503 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:36.233834 19654 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:36.270572 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:36.257586 20262 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:36.271238 19507 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:36.271679 20262 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:36.272384 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:36.272554 20303 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.272621 20220 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.271013 20370 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.273965 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:36.274545 19506 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.276660 19503 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:36.223835 20170 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.279109 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:36.279908 19661 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.280298 20184 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.282397 20184 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.214936 20325 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.285055 20325 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.244788 20225 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:36.285858 20225 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.288036 20225 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.289390 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.292974 20174 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.219336 20297 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.295540 20297 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:36.296763 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 107003us
I20260709 13:17:36.309978 19507 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
W20260709 13:17:36.319008 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 61311.3us
I20260709 13:17:36.247133 19652 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:36.210634 20387 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.279134 20170 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.350730 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:36.354380 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.328349 20303 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.325675 20166 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.366643 20303 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.368063 19580 raft_consensus.cc:2368] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
I20260709 13:17:36.329334 20180 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.314018 20257 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:17:36.378660 20303 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.272607 20262 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.380812 19653 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
W20260709 13:17:36.412598 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 163590us
I20260709 13:17:36.414059 19661 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:36.423702 20377 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.379842 20166 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.427403 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:36.437381 19510 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:36.381318 20372 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.532877 20166 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:36.456693 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 120531us
I20260709 13:17:36.541041 20387 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.464236 19506 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:36.547488 19478 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:36.548956 20267 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.549431 20265 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.549779 20371 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.541567 20372 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:17:36.552917 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 223374us
I20260709 13:17:36.551697 20371 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.558182 20303 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:36.582516 20303 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.582908 20303 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.583209 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.554639 20265 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.584075 19661 raft_consensus.cc:2393] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:36.582926 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.584982 20371 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.579495 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.586048 19653 raft_consensus.cc:2393] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:36.581679 19504 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:36.586647 19652 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:36.587230 20375 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:36.587767 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:36.576882 20257 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.589833 20257 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.554927 20267 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.592432 20257 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:36.594547 20267 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.564110 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:36.602685 19478 leader_election.cc:400] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
I20260709 13:17:36.603152 19478 leader_election.cc:403] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:36.604935 19625 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:36.585376 20265 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.554201 20325 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.610261 20371 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:36.610599 20370 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.610793 20375 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:36.610261 20181 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:17:36.618914 20371 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:36.629052 19924 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.630923 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:17:36.631632 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 81400.1us
I20260709 13:17:36.632668 19924 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.633379 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:36.642901 19507 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 2: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:36.634080 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:36.643383 19509 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:36.650671 19924 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:36.655205 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:36.617817 20325 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.654808 19476 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:36.640829 20371 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:36.662269 20174 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:36.662683 20174 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.663049 20174 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.642421 20276 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.666007 20276 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.668081 20276 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:36.623632 20267 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:36.655726 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:36.670017 19507 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:36.670815 20267 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.671732 20170 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:36.672245 20170 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.672473 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:36.673740 19625 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:36.674190 20170 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:36.670024 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 242710us
I20260709 13:17:36.674551 20255 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:36.674695 20170 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:36.675165 20255 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.675570 20255 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.675277 20170 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.675678 20374 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:36.676080 20374 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.676398 20374 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.656203 19506 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:36.680567 19507 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:36.682395 20294 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:36.682559 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:36.682929 20294 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.683882 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:36.684494 19580 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:36.684906 20294 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.686000 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:36.686621 19579 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:36.686997 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:36.687562 19578 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:36.688185 19506 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:36.688429 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:36.689195 19585 raft_consensus.cc:2368] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
I20260709 13:17:36.690127 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:36.683213 19584 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:36.690927 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:36.692055 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:36.692584 19587 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:36.692685 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:36.695426 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:36.695976 19586 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:36.696024 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:36.697773 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:36.698632 19586 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:36.705351 19625 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:36.696916 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:17:36.729693 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 74985.4us
I20260709 13:17:36.731113 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:36.731279 19478 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:36.732072 19625 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:36.733662 19587 raft_consensus.cc:2393] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:36.677318 20170 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.677794 20372 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:36.734125 19478 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:36.682106 20267 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.653678 20303 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.758991 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:36.778342 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:36.781764 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:36.782634 19586 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:36.782732 19661 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.783422 19924 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:36.784123 19924 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.784483 19924 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:36.783509 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 58965.4us
I20260709 13:17:36.729010 20262 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:36.750125 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:36.729267 20297 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:36.716291 20180 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:36.797840 19587 raft_consensus.cc:2368] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3.
I20260709 13:17:36.802207 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.797173 19661 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:36.801513 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:36.802935 19657 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 2: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:36.803112 19582 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:36.804004 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:36.733381 20397 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:36.805146 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:36.805878 19509 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.808763 19586 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:36.771807 20166 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:36.709265 20184 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:17:36.776389 20372 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.817539 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.818655 19661 raft_consensus.cc:2393] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 2: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:36.736227 20225 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.819456 19507 raft_consensus.cc:2368] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3.
I20260709 13:17:36.824565 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.825582 19661 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 2: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:36.823458 20397 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:36.834123 19660 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:36.834594 20397 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.819950 20297 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:36.736019 20394 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 13:17:36.837945 20297 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:36.838399 20396 log.cc:927] Time spent T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:17:36.839386 20370 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
W20260709 13:17:36.840464 20399 log.cc:927] Time spent T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:17:36.820374 20372 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.843060 20325 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.814956 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:36.844223 19578 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:36.801378 20181 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.853993 19924 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.804608 20180 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.814030 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.818130 20228 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.875766 19509 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:36.879359 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:36.856992 20225 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.882179 20225 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.884223 20303 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:36.858297 20398 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.818653 20166 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:17:36.888937 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 154829us
I20260709 13:17:36.821331 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:36.888300 19511 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:36.831094 20304 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.895202 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:36.898661 19510 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:36.899004 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.899565 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:36.900110 19657 raft_consensus.cc:2393] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 2: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:36.900168 19510 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:36.900259 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:36.901302 19507 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:36.903285 20262 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:36.885345 20398 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.871603 20180 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.904829 19478 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:36.885588 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.848165 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:36.918210 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 187407us
I20260709 13:17:36.966751 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.967558 19661 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:36.970504 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.905117 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:36.889400 20306 log.cc:927] Time spent T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:17:36.859880 20387 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:36.918888 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.918462 20373 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:36.928458 20262 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.929975 20408 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:36.932035 20371 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.935103 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.975517 20387 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:17:36.936712 20405 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.056s	user 0.003s	sys 0.000s
I20260709 13:17:36.976330 20373 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.977939 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 397) took 1046 ms. Trace:
I20260709 13:17:36.978500 20373 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:36.978955 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:36.978305 19581 rpcz_store.cc:276] 0709 13:17:35.931635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.944977 (+ 13342us) service_pool.cc:224] Handling call
0709 13:17:36.262345 (+317368us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:36.439836 (+177491us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635e9c 00007f6c2e635a5b 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:36.440119 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:36.680424 (+240305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:36.680460 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:36.681068 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.835239 (+154171us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:36.835285 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.835372 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.936095 (+100723us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:17:36.977685 (+ 41590us) raft_consensus.cc:1685] finished
0709 13:17:36.977704 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.977869 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":238302,"raft.queue_time_us":240813,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":103159936,"thread_start_us":140464,"threads_started":1,"wal-append.queue_time_us":199295}
I20260709 13:17:36.980679 19476 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:36.977217 20374 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.981190 20408 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.894217 20166 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:36.895864 20228 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.906127 19655 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.940424 20255 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.941540 20276 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.921801 20304 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.951022 20372 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.952940 20398 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:36.973233 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:36.949051 20180 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.975661 19660 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 2: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:36.975979 20387 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:36.872105 20181 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:36.981798 19583 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:36.986243 20303 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:36.982369 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:36.983811 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57810.6us
I20260709 13:17:37.002097 19478 leader_election.cc:400] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
I20260709 13:17:37.002537 19478 leader_election.cc:403] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:17:37.003719 19478 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:36.956554 20174 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.028523 19509 raft_consensus.cc:2368] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3.
I20260709 13:17:37.005496 19478 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:37.030359 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:37.031255 19510 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:36.974507 19652 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:37.000411 19586 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:36.984050 20408 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.981856 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:17:36.988498 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 110501us
I20260709 13:17:37.007503 20410 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:37.008364 20265 raft_consensus.cc:2764] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:17:37.008836 20325 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
I20260709 13:17:37.009040 20181 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:37.011399 20372 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:37.014463 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:37.015237 19661 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:37.015703 19653 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:37.016789 20304 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:37.016889 20255 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:37.021196 20303 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.027341 20374 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:37.033847 19478 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:36.993687 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:17:37.041429 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 59638us
I20260709 13:17:37.046743 20398 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.998788 20276 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.001533 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:37.049543 20370 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:37.090741 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:37.091334 19659 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.091755 20276 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:37.092449 19657 raft_consensus.cc:2393] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 2: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:37.094364 20228 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:37.090010 20370 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.097908 20406 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:37.098136 20370 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.101912 20408 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.104118 20408 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:37.104979 19659 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:37.081266 19627 leader_election.cc:400] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3.
W20260709 13:17:37.081215 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 47761.8us
I20260709 13:17:37.106559 19478 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:37.107764 20267 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:37.108125 20267 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.108450 20267 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.079737 20303 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.110065 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:37.110755 19506 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:37.083665 19551 leader_election.cc:400] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3.
I20260709 13:17:37.113772 19551 leader_election.cc:403] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:37.114504 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:37.114991 20387 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.115337 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:37.085253 20398 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.123489 19660 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:37.124279 20297 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:37.124555 20398 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:37.083570 20325 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:37.124718 20297 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:37.125150 20325 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.125193 20297 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:37.127315 20228 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:37.127758 20228 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:37.128187 20228 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:37.127820 20267 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.087265 20371 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:37.088359 20384 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:37.088596 19655 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:37.116621 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:37.130426 20384 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:37.130919 20384 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:37.084676 19654 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:37.089288 19504 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:37.075791 20410 raft_consensus.cc:697] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:37.119763 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:37.135821 19627 leader_election.cc:403] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:17:37.131266 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:37.119709 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:37.137526 19583 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:37.105387 20174 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:37.120803 20262 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.121138 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:37.122670 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:37.125679 20325 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.118466 19476 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:37.086344 20166 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.136837 19655 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:37.139099 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:37.173833 19657 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:37.174098 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:37.174813 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:37.175374 19657 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:37.175278 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:37.176162 19655 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.176241 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:37.176602 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:37.176920 19583 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.177232 19659 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:37.177161 20410 consensus_queue.cc:237] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.178308 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:37.179111 19659 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:37.179739 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:37.180295 19584 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.176368 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:37.145251 19586 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:37.182204 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:17:37.183694 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 102614us
I20260709 13:17:37.186537 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:37.188874 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:17:37.192942 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 74554.1us
I20260709 13:17:37.193542 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:37.195011 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:37.195314 19476 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:37.114507 20180 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:37.201607 20304 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:37.228830 20304 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.229142 20166 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:37.229247 20304 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.232615 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:37.233019 19583 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:37.233271 19658 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.233830 20267 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:37.234216 20407 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:37.201515 20203 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:37.139582 20374 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:37.188830 20332 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3.
I20260709 13:17:37.243147 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:37.247118 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:37.266165 19657 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.266355 19586 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:37.247388 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:37.268468 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:37.269245 19587 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.237187 19584 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:37.253605 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:37.253916 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:37.254659 20374 raft_consensus.cc:697] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:37.260618 19654 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:37.263091 19478 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:37.248392 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:37.227836 19508 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:37.197824 20265 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:37.294107 20265 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.294536 20265 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.295689 19655 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:37.251343 20407 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:37.297055 20407 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:37.188934 20294 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:17:37.197146 20408 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:37.307374 19924 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:37.282181 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:37.197636 20377 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:37.286468 20303 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.291829 20387 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:37.291761 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:37.292584 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:37.276585 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:37.321367 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 58371.9us
I20260709 13:17:37.308982 19476 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:37.281137 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:37.313550 19661 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:37.257297 20297 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.194458 19578 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:37.346953 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:37.347661 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:37.350095 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:37.350464 20411 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.305315 20203 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:37.350996 20411 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.351871 20203 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.352380 19654 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:37.353211 20411 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:37.343986 19579 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:37.355269 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:37.357788 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:37.358201 19508 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.344547 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:37.357290 19587 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:37.310981 20174 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:37.319823 20377 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.358713 20409 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:37.280378 20370 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.342300 20371 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:37.379498 19657 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
W20260709 13:17:37.380959 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 72064.6us
I20260709 13:17:37.382524 19551 leader_election.cc:400] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3.
I20260709 13:17:37.382827 19551 leader_election.cc:403] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:37.323357 20304 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.384989 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:37.385890 19504 raft_consensus.cc:2393] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:37.386502 20304 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:37.386847 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:37.387688 19504 raft_consensus.cc:2393] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:37.389609 19508 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:37.391635 19504 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:37.365157 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:17:37.401991 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 78467us
W20260709 13:17:37.404261 19458 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:37.367218 20409 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.367022 20377 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.414366 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:37.370779 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:37.365772 20170 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:17:37.380271 20371 raft_consensus.cc:697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:37.367342 20174 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.397903 20184 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:17:37.424928 20409 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.350466 20374 consensus_queue.cc:237] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:37.442255 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 59208.3us
I20260709 13:17:37.437347 19580 raft_consensus.cc:2368] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
I20260709 13:17:37.423728 19658 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:37.479787 19476 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:37.439069 20408 raft_consensus.cc:697] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:17:37.495424 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 75750.3us
W20260709 13:17:37.498224 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 83928.3us
I20260709 13:17:37.502468 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:37.504323 20421 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3.
I20260709 13:17:37.505352 20180 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:37.503043 20387 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:37.506108 20180 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:37.507088 20180 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.506183 20425 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:37.505417 20385 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:37.515651 19627 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:37.522739 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:37.502435 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:37.524034 20423 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:37.515241 20303 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:37.530076 19655 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.516531 20371 consensus_queue.cc:237] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.520721 20297 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:37.503711 20228 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.529563 20423 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.526830 20385 raft_consensus.cc:697] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:37.641573 19627 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:37.655448 19625 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:37.656765 19582 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.560108 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:37.658178 19587 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:37.631776 20420 log.cc:927] Time spent T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:17:37.594496 19584 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:37.553776 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:37.654824 19655 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:37.663017 19658 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 2: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:37.663666 19505 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:37.554745 20174 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:37.669919 19587 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:37.532945 20425 raft_consensus.cc:697] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:37.604175 20262 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3.
I20260709 13:17:37.651361 20423 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.676383 20325 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.680222 20407 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.682511 19658 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:37.684767 19924 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:37.685424 19924 raft_consensus.cc:697] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:17:37.686156 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 44680.5us
I20260709 13:17:37.560721 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:37.559528 19581 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:17:37.723635 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 49166.5us
I20260709 13:17:37.724612 19625 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:37.724961 19627 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:37.525651 20408 consensus_queue.cc:237] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.722450 19924 consensus_queue.cc:237] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.730161 19625 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:37.732774 19582 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:37.727448 20394 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:17:37.745565 20257 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:37.747124 20422 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:37.747305 20257 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.748481 20385 consensus_queue.cc:237] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.767179 20159 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:37.767999 20424 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:37.717099 19503 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:37.779919 20267 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:37.787631 20265 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.722054 20425 consensus_queue.cc:237] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:37.826923 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 52455.9us
I20260709 13:17:37.828740 20376 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:37.785439 20267 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:37.850502 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 93069.9us
I20260709 13:17:37.853412 19507 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:37.790673 20424 raft_consensus.cc:697] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:37.868469 20412 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:17:37.883296 20375 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:37.894018 20325 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:37.897212 20228 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:38.038126 19476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.027s	sys 0.051s
I20260709 13:17:38.038546 20170 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.040550 20424 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:37.871327 20413 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:17:38.064391 19478 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.000s	sys 0.014s
W20260709 13:17:38.065326 19476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.027s	sys 0.051s
W20260709 13:17:38.072616 19478 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.000s	sys 0.015s
W20260709 13:17:38.066558 19657 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.005s	sys 0.009s
W20260709 13:17:38.072962 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 576774us
W20260709 13:17:38.073374 19657 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.005s	sys 0.009s
I20260709 13:17:38.074254 19478 leader_election.cc:400] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
I20260709 13:17:38.074594 19478 leader_election.cc:403] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:17:38.065361 20384 consensus_meta.cc:287] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.934s	user 0.017s	sys 0.001s
I20260709 13:17:38.069285 20170 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.084401 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:38.106138 19661 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:38.068069 19585 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
W20260709 13:17:38.107491 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 250588us
I20260709 13:17:38.110625 20304 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:38.115842 20439 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:17:38.118348 20409 consensus_meta.cc:287] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.672s	user 0.012s	sys 0.003s
I20260709 13:17:38.118533 20265 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:38.118772 20409 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.118556 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:38.119751 19658 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:38.122845 20377 consensus_meta.cc:287] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.006s
I20260709 13:17:38.123258 20377 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.123821 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:38.124486 19583 raft_consensus.cc:2393] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:38.124703 19505 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 3: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:38.126346 20304 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
I20260709 13:17:38.138319 20170 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:38.139232 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:38.142665 20403 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:38.142973 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:38.143241 20403 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:17:38.140484 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 66367.6us
I20260709 13:17:38.120985 20409 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:38.168905 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:38.169766 19578 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.177115 19578 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:38.178102 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:38.178298 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:38.179416 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:38.180271 19504 raft_consensus.cc:2368] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3.
I20260709 13:17:38.181427 19504 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:38.183199 19652 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:38.185163 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:38.188067 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:38.188804 20228 raft_consensus.cc:2764] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:17:38.188865 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:38.189500 20228 raft_consensus.cc:2764] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:17:38.190706 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:38.087337 20384 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.071920 20413 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.201438 19407 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48852 (request call id 112) took 3160 ms. Trace:
I20260709 13:17:38.179416 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:38.195442 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:38.186127 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:38.206506 19511 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:38.206686 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:38.147270 20423 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.216635 19587 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:38.217283 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:38.217727 19587 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.223845 19587 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:38.195801 19505 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:38.195628 20170 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:38.203286 19407 rpcz_store.cc:276] 0709 13:17:35.041321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.041472 (+   151us) service_pool.cc:224] Handling call
0709 13:17:38.201346 (+3159874us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:36.093897 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:36.094475 (+   578us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:36.094507 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:17:36.094524 (+    17us) tablet.cc:662] Decoding operations
0709 13:17:36.095123 (+   599us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:36.095201 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:36.095230 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:17:36.095623 (+   393us) tablet.cc:701] Row locks acquired
0709 13:17:36.095642 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:17:36.095777 (+   135us) write_op.cc:270] Start()
0709 13:17:36.095910 (+   133us) write_op.cc:276] Timestamp: P: 1783603056095738 usec, L: 0
0709 13:17:36.095932 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:17:36.096597 (+   665us) log.cc:844] Serialized 1717 byte log entry
0709 13:17:36.201576 (+104979us) op_driver.cc:464] REPLICATION: finished
0709 13:17:36.621366 (+419790us) write_op.cc:301] APPLY: starting
0709 13:17:36.622545 (+  1179us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:36.641475 (+ 18930us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:36.661221 (+ 19746us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:36.679086 (+ 17865us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:36.737154 (+ 58068us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:17:36.775684 (+ 38530us) write_op.cc:312] APPLY: finished
0709 13:17:36.817598 (+ 41914us) log.cc:844] Serialized 40 byte log entry
0709 13:17:36.820969 (+  3371us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:36.821075 (+   106us) write_op.cc:454] Released schema lock
0709 13:17:36.827784 (+  6709us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:36.923251 (+ 95467us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:36.925815 (+  2564us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":56460,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":411723,"apply.run_cpu_time_us":3133,"apply.run_wall_time_us":269372,"num_ops":4,"prepare.queue_time_us":313495,"prepare.run_cpu_time_us":2993,"prepare.run_wall_time_us":2994,"replication_time_us":105485,"thread_start_us":259178,"threads_started":2}]]}
I20260709 13:17:38.222604 19578 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.213080 20384 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:38.230144 20403 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.235275 19661 raft_consensus.cc:2393] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:38.222330 20422 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:38.208635 20228 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:17:38.238025 20180 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:38.239905 20423 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:38.242272 20407 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:38.242062 20170 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.251520 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:38.226729 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:17:38.275279 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 47626.8us
I20260709 13:17:38.228374 20377 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:38.235836 20166 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:38.227924 20225 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:38.281338 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:38.269666 20180 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:38.282068 20257 consensus_meta.cc:287] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.009s
I20260709 13:17:38.312815 20257 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:38.275732 20412 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.350566 19654 raft_consensus.cc:2368] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3.
I20260709 13:17:38.351341 20370 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:38.361786 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:38.363369 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 49364.6us
I20260709 13:17:38.389597 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:38.305593 20225 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.305578 20166 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.393594 19478 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:38.344161 19658 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:38.363245 20413 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:38.407931 19505 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:38.352514 20412 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.411214 20412 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:38.415115 20166 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:38.416308 20170 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:38.416190 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:38.423725 19551 leader_election.cc:400] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3.
I20260709 13:17:38.403365 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:38.393599 20408 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:38.425132 19551 leader_election.cc:403] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:17:38.423331 20453 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:38.431882 20225 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:38.405828 20449 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:38.423537 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:38.433842 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:38.435554 19660 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 2: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:38.419154 20385 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:38.445053 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 448) took 1093 ms. Trace:
I20260709 13:17:38.445785 19510 rpcz_store.cc:276] 0709 13:17:37.345533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.345675 (+   142us) service_pool.cc:224] Handling call
0709 13:17:37.363725 (+ 18050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.446094 (+ 82369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:37.446139 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:37.446197 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:37.446244 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.438712 (+992468us) spinlock_profiling.cc:243] Waited 82.1 ms on lock 0x7b54002aa3d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:17:38.438756 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.438900 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188873088}
I20260709 13:17:38.447363 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:38.448671 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:38.449728 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:38.450778 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:38.454070 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:38.455287 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:38.456049 19584 raft_consensus.cc:2393] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:38.459209 19512 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:38.460260 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:38.461539 19627 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:38.463989 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:38.464921 19512 raft_consensus.cc:2368] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3.
I20260709 13:17:38.439710 19652 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.466487 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:38.466702 19627 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:38.469172 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:38.463994 19476 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:38.455322 19660 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:38.476478 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:38.477171 19512 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:38.498226 19625 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:38.472069 20170 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:17:38.465377 20166 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:38.475611 20373 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:38.507687 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:38.471494 20430 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:17:38.508878 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:38.509011 19511 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:38.475941 20425 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:38.467931 20184 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:17:38.513432 20393 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:38.513929 20393 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.507513 20166 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.520879 20166 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:38.527640 20455 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.528365 20455 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.475080 20384 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:38.530355 20384 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.464874 20449 raft_consensus.cc:697] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:38.534152 20449 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.462942 20385 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.540642 20385 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:38.463215 20422 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:38.514346 20393 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:38.527652 20425 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:38.663884 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:38.690858 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:38.691216 20413 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:38.703298 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 69150.1us
I20260709 13:17:38.704097 19512 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:38.470672 20180 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:38.736500 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:17:38.738233 19583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 435) took 1490 ms (client timeout 1983 ms). Trace:
I20260709 13:17:38.472692 19578 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
W20260709 13:17:38.739420 19583 rpcz_store.cc:269] 0709 13:17:37.248062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.248174 (+   112us) service_pool.cc:224] Handling call
0709 13:17:38.738011 (+1489837us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b5400107a54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:17:38.738169 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1939847552}
I20260709 13:17:38.770339 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:38.700642 20374 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:17:38.775723 19478 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.667s (SENT) [suppressed 65 similar messages]
I20260709 13:17:38.741379 20384 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:38.785590 20430 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:38.791272 20430 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.794471 20455 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:38.741166 19652 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:38.768155 20225 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3.
I20260709 13:17:38.802625 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:38.740368 20170 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:17:38.739740 20413 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.793421 20430 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:38.811422 19583 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:38.788136 20458 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.815070 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:38.816972 19660 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:38.820221 20444 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:38.820755 20444 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.785494 20374 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.822937 20444 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:38.832333 19512 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:38.818524 20257 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:38.818538 20458 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.789647 20425 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.913775 20374 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:38.846314 20257 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:38.934752 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 115756us
I20260709 13:17:38.923259 20174 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:38.959542 20174 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:38.932991 20257 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:38.962903 20174 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:38.968745 20444 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:17:38.990607 19582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 401) took 1808 ms (client timeout 1892 ms). Trace:
W20260709 13:17:38.991235 19582 rpcz_store.cc:269] 0709 13:17:37.181888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.181995 (+   107us) service_pool.cc:224] Handling call
0709 13:17:38.990345 (+1808350us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b5400106b54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:17:38.990519 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1090129152}
I20260709 13:17:38.923353 20458 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:39.033262 20373 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:39.033123 20393 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.038904 20373 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.042193 19660 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:17:39.044579 20393 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:17:39.044812 19585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 394) took 1926 ms (client timeout 1667 ms). Trace:
I20260709 13:17:39.045145 20373 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:17:39.045225 19585 rpcz_store.cc:269] 0709 13:17:37.118660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.122418 (+  3758us) service_pool.cc:224] Handling call
0709 13:17:39.044609 (+1922191us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54002fbf54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:17:39.044733 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147092736}
I20260709 13:17:39.055899 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:39.056614 19656 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.062309 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 460) took 1228 ms. Trace:
W20260709 13:17:39.063836 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 93042.1us
I20260709 13:17:39.062786 19579 rpcz_store.cc:276] 0709 13:17:37.833752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.889648 (+ 55896us) service_pool.cc:224] Handling call
0709 13:17:37.890105 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.135424 (+245319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.140403 (+  4979us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:38.215505 (+ 75102us) log.cc:844] Serialized 26 byte log entry
0709 13:17:38.395231 (+179726us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:38.399667 (+  4436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.061822 (+662155us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b54003ebf54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:17:39.061879 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:39.061938 (+    59us) raft_consensus.cc:1685] finished
0709 13:17:39.061953 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.062208 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16230,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":4881,"spinlock_wait_cycles":49471232,"thread_start_us":91653,"threads_started":1,"wal-append.queue_time_us":180681}
I20260709 13:17:39.067710 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.069015 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.069645 19511 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:39.070197 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.070533 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.080089 20267 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:39.080804 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:39.081810 19504 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:39.081439 19507 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 451) took 1734 ms (client timeout 2030 ms). Trace:
W20260709 13:17:39.084291 19507 rpcz_store.cc:269] 0709 13:17:37.346588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.346701 (+   113us) service_pool.cc:224] Handling call
0709 13:17:39.081253 (+1734552us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b54001cff54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:17:39.081371 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1159486208}
I20260709 13:17:39.087920 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:39.088744 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 422) took 1004 ms. Trace:
I20260709 13:17:39.089906 19652 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3. Ops: []
W20260709 13:17:39.090065 19503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 454) took 1742 ms (client timeout 1983 ms). Trace:
W20260709 13:17:39.090430 19503 rpcz_store.cc:269] 0709 13:17:37.347420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.355883 (+  8463us) service_pool.cc:224] Handling call
0709 13:17:39.089896 (+1734013us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54000fda54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:17:39.089997 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593289984}
I20260709 13:17:39.094085 20431 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.094544 20431 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.095863 19652 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:39.096611 20431 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:39.106163 19476 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:39.106485 20406 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:39.107925 19476 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:39.109594 19476 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:39.112430 20431 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.112150 20406 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.120038 20406 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:39.112900 20174 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.113436 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.122124 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.123507 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.124794 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.114050 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.111577 20458 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:39.126312 20458 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:39.125458 20463 log.cc:927] Time spent T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.619s	user 0.004s	sys 0.009s
I20260709 13:17:39.089083 19659 rpcz_store.cc:276] 0709 13:17:38.084018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.086686 (+  2668us) service_pool.cc:224] Handling call
0709 13:17:39.087753 (+1001067us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b58000e1c98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:17:39.088689 (+   936us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25933696}
I20260709 13:17:39.129314 20458 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:39.143136 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 63542.2us
I20260709 13:17:39.137765 20406 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:39.114073 19656 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:39.153877 20450 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.154426 20450 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.155844 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:39.156697 20257 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:39.156968 20450 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:39.157228 20257 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:39.157886 20257 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:39.152657 20255 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:39.169754 20255 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.172027 20255 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:39.148783 20398 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:39.179811 19476 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:39.182760 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:39.184507 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:39.147289 20304 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:17:39.159736 20412 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:39.206296 20412 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.207741 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:39.208539 19661 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:39.208827 20412 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:39.182137 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:39.209513 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 493) took 1021 ms. Trace:
I20260709 13:17:39.209956 19654 rpcz_store.cc:276] 0709 13:17:38.188521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.188638 (+   117us) service_pool.cc:224] Handling call
0709 13:17:39.209331 (+1020693us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54003f3c54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:17:39.209459 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286605696}
I20260709 13:17:39.160871 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:39.175556 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.218981 19661 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:39.220697 20371 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:39.221114 20371 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:39.216286 20453 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:39.222015 20453 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.222102 20371 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.223758 19476 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:39.179391 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 425) took 1085 ms. Trace:
I20260709 13:17:39.199985 20413 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:39.201171 19504 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:17:39.189416 20398 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.226763 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.227857 20398 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:39.227929 19656 rpcz_store.cc:276] 0709 13:17:38.086849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.088307 (+  1458us) service_pool.cc:224] Handling call
0709 13:17:39.055713 (+967406us) spinlock_profiling.cc:243] Waited 8.31 ms on lock 0x7b58000e1c98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:17:39.161053 (+105340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19121536}
I20260709 13:17:39.229236 19503 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:17:39.234298 19510 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:39.202123 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 459) took 1426 ms. Trace:
I20260709 13:17:39.235101 20412 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.240676 20412 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.239989 19580 rpcz_store.cc:276] 0709 13:17:37.775588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.827046 (+ 51458us) service_pool.cc:224] Handling call
0709 13:17:39.201216 (+1374170us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:39.201467 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.201705 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.201738 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:39.201790 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:39.201829 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.201904 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.202053 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11373952}
W20260709 13:17:39.207855 19509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 455) took 1860 ms (client timeout 2031 ms). Trace:
I20260709 13:17:39.153306 20408 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:39.243150 20412 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:39.212019 20406 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:39.188921 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:39.242777 19509 rpcz_store.cc:269] 0709 13:17:37.347713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.349782 (+  2069us) service_pool.cc:224] Handling call
0709 13:17:39.207644 (+1857862us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b54002a2bd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:17:39.207788 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2105553280}
I20260709 13:17:39.189867 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:39.222419 19506 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:39.237851 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 407) took 1067 ms. Trace:
I20260709 13:17:39.195865 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:39.238529 19625 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:39.249010 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.250224 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:39.250366 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.251391 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.252043 19509 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:39.252951 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.245904 19587 rpcz_store.cc:276] 0709 13:17:38.170286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.381921 (+211635us) service_pool.cc:224] Handling call
0709 13:17:38.386946 (+  5025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.405951 (+ 19005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.405985 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.406027 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:38.406062 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.237642 (+831580us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b5400247a54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:17:39.237685 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.237793 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43234176}
I20260709 13:17:39.255328 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:39.258770 19476 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:39.260306 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:39.243579 20408 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.262607 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.263893 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:39.264792 19504 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:39.264878 20257 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.246594 19658 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:39.265764 20409 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:39.266494 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.266393 20409 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.267117 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:39.271989 19409 catalog_manager.cc:5697] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 3, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 3 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:39.274844 19625 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:39.248301 19654 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:39.251535 20449 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:39.256696 20394 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:39.256410 20412 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:39.282963 20411 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.286003 20159 raft_consensus.cc:2764] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:17:39.278038 20409 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:39.298189 19660 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:39.281102 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:39.284435 20410 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:39.276859 20373 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:17:39.291777 20426 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:39.370652 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 65928.9us
W20260709 13:17:39.378496 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 76928.8us
I20260709 13:17:39.407994 19625 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:39.293069 20453 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:39.298539 20412 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:17:39.443713 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 162034us
I20260709 13:17:39.292562 20394 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.450371 19659 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:39.450238 20435 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.191s
I20260709 13:17:39.451373 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.451967 19510 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:39.458289 20257 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:39.460052 20408 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:39.369973 20410 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.463784 20410 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:39.466572 19625 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:39.467254 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:39.467449 20376 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:39.467830 20376 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.468170 20376 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:39.436192 20411 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:39.475775 19551 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:39.478089 19551 leader_election.cc:400] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3.
I20260709 13:17:39.478415 19551 leader_election.cc:403] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:17:39.412447 20440 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:17:39.447917 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 423) took 1361 ms. Trace:
I20260709 13:17:39.470341 20184 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:39.489380 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:39.477548 20385 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:39.480445 20225 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3.
I20260709 13:17:39.479162 20453 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:17:39.495805 20294 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.483744 20297 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:17:39.491928 20410 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:39.481752 20409 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:17:39.501989 20453 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:39.482038 20412 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.511564 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:39.491403 20184 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.519121 19661 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:39.522801 20451 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.528012 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:39.510020 20453 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:39.535135 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 456) took 1776 ms. Trace:
I20260709 13:17:39.534380 20453 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.524212 20410 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:39.486771 19655 rpcz_store.cc:276] 0709 13:17:38.086157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.086749 (+   592us) service_pool.cc:224] Handling call
0709 13:17:39.167824 (+1081075us) spinlock_profiling.cc:243] Waited 8.38 ms on lock 0x7b58000e1c98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635e9c 00007f6c2e635a5b 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:39.168090 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.233348 (+ 65258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.233391 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:39.233446 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:39.233487 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.415730 (+182243us) spinlock_profiling.cc:243] Waited 65 ms on lock 0x7b54001ec654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:17:39.437030 (+ 21300us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.446168 (+  9138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168801920}
I20260709 13:17:39.536309 20394 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:39.543567 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:39.547420 20411 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:39.555924 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:39.560253 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:39.544937 19581 rpcz_store.cc:276] 0709 13:17:37.758266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.769565 (+ 11299us) service_pool.cc:224] Handling call
0709 13:17:39.230044 (+1460479us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:39.230250 (+   206us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:39.230608 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.230646 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:39.231177 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:17:39.487561 (+256384us) raft_consensus.cc:1645] Marking committed up to 0
0709 13:17:39.488733 (+  1172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.492371 (+  3638us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:39.534698 (+ 42327us) raft_consensus.cc:1685] finished
0709 13:17:39.534734 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.535049 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16435,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":17540,"spinlock_wait_cycles":58898304,"thread_start_us":245924,"threads_started":1,"wal-append.queue_time_us":277649}
I20260709 13:17:39.574642 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:39.573272 20394 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:39.565562 20411 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:39.578452 20394 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:39.585654 20440 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:39.586045 20394 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.572584 20453 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:39.565270 20385 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.586292 20440 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.579280 20409 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.594206 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 469) took 1510 ms. Trace:
I20260709 13:17:39.594492 20184 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:39.595028 20297 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.594992 20409 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:39.606962 20297 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.607160 20409 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.607529 20297 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:39.610873 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:39.616478 20479 log.cc:927] Time spent T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.354s	user 0.003s	sys 0.000s
I20260709 13:17:39.594709 19508 rpcz_store.cc:276] 0709 13:17:38.084062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.123411 (+ 39349us) service_pool.cc:224] Handling call
0709 13:17:39.593459 (+1470048us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:39.593688 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.593865 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.593896 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:39.593937 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:39.593978 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.594036 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.594147 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25460096}
I20260709 13:17:39.619266 20371 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.622056 20440 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:39.628334 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:39.629559 20385 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:39.631075 20385 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.633267 20385 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:39.634382 20297 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:39.635167 19478 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:39.635957 20424 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.642082 20438 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:39.659590 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.589951 20376 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:39.670025 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 72815.4us
I20260709 13:17:39.600308 20484 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
W20260709 13:17:39.682610 20488 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:17:39.687069 20376 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:17:39.697821 20487 log.cc:927] Time spent T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:17:39.700831 20411 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.702399 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:39.703110 19507 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:39.707505 20375 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:39.708159 20375 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.712646 20375 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:39.712754 20406 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:39.712765 19551 leader_election.cc:400] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3.
I20260709 13:17:39.715014 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:39.717837 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:39.719110 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:39.730088 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 507) took 1255 ms. Trace:
I20260709 13:17:39.730721 20453 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.731822 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 415) took 1533 ms. Trace:
I20260709 13:17:39.732285 19507 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:17:39.732199 19584 rpcz_store.cc:276] 0709 13:17:38.198625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.477250 (+278625us) service_pool.cc:224] Handling call
0709 13:17:38.477609 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.560952 (+ 83343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.560996 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.561059 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:38.561102 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.731611 (+1170509us) spinlock_profiling.cc:243] Waited 83 ms on lock 0x7b54003eba54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:17:39.731648 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.731759 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190840704}
I20260709 13:17:39.733457 19625 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:39.734273 20181 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:39.730496 19658 rpcz_store.cc:276] 0709 13:17:38.474838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.690529 (+215691us) service_pool.cc:224] Handling call
0709 13:17:39.729907 (+1039378us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54000adf54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:17:39.730029 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1250299264}
I20260709 13:17:39.735013 20181 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:39.736346 20181 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.737886 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:39.719875 20406 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.724713 20385 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:39.720072 20410 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.746402 20406 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:39.760964 20407 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.761214 20406 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.746447 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:39.745600 20409 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.766129 20409 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:39.793656 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 424) took 1707 ms. Trace:
I20260709 13:17:39.822131 19408 rpcz_store.cc:275] Call kudu.master.MasterService.IsCreateTableDone from 127.0.0.1:48858 (request call id 41) took 2027 ms. Trace:
I20260709 13:17:39.823858 19408 rpcz_store.cc:276] 0709 13:17:37.769983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.770225 (+   242us) service_pool.cc:224] Handling call
0709 13:17:37.770526 (+   301us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0709 13:17:38.200764 (+430238us) catalog_manager.cc:2317] Verify if the table creation is in progress for test-workload [id=aed62f436c1a475c9621b6aef3f2a036]
0709 13:17:39.797197 (+1596433us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2024059}
I20260709 13:17:39.794291 19653 rpcz_store.cc:276] 0709 13:17:38.086491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.087919 (+  1428us) service_pool.cc:224] Handling call
0709 13:17:39.207020 (+1119101us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b58000e1c98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:17:39.733321 (+526301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.733505 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.733533 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:39.733579 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:39.733611 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.733719 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.793399 (+ 59680us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b54000adf50. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:17:39.793566 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1235220608}
W20260709 13:17:39.865712 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 141488us
I20260709 13:17:39.865931 19584 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:39.866634 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:39.870803 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:39.875233 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:39.875664 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:39.876504 19587 raft_consensus.cc:2376] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3. Re-sending same reply.
I20260709 13:17:39.879633 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:39.880241 19587 raft_consensus.cc:2376] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3. Re-sending same reply.
I20260709 13:17:39.880263 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:39.881701 19586 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:39.883692 19582 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:39.884843 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:39.885528 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:39.886128 19586 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:39.885006 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:39.887668 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:39.889750 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:39.890583 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:39.871249 20184 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.867851 20409 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:39.893121 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:39.893219 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:39.870783 20413 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:39.898303 19580 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:39.902915 19582 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:39.902325 20371 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:39.908196 20371 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:39.919616 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 48901.9us
I20260709 13:17:39.892092 20297 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.921443 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:39.918814 20413 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.903151 20409 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:39.928148 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:39.951594 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:39.953938 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:39.954582 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:39.955581 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:39.964416 19627 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:39.966599 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:39.968641 19627 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:39.970723 19478 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:39.922632 20297 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:39.973325 19583 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:39.975560 19478 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:39.974184 20412 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:39.972895 20372 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.973191 20375 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:39.976307 20297 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.976392 20423 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:39.977010 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:39.977216 20475 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:39.979530 20429 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:39.989145 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:39.981271 20267 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:39.976859 20425 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:17:39.993201 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:39.997246 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:39.998220 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:40.001230 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:40.001909 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:40.002605 19511 raft_consensus.cc:2368] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4.
I20260709 13:17:40.003988 19581 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:40.004273 19504 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:17:40.003930 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:40.001233 20267 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:39.984819 20407 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:17:40.007493 20267 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.010696 20426 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:40.011248 20426 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.012382 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:40.014070 19478 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.015081 20325 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:40.015501 20438 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:40.014389 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:40.001431 20406 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.017668 19478 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.018466 20406 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.018362 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:40.019261 19656 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:40.019948 20425 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:40.022570 19478 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:17:40.022855 20500 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.170s	user 0.000s	sys 0.003s
I20260709 13:17:40.022778 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:40.023434 20425 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.994788 20423 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.026432 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:40.026619 20423 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:40.028283 20409 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:40.029263 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:40.030174 19584 raft_consensus.cc:2410] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:40.030099 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:40.047202 20413 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:40.055321 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:40.001909 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:40.061456 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:40.096189 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 73748us
I20260709 13:17:40.097379 19660 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:40.032542 20297 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.101817 20449 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:17:40.229734 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 123633us
I20260709 13:17:40.191154 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:40.239503 19586 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:40.226516 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:40.229887 20449 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:40.244858 20394 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.254139 19656 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:17:40.274044 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:40.278800 20394 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.286638 20297 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:40.287552 20394 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:40.291188 20411 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:17:40.295882 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57230.4us
I20260709 13:17:40.263070 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:17:40.315673 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 62892.5us
I20260709 13:17:40.327520 19551 leader_election.cc:400] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4.
I20260709 13:17:40.329720 20519 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:40.338191 20225 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:40.339255 20225 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:40.339705 20225 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:17:40.339937 19458 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:40.340742 20225 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.330459 20519 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.399514 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:40.401966 20426 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:40.427820 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:40.344885 20225 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:40.405535 19659 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:40.359979 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:40.382184 19656 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:40.417225 19661 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:40.376431 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:40.374984 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:40.442514 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:40.370054 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:40.466574 20513 log.cc:927] Time spent T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.182s	user 0.003s	sys 0.000s
I20260709 13:17:40.467134 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:40.468689 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:40.469043 19506 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:17:40.411839 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:40.352476 20371 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:40.438441 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 68905.5us
I20260709 13:17:40.412350 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:40.403977 19585 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:40.416420 19627 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:17:40.486752 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 70441.2us
I20260709 13:17:40.487437 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:40.351477 20449 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.377724 19509 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:40.380923 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:40.444753 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:40.446736 20458 consensus_queue.cc:1059] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:40.451385 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:40.471027 19506 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:17:40.477098 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.500507 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.501557 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.502542 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:40.503841 19504 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:40.504034 20501 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.504556 20458 raft_consensus.cc:3055] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:40.506263 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.479269 20519 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:40.483366 20302 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:40.496187 19478 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.487576 19476 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.504789 20501 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.513809 19476 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.515846 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.504913 20458 raft_consensus.cc:740] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:40.495292 20398 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.498409 20423 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.520391 19627 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:40.524490 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:40.524253 20521 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 13:17:40.525048 20512 log.cc:927] Time spent T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.240s	user 0.002s	sys 0.000s
I20260709 13:17:40.526840 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:40.499420 20159 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:17:40.511744 20499 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:40.517283 20520 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.530681 20520 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:40.531243 20520 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.532819 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.536886 19627 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:40.543193 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.543581 19582 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:40.546844 19582 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:17:40.547740 19582 pending_rounds.cc:85] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 1
I20260709 13:17:40.548381 19582 pending_rounds.cc:107] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:17:40.548779 19582 raft_consensus.cc:2889] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:40.498693 20426 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:17:40.519023 20519 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:40.557549 20517 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:40.558310 20458 consensus_queue.cc:260] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.559643 20458 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.561455 20159 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:40.563174 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.562125 20370 consensus_queue.cc:1059] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:40.523626 20371 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:40.563648 20407 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:17:40.576602 20385 consensus_queue.cc:1059] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:40.576839 20501 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:40.557641 19580 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:40.542268 20297 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.549124 20429 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:40.548857 20430 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:40.543891 20438 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.577566 20497 raft_consensus.cc:3055] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:40.604699 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:40.566146 20294 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
W20260709 13:17:40.597492 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 48235.6us
I20260709 13:17:40.607908 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:40.603933 20497 raft_consensus.cc:740] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:40.609714 20497 consensus_queue.cc:260] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.610993 20497 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:40.601786 20429 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:40.612191 20429 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.631008 20438 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.632143 20438 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.622556 20484 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.632965 20181 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:40.633237 20484 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.621560 20449 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:40.602330 20444 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.637804 20294 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:40.638041 20444 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:40.638263 20294 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:40.638528 20444 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.639318 20294 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.633302 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:40.641885 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:40.640259 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:40.639737 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.645313 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.596786 20225 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:40.646036 20267 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:17:40.647917 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 44933.2us
I20260709 13:17:40.646826 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.647959 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:40.661494 19625 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:40.663373 19625 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:40.649775 20475 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:40.649673 20385 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:40.652063 20423 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:40.657790 20410 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.669754 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:40.677666 19504 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.652509 20438 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:40.666910 20159 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:40.674538 19660 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:40.667094 20375 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.667255 20501 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:40.679168 20159 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:40.699658 20159 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:40.678081 20423 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.707049 20423 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:40.683025 19653 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:40.683601 20484 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:40.686849 20520 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.690282 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:40.714973 19583 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:40.716173 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:40.690831 19586 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:40.718004 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:40.710747 19476 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:40.713160 19551 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.662946 20444 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.726845 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:40.740588 19625 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:40.721396 20501 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.753278 19660 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:40.753759 19579 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:40.754139 20375 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:40.754868 20520 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:40.755432 20444 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:40.756430 19504 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:40.745136 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:40.741150 20438 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:40.770033 20438 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.770520 20438 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:40.789847 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:40.793278 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:40.793753 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:40.801842 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:17:40.816535 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 100080us
W20260709 13:17:40.818451 20529 log.cc:927] Time spent T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:17:40.821698 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.829800 19586 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:17:40.830401 19586 pending_rounds.cc:85] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 1
I20260709 13:17:40.830724 19586 pending_rounds.cc:107] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:17:40.831067 19586 raft_consensus.cc:2889] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:40.800079 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:40.837809 20267 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:17:40.841470 20159 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.843044 19659 raft_consensus.cc:1240] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:40.843714 20159 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:40.833015 20520 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:40.846109 20430 consensus_queue.cc:1059] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:40.846611 19409 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48840 (request call id 107) took 4881 ms. Trace:
I20260709 13:17:40.846740 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:40.847162 20484 raft_consensus.cc:3055] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:40.847875 20484 raft_consensus.cc:740] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:40.805197 20429 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.854293 20429 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:40.849154 20484 consensus_queue.cc:260] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:40.827294 20385 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:40.798943 20497 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:17:40.876009 20484 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:40.847012 19409 rpcz_store.cc:276] 0709 13:17:35.965003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.965156 (+   153us) service_pool.cc:224] Handling call
0709 13:17:40.846530 (+4881374us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:39.531605 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:39.532206 (+   601us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:39.532237 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:17:39.532256 (+    19us) tablet.cc:662] Decoding operations
0709 13:17:39.532580 (+   324us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:39.532660 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:39.532696 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:39.532886 (+   190us) tablet.cc:701] Row locks acquired
0709 13:17:39.532904 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:17:39.533031 (+   127us) write_op.cc:270] Start()
0709 13:17:39.533138 (+   107us) write_op.cc:276] Timestamp: P: 1783603059532993 usec, L: 0
0709 13:17:39.533158 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:17:39.533825 (+   667us) log.cc:844] Serialized 543 byte log entry
0709 13:17:39.727981 (+194156us) op_driver.cc:464] REPLICATION: finished
0709 13:17:39.914867 (+186886us) write_op.cc:301] APPLY: starting
0709 13:17:39.915006 (+   139us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:39.915155 (+   149us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:39.915354 (+   199us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:39.915630 (+   276us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:39.915874 (+   244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:39.915958 (+    84us) write_op.cc:312] APPLY: finished
0709 13:17:39.923506 (+  7548us) log.cc:844] Serialized 22 byte log entry
0709 13:17:39.925050 (+  1544us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:39.925177 (+   127us) write_op.cc:454] Released schema lock
0709 13:17:39.925234 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:39.925657 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:39.925698 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":186572,"apply.run_cpu_time_us":2490,"apply.run_wall_time_us":10779,"num_ops":1,"prepare.queue_time_us":223930,"prepare.run_cpu_time_us":9315,"prepare.run_wall_time_us":59756,"raft.queue_time_us":104610,"raft.run_cpu_time_us":44972,"raft.run_wall_time_us":151484,"replication_time_us":194661,"thread_start_us":412487,"threads_started":4,"wal-append.queue_time_us":71130}]]}
I20260709 13:17:40.895102 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:40.897931 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:40.904397 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:40.908342 19507 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:40.917569 19625 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:40.911566 19410 catalog_manager.cc:5697] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 1 to 2, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:40.930423 19478 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:40.930418 19410 catalog_manager.cc:5697] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 2 to 3, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 3 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:40.984124 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57155.9us
I20260709 13:17:40.924460 20424 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:17:40.999315 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 68978.9us
W20260709 13:17:40.996980 20532 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:17:40.927479 20475 consensus_queue.cc:1059] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:17:41.011145 20265 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:17:41.043687 20540 log.cc:927] Time spent T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:41.015942 20424 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:17:41.050312 20475 raft_consensus.cc:3055] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.050863 20475 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:41.051836 20475 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:41.052599 20535 log.cc:927] Time spent T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.242s	user 0.003s	sys 0.003s
I20260709 13:17:41.053267 20475 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.992822 20440 consensus_queue.cc:1059] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:17:41.054195 20294 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:41.055706 20371 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.056241 20371 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:41.068774 20440 raft_consensus.cc:3055] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.069236 20440 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:41.070039 20440 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:41.083668 20438 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:41.085698 19580 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
W20260709 13:17:41.088351 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 103135us
I20260709 13:17:41.089781 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:17:41.145810 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 56168.5us
I20260709 13:17:41.097314 20440 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.163226 19584 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.150988 20521 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:17:41.246052 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 75866.2us
W20260709 13:17:41.258412 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 69217.8us
I20260709 13:17:41.247920 20445 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.200515 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:41.264024 20438 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:41.272117 19581 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:41.267632 20445 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:41.359328 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 89565.1us
W20260709 13:17:41.361536 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 90470.1us
I20260709 13:17:41.364794 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:41.371469 19655 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:41.372251 20445 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:17:41.374259 20538 log.cc:927] Time spent T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.372s	user 0.002s	sys 0.000s
I20260709 13:17:41.374985 19656 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:17:41.375627 20547 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:17:41.413601 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:41.429917 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 63640.6us
I20260709 13:17:41.436085 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:41.442550 19655 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
W20260709 13:17:41.421262 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 60225.6us
I20260709 13:17:41.470654 19627 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:41.491664 19476 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:41.493728 20550 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:17:41.504659 20265 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:41.529870 20444 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:41.502481 20371 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:41.545181 20265 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:41.595952 20265 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:41.611084 19581 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
W20260709 13:17:41.614006 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 143460us
I20260709 13:17:41.587798 20371 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:41.615945 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 155724us
I20260709 13:17:41.655313 20267 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:17:41.687637 20440 consensus_meta.cc:287] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.001s
I20260709 13:17:41.657341 20267 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.718217 20267 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:41.719204 20267 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:41.720489 20267 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:41.721553 19458 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:41.740064 19478 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:41.746400 20166 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:41.746898 20166 raft_consensus.cc:697] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:41.759514 20166 consensus_queue.cc:237] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:41.810413 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.794665 20458 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:41.821966 20458 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:41.824160 20458 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:41.827541 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:41.828231 19581 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:17:41.829522 19478 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:41.837322 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:41.842269 19661 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.846675 19658 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 4: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:17:41.833230 20566 log.cc:927] Time spent T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:17:41.835605 20408 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:41.861403 20408 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:41.861851 20408 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:41.873811 20550 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.875592 20408 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:41.859622 20567 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.879769 20567 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:41.882319 20550 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:41.884574 20550 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:41.899242 20408 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:41.901933 20567 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:41.903743 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:41.915624 19508 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:17:41.911633 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:41.918617 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:41.919471 20567 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:41.919857 20567 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.920213 20567 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:41.928447 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:41.933750 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:41.934485 19580 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:41.940121 20567 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:41.941526 19653 raft_consensus.cc:2368] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5.
I20260709 13:17:41.943137 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:41.943812 19508 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:41.945658 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:41.950028 19476 leader_election.cc:400] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5.
I20260709 13:17:41.950764 19476 leader_election.cc:403] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:17:41.954214 19478 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:41.955477 19508 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:17:41.956044 20550 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5.
I20260709 13:17:41.956308 19581 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:17:41.958393 20550 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:41.958832 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:41.958915 20550 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.959591 20550 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:41.959847 20445 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:41.960338 20445 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:41.961658 19410 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48826 (request call id 121) took 5410 ms. Trace:
I20260709 13:17:41.961236 20445 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:41.962092 19410 rpcz_store.cc:276] 0709 13:17:36.551523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.556409 (+  4886us) service_pool.cc:224] Handling call
0709 13:17:41.961569 (+5405160us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:41.331994 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:41.419654 (+ 87660us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:41.419698 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:17:41.419723 (+    25us) tablet.cc:662] Decoding operations
0709 13:17:41.421861 (+  2138us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:41.421958 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:41.422005 (+    47us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:17:41.422906 (+   901us) tablet.cc:701] Row locks acquired
0709 13:17:41.422929 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:17:41.423101 (+   172us) write_op.cc:270] Start()
0709 13:17:41.423227 (+   126us) write_op.cc:276] Timestamp: P: 1783603061423063 usec, L: 0
0709 13:17:41.423251 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:17:41.423978 (+   727us) log.cc:844] Serialized 934 byte log entry
0709 13:17:41.606257 (+182279us) op_driver.cc:464] REPLICATION: finished
0709 13:17:41.830024 (+223767us) write_op.cc:301] APPLY: starting
0709 13:17:41.832107 (+  2083us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:41.841849 (+  9742us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:41.877780 (+ 35931us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:41.878117 (+   337us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:41.878273 (+   156us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:17:41.878320 (+    47us) write_op.cc:312] APPLY: finished
0709 13:17:41.878528 (+   208us) log.cc:844] Serialized 28 byte log entry
0709 13:17:41.878692 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:41.878775 (+    83us) write_op.cc:454] Released schema lock
0709 13:17:41.878810 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:41.879171 (+   361us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:41.879206 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":157415,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":200906,"apply.run_cpu_time_us":2130,"apply.run_wall_time_us":60712,"num_ops":2,"prepare.queue_time_us":299904,"prepare.run_cpu_time_us":19294,"prepare.run_wall_time_us":158456,"raft.queue_time_us":104087,"raft.run_cpu_time_us":7443,"raft.run_wall_time_us":21913,"replication_time_us":182869,"thread_start_us":334095,"threads_started":4,"wal-append.queue_time_us":37522}]]}
I20260709 13:17:41.958431 20567 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:41.969065 19407 catalog_manager.cc:5697] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:17:41.973871 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:41.975787 19585 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:41.979187 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:41.990671 19585 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:17:41.991252 20184 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.991669 19407 catalog_manager.cc:5697] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.002810 20184 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.005157 20184 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:42.012110 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:42.015934 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:42.016736 19655 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:17:42.019049 19551 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:42.020135 20184 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:42.020584 20184 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.020948 20184 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:42.003925 19407 catalog_manager.cc:5697] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 1 to 3, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 3 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.026073 20550 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.029536 20184 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.035939 20184 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:42.037437 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:42.038764 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:42.024636 19407 catalog_manager.cc:5697] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 0 to 2, leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 2 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.042932 19655 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:42.058620 20567 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:42.059186 20567 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.062688 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:42.063512 19505 raft_consensus.cc:2368] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4.
I20260709 13:17:42.065390 19625 leader_election.cc:400] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4.
I20260709 13:17:42.065737 19625 leader_election.cc:403] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:42.065516 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:42.066329 20521 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.067498 19580 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:42.067770 19407 catalog_manager.cc:5697] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.068674 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:42.062718 19657 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:42.072037 20408 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:42.073037 20166 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:42.066336 19585 raft_consensus.cc:2393] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:42.076221 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:42.078069 20550 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:42.080262 19655 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:17:42.082583 20567 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:42.086635 19551 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:42.087476 20184 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:42.088023 20184 raft_consensus.cc:697] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:42.088652 20521 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4.
I20260709 13:17:42.088934 20184 consensus_queue.cc:237] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.098421 19653 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:17:42.100452 19476 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:42.101500 20408 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:42.102007 20408 raft_consensus.cc:697] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:42.081988 19407 catalog_manager.cc:5697] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 1 to 3, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 3 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.102821 20408 consensus_queue.cc:237] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.103935 19407 catalog_manager.cc:5697] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 1 to 2, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 2 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.105608 19407 catalog_manager.cc:5697] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:17:42.196666 19407 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48852 (request call id 113) took 2539 ms. Trace:
I20260709 13:17:42.199169 20445 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:42.199846 20445 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.202275 20445 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:42.203852 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:42.204656 19505 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:42.197247 19407 rpcz_store.cc:276] 0709 13:17:39.657523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.657964 (+   441us) service_pool.cc:224] Handling call
0709 13:17:42.196582 (+2538618us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:42.156977 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:42.157595 (+   618us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:42.157655 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:17:42.157676 (+    21us) tablet.cc:662] Decoding operations
0709 13:17:42.158591 (+   915us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:42.158663 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:42.158704 (+    41us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:17:42.159405 (+   701us) tablet.cc:701] Row locks acquired
0709 13:17:42.159427 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:17:42.159587 (+   160us) write_op.cc:270] Start()
0709 13:17:42.159705 (+   118us) write_op.cc:276] Timestamp: P: 1783603062159539 usec, L: 0
0709 13:17:42.159729 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:17:42.160497 (+   768us) log.cc:844] Serialized 3281 byte log entry
0709 13:17:42.174749 (+ 14252us) op_driver.cc:464] REPLICATION: finished
0709 13:17:42.175128 (+   379us) write_op.cc:301] APPLY: starting
0709 13:17:42.175215 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:42.175447 (+   232us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:42.175554 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:42.177367 (+  1813us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:42.177614 (+   247us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:17:42.177692 (+    78us) write_op.cc:312] APPLY: finished
0709 13:17:42.178009 (+   317us) log.cc:844] Serialized 64 byte log entry
0709 13:17:42.178184 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:42.178325 (+   141us) write_op.cc:454] Released schema lock
0709 13:17:42.178376 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:42.178758 (+   382us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:42.178787 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26904,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":106,"apply.run_cpu_time_us":3600,"apply.run_wall_time_us":3598,"num_ops":8,"prepare.queue_time_us":25240,"prepare.run_cpu_time_us":3834,"prepare.run_wall_time_us":3834,"replication_time_us":14863,"thread_start_us":21310,"threads_started":1}]]}
I20260709 13:17:42.207489 19625 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:42.208362 20445 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:42.208729 20445 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:42.209097 20445 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.214931 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:42.215854 19581 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:42.222278 19655 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:42.226812 20550 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:42.229067 19408 catalog_manager.cc:5697] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:17:42.231488 19408 catalog_manager.cc:5697] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.232662 20445 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.233399 19408 catalog_manager.cc:5697] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:17:42.238196 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:42.239035 20445 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:42.242522 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:42.243434 19585 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:42.264287 19508 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:42.265173 20408 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:42.267257 19625 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:42.267623 20408 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.270761 20302 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:42.271287 20302 raft_consensus.cc:697] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:42.272140 20302 consensus_queue.cc:237] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.272578 20408 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:42.276904 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:42.279266 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:42.265029 19408 catalog_manager.cc:5697] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 4, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 4 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:17:42.280124 19655 raft_consensus.cc:2368] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5.
I20260709 13:17:42.281307 19408 catalog_manager.cc:5697] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:17:42.283883 19476 leader_election.cc:400] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5.
I20260709 13:17:42.284235 19476 leader_election.cc:403] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:42.285171 20408 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:17:42.292997 19585 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:42.300521 20550 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.306286 20521 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.310050 20521 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.312791 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:42.312812 20521 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:42.313601 19503 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:42.314905 20408 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5.
I20260709 13:17:42.315183 19625 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:42.318019 20521 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:42.318468 20521 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.318868 20521 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.322635 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:42.323297 19580 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:17:42.350826 20521 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.343159 19408 catalog_manager.cc:5697] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 4, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 4 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:17:42.361250 19408 catalog_manager.cc:5697] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 3, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 3 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.363941 19408 catalog_manager.cc:5697] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:17:42.365532 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:42.368221 19508 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.365681 19408 catalog_manager.cc:5697] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 3, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 3 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.371742 20521 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:42.376047 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:42.378266 19585 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.375553 19408 catalog_manager.cc:5697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 3, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 3 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:17:42.381199 19508 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:42.381865 19408 catalog_manager.cc:5697] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:17:42.383131 19625 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:42.383447 19408 catalog_manager.cc:5697] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:17:42.385097 20302 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:42.387753 20302 raft_consensus.cc:697] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:42.390439 19585 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:42.388545 20302 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.404488 19508 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:42.407815 20424 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:42.431432 19581 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:42.436866 20424 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.469483 20294 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.470062 20294 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.472271 20294 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:42.474608 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:42.474643 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:42.476478 19508 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:42.477602 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:42.478485 20294 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:42.478915 20294 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.479266 20294 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.476816 19410 catalog_manager.cc:5697] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 1 to 4, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 4 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.496753 20294 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.497234 19410 catalog_manager.cc:5697] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 1 to 4, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 4 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.500013 20294 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:42.500701 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:42.501993 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:42.502573 19508 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.508181 19508 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:17:42.509085 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:42.509724 20294 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:42.511264 20294 raft_consensus.cc:697] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:42.514228 20294 consensus_queue.cc:237] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.527051 19408 catalog_manager.cc:5697] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.528875 19408 catalog_manager.cc:5697] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 5, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 5 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:17:42.563758 19410 catalog_manager.cc:5697] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.579079 19409 catalog_manager.cc:5697] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 2 to 4, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 4 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.606478 19585 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.618187 19407 catalog_manager.cc:5697] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.627260 19653 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:42.628763 20519 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.629938 19653 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:42.632117 20408 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.636996 19585 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:42.640794 20408 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.645033 19508 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:42.654608 20184 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:42.655109 20184 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.655838 20294 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.666798 20184 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:42.667965 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:42.668620 19503 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:42.671734 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:42.672549 19653 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:42.674180 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:42.675433 20184 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:42.675773 20184 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:42.676532 20184 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.703477 20184 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.706146 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:42.717079 19508 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:42.718304 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:42.719754 20294 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:42.720340 20294 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:42.720456 20184 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:42.721459 20294 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.725346 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:42.726452 19655 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:42.765098 20294 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.765755 20294 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.785588 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:42.786264 19508 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:42.786538 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:42.787690 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:42.788492 20184 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:42.788844 20184 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.789203 20184 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.790865 20294 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:42.799742 19508 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:42.801965 20302 consensus_queue.cc:1059] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:42.802990 20302 raft_consensus.cc:3055] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:42.803440 20302 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:42.804380 20302 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.805547 20302 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.808459 19407 catalog_manager.cc:5697] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 2 to 3, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 3 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.802951 20184 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.817896 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:42.818497 19508 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.824147 19505 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:42.826004 20424 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:42.831501 19508 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:17:42.832705 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:42.839210 20519 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:42.839788 20519 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:42.840760 20519 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.854812 20184 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:42.855906 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:42.890421 19410 catalog_manager.cc:5697] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 2 to 4, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 4 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.905030 19581 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:42.921693 20424 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.922233 20424 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.924256 20424 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:42.927270 19653 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:17:42.927757 19653 pending_rounds.cc:85] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 2
I20260709 13:17:42.928036 19653 pending_rounds.cc:107] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:17:42.927297 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:42.928936 19512 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:42.930099 20521 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:42.930749 19625 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:42.931855 20424 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:42.932230 20424 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.932636 20424 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.928301 19653 raft_consensus.cc:2889] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:42.937505 20184 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.941220 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:42.966104 20424 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:42.969111 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:42.969723 19508 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.982795 19512 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:42.984881 20598 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.982854 20424 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:42.990986 19508 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:17:42.992516 19625 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:42.993506 20424 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:42.994330 20424 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:42.995306 20424 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:43.036485 19409 catalog_manager.cc:5697] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 3 to 4, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 4 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.058494 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:43.113893 19653 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:43.115602 20184 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:43.116329 20184 consensus_queue.cc:1243] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:17:43.118880 20519 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:43.119279 20519 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:43.121039 20519 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:43.123118 20519 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:43.310002 20424 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:43.311575 20424 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:43.315773 20424 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:43.315734 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:43.316274 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:43.319823 19504 raft_consensus.cc:2368] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4.
I20260709 13:17:43.321770 19625 leader_election.cc:400] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4.
I20260709 13:17:43.322149 19625 leader_election.cc:403] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:43.322487 19505 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:43.323177 20424 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:17:43.324515 20184 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:43.338042 20424 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4.
I20260709 13:17:43.366943 19653 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:43.379597 20294 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:43.420608 19580 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:17:43.421183 19580 pending_rounds.cc:85] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 2
I20260709 13:17:43.421545 19580 pending_rounds.cc:107] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:17:43.423074 19580 raft_consensus.cc:2889] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:43.424844 20424 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:43.443418 19503 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:43.450505 20302 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:43.934028 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:43.968748 20608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:43.973754 20609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:43.994571 18414 server_base.cc:1061] running on GCE node
W20260709 13:17:44.019207 20611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:44.021329 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:44.021667 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:44.021924 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603064021898 us; error 0 us; skew 500 ppm
I20260709 13:17:44.022729 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:44.082607 18414 webserver.cc:533] Webserver started at http://127.17.251.132:36195/ using document root <none> and password file <none>
I20260709 13:17:44.083520 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:44.083881 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:44.084358 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:44.086159 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-3-root/instance:
uuid: "068c03c9dcc848e6bf909131b1f83065"
format_stamp: "Formatted at 2026-07-09 13:17:44 on dist-test-slave-7f95"
I20260709 13:17:44.094816 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:17:44.099040 20617 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:44.100059 18414 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:17:44.100467 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-3-root
uuid: "068c03c9dcc848e6bf909131b1f83065"
format_stamp: "Formatted at 2026-07-09 13:17:44 on dist-test-slave-7f95"
I20260709 13:17:44.100795 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:17:44.350018 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 170927us
W20260709 13:17:44.422477 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 43539.6us
W20260709 13:17:44.853184 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 448156us
W20260709 13:17:44.904973 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 532829us
W20260709 13:17:44.914798 18414 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 0.802s	user 0.124s	sys 0.254s
W20260709 13:17:44.915194 18414 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 0.803s	user 0.124s	sys 0.254s
I20260709 13:17:45.015399 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:45.017477 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:45.031152 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:45.048647 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:45.048977 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:45.049291 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:45.049512 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:45.205467 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.132:40615
I20260709 13:17:45.205595 20690 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.132:40615 every 8 connection(s)
I20260709 13:17:45.218782 18414 auto_leader_rebalancer-test.cc:384] add a tserver: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:17:45.276436 20691 heartbeater.cc:344] Connected to a master server at 127.17.251.190:33289
I20260709 13:17:45.277066 20691 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:45.278218 20691 heartbeater.cc:507] Master 127.17.251.190:33289 requested a full tablet report, sending...
I20260709 13:17:45.281103 19409 ts_manager.cc:194] Registered new tserver with Master: 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:17:45.284570 19409 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33582
W20260709 13:17:45.483379 18419 debug-util.cc:398] Leaking SignalData structure 0x7b080000f3c0 after lost signal to thread 18414
W20260709 13:17:45.919075 19682 debug-util.cc:398] Leaking SignalData structure 0x7b080019a560 after lost signal to thread 18417
W20260709 13:17:45.920257 19682 debug-util.cc:398] Leaking SignalData structure 0x7b08000cb2e0 after lost signal to thread 19444
W20260709 13:17:45.921643 19682 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee040 after lost signal to thread 19536
W20260709 13:17:45.922857 19682 debug-util.cc:398] Leaking SignalData structure 0x7b0800303ea0 after lost signal to thread 19611
W20260709 13:17:45.924046 19682 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4220 after lost signal to thread 19685
I20260709 13:17:46.301529 20691 heartbeater.cc:499] Master 127.17.251.190:33289 was elected leader, sending a full tablet report...
W20260709 13:17:47.004554 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51013us
W20260709 13:17:47.304194 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 69068us
W20260709 13:17:47.316458 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 60521us
W20260709 13:17:47.455222 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 60498.8us
W20260709 13:17:47.757803 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 72562.7us
I20260709 13:17:47.868363 19503 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
W20260709 13:17:48.012544 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.116245 19657 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:48.117715 20632 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:48.175333 19585 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:48.183763 20711 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:17:48.198537 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 66219.4us
I20260709 13:17:48.200750 20712 raft_consensus.cc:2955] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
W20260709 13:17:48.203903 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 72557.4us
I20260709 13:17:48.221045 19653 raft_consensus.cc:2955] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
W20260709 13:17:48.253945 19478 consensus_peers.cc:597] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 -> Peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615): Couldn't send request to peer 068c03c9dcc848e6bf909131b1f83065. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e40c25a076fd424281aab1a64f5a1498. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:48.265249 19409 catalog_manager.cc:5697] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: config changed from index -1 to 3, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New cstate: current_term: 3 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:48.311168 19587 raft_consensus.cc:2955] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:48.313705 19653 consensus_queue.cc:237] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:48.337064 19508 raft_consensus.cc:1275] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:48.338930 20445 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:48.339303 19587 raft_consensus.cc:1275] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:48.341504 20707 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:17:48.665162 20625 raft_consensus.cc:2955] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:48.670315 19512 raft_consensus.cc:2955] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:48.701398 19658 consensus_queue.cc:237] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:48.720911 19585 raft_consensus.cc:2955] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
W20260709 13:17:48.727962 19627 consensus_peers.cc:597] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615): Couldn't send request to peer 068c03c9dcc848e6bf909131b1f83065. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 556595dcbb8644d2a073cbc04a679832. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:48.786849 20734 ts_tablet_manager.cc:933] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645)
I20260709 13:17:48.789585 19585 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:48.806216 19410 catalog_manager.cc:5697] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: config changed from index -1 to 2, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:48.831056 19512 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:48.847996 20707 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:48.856737 20707 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:48.884410 20735 raft_consensus.cc:2955] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
W20260709 13:17:48.889842 19627 consensus_peers.cc:597] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615): Couldn't send request to peer 068c03c9dcc848e6bf909131b1f83065. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a8709264e614e01ad899bfabc6c04f7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:48.889045 19512 raft_consensus.cc:2955] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:48.899649 20734 tablet_copy_client.cc:323] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Beginning tablet copy session from remote peer at address 127.17.251.129:38645
I20260709 13:17:48.927044 19407 catalog_manager.cc:5697] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: config changed from index -1 to 3, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New cstate: current_term: 3 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:48.970088 19581 raft_consensus.cc:2955] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:49.004215 19522 tablet_copy_service.cc:140] P d56df3728fc04e37b2d29a3bcd91d167: Received BeginTabletCopySession request for tablet e40c25a076fd424281aab1a64f5a1498 from peer 068c03c9dcc848e6bf909131b1f83065 ({username='slave'} at 127.0.0.1:60692)
I20260709 13:17:49.005190 19522 tablet_copy_service.cc:161] P d56df3728fc04e37b2d29a3bcd91d167: Beginning new tablet copy session on tablet e40c25a076fd424281aab1a64f5a1498 from peer 068c03c9dcc848e6bf909131b1f83065 at {username='slave'} at 127.0.0.1:60692: session id = 068c03c9dcc848e6bf909131b1f83065-e40c25a076fd424281aab1a64f5a1498
I20260709 13:17:49.028167 20742 ts_tablet_manager.cc:933] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:49.031607 19522 tablet_copy_source_session.cc:215] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:49.037554 20734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e40c25a076fd424281aab1a64f5a1498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:49.043027 20742 tablet_copy_client.cc:323] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Beginning tablet copy session from remote peer at address 127.17.251.131:33295
I20260709 13:17:49.108525 19671 tablet_copy_service.cc:140] P e19c80e9149b4b8d88ae13bde8e43864: Received BeginTabletCopySession request for tablet 556595dcbb8644d2a073cbc04a679832 from peer 068c03c9dcc848e6bf909131b1f83065 ({username='slave'} at 127.0.0.1:59942)
I20260709 13:17:49.109191 19671 tablet_copy_service.cc:161] P e19c80e9149b4b8d88ae13bde8e43864: Beginning new tablet copy session on tablet 556595dcbb8644d2a073cbc04a679832 from peer 068c03c9dcc848e6bf909131b1f83065 at {username='slave'} at 127.0.0.1:59942: session id = 068c03c9dcc848e6bf909131b1f83065-556595dcbb8644d2a073cbc04a679832
I20260709 13:17:49.117826 19671 tablet_copy_source_session.cc:215] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:49.123410 20742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556595dcbb8644d2a073cbc04a679832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:49.126910 19582 consensus_queue.cc:237] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:49.147446 20734 tablet_copy_client.cc:806] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:49.148262 20734 tablet_copy_client.cc:670] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:49.152863 20734 tablet_copy_client.cc:538] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:49.174290 20742 tablet_copy_client.cc:806] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:49.175086 20742 tablet_copy_client.cc:670] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:49.180989 20734 tablet_bootstrap.cc:492] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap starting.
I20260709 13:17:49.187798 19512 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:49.190374 19658 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:49.194510 20598 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:49.195441 20710 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:49.187861 20742 tablet_copy_client.cc:538] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:49.264366 20742 tablet_bootstrap.cc:492] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap starting.
I20260709 13:17:49.303804 20750 ts_tablet_manager.cc:933] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:49.319155 20598 raft_consensus.cc:2955] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:49.323596 19658 raft_consensus.cc:2955] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:49.360777 19407 catalog_manager.cc:5697] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf reported cstate change: config changed from index -1 to 4, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New cstate: current_term: 5 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.410373 20750 tablet_copy_client.cc:323] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Beginning tablet copy session from remote peer at address 127.17.251.131:33295
I20260709 13:17:49.415043 20734 tablet_bootstrap.cc:492] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:49.440824 19671 tablet_copy_service.cc:140] P e19c80e9149b4b8d88ae13bde8e43864: Received BeginTabletCopySession request for tablet 1a8709264e614e01ad899bfabc6c04f7 from peer 068c03c9dcc848e6bf909131b1f83065 ({username='slave'} at 127.0.0.1:59942)
I20260709 13:17:49.441485 19671 tablet_copy_service.cc:161] P e19c80e9149b4b8d88ae13bde8e43864: Beginning new tablet copy session on tablet 1a8709264e614e01ad899bfabc6c04f7 from peer 068c03c9dcc848e6bf909131b1f83065 at {username='slave'} at 127.0.0.1:59942: session id = 068c03c9dcc848e6bf909131b1f83065-1a8709264e614e01ad899bfabc6c04f7
I20260709 13:17:49.435837 20734 tablet_bootstrap.cc:492] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap complete.
I20260709 13:17:49.443871 20734 ts_tablet_manager.cc:1403] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Time spent bootstrapping tablet: real 0.263s	user 0.016s	sys 0.019s
W20260709 13:17:49.462548 19553 consensus_peers.cc:597] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf -> Peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615): Couldn't send request to peer 068c03c9dcc848e6bf909131b1f83065. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 56b49831037b480f8eda4069cf653878. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.477352 20734 raft_consensus.cc:359] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:49.481810 20734 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Initialized, Role: LEARNER
I20260709 13:17:49.479771 19671 tablet_copy_source_session.cc:215] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:49.508275 20750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a8709264e614e01ad899bfabc6c04f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:49.510769 20734 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
W20260709 13:17:49.639492 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 125237us
I20260709 13:17:49.706121 20742 tablet_bootstrap.cc:492] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:49.707168 20742 tablet_bootstrap.cc:492] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap complete.
I20260709 13:17:49.707909 20742 ts_tablet_manager.cc:1403] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065: Time spent bootstrapping tablet: real 0.444s	user 0.036s	sys 0.007s
W20260709 13:17:49.756168 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 115867us
I20260709 13:17:49.758469 19508 raft_consensus.cc:2955] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:49.780923 20734 ts_tablet_manager.cc:1434] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Time spent starting tablet: real 0.337s	user 0.004s	sys 0.018s
I20260709 13:17:49.781972 20742 raft_consensus.cc:359] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:49.774612 20665 raft_consensus.cc:1217] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:17:49.805226 20742 raft_consensus.cc:740] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Initialized, Role: LEARNER
I20260709 13:17:49.806049 20742 consensus_queue.cc:260] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:49.819924 20766 ts_tablet_manager.cc:933] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:49.823057 20750 tablet_copy_client.cc:806] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:49.823884 20750 tablet_copy_client.cc:670] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:49.831488 19522 tablet_copy_service.cc:342] P d56df3728fc04e37b2d29a3bcd91d167: Request end of tablet copy session 068c03c9dcc848e6bf909131b1f83065-e40c25a076fd424281aab1a64f5a1498 received from {username='slave'} at 127.0.0.1:60692
I20260709 13:17:49.832059 19522 tablet_copy_service.cc:434] P d56df3728fc04e37b2d29a3bcd91d167: ending tablet copy session 068c03c9dcc848e6bf909131b1f83065-e40c25a076fd424281aab1a64f5a1498 on tablet e40c25a076fd424281aab1a64f5a1498 with peer 068c03c9dcc848e6bf909131b1f83065
I20260709 13:17:49.882431 20766 tablet_copy_client.cc:323] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Beginning tablet copy session from remote peer at address 127.17.251.130:36471
W20260709 13:17:49.965987 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57636.6us
I20260709 13:17:49.985407 20750 tablet_copy_client.cc:538] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:50.005649 20742 ts_tablet_manager.cc:1434] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065: Time spent starting tablet: real 0.297s	user 0.014s	sys 0.036s
W20260709 13:17:50.041405 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 105449us
W20260709 13:17:50.052582 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 84312.4us
W20260709 13:17:50.059101 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 79496.4us
I20260709 13:17:50.080091 19671 tablet_copy_service.cc:342] P e19c80e9149b4b8d88ae13bde8e43864: Request end of tablet copy session 068c03c9dcc848e6bf909131b1f83065-556595dcbb8644d2a073cbc04a679832 received from {username='slave'} at 127.0.0.1:59942
I20260709 13:17:50.084200 19671 tablet_copy_service.cc:434] P e19c80e9149b4b8d88ae13bde8e43864: ending tablet copy session 068c03c9dcc848e6bf909131b1f83065-556595dcbb8644d2a073cbc04a679832 on tablet 556595dcbb8644d2a073cbc04a679832 with peer 068c03c9dcc848e6bf909131b1f83065
I20260709 13:17:50.087159 20666 raft_consensus.cc:1217] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:50.107792 19597 tablet_copy_service.cc:140] P 2cfd02601ea44976833027665abc93bf: Received BeginTabletCopySession request for tablet 56b49831037b480f8eda4069cf653878 from peer 068c03c9dcc848e6bf909131b1f83065 ({username='slave'} at 127.0.0.1:35102)
I20260709 13:17:50.108397 19597 tablet_copy_service.cc:161] P 2cfd02601ea44976833027665abc93bf: Beginning new tablet copy session on tablet 56b49831037b480f8eda4069cf653878 from peer 068c03c9dcc848e6bf909131b1f83065 at {username='slave'} at 127.0.0.1:35102: session id = 068c03c9dcc848e6bf909131b1f83065-56b49831037b480f8eda4069cf653878
W20260709 13:17:50.126238 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 147267us
I20260709 13:17:50.117478 20750 tablet_bootstrap.cc:492] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap starting.
I20260709 13:17:50.141531 19597 tablet_copy_source_session.cc:215] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:50.169138 20766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b49831037b480f8eda4069cf653878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:50.244004 20757 raft_consensus.cc:1064] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:17:50.244735 20766 tablet_copy_client.cc:806] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:50.245385 20766 tablet_copy_client.cc:670] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:50.247896 20757 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:50.262956 20766 tablet_copy_client.cc:538] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:50.292371 19653 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:50.294031 20757 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:50.298300 20750 tablet_bootstrap.cc:492] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:50.305805 20666 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEARNER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:50.310969 20750 tablet_bootstrap.cc:492] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap complete.
I20260709 13:17:50.311815 20757 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:50.312788 19582 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:50.314311 20750 ts_tablet_manager.cc:1403] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: Time spent bootstrapping tablet: real 0.197s	user 0.015s	sys 0.015s
I20260709 13:17:50.323953 20711 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:50.331357 20750 raft_consensus.cc:359] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:50.344403 20750 raft_consensus.cc:740] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Initialized, Role: LEARNER
I20260709 13:17:50.353670 20750 consensus_queue.cc:260] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:50.352320 20761 raft_consensus.cc:2955] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:50.363404 20750 ts_tablet_manager.cc:1434] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:17:50.366446 19671 tablet_copy_service.cc:342] P e19c80e9149b4b8d88ae13bde8e43864: Request end of tablet copy session 068c03c9dcc848e6bf909131b1f83065-1a8709264e614e01ad899bfabc6c04f7 received from {username='slave'} at 127.0.0.1:59942
I20260709 13:17:50.366904 19671 tablet_copy_service.cc:434] P e19c80e9149b4b8d88ae13bde8e43864: ending tablet copy session 068c03c9dcc848e6bf909131b1f83065-1a8709264e614e01ad899bfabc6c04f7 on tablet 1a8709264e614e01ad899bfabc6c04f7 with peer 068c03c9dcc848e6bf909131b1f83065
I20260709 13:17:50.355214 20666 raft_consensus.cc:2955] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:50.370759 19653 raft_consensus.cc:2955] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:50.392444 19409 catalog_manager.cc:5697] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: config changed from index 3 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:50.410207 19581 raft_consensus.cc:2955] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:50.395665 20766 tablet_bootstrap.cc:492] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap starting.
I20260709 13:17:50.550838 19512 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:50.553539 20766 tablet_bootstrap.cc:492] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:50.584336 20766 tablet_bootstrap.cc:492] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap complete.
I20260709 13:17:50.585129 20766 ts_tablet_manager.cc:1403] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065: Time spent bootstrapping tablet: real 0.190s	user 0.027s	sys 0.009s
I20260709 13:17:50.563483 20779 raft_consensus.cc:1064] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:17:50.593328 20779 consensus_queue.cc:237] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:50.589102 20766 raft_consensus.cc:359] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:50.602571 20766 raft_consensus.cc:740] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Initialized, Role: LEARNER
I20260709 13:17:50.604550 20666 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:50.605020 19581 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:50.605937 20766 consensus_queue.cc:260] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:50.607817 20757 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:50.613539 20757 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:50.614770 20766 ts_tablet_manager.cc:1434] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:17:50.620311 20777 raft_consensus.cc:2955] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:50.644933 19597 tablet_copy_service.cc:342] P 2cfd02601ea44976833027665abc93bf: Request end of tablet copy session 068c03c9dcc848e6bf909131b1f83065-56b49831037b480f8eda4069cf653878 received from {username='slave'} at 127.0.0.1:35102
I20260709 13:17:50.645520 19597 tablet_copy_service.cc:434] P 2cfd02601ea44976833027665abc93bf: ending tablet copy session 068c03c9dcc848e6bf909131b1f83065-56b49831037b480f8eda4069cf653878 on tablet 56b49831037b480f8eda4069cf653878 with peer 068c03c9dcc848e6bf909131b1f83065
I20260709 13:17:50.649020 19511 raft_consensus.cc:1275] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:50.651402 20665 raft_consensus.cc:1275] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 1 LEARNER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:50.653931 19582 raft_consensus.cc:1275] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:50.655925 20719 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:50.657450 20759 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:50.662819 19395 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e40c25a076fd424281aab1a64f5a1498 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:50.624238 19581 raft_consensus.cc:2955] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:50.668957 20665 raft_consensus.cc:2955] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:50.676654 20779 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:50.687739 20663 raft_consensus.cc:1217] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 LEARNER]: Deduplicated request from leader. Original: 5.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 13:17:50.709395 20666 raft_consensus.cc:1217] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:17:50.736362 19407 catalog_manager.cc:5697] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: config changed from index 4 to 5, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New cstate: current_term: 3 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:50.875310 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 108720us
I20260709 13:17:50.941143 19646 tablet_service.cc:1558] Processing DeleteTablet for tablet e40c25a076fd424281aab1a64f5a1498 with delete_type TABLET_DATA_TOMBSTONED (TS e19c80e9149b4b8d88ae13bde8e43864 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:56808
I20260709 13:17:50.960966 20798 raft_consensus.cc:2955] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:50.985234 20805 tablet_replica.cc:333] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:17:50.986586 20805 raft_consensus.cc:2243] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.995929 20665 raft_consensus.cc:2955] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:50.999698 20805 raft_consensus.cc:2272] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.003162 19511 raft_consensus.cc:2955] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:51.015210 19410 catalog_manager.cc:5697] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: config changed from index 2 to 3, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.019341 20805 ts_tablet_manager.cc:1916] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:51.020618 19582 raft_consensus.cc:2955] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:51.036682 19653 consensus_queue.cc:237] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:51.069664 20664 raft_consensus.cc:1275] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 1 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:51.096710 20798 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:51.104818 20805 ts_tablet_manager.cc:1929] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:17:51.107357 20805 log.cc:1199] T e40c25a076fd424281aab1a64f5a1498 P e19c80e9149b4b8d88ae13bde8e43864: Deleting WAL directory at /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-2-root/wals/e40c25a076fd424281aab1a64f5a1498
I20260709 13:17:51.110226 19583 raft_consensus.cc:1275] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:51.111816 19395 catalog_manager.cc:5028] TS e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): tablet e40c25a076fd424281aab1a64f5a1498 (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
I20260709 13:17:51.116330 20798 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:51.121750 20776 raft_consensus.cc:2955] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:51.135907 20665 raft_consensus.cc:2955] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:51.154000 19395 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 556595dcbb8644d2a073cbc04a679832 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:51.162621 19581 raft_consensus.cc:2955] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:51.187350 19408 catalog_manager.cc:5697] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: config changed from index 3 to 4, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.194933 20710 raft_consensus.cc:1064] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:17:51.208771 20710 consensus_queue.cc:237] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 2, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:51.260959 20779 raft_consensus.cc:1064] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:17:51.266005 20779 consensus_queue.cc:237] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:51.293603 20664 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 LEARNER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:51.299141 19653 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:51.302541 19498 tablet_service.cc:1558] Processing DeleteTablet for tablet 556595dcbb8644d2a073cbc04a679832 with delete_type TABLET_DATA_TOMBSTONED (TS d56df3728fc04e37b2d29a3bcd91d167 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50816
I20260709 13:17:51.303143 19511 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:51.319706 20763 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:51.321967 20763 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:51.331516 20710 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:51.405100 20807 tablet_replica.cc:333] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
W20260709 13:17:51.409982 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 72608.9us
I20260709 13:17:51.444849 20664 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEARNER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:51.445554 19511 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:51.455369 20794 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:51.483831 20804 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:51.614612 20807 raft_consensus.cc:2243] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.615612 20807 raft_consensus.cc:2272] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.617169 20811 raft_consensus.cc:2955] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:51.627660 20807 ts_tablet_manager.cc:1916] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:51.641799 19580 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:17:51.703948 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 212006us
W20260709 13:17:51.717917 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 55983.3us
I20260709 13:17:51.744140 20807 ts_tablet_manager.cc:1929] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:51.745285 20807 log.cc:1199] T 556595dcbb8644d2a073cbc04a679832 P d56df3728fc04e37b2d29a3bcd91d167: Deleting WAL directory at /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-0-root/wals/556595dcbb8644d2a073cbc04a679832
W20260709 13:17:51.744695 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 252476us
I20260709 13:17:51.711323 20776 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:17:51.764580 20665 raft_consensus.cc:2955] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:17:51.770464 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 69900.6us
I20260709 13:17:51.770020 19508 raft_consensus.cc:2955] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:51.842700 19408 catalog_manager.cc:5697] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: config changed from index 4 to 5, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:17:51.846293 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 127345us
W20260709 13:17:51.898715 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45130.8us
I20260709 13:17:51.908324 19395 catalog_manager.cc:5028] TS d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): tablet 556595dcbb8644d2a073cbc04a679832 (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
W20260709 13:17:51.946910 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 147428us
W20260709 13:17:51.989820 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 112491us
I20260709 13:17:52.019728 19652 raft_consensus.cc:2955] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:17:52.058815 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 71993.7us
W20260709 13:17:52.062310 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 61264.7us
I20260709 13:17:52.096259 20804 raft_consensus.cc:2955] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:17:52.107724 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 105061us
I20260709 13:17:52.140307 20665 raft_consensus.cc:2955] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:52.148474 19582 raft_consensus.cc:2955] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:17:52.199685 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51809.5us
I20260709 13:17:52.277158 19511 raft_consensus.cc:2955] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:17:52.286051 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51816.7us
W20260709 13:17:52.301771 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 55381.1us
I20260709 13:17:52.327286 19407 catalog_manager.cc:5697] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 3 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:52.361989 19652 consensus_queue.cc:237] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:52.374323 19578 consensus_queue.cc:237] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:17:52.379534 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 45990.1us
W20260709 13:17:52.379439 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 55390.1us
W20260709 13:17:52.414628 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 46846us
I20260709 13:17:52.415457 20665 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:52.415587 19652 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:52.421469 20665 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:52.425966 20813 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:52.425974 20798 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:17:52.428404 19511 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:52.432785 20825 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:52.438103 20813 raft_consensus.cc:2955] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:52.440881 19655 raft_consensus.cc:2955] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:52.444635 20825 raft_consensus.cc:2955] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:52.453096 20665 raft_consensus.cc:2955] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:52.456300 19511 raft_consensus.cc:2955] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:52.478193 19410 catalog_manager.cc:5697] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 4 to 5, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New cstate: current_term: 3 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:52.473847 19409 catalog_manager.cc:5697] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: config changed from index 5 to 6, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New cstate: current_term: 5 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:52.487665 19397 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 56b49831037b480f8eda4069cf653878 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:52.496181 19395 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1a8709264e614e01ad899bfabc6c04f7 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:52.511672 19498 tablet_service.cc:1558] Processing DeleteTablet for tablet 56b49831037b480f8eda4069cf653878 with delete_type TABLET_DATA_TOMBSTONED (TS d56df3728fc04e37b2d29a3bcd91d167 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:50816
I20260709 13:17:52.512346 19571 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a8709264e614e01ad899bfabc6c04f7 with delete_type TABLET_DATA_TOMBSTONED (TS 2cfd02601ea44976833027665abc93bf not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60798
I20260709 13:17:52.546814 20710 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:17:52.582654 20840 tablet_replica.cc:333] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:17:52.583920 20840 raft_consensus.cc:2243] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:52.584795 20840 raft_consensus.cc:2272] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:52.605638 20665 raft_consensus.cc:2955] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:52.629745 20839 tablet_replica.cc:333] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:17:52.630822 20839 raft_consensus.cc:2243] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:52.631968 20839 raft_consensus.cc:2272] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:52.640910 20840 ts_tablet_manager.cc:1916] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:52.649678 20839 ts_tablet_manager.cc:1916] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:52.673776 20840 ts_tablet_manager.cc:1929] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:17:52.678208 20840 log.cc:1199] T 1a8709264e614e01ad899bfabc6c04f7 P 2cfd02601ea44976833027665abc93bf: Deleting WAL directory at /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-1-root/wals/1a8709264e614e01ad899bfabc6c04f7
I20260709 13:17:52.680164 20839 ts_tablet_manager.cc:1929] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260709 13:17:52.680702 20839 log.cc:1199] T 56b49831037b480f8eda4069cf653878 P d56df3728fc04e37b2d29a3bcd91d167: Deleting WAL directory at /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-0-root/wals/56b49831037b480f8eda4069cf653878
I20260709 13:17:52.682363 19395 catalog_manager.cc:5028] TS d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): tablet 56b49831037b480f8eda4069cf653878 (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
I20260709 13:17:52.683518 19397 catalog_manager.cc:5028] TS 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): tablet 1a8709264e614e01ad899bfabc6c04f7 (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
I20260709 13:17:53.728865 19504 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
W20260709 13:17:53.798995 19478 consensus_peers.cc:597] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 -> Peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615): Couldn't send request to peer 068c03c9dcc848e6bf909131b1f83065. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 911988cab3914bb19f77d4d3e24a31f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.799886 19585 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:53.802559 20802 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:53.808061 19652 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:53.809962 20802 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:53.834118 20803 raft_consensus.cc:2955] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:53.849114 19652 raft_consensus.cc:2955] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:53.864470 19655 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:53.842126 19585 raft_consensus.cc:2955] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:53.884392 19409 catalog_manager.cc:5697] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: config changed from index -1 to 4, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New cstate: current_term: 4 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:53.897466 19627 consensus_peers.cc:597] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615): Couldn't send request to peer 068c03c9dcc848e6bf909131b1f83065. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6eb38e2ac9064d3286fe2f20aeb2381c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.906702 19578 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:53.909219 20845 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:53.922721 19512 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:53.926946 20823 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:53.948973 19585 raft_consensus.cc:2955] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:53.945091 20823 raft_consensus.cc:2955] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:53.997767 19410 catalog_manager.cc:5697] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: config changed from index -1 to 2, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New cstate: current_term: 1 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:54.010074 19511 raft_consensus.cc:2955] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:53.999660 19504 consensus_queue.cc:237] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
W20260709 13:17:54.078843 19478 consensus_peers.cc:597] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 -> Peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615): Couldn't send request to peer 068c03c9dcc848e6bf909131b1f83065. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d05498e224814b9b8f31e3f965ab2583. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:54.079612 19652 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:54.081462 19578 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:54.081645 20802 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:54.084901 20803 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:54.097568 20803 raft_consensus.cc:2955] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:54.102857 19578 raft_consensus.cc:2955] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:54.114640 19655 raft_consensus.cc:2955] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:54.139756 19585 consensus_queue.cc:237] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:54.142354 19410 catalog_manager.cc:5697] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: config changed from index -1 to 3, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New cstate: current_term: 3 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
W20260709 13:17:54.209082 19553 consensus_peers.cc:597] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf -> Peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615): Couldn't send request to peer 068c03c9dcc848e6bf909131b1f83065. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 46d39387ed0c44978cdb2b736f9c1ccf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:54.212081 19511 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:54.213719 20846 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:54.214592 19652 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:54.216090 20846 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:54.238443 20842 raft_consensus.cc:2955] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:54.244829 19504 raft_consensus.cc:2955] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:54.257670 19655 raft_consensus.cc:2955] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:54.305320 19410 catalog_manager.cc:5697] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: config changed from index -1 to 2, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New cstate: current_term: 1 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:17:54.344724 20864 ts_tablet_manager.cc:933] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645)
W20260709 13:17:54.343617 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 73174.3us
I20260709 13:17:54.371666 20864 tablet_copy_client.cc:323] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Beginning tablet copy session from remote peer at address 127.17.251.129:38645
I20260709 13:17:54.375308 19522 tablet_copy_service.cc:140] P d56df3728fc04e37b2d29a3bcd91d167: Received BeginTabletCopySession request for tablet 911988cab3914bb19f77d4d3e24a31f4 from peer 068c03c9dcc848e6bf909131b1f83065 ({username='slave'} at 127.0.0.1:60692)
I20260709 13:17:54.375998 19522 tablet_copy_service.cc:161] P d56df3728fc04e37b2d29a3bcd91d167: Beginning new tablet copy session on tablet 911988cab3914bb19f77d4d3e24a31f4 from peer 068c03c9dcc848e6bf909131b1f83065 at {username='slave'} at 127.0.0.1:60692: session id = 068c03c9dcc848e6bf909131b1f83065-911988cab3914bb19f77d4d3e24a31f4
I20260709 13:17:54.386544 19522 tablet_copy_source_session.cc:215] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:54.390575 20864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911988cab3914bb19f77d4d3e24a31f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.417734 20864 tablet_copy_client.cc:806] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:54.418514 20864 tablet_copy_client.cc:670] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:54.423197 20864 tablet_copy_client.cc:538] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:54.448096 20864 tablet_bootstrap.cc:492] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap starting.
I20260709 13:17:54.553041 20864 tablet_bootstrap.cc:492] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:54.573400 20864 tablet_bootstrap.cc:492] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap complete.
I20260709 13:17:54.577607 20864 ts_tablet_manager.cc:1403] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: Time spent bootstrapping tablet: real 0.130s	user 0.026s	sys 0.007s
I20260709 13:17:54.591637 20869 ts_tablet_manager.cc:933] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:54.595993 20867 ts_tablet_manager.cc:933] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645)
I20260709 13:17:54.594084 20864 raft_consensus.cc:359] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:54.598783 20864 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Initialized, Role: LEARNER
I20260709 13:17:54.599694 20864 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:54.613933 20869 tablet_copy_client.cc:323] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Beginning tablet copy session from remote peer at address 127.17.251.131:33295
I20260709 13:17:54.623359 19671 tablet_copy_service.cc:140] P e19c80e9149b4b8d88ae13bde8e43864: Received BeginTabletCopySession request for tablet 6eb38e2ac9064d3286fe2f20aeb2381c from peer 068c03c9dcc848e6bf909131b1f83065 ({username='slave'} at 127.0.0.1:59942)
I20260709 13:17:54.623991 19671 tablet_copy_service.cc:161] P e19c80e9149b4b8d88ae13bde8e43864: Beginning new tablet copy session on tablet 6eb38e2ac9064d3286fe2f20aeb2381c from peer 068c03c9dcc848e6bf909131b1f83065 at {username='slave'} at 127.0.0.1:59942: session id = 068c03c9dcc848e6bf909131b1f83065-6eb38e2ac9064d3286fe2f20aeb2381c
I20260709 13:17:54.636438 19671 tablet_copy_source_session.cc:215] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:54.618492 20864 ts_tablet_manager.cc:1434] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.001s
I20260709 13:17:54.646385 20867 tablet_copy_client.cc:323] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Beginning tablet copy session from remote peer at address 127.17.251.129:38645
I20260709 13:17:54.646523 19522 tablet_copy_service.cc:342] P d56df3728fc04e37b2d29a3bcd91d167: Request end of tablet copy session 068c03c9dcc848e6bf909131b1f83065-911988cab3914bb19f77d4d3e24a31f4 received from {username='slave'} at 127.0.0.1:60692
I20260709 13:17:54.647396 19522 tablet_copy_service.cc:434] P d56df3728fc04e37b2d29a3bcd91d167: ending tablet copy session 068c03c9dcc848e6bf909131b1f83065-911988cab3914bb19f77d4d3e24a31f4 on tablet 911988cab3914bb19f77d4d3e24a31f4 with peer 068c03c9dcc848e6bf909131b1f83065
I20260709 13:17:54.647516 20869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb38e2ac9064d3286fe2f20aeb2381c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.648794 19521 tablet_copy_service.cc:140] P d56df3728fc04e37b2d29a3bcd91d167: Received BeginTabletCopySession request for tablet d05498e224814b9b8f31e3f965ab2583 from peer 068c03c9dcc848e6bf909131b1f83065 ({username='slave'} at 127.0.0.1:60692)
I20260709 13:17:54.649528 19521 tablet_copy_service.cc:161] P d56df3728fc04e37b2d29a3bcd91d167: Beginning new tablet copy session on tablet d05498e224814b9b8f31e3f965ab2583 from peer 068c03c9dcc848e6bf909131b1f83065 at {username='slave'} at 127.0.0.1:60692: session id = 068c03c9dcc848e6bf909131b1f83065-d05498e224814b9b8f31e3f965ab2583
I20260709 13:17:54.703660 20869 tablet_copy_client.cc:806] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:54.704484 20869 tablet_copy_client.cc:670] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:54.713064 20869 tablet_copy_client.cc:538] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:54.715371 20864 ts_tablet_manager.cc:933] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:54.717868 19521 tablet_copy_source_session.cc:215] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:54.747680 20867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05498e224814b9b8f31e3f965ab2583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.752487 20869 tablet_bootstrap.cc:492] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: Bootstrap starting.
I20260709 13:17:54.778043 20864 tablet_copy_client.cc:323] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Beginning tablet copy session from remote peer at address 127.17.251.130:36471
I20260709 13:17:54.780380 19597 tablet_copy_service.cc:140] P 2cfd02601ea44976833027665abc93bf: Received BeginTabletCopySession request for tablet 46d39387ed0c44978cdb2b736f9c1ccf from peer 068c03c9dcc848e6bf909131b1f83065 ({username='slave'} at 127.0.0.1:35102)
I20260709 13:17:54.780948 19597 tablet_copy_service.cc:161] P 2cfd02601ea44976833027665abc93bf: Beginning new tablet copy session on tablet 46d39387ed0c44978cdb2b736f9c1ccf from peer 068c03c9dcc848e6bf909131b1f83065 at {username='slave'} at 127.0.0.1:35102: session id = 068c03c9dcc848e6bf909131b1f83065-46d39387ed0c44978cdb2b736f9c1ccf
I20260709 13:17:54.803850 19597 tablet_copy_source_session.cc:215] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:54.809450 20864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d39387ed0c44978cdb2b736f9c1ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.912287 20875 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:55.913262 20875 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:55.920511 20875 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:17:55.923900 20875 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:55.924870 20875 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:55.927714 20875 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:55.931334 20876 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:55.932143 20876 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:55.933997 20879 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:55.935236 20876 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:55.934689 20879 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:55.938614 20879 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:55.969172 20879 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:55.969081 20878 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:55.969898 20879 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:55.970000 20878 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:55.972070 20879 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:55.972182 20878 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:55.976652 20880 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:55.977247 20880 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:55.980015 20880 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:55.982017 20881 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:55.982751 20881 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:55.986189 20881 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:55.988107 20882 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:55.988737 20882 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:55.991211 20878 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:55.991220 20882 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:55.992482 20879 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:55.991820 20878 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:55.994190 20879 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:55.995760 20878 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:55.996150 20879 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.017176 20832 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.017933 20832 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.018714 20878 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.019295 20878 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:56.020190 20832 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.021468 20878 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:17:56.022650 20812 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.023172 20883 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.023329 20812 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.023844 20883 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:56.026839 20883 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.027451 20883 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.027983 20878 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.028477 20878 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.028838 20884 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.029398 20884 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.029816 20879 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.030340 20879 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.030696 20878 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.031574 20884 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.032430 20879 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.059324 20887 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.060479 20887 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.034121 20812 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.038666 20877 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.072427 20877 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.073884 20887 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.075078 20877 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.075713 20877 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.076623 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.077037 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.040915 20846 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.077591 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.027966 20883 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.078054 20846 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.080667 20846 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.044931 20880 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.081951 20880 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.062965 20889 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:56.061952 20878 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:56.083797 20878 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.084470 20883 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.085017 20880 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.053826 20875 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:56.085877 20878 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.085860 20875 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.086735 20889 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.088829 20875 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:56.066193 19441 debug-util.cc:398] Leaking SignalData structure 0x7b080004dfa0 after lost signal to thread 18417
I20260709 13:17:56.068718 20797 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.090067 20797 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.090721 20889 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.091179 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.092303 20797 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.069928 20881 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.093914 20881 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.095108 19508 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:56.096304 20881 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.096382 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.096988 20881 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.070448 20882 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.093250 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.071205 20802 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.071429 20884 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.098919 20884 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.100411 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.100800 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.101275 20884 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.097930 20882 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.102921 20878 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:56.103433 20882 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.104411 20887 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.066962 20869 tablet_bootstrap.cc:492] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:56.104990 20887 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.105880 20869 tablet_bootstrap.cc:492] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: Bootstrap complete.
I20260709 13:17:56.106752 20869 ts_tablet_manager.cc:1403] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: Time spent bootstrapping tablet: real 1.355s	user 0.023s	sys 0.021s
I20260709 13:17:56.098872 20802 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.107694 20881 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:56.109232 20888 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.146241 20888 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.109519 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.109983 20887 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.110412 20882 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.103461 20878 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.151613 20882 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.153136 20878 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.154268 20882 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.112459 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:56.155714 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.156359 19661 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:56.157344 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.157563 20865 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:56.158087 20865 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.095268 20891 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.158499 20865 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.159226 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.158836 20891 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:56.160750 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.162163 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.163115 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.163594 19585 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:56.164306 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.169817 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.076412 20877 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:56.171566 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.172257 19508 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:17:56.172411 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.172840 20877 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.175266 20887 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.175947 20887 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.177961 20863 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.178512 20863 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.180675 20863 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.181167 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.181872 19510 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:56.184170 20891 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.184779 20891 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:56.185488 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.185484 20896 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.115180 20881 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.119717 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.119927 20889 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.120177 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:17:56.120877 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.119787 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.121698 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.350984 20889 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.351533 19584 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:56.352753 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.121876 20763 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.353313 20889 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.353936 20763 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.350324 20896 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:56.356662 20763 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.123960 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.353427 19581 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:56.126113 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.126952 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.127827 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.360164 19586 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:56.360324 19578 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:56.133509 20886 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.361495 20886 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.364001 20886 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.133775 20875 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.364660 20875 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.366446 19579 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:56.366840 20875 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.135100 20832 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.138450 20846 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:56.140046 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.142478 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.367873 20846 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.367741 20832 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.370177 20846 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.146922 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.109406 20802 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.148947 20864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59444 (request call id 16) took 1434 ms. Trace:
I20260709 13:17:56.148865 20869 raft_consensus.cc:359] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:56.371701 20869 raft_consensus.cc:740] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Initialized, Role: LEARNER
I20260709 13:17:56.371609 20864 rpcz_store.cc:276] 0709 13:17:54.714562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.714755 (+   193us) service_pool.cc:224] Handling call
0709 13:17:54.715769 (+  1014us) ts_tablet_manager.cc:934] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
0709 13:17:54.808156 (+ 92387us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:17:56.122636 (+1314480us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:56.122779 (+   143us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:17:56.148102 (+ 25323us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:17:56.148445 (+   343us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:56.148758 (+   313us) ts_tablet_manager.cc:989] Replica registered.
0709 13:17:56.148860 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":225,"tablet-copy.queue_time_us":110,"thread_start_us":61407,"threads_started":1}
I20260709 13:17:56.372527 20869 consensus_queue.cc:260] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:56.373245 20864 tablet_copy_client.cc:806] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:56.373823 20864 tablet_copy_client.cc:670] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:56.186918 20887 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.185308 20891 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:56.376350 20664 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:56.377360 20869 ts_tablet_manager.cc:1434] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: Time spent starting tablet: real 0.270s	user 0.008s	sys 0.000s
I20260709 13:17:56.188304 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:17:56.379195 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 190961us
I20260709 13:17:56.380374 19551 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:56.381145 20875 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:56.381592 20875 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.382109 20875 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:56.382386 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.383617 20887 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:56.384037 20887 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.384370 20887 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.389348 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.390396 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.391866 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.393464 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.394236 19505 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:56.395376 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.396107 19505 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:17:56.190085 20880 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.181202 20863 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.401176 20863 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.401538 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:17:56.402292 19580 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:56.403419 20863 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.192462 20882 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.199198 20888 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.253008 20812 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.404479 20812 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.404779 20882 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.406637 20812 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.406888 20882 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.407266 19508 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:56.407609 19509 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
W20260709 13:17:56.258986 20867 consensus_meta.cc:287] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 1.459s	user 0.011s	sys 0.012s
I20260709 13:17:56.397161 20880 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:56.409166 20867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59430 (request call id 21) took 1850 ms. Trace:
I20260709 13:17:56.270216 20878 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.409914 20878 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.411971 20878 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.272392 20803 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.412798 20803 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.412446 20867 rpcz_store.cc:276] 0709 13:17:54.558728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.559009 (+   281us) service_pool.cc:224] Handling call
0709 13:17:54.596346 (+ 37337us) ts_tablet_manager.cc:934] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645)
0709 13:17:54.734696 (+138350us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:17:54.799011 (+ 64315us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:54.799130 (+   119us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:17:56.408368 (+1609238us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:17:56.408708 (+   340us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:56.409034 (+   326us) ts_tablet_manager.cc:989] Replica registered.
0709 13:17:56.409104 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":274,"tablet-copy.queue_time_us":36208,"thread_start_us":76520,"threads_started":2}
I20260709 13:17:56.415028 20803 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.415151 20825 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:56.415763 20825 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.418080 20825 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.423441 20889 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:56.424209 20889 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.427055 20898 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.427307 20889 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.427474 20878 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.427722 20898 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.428073 20878 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.429028 20888 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.429581 20888 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.431679 20888 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.282135 20877 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.337138 20885 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.432533 20878 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.432888 20885 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.435585 20885 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.433292 20896 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.370478 20832 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.436278 19510 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:17:56.436893 20877 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.437491 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.437664 20875 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.439087 20877 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.439790 20875 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.447227 20891 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.447681 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.448091 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.448516 20888 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:56.448729 19509 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:56.449065 20888 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.450212 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.450596 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.451017 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.451215 19506 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:56.451408 20888 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.144971 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.452064 19512 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:17:56.452381 20879 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.452664 20867 tablet_copy_client.cc:806] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:56.453327 20867 tablet_copy_client.cc:670] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:56.451344 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.454027 19508 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:56.451627 19505 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:56.187896 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.455777 20797 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.456593 20797 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.457360 20880 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:17:56.452925 20879 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.458077 20890 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:56.458813 20890 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.459501 20879 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.461232 20890 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.463750 20797 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.405215 20665 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:56.466853 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.463413 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:56.501202 19505 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:56.467737 20832 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.501910 20832 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.504172 20832 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.467830 19553 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:56.506996 20899 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:56.507416 20899 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:56.507745 20899 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:56.508855 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.509346 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.510571 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.511785 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.512588 19476 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:56.513473 20803 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:56.513947 20803 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.469129 20880 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.476202 20887 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:56.514396 20803 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.514721 20880 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.516086 20887 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.458112 20898 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:17:56.481062 19441 debug-util.cc:398] Leaking SignalData structure 0x7b0800220420 after lost signal to thread 19444
I20260709 13:17:56.517342 19585 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:56.482571 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:56.517838 19441 debug-util.cc:398] Leaking SignalData structure 0x7b0800064860 after lost signal to thread 19536
W20260709 13:17:56.518886 19441 debug-util.cc:398] Leaking SignalData structure 0x7b080004d5a0 after lost signal to thread 19611
W20260709 13:17:56.519929 19441 debug-util.cc:398] Leaking SignalData structure 0x7b08002531a0 after lost signal to thread 19685
W20260709 13:17:56.520985 19441 debug-util.cc:398] Leaking SignalData structure 0x7b0800249220 after lost signal to thread 20690
W20260709 13:17:56.521685 19441 debug-util.cc:398] Leaking SignalData structure 0x7b0800249280 after lost signal to thread 20842
I20260709 13:17:56.523164 20803 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:56.524230 19505 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:17:56.490783 20864 tablet_copy_client.cc:538] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:56.491102 20897 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.536320 20897 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.537180 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.537957 19652 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:56.538683 20897 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.539440 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.540882 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.541199 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.495534 20845 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.542069 20845 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.544598 20845 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.496471 20879 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.545470 20879 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:56.548002 20879 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:17:56.496865 20876 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.548866 20876 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.551265 20876 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.487455 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:56.552392 20897 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:56.552814 20897 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.553220 20897 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.525355 20803 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.557467 20664 raft_consensus.cc:1217] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:56.558221 20899 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:56.528100 19553 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:17:56.528141 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:17:56.587715 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 59717.3us
I20260709 13:17:56.589243 20832 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.589954 20898 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:56.589848 20832 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.590437 20898 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.590876 20898 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.592329 20832 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.583841 20879 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.594087 20894 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.594132 20879 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.594897 20894 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.184208 20865 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.599287 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:17:56.599741 19587 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:56.600791 20865 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.115021 20892 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.601667 20892 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.602695 19586 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:56.603571 19582 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:56.603892 19587 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:56.530679 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.605453 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.531106 20880 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.491698 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.496048 20825 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.607825 20825 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:56.564492 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 77121us
I20260709 13:17:56.609956 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.610695 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:56.610725 19511 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 3.
I20260709 13:17:56.611953 20887 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:56.612349 20887 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.612711 20887 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:56.526806 19507 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:56.618180 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:56.618374 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 488055us
I20260709 13:17:56.574030 20803 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.578156 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.579452 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.580586 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.581326 20845 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.581676 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.621415 20894 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.582528 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.622347 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:56.622854 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.623274 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.621331 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.623931 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.624243 19652 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:56.624511 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.625031 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.625188 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.625643 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.625793 20845 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.626322 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.626724 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.627367 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.627758 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.583066 20890 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:56.582948 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.583251 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.628415 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:56.583912 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.628710 19653 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:56.629191 19656 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:17:56.581326 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.603886 20892 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.582664 20888 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:56.609958 20825 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.621984 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.610077 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.623378 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.588214 20899 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:17:56.596592 20879 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.627897 20845 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.530006 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 958) took 1717 ms. Trace:
I20260709 13:17:56.581840 20876 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.494096 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.635910 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.629467 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.629519 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.620790 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:56.662163 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:56.657044 19476 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:56.568220 20897 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.662452 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.664842 19585 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:56.666656 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.570257 20864 tablet_bootstrap.cc:492] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065: Bootstrap starting.
I20260709 13:17:56.684195 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.667627 20876 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.669492 20894 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:56.686378 20894 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.686797 20894 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:56.670774 19507 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:56.670971 20892 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:56.661652 19671 tablet_copy_service.cc:342] P e19c80e9149b4b8d88ae13bde8e43864: Request end of tablet copy session 068c03c9dcc848e6bf909131b1f83065-6eb38e2ac9064d3286fe2f20aeb2381c received from {username='slave'} at 127.0.0.1:59942
I20260709 13:17:56.687965 20892 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.688110 19671 tablet_copy_service.cc:434] P e19c80e9149b4b8d88ae13bde8e43864: ending tablet copy session 068c03c9dcc848e6bf909131b1f83065-6eb38e2ac9064d3286fe2f20aeb2381c on tablet 6eb38e2ac9064d3286fe2f20aeb2381c with peer 068c03c9dcc848e6bf909131b1f83065
I20260709 13:17:56.688426 20892 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.661834 20803 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.671828 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.673274 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.690696 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.667348 20888 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.673115 20865 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:56.691743 20865 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.692165 20865 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:56.659142 19504 rpcz_store.cc:276] 0709 13:17:54.812194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.830963 (+ 18769us) service_pool.cc:224] Handling call
0709 13:17:56.478855 (+1647892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.528987 (+ 50132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.529020 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:56.529065 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:56.529098 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.529739 (+   641us) spinlock_profiling.cc:243] Waited 49.9 ms on lock 0x7b540003eb54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:17:56.529785 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.529921 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114817280}
I20260709 13:17:56.693921 20876 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.674964 20887 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.675334 19578 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:56.675657 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:56.696164 20895 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:56.696282 20619 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:56.628458 20890 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:56.667958 19654 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:17:56.698882 20891 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:56.699402 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.699936 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.700667 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.700863 19661 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:56.701109 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.701683 20867 tablet_copy_client.cc:538] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:56.701889 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.676420 20897 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.691298 20803 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.696655 20895 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.702975 20895 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:56.678094 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.699775 20865 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.674610 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.702044 20888 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.709931 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.712852 20895 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:56.630160 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:56.679515 20898 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:56.695756 20894 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.707228 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.707744 20884 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.708277 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.684616 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:56.696313 20887 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.750766 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.750990 20897 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:56.751438 20897 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.751832 20897 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:56.753921 20867 tablet_bootstrap.cc:492] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap starting.
I20260709 13:17:56.729543 19476 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:56.734933 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.735623 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.737738 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.738379 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.756187 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.739419 20898 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:17:56.739794 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.740782 19579 raft_consensus.cc:2393] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 2: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:17:56.750458 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 65936.8us
I20260709 13:17:56.761837 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:56.750310 20892 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.757151 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.741745 20865 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.777422 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.758100 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.758774 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.759855 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.803994 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:56.768736 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.804481 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.799592 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:17:56.788404 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 58914.9us
I20260709 13:17:56.812492 20887 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:56.810113 20863 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:56.814119 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.836226 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.831853 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.825822 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.820248 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.831434 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.810465 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:56.826076 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.769943 20890 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:56.772889 20894 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.850286 19583 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:56.808023 20803 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:17:56.851967 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 89869.6us
I20260709 13:17:56.830140 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:17:56.853999 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 88826.2us
I20260709 13:17:56.775261 20665 raft_consensus.cc:1217] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:17:56.768380 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:17:56.849503 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:56.771348 20895 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.855326 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.775786 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:17:56.751437 20884 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.871093 20884 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.873209 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.846498 20863 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.766842 20879 consensus_queue.cc:1059] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:17:56.868417 19625 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:56.856411 20803 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:56.846688 20887 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.853752 20898 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:56.764430 20876 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:17:56.835923 20897 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.874773 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.862808 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:56.869252 20865 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:56.880827 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.883025 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.884356 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:56.886019 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.888324 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.762426 20900 consensus_queue.cc:1059] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.116s
I20260709 13:17:56.894745 20897 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.911550 20631 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:56.907228 20876 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:56.990585 20891 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.990813 20890 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:56.991585 20900 raft_consensus.cc:3055] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:56.991948 20900 raft_consensus.cc:740] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:56.911670 20901 raft_consensus.cc:3055] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:56.993436 20901 raft_consensus.cc:740] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:56.907842 19580 raft_consensus.cc:1240] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:56.895841 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:56.976249 20892 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:56.994386 20901 consensus_queue.cc:260] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:56.995191 20892 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:56.995587 20892 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.995994 20892 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:56.996235 20865 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:56.996680 20865 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:56.990983 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 106725us
W20260709 13:17:56.999085 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.908641 20888 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 13:17:56.906867 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:56.886826 20887 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:56.907225 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.899196 20898 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:57.003491 20898 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.896634 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:56.992882 20900 consensus_queue.cc:260] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:56.890892 20797 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.006794 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:57.007233 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.889969 20803 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.008376 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:57.009091 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.009689 19507 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:57.010602 20900 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.012677 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:57.013481 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:57.013988 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:57.014775 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:56.998111 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 86686.5us
I20260709 13:17:57.018751 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:57.019145 20891 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.019963 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:57.021672 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.878420 20863 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.022137 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:57.008083 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:56.990664 20876 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.026136 20876 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.027303 20876 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:57.030354 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:17:56.990911 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 128173us
I20260709 13:17:57.032584 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:57.033480 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:57.033809 20877 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:57.034348 20877 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:17:57.034832 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 125028us
I20260709 13:17:57.034495 20892 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.035382 20877 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.036803 20892 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.042433 19625 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.038446 19478 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.048199 19507 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 4.
I20260709 13:17:56.995769 20901 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.048281 19625 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.049163 19506 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:57.053725 19625 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:17:57.055255 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 196094us
I20260709 13:17:57.055578 19478 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.049685 20797 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.059453 20879 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.064211 20890 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.067166 20812 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:57.067909 20812 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.067996 19478 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.068753 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.070176 20885 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:57.070577 20885 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:57.070925 20885 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.069401 19478 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.069592 20891 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:57.076078 20891 raft_consensus.cc:697] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 4 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:17:57.077996 20832 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:57.069152 19625 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.081281 19478 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.082525 20803 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.088528 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.088754 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.089952 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:57.091511 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:57.091822 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:57.092669 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.093091 19506 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:57.093859 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.097318 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:57.100032 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.137880 19478 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.031455 20887 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.054996 20892 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:57.140496 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.154330 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:57.097452 20825 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:57.142503 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.077014 20891 consensus_queue.cc:237] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:57.147087 20887 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.147296 19478 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.148854 20882 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:57.151130 20898 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.171706 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.157189 19625 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.107406 20812 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:57.141368 20803 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.152127 20903 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:57.153877 20892 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:57.179139 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.164150 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.181519 19507 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:57.182106 20803 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:57.184794 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.190582 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.191111 20803 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:57.173733 20812 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:57.201135 20812 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:57.173679 20907 log.cc:927] Time spent T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:17:57.191709 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.191767 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.207839 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.192425 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.171334 20882 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:57.187361 19407 catalog_manager.cc:5697] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 5 to 6, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 6 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:57.195405 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.201135 20803 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.173822 20797 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:57.155414 20885 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.203889 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.207805 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.175832 20894 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:57.202802 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.209687 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.167698 20823 consensus_queue.cc:1059] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:17:57.223582 20823 raft_consensus.cc:3055] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:57.223954 20823 raft_consensus.cc:740] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.174911 20903 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:57.224680 20903 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.210688 20882 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.181102 20892 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.221540 20803 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.248811 20803 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.222637 20894 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:57.249533 20894 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:57.253919 20823 consensus_queue.cc:260] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.255570 20823 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.233162 20885 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.239729 20898 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.240494 20863 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.242971 20865 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.257115 20894 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:57.265027 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 89034.5us
W20260709 13:17:57.271312 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 106488us
W20260709 13:17:57.279202 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 107565us
I20260709 13:17:57.281769 19625 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.281832 19478 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.284318 19654 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:57.284883 20894 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.286276 20812 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.288836 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.289705 20910 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.291054 20812 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.291497 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.292438 20910 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.292526 19625 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.283140 19478 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.293591 20908 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:57.294682 20863 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.298691 20879 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.299002 20890 consensus_queue.cc:1059] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:57.299782 20879 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:57.300021 20823 raft_consensus.cc:3055] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:57.300155 20879 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.300415 20823 raft_consensus.cc:740] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.297449 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.301189 20823 consensus_queue.cc:260] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:57.301045 20879 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.302927 20864 tablet_bootstrap.cc:492] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:57.303336 20879 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.303931 20864 tablet_bootstrap.cc:492] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065: Bootstrap complete.
I20260709 13:17:57.294742 19625 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.282966 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.307773 20664 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 4 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:57.308336 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:57.309303 20877 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:57.309799 20877 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:57.310173 20877 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.310191 19583 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:57.309392 19587 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:57.311655 19625 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.313055 19653 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:57.316565 19578 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:57.313356 19625 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.310786 20890 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:57.302946 20823 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.315249 20902 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:57.315104 20665 raft_consensus.cc:1240] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:57.306128 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.326553 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.320340 19478 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.322774 19625 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.322003 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:17:57.339227 19478 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.340539 20803 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:57.340880 20803 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:57.319654 20864 ts_tablet_manager.cc:1403] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065: Time spent bootstrapping tablet: real 0.750s	user 0.024s	sys 0.019s
I20260709 13:17:57.341243 20803 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:57.340991 19625 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.320564 20812 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.323210 20900 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:57.324077 19579 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:57.341702 20885 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.329114 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.342864 20845 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:17:57.366657 20845 consensus_queue.cc:1243] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer 068c03c9dcc848e6bf909131b1f83065 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:57.367200 20845 raft_consensus.cc:3055] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:57.367527 20845 raft_consensus.cc:740] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.368289 20845 consensus_queue.cc:260] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:57.342692 20901 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.345959 20876 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.331763 20898 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.370863 19625 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.349287 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.351008 20865 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.350718 19410 catalog_manager.cc:5697] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 3 to 4, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 4 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.371392 20903 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.372102 20812 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.357546 20877 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.341361 20890 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:57.363962 20882 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.374982 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.375563 20882 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.372979 20892 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.352962 20864 raft_consensus.cc:359] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:57.377504 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.377926 20864 raft_consensus.cc:740] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Initialized, Role: LEARNER
I20260709 13:17:57.379189 20877 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.378600 20864 consensus_queue.cc:260] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:57.373772 20903 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.379469 20898 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:57.380406 20890 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:57.381531 20864 ts_tablet_manager.cc:1434] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065: Time spent starting tablet: real 0.038s	user 0.001s	sys 0.005s
I20260709 13:17:57.381671 19625 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.382750 20885 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.377743 20892 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.383513 20890 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:57.383576 19597 tablet_copy_service.cc:342] P 2cfd02601ea44976833027665abc93bf: Request end of tablet copy session 068c03c9dcc848e6bf909131b1f83065-46d39387ed0c44978cdb2b736f9c1ccf received from {username='slave'} at 127.0.0.1:35102
I20260709 13:17:57.381268 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.384251 19597 tablet_copy_service.cc:434] P 2cfd02601ea44976833027665abc93bf: ending tablet copy session 068c03c9dcc848e6bf909131b1f83065-46d39387ed0c44978cdb2b736f9c1ccf on tablet 46d39387ed0c44978cdb2b736f9c1ccf with peer 068c03c9dcc848e6bf909131b1f83065
I20260709 13:17:57.384946 19625 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.386396 19478 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.388837 20892 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.389127 20867 tablet_bootstrap.cc:492] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:57.369542 20845 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:57.314711 20911 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:57.389812 20911 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:57.390064 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.390272 20911 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.379603 20803 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.391515 20890 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.392761 19625 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.393432 20876 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.393990 20803 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.394134 19625 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.395121 20903 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.395722 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.398649 19504 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:57.399791 20876 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.401110 19504 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:57.390851 20892 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.401732 19506 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:57.402420 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.403162 20892 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.399982 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.404464 19582 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:57.404574 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.404629 19507 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:57.404601 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.406404 20892 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:57.407033 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.407785 20892 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:57.408136 20892 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:57.408732 20892 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.409791 19478 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.411168 19582 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:57.408735 20882 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:57.412473 20903 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.413098 20903 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.414208 19478 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.411561 19507 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:57.415637 19478 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.408134 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.416313 20803 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:57.416781 19478 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.417150 19627 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.419337 20898 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:57.419430 20903 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.419795 20898 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:57.420207 20898 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:57.420629 20823 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:57.421463 20823 consensus_queue.cc:1059] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:57.422088 20901 consensus_queue.cc:1059] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:57.419260 19478 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.424095 19478 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.422874 20825 consensus_queue.cc:1059] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:17:57.425855 20903 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.426096 20901 raft_consensus.cc:3055] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:57.426505 20901 raft_consensus.cc:740] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.427419 20901 consensus_queue.cc:260] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.428000 20903 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.428717 20901 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:57.430055 20867 tablet_bootstrap.cc:492] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap complete.
I20260709 13:17:57.429970 20825 raft_consensus.cc:3055] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:57.430467 20825 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.431151 19478 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.431504 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.432897 20903 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:57.433909 20823 raft_consensus.cc:3055] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:57.434317 20823 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.434907 20867 ts_tablet_manager.cc:1403] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: Time spent bootstrapping tablet: real 0.681s	user 0.034s	sys 0.036s
I20260709 13:17:57.435129 20823 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.436846 20823 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.437691 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.438521 20887 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:57.438906 20887 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:57.439277 20887 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:57.435554 20877 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.433911 20825 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.442632 20825 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:57.444778 19551 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.445539 20897 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.446975 19551 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:57.446708 20887 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.448990 20887 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.449652 20897 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:57.450201 20897 raft_consensus.cc:697] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:57.451153 20897 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:57.451591 20910 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:57.453552 20902 consensus_queue.cc:1059] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:57.455381 20902 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:57.455888 20876 raft_consensus.cc:3055] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:57.456341 20876 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.457073 20665 raft_consensus.cc:1217] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:57.457193 20876 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.455730 20902 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.458493 20876 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.458649 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:57.460444 20865 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:57.460924 20865 raft_consensus.cc:697] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:57.417866 20882 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.459254 20902 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.463411 19507 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:57.464425 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:57.465993 20902 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:57.466624 20910 consensus_queue.cc:1059] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:57.466843 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:57.467653 20910 consensus_queue.cc:1059] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:57.467996 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:57.468438 20879 raft_consensus.cc:3055] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:57.468745 20890 raft_consensus.cc:3055] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:57.468811 20879 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.469233 20890 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.469892 20879 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.470089 20890 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.471235 20879 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.470789 20898 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.474661 20845 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:57.461784 20865 consensus_queue.cc:237] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.476017 20900 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.477065 20900 raft_consensus.cc:3055] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:57.478840 19584 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:57.479621 19585 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:57.477382 20900 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.480767 20900 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.484084 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:57.485101 20900 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.428821 20911 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.473385 20898 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.490216 20890 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.491071 19585 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:57.495081 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:57.490981 20892 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.491883 20908 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:57.496807 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:57.500015 20908 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.497514 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:57.498443 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:57.501263 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:57.500944 20908 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.501745 20845 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:57.502365 20908 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.502769 20845 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:57.499506 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:57.503159 20845 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.503988 20845 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.508100 19585 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:57.511713 20845 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:57.517179 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:57.518265 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.521844 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.523579 19504 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:57.526530 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.527550 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.527675 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.522673 20882 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.523756 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.523203 20825 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:17:57.530861 20825 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:57.523581 19579 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:57.537779 20825 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.538022 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:57.538815 19578 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:57.537428 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.532388 19478 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.540808 20882 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.535511 19653 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:57.537045 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.538733 20825 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.543280 19476 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:57.543872 20825 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:57.544078 20803 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:57.544552 20892 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.544610 20803 raft_consensus.cc:697] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:57.545814 20803 consensus_queue.cc:237] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.549194 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.550063 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.499019 20867 raft_consensus.cc:359] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:57.531363 20911 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.552400 20867 raft_consensus.cc:740] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Initialized, Role: LEARNER
I20260709 13:17:57.556465 20867 consensus_queue.cc:260] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:57.568542 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.569518 20903 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.570855 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.571736 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.573192 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.574286 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.575388 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.577414 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.579097 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.582453 19657 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:57.586074 19583 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:57.587458 19579 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:57.588013 20902 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:57.588918 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.589195 20890 raft_consensus.cc:3055] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:57.589267 20902 consensus_queue.cc:1059] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:57.589717 20890 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.590642 20876 raft_consensus.cc:3055] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:57.590711 20890 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.591161 20876 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.592276 20890 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.594197 19654 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:17:57.599300 20803 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:57.599851 20803 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:57.591935 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 49149.2us
I20260709 13:17:57.607664 20903 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:57.608271 20903 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.605852 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.611240 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.611434 20803 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.612500 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.612524 19659 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:17:57.613999 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:57.614359 20892 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.615388 20898 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.614207 20885 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:57.616631 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.596891 20876 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.618217 19478 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.618554 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.619562 20803 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.620728 19478 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.621821 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.622645 20909 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:57.622169 20812 consensus_queue.cc:1059] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:17:57.626065 20877 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:57.626228 20863 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:57.620013 20882 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:17:57.626641 20877 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.626727 20863 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.627703 20882 raft_consensus.cc:3055] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:57.628060 20882 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:57.628723 20863 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.626808 20909 raft_consensus.cc:3055] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:57.629281 20897 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:57.629359 20909 raft_consensus.cc:740] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:57.629846 20892 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.621997 20898 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:57.630412 20909 consensus_queue.cc:260] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.630736 20898 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.631913 20909 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:57.614480 20887 consensus_queue.cc:1059] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:17:57.632972 20898 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.620438 20865 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.628712 20877 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.622951 19478 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.622567 20803 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.629927 20897 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.640311 20903 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.640717 19579 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:57.641194 20897 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:57.644985 19478 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.616175 20911 consensus_queue.cc:1059] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:17:57.645215 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:57.641274 20876 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.628060 20867 ts_tablet_manager.cc:1434] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: Time spent starting tablet: real 0.193s	user 0.009s	sys 0.000s
I20260709 13:17:57.633985 20865 raft_consensus.cc:3055] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:57.655042 19478 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.655733 20825 consensus_queue.cc:1059] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:57.651676 20812 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.657325 20885 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:57.657882 20911 raft_consensus.cc:3055] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:57.658267 20911 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:57.655974 20865 raft_consensus.cc:740] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:57.659101 20911 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.660511 20911 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.629022 20882 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:57.663297 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.663681 20885 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.664716 20885 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:57.665562 19478 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.666507 20803 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.669840 20906 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:57.676751 20803 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:57.677331 20803 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:57.679909 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:57.670447 20890 raft_consensus.cc:3055] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:57.684474 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:57.686980 19653 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:57.687333 20882 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:57.689657 19507 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:57.683768 20890 raft_consensus.cc:740] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:57.690902 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.691689 20890 consensus_queue.cc:260] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.693231 20894 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.693506 20890 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.693886 19521 tablet_copy_service.cc:342] P d56df3728fc04e37b2d29a3bcd91d167: Request end of tablet copy session 068c03c9dcc848e6bf909131b1f83065-d05498e224814b9b8f31e3f965ab2583 received from {username='slave'} at 127.0.0.1:60692
I20260709 13:17:57.694355 19521 tablet_copy_service.cc:434] P d56df3728fc04e37b2d29a3bcd91d167: ending tablet copy session 068c03c9dcc848e6bf909131b1f83065-d05498e224814b9b8f31e3f965ab2583 on tablet d05498e224814b9b8f31e3f965ab2583 with peer 068c03c9dcc848e6bf909131b1f83065
I20260709 13:17:57.694994 19478 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.695706 20894 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.696862 20803 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.660359 20865 consensus_queue.cc:260] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:57.693166 20891 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:17:57.703976 20891 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:57.704905 20865 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:57.719188 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 85446.6us
I20260709 13:17:57.724594 20877 consensus_queue.cc:1059] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.725791 20922 raft_consensus.cc:3055] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:57.726174 20922 raft_consensus.cc:740] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:57.727499 20922 consensus_queue.cc:260] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.728619 20922 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.730692 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.731436 20897 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:57.733088 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.734081 20865 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.734208 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.735406 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.735885 20865 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:57.742415 20897 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:57.743882 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.751175 20803 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.765269 20897 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:57.765800 19409 catalog_manager.cc:5697] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 1 to 2, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:57.772073 20892 consensus_queue.cc:1059] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:57.768484 19410 catalog_manager.cc:5697] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 2, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 2 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:57.773248 20865 raft_consensus.cc:3055] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:57.773677 20865 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:57.773469 19410 catalog_manager.cc:5697] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 2, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 2 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:57.774533 20865 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.778360 20865 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.789650 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:57.791502 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:57.797601 19507 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:17:57.819797 19578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60798
I20260709 13:17:57.820510 19578 raft_consensus.cc:606] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Received request to transfer leadership
I20260709 13:17:57.835820 19578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60798
I20260709 13:17:57.836391 19578 raft_consensus.cc:606] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Received request to transfer leadership
W20260709 13:17:57.837900 19397 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 6eb38e2ac9064d3286fe2f20aeb2381c already in progress [suppressed 4 similar messages]
I20260709 13:17:57.845472 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:57.848003 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:57.840826 19507 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:57.851765 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:57.852330 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:57.852917 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:57.855528 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:57.856133 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:57.857018 20665 raft_consensus.cc:1217] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:17:57.858121 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:57.860441 19581 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:57.861892 19654 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:57.864049 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.864831 20865 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.868144 20903 consensus_queue.cc:1059] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:17:57.869261 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.869517 20906 raft_consensus.cc:3055] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:57.871219 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.872251 20865 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.869995 20906 raft_consensus.cc:740] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:57.874650 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.875435 20865 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.874940 20906 consensus_queue.cc:260] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.876576 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.876654 20906 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:57.885013 20665 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 1 LEARNER]: Advancing to term 2
I20260709 13:17:57.886610 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:57.888016 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.888782 20892 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.889531 20892 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:57.889818 20922 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:57.890363 20922 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:57.891352 20922 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.898324 20665 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 2 LEARNER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:57.889046 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:57.900635 20865 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:57.902256 20865 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:57.910635 20865 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:57.911782 20865 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.916206 20877 raft_consensus.cc:1064] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
W20260709 13:17:57.916769 20877 raft_consensus.cc:1068] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: Unable to promote non-voter 068c03c9dcc848e6bf909131b1f83065: Service unavailable: leader transfer in progress
I20260709 13:17:57.902626 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:17:57.906679 19397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 68916.3us
I20260709 13:17:57.921921 19579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60798
I20260709 13:17:57.922641 19579 raft_consensus.cc:606] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Received request to transfer leadership
W20260709 13:17:57.931797 19458 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:17:57.932397 19458 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 6eb38e2ac9064d3286fe2f20aeb2381c already in progress
W20260709 13:17:57.932751 19458 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 6eb38e2ac9064d3286fe2f20aeb2381c already in progress
I20260709 13:17:57.935631 19408 catalog_manager.cc:5697] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 2 to 3, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 3 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:57.940017 19579 raft_consensus.cc:1275] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:57.948405 20892 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:57.948763 20903 consensus_queue.cc:1048] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.949167 20892 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:57.950388 20892 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:57.967309 19659 raft_consensus.cc:1275] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:17:57.968463 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 49943.5us
I20260709 13:17:57.969635 20906 consensus_queue.cc:1048] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:17:57.975992 20922 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:57.994683 19654 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:58.006742 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:58.008323 20892 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:58.023367 20892 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:58.025328 20892 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:58.051044 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:58.064117 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:58.065213 20898 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:58.076658 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:58.077884 20922 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:58.078279 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:58.076545 20898 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:58.082574 19504 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:58.076372 20865 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:17:58.079766 20877 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:58.090211 20906 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.090729 20906 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:58.092777 20906 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:58.095465 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:58.097469 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:58.098779 19659 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:58.099313 19478 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:58.101400 20911 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:58.111131 20865 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:58.111579 20892 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:58.114113 19408 catalog_manager.cc:5697] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 4 to 5, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 5 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:58.121379 19408 catalog_manager.cc:5697] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 4 to 5, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 5 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:58.145485 20906 raft_consensus.cc:1064] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:17:58.148609 20865 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:17:58.148694 20906 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:58.163776 19504 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:58.173869 20877 raft_consensus.cc:993] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: : Instructing follower e19c80e9149b4b8d88ae13bde8e43864 to start an election
I20260709 13:17:58.174561 20877 raft_consensus.cc:1081] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Signalling peer e19c80e9149b4b8d88ae13bde8e43864 to start an election
I20260709 13:17:58.183558 20892 raft_consensus.cc:1064] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
W20260709 13:17:58.184044 20892 raft_consensus.cc:1068] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: Unable to promote non-voter 068c03c9dcc848e6bf909131b1f83065: Service unavailable: leader transfer in progress
I20260709 13:17:58.207890 19408 catalog_manager.cc:5697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 2 to 3, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 3 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:58.209904 19657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
 from {username='slave'} at 127.0.0.1:56824
I20260709 13:17:58.220981 19657 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:58.221392 19657 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:58.228859 20892 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:58.239867 19657 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:58.270771 19657 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:58.271260 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:58.272053 19579 raft_consensus.cc:3055] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:58.272460 19579 raft_consensus.cc:740] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:58.273350 19579 consensus_queue.cc:260] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:58.271216 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:58.280689 19507 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:58.280871 20665 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 4 LEARNER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:17:58.281004 19578 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:17:58.282437 20930 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:58.286026 20930 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:58.281577 19657 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:17:58.291991 20930 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:17:58.293591 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 66271.3us
I20260709 13:17:58.294533 19579 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:58.316433 19507 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:58.317847 19625 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:58.318713 20845 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:58.319231 20845 raft_consensus.cc:697] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:58.320123 20845 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:58.324615 20903 raft_consensus.cc:2955] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:58.332969 19579 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:58.333603 20665 raft_consensus.cc:2955] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:58.367902 19653 raft_consensus.cc:2955] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:58.389315 19410 catalog_manager.cc:5697] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 2 to 3, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 3 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:58.395256 19408 catalog_manager.cc:5697] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 4 to 5, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:58.415307 19579 raft_consensus.cc:2955] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:58.420475 19657 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:58.427826 19657 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:58.433961 19654 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:58.435763 20922 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:58.435972 20946 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:58.437162 20922 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:58.437669 20922 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:58.439608 20922 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:58.442586 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:58.443385 19509 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 2: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:58.443385 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:58.444120 19656 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:58.445215 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:58.446424 20877 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:58.446815 20877 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:58.447292 20877 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:58.467938 20877 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:58.472232 19507 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:58.477923 20903 raft_consensus.cc:1064] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:17:58.482898 20903 consensus_queue.cc:237] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:58.487931 19653 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:58.490708 20898 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:58.493243 19507 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:58.494216 20665 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:58.495303 20898 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:58.495960 20906 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:58.498742 19579 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:58.500572 20906 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:58.506947 20665 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEARNER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:58.507879 19654 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:58.510349 19578 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:58.510782 20930 raft_consensus.cc:2955] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:58.513805 20885 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:58.516069 20911 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:58.519896 20911 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:58.520422 20911 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:58.524632 20885 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:58.525243 20665 raft_consensus.cc:2955] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:58.530237 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:58.531108 19578 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:58.554440 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:58.555189 19656 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:58.561473 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:58.562556 19507 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 2: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:58.564394 19504 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:58.562357 20911 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:58.583103 20877 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:58.612309 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:58.640271 19408 catalog_manager.cc:5697] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 5 to 6, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New cstate: current_term: 4 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:58.624696 20903 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:58.650358 20903 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:58.674921 20903 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:58.675695 20926 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.677942 20845 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:17:58.719787 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 150366us
I20260709 13:17:58.718616 20956 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.726807 20956 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:58.729017 20956 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:58.701116 20926 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:58.705385 20845 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:58.737406 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:58.760192 20898 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:58.764128 20903 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:58.766661 20876 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.767405 20876 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:58.769263 19578 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:58.770255 19646 tablet_service.cc:1558] Processing DeleteTablet for tablet 911988cab3914bb19f77d4d3e24a31f4 with delete_type TABLET_DATA_TOMBSTONED (TS e19c80e9149b4b8d88ae13bde8e43864 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:56808
I20260709 13:17:58.774124 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:58.776641 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:58.779167 19578 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:58.780858 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:58.786185 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:58.790596 19654 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:58.792486 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:58.729566 20956 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.794066 20956 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:58.796505 20961 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:58.796969 20956 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:58.797047 20845 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:58.807312 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:58.793321 20876 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:17:58.797140 20961 raft_consensus.cc:697] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:17:58.808893 19579 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 2: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:58.810837 20956 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:58.811738 20956 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.812398 20956 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:58.814635 20961 consensus_queue.cc:237] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:58.815424 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 263615us
I20260709 13:17:58.817116 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:58.817922 19579 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 2.
I20260709 13:17:58.818141 19581 raft_consensus.cc:2955] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:58.828243 19509 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:58.830665 19654 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:58.834332 19395 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 911988cab3914bb19f77d4d3e24a31f4 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:58.835456 20631 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:17:58.836688 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:58.837589 19578 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:58.838932 19627 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:58.841917 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:58.842865 19583 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:58.843894 19657 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:58.887679 19504 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:58.820243 20845 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.784094 20903 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:58.813153 20876 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:17:58.887108 20959 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.915971 19509 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:58.926790 19504 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:58.895651 20926 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:58.894832 20845 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:58.930868 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:58.935454 19506 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:58.950397 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:58.951285 19505 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:58.962934 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:58.970391 20876 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:58.935108 20926 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:58.963845 19509 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:17:58.972568 20926 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.991130 20968 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.992990 20964 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:58.942700 20906 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:58.971021 20876 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.046276 20969 tablet_replica.cc:333] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:17:59.047789 20969 raft_consensus.cc:2243] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:59.053921 20970 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.054591 20970 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.057094 20970 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:59.067940 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:59.077832 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:59.078857 19578 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:59.080338 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:17:59.001058 20926 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:58.919420 20959 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.032028 20964 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.042515 20876 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.107906 20665 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 2 LEARNER]: Advancing to term 3
I20260709 13:17:59.112843 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:17:59.103423 20969 raft_consensus.cc:2272] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:59.041893 20906 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.128512 20665 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEARNER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:59.134495 20911 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.135077 20911 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.137148 20911 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.126324 20877 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:17:59.084054 20968 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.140096 20968 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:59.140594 20968 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.141067 20974 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:59.113739 20962 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.137869 20972 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:59.102085 20964 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.141760 20974 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.129733 20845 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:59.141029 20968 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.125751 20979 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.161381 20979 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.175854 20962 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.178714 20959 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.178942 20962 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.151826 20966 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:59.186076 20966 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:59.189011 20966 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:59.160583 20972 raft_consensus.cc:697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:17:59.190680 20972 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:59.205791 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 348020us
I20260709 13:17:59.233366 20974 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:59.168135 20979 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:59.244496 20967 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:17:59.286757 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 172381us
I20260709 13:17:59.311445 20965 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.304020 20959 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.304333 20922 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.314340 20906 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.327903 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:59.319324 20961 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.328724 19657 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:59.330148 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:59.332083 19578 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:59.336113 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:59.341986 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:59.342634 19581 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:17:59.345479 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:59.347690 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:59.348335 19581 raft_consensus.cc:2393] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:59.348438 19659 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:17:59.351114 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:59.358887 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:59.360441 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:59.377198 19659 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:59.361213 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:59.356469 20966 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:17:59.381588 20975 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:17:59.381597 20966 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.382210 20966 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.346395 20930 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.383405 20930 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.385140 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:59.352705 20906 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.385787 19506 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:59.385970 20906 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.386526 20986 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:59.387045 20986 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.388092 20906 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.389125 20986 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.373181 20898 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:59.390895 20898 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.392900 20898 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.339504 20961 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.343811 20968 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:59.325800 20959 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:59.325664 20922 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:17:59.376434 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:59.344354 20926 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:59.380491 19581 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:59.282795 20967 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:59.375095 20978 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:59.381013 20983 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.324216 20965 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.346952 20885 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:17:59.366328 20956 consensus_meta.cc:287] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.547s	user 0.006s	sys 0.006s
I20260709 13:17:59.394381 19476 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:59.378892 19656 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:59.399756 19660 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:17:59.432924 19476 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:59.400355 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:59.434468 19659 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:17:59.406381 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:59.409360 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:59.406297 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:59.415944 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:59.424228 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:59.438002 19579 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:17:59.427783 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:59.385604 20930 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.441264 19582 raft_consensus.cc:2393] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 4: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:59.437382 19655 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:17:59.436570 19580 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:59.438838 19586 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:59.436043 19587 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:59.434589 19410 catalog_manager.cc:5697] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 2 to 3, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 3 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:59.445173 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 73400.7us
I20260709 13:17:59.425964 20978 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.398514 20962 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:17:59.449218 20965 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.416064 20865 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:17:59.428588 20983 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:59.458715 20979 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:59.459776 19627 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:59.458696 20978 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:59.460819 20983 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:17:59.450608 20903 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:59.461694 20903 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.462108 20903 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:59.463208 19625 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:59.464072 20988 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:59.464478 20988 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:59.464879 20988 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:59.453821 20969 ts_tablet_manager.cc:1916] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:59.467648 20664 raft_consensus.cc:2393] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:17:59.461200 19627 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:59.470465 19627 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:59.470816 20959 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.471498 19627 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:59.472453 20926 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.472211 20876 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.472496 19627 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:59.473866 20987 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:59.473970 20845 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:59.475338 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:59.476912 19625 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:59.477357 19582 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:59.474479 20987 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.474519 20974 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:59.474617 20922 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.460611 20979 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:59.480904 20877 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:59.476770 20845 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.478525 20978 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:59.431528 20956 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:59.477747 20957 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:59.515779 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:17:59.439626 20885 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.520112 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:59.520763 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:59.483834 20987 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:59.521845 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 160466us
I20260709 13:17:59.520769 19506 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:17:59.487526 20974 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:59.515592 20845 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.500138 20979 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.532195 19654 raft_consensus.cc:2393] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:17:59.517373 20978 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.533466 19509 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:59.514249 20970 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:59.524308 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:59.537384 19504 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:59.486720 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:59.543390 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:59.544850 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:59.545643 19508 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:17:59.549455 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:59.550275 19508 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:17:59.552237 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:59.553042 19508 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:17:59.558055 19586 raft_consensus.cc:2393] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:59.563804 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:59.564759 19504 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:17:59.575156 19506 raft_consensus.cc:2393] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 2: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:59.519158 20957 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:59.513919 20877 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:59.585304 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 186373us
W20260709 13:17:59.594080 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 143879us
I20260709 13:17:59.531064 20974 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:59.557577 20978 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:59.538932 20979 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.557269 20970 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.589686 20957 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:59.611629 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:59.612318 19509 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.577375 20966 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.592046 20985 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.626456 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:17:59.620182 19476 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:59.613999 20970 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:59.635159 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57644.3us
I20260709 13:17:59.631560 20876 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:59.646391 19476 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:59.650599 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:59.651238 19586 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.652220 19476 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:59.653139 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:59.631961 20961 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.635748 20897 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.668713 19509 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:17:59.672437 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:59.650487 20973 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:17:59.682047 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 77553.6us
I20260709 13:17:59.666163 20968 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:17:59.501565 20911 raft_consensus.cc:2955] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:59.686431 19625 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:59.691481 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:59.692121 19660 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:17:59.693926 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:59.694070 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:59.694722 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:59.695314 19509 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 4.
I20260709 13:17:59.634302 20985 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:17:59.693389 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 50256.7us
I20260709 13:17:59.699544 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:59.700758 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:59.703115 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:59.704177 19511 raft_consensus.cc:2393] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 4: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:59.704919 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:59.704830 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:59.705775 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:59.705814 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:17:59.706272 19506 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:17:59.705691 19507 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:59.677021 20967 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:59.682195 20885 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.684625 20973 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.709599 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:17:59.677353 20897 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.716399 19582 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 3.
I20260709 13:17:59.695209 20983 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:59.722874 19509 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 3: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:17:59.719187 19655 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:17:59.692276 20968 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.777220 21002 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:17:59.778335 20877 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.713734 20973 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:59.778913 21002 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:59.779356 21002 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:59.779721 21002 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.783603 20995 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:59.784067 20995 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.784507 20995 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:59.786473 20892 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.787133 20892 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.789220 20892 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.790040 20966 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:17:59.790261 20993 log.cc:927] Time spent T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:17:59.713253 20956 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:17:59.791366 20982 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:59.791793 20982 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:17:59.792146 20982 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:59.793588 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 100124us
I20260709 13:17:59.795316 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:59.795890 19587 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.796191 19476 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:59.802776 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:59.803892 19582 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 4: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:17:59.804423 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 118063us
I20260709 13:17:59.807839 19625 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:59.767751 20983 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.819736 20897 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.824888 19586 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:17:59.826058 19627 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:17:59.799286 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 89505.2us
I20260709 13:17:59.835842 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:17:59.821749 21004 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:59.814885 20983 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.834836 21006 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:59.840844 21006 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.841224 21006 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:59.857586 20903 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.859973 20903 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.861047 19508 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:17:59.861716 20987 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.863722 19587 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:17:59.865567 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:59.865785 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:59.866078 21008 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:59.866201 19587 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:59.866523 21008 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:59.866940 21008 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:59.867461 20987 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:59.874050 21005 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:59.879858 21005 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:59.880920 21002 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.881114 21005 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.886051 21002 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:59.847513 21004 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.869856 20898 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.823412 20988 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.822305 20631 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:17:59.898077 19587 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:17:59.899364 19627 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:59.902660 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:17:59.903277 20977 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:59.903860 21002 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:17:59.903307 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 92967.6us
I20260709 13:17:59.904517 21002 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:17:59.903894 20977 raft_consensus.cc:697] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:17:59.905386 21002 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.903466 19586 raft_consensus.cc:2393] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 4: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:17:59.905995 20977 consensus_queue.cc:237] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:59.908529 20985 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:59.910275 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:17:59.910981 19587 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:17:59.895435 21004 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:59.923607 19627 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:17:59.909847 19654 raft_consensus.cc:2955] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:17:59.930065 20619 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:17:59.921300 21007 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:59.937317 20845 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.940218 20926 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:59.940733 20926 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:17:59.941130 20926 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.947332 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:17:59.950829 19660 raft_consensus.cc:2368] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4.
I20260709 13:17:59.952143 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:17:59.953413 20985 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:59.954277 20845 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:59.901535 20898 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.931357 20876 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:59.946717 21006 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.973675 20876 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.978291 20876 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:59.974004 20965 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.967686 20926 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:17:59.989372 21007 raft_consensus.cc:697] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:00.017849 20898 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:17:59.974160 20978 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.042711 19661 raft_consensus.cc:2368] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5.
W20260709 13:18:00.043869 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 330333us
I20260709 13:18:00.016422 20965 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:17:59.988672 20995 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.083425 20984 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.083539 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:00.084091 20984 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.084458 20666 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:00.083528 20664 raft_consensus.cc:2955] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:00.067087 20996 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:00.152666 20974 consensus_meta.cc:287] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.002s
I20260709 13:18:00.154580 20926 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:00.154284 20876 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.156237 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:00.156966 19587 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 4: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:00.085410 20988 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:17:59.988909 20979 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.165495 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:00.138037 20978 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:00.166852 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:00.168992 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:00.153132 20974 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:18:00.173094 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:00.174276 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:00.061478 20973 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.181489 19656 raft_consensus.cc:2368] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4.
I20260709 13:18:00.181571 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:00.180163 19510 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:18:00.078855 20982 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.185070 19503 raft_consensus.cc:2393] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:00.193182 19653 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:18:00.195883 21014 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.196615 21014 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.199510 21014 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:00.184422 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:00.211755 19507 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:00.179531 20968 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:00.189356 20978 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:00.230381 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 413602us
I20260709 13:18:00.191087 21006 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:00.252305 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:00.252952 19510 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:00.162854 20996 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.261273 20996 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:00.227365 21014 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:00.235532 20956 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.250461 20978 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.273003 20995 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:00.276530 20969 ts_tablet_manager.cc:1929] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:18:00.278282 20979 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:00.290944 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:00.290963 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:00.291520 19579 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:00.292045 19580 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 2: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:00.288946 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:00.292630 19582 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:00.265867 21014 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.300633 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:00.301959 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:00.302559 19580 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:00.292198 20970 consensus_meta.cc:287] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.642s	user 0.011s	sys 0.000s
I20260709 13:18:00.137460 21007 consensus_queue.cc:237] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.298321 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:00.297922 19627 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:00.313998 19583 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:18:00.304309 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:00.315449 19587 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.285905 20965 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:00.293388 20969 log.cc:1199] T 911988cab3914bb19f77d4d3e24a31f4 P e19c80e9149b4b8d88ae13bde8e43864: Deleting WAL directory at /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-2-root/wals/911988cab3914bb19f77d4d3e24a31f4
W20260709 13:18:00.313062 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 62215.7us
I20260709 13:18:00.316942 19586 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:00.305512 21014 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:00.310989 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:00.318722 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:00.319033 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:00.321447 19584 raft_consensus.cc:2955] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:00.334306 19582 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:00.334338 19583 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:00.313182 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:00.335573 19578 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:18:00.309978 20876 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:00.290578 20956 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:00.324836 20957 consensus_meta.cc:287] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.694s	user 0.009s	sys 0.002s
I20260709 13:18:00.303064 20984 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:00.343101 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:00.343976 19551 leader_election.cc:400] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4.
I20260709 13:18:00.353282 19551 leader_election.cc:403] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:00.309298 20970 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.350369 19507 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:00.324970 21005 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:00.338011 20964 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:00.362068 20974 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:00.363997 19579 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:00.365880 20964 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.368144 20964 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:00.371061 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:00.372058 19504 raft_consensus.cc:2393] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 4: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:00.372529 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:00.373284 19654 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:00.378135 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:00.379065 19504 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:00.380038 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:00.380221 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:00.380576 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:00.380746 19654 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:18:00.381572 19579 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:00.373065 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:00.382292 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:00.383404 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:00.359061 21005 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:00.398356 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:00.399010 19578 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:18:00.401942 19504 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:00.405436 19512 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:18:00.389925 19656 raft_consensus.cc:2368] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5.
I20260709 13:18:00.409472 19587 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:00.389897 19551 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:00.419688 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:00.423092 21020 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:18:00.424358 19579 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:00.431592 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:00.432488 19512 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:18:00.397176 21005 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.354363 20957 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.433440 19580 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:00.388792 20969 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56808 (request call id 62) took 1631 ms. Trace:
W20260709 13:18:00.439476 21019 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:18:00.447587 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:00.410158 20865 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4.
I20260709 13:18:00.441311 19580 raft_consensus.cc:1275] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:00.397737 20972 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:00.443482 19510 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:00.452356 19505 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:00.448336 19579 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:18:00.448720 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 58950.1us
I20260709 13:18:00.439982 21016 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:00.461282 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:00.461853 19510 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.464237 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:00.464676 19660 raft_consensus.cc:1275] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:00.466333 20967 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:00.448274 20978 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:00.457551 20997 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:00.481846 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:00.484828 19512 raft_consensus.cc:2393] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:00.481212 19510 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:00.456197 20972 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.482295 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:00.483111 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 224481us
I20260709 13:18:00.490697 19579 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:00.502238 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:00.502224 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:00.503631 19579 raft_consensus.cc:2368] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6.
W20260709 13:18:00.510912 21025 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:18:00.509744 19478 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:00.488335 20997 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.495244 20972 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.521673 19580 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:00.522601 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:00.523263 19578 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
W20260709 13:18:00.523315 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 68837us
I20260709 13:18:00.484681 20967 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:18:00.524667 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:00.473486 21016 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.526118 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:00.531489 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:00.534608 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:00.519588 20997 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.535988 19478 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:00.534111 21024 log.cc:927] Time spent T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Append to log took a long time: real 0.206s	user 0.000s	sys 0.002s
I20260709 13:18:00.543720 20970 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:00.548095 20998 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.960s	user 0.009s	sys 0.003s
I20260709 13:18:00.549144 20903 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:00.549453 19657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1125) took 1193 ms. Trace:
I20260709 13:18:00.552765 20903 raft_consensus.cc:697] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:00.553462 20983 consensus_meta.cc:287] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.681s	user 0.006s	sys 0.005s
I20260709 13:18:00.553784 20903 consensus_queue.cc:237] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.550105 19657 rpcz_store.cc:276] 0709 13:17:59.356341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.358651 (+  2310us) service_pool.cc:224] Handling call
0709 13:17:59.358954 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:59.368880 (+  9926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.368909 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:59.376185 (+  7276us) log.cc:844] Serialized 26 byte log entry
0709 13:17:59.590992 (+214807us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:59.591038 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.591176 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:00.544937 (+953761us) spinlock_profiling.cc:243] Waited 8.68 ms on lock 0x7b2400397298. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e4f39c4 00007f6c2e4f1acb 00007f6c2e6acdc9 00007f6c2e6aca55 00007f6c2e6ac09d 00007f6c312de10e 00007f6c312f588c 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221
0709 13:18:00.549014 (+  4077us) raft_consensus.cc:1685] finished
0709 13:18:00.549049 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.549350 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2840,"raft.queue_time_us":99187,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":19954432,"thread_start_us":175106,"threads_started":1,"wal-append.queue_time_us":186749}
I20260709 13:18:00.444923 20969 rpcz_store.cc:276] 0709 13:17:58.769581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.769990 (+   409us) service_pool.cc:224] Handling call
0709 13:17:59.045664 (+275674us) ts_tablet_manager.cc:1151] Deleting tablet 911988cab3914bb19f77d4d3e24a31f4
0709 13:17:59.045794 (+   130us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:17:59.953274 (+907480us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:00.276375 (+323101us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:00.368778 (+ 92403us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":274676,"thread_start_us":313049,"threads_started":1}
I20260709 13:18:00.533072 20956 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:00.568789 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:00.577410 19478 leader_election.cc:400] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6.
I20260709 13:18:00.577958 19478 leader_election.cc:403] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:18:00.534106 20996 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:00.516497 20981 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:18:00.559171 20965 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:00.588076 20971 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6.
I20260709 13:18:00.589103 20960 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:18:00.592568 21022 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 13:18:00.598030 21023 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:18:00.572606 21014 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:00.601672 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 77075.1us
I20260709 13:18:00.553880 20983 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.580242 19395 catalog_manager.cc:5028] TS e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): tablet 911988cab3914bb19f77d4d3e24a31f4 (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
I20260709 13:18:00.583055 20964 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:00.581670 20996 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.604584 20892 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:18:00.609844 20983 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:00.583633 20965 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.590415 21003 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:00.620064 21003 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.620488 21003 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.596056 20957 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:00.615451 20964 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.616283 20996 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.621174 20965 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.629577 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:00.642042 20922 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:00.642489 20922 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.642877 20922 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.649930 20962 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.650604 20962 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.651015 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:00.654363 20898 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.654920 20898 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.665858 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:00.665923 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:00.667695 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:00.668170 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:00.666723 19627 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:00.697387 19579 raft_consensus.cc:2368] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4.
I20260709 13:18:00.697528 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:00.698984 19582 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 4: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:00.698908 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:00.699462 19580 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:00.703145 19657 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:18:00.677531 19655 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:00.700388 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:00.704367 19510 raft_consensus.cc:2368] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for earlier term 4. Current term is 5.
I20260709 13:18:00.632138 20964 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.707762 20972 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.706774 19627 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:00.711885 20664 consensus_meta.cc:287] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.622s	user 0.010s	sys 0.000s
I20260709 13:18:00.718081 19582 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:18:00.717976 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:00.719965 19578 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:18:00.720361 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 59204.2us
I20260709 13:18:00.722261 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:00.723973 19476 leader_election.cc:400] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4.
I20260709 13:18:00.724303 19476 leader_election.cc:403] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:00.726909 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:00.727730 19656 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.729506 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:00.730703 19627 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:00.696076 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:00.685417 21014 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:00.694577 21032 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:00.732770 19627 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:00.723030 19655 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:18:00.734712 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:00.735008 20666 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:00.735152 20966 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:00.736081 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:00.736209 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:00.715732 20970 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:00.743043 19509 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:00.735016 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:00.737488 19478 leader_election.cc:400] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4.
I20260709 13:18:00.744428 19478 leader_election.cc:403] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:00.744457 19508 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.738476 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:00.745609 19511 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:18:00.741904 21032 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.734733 20989 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:00.748397 19586 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:00.753301 19578 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:00.756223 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:00.767416 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:00.595377 20960 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:00.720968 20946 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:00.749130 21032 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.775206 19510 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.782768 19509 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:00.783421 19627 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:00.738787 20962 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:00.789773 19511 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:18:00.789963 19579 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:18:00.737376 20906 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:00.795449 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:00.739847 20956 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:18:00.795674 21028 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 13:18:00.774046 21004 consensus_meta.cc:287] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.841s	user 0.010s	sys 0.003s
I20260709 13:18:00.748741 20845 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:00.805032 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 48630.1us
I20260709 13:18:00.842566 19656 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:00.845419 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:00.789952 20966 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:00.787575 20970 raft_consensus.cc:697] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:00.800352 20983 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.852429 19580 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:00.801262 20989 raft_consensus.cc:697] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:00.853065 19508 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:00.864362 20972 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:00.845885 20978 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:00.879375 19510 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:00.889415 20959 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:00.869664 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:00.890309 21014 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4.
I20260709 13:18:00.900337 21016 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:00.833841 20946 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.847487 21004 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.841991 20964 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.866145 20876 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:00.854127 20845 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:00.932648 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 195301us
W20260709 13:18:00.935889 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 222072us
I20260709 13:18:00.854075 20906 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.927131 20666 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
W20260709 13:18:00.937357 21008 consensus_meta.cc:287] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 1.069s	user 0.006s	sys 0.010s
I20260709 13:18:00.956403 19506 raft_consensus.cc:2368] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5.
I20260709 13:18:00.934522 20892 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:00.957103 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:00.957161 21035 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:18:00.966883 20946 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:00.967907 20906 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:00.939783 20845 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.941534 20967 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:00.948267 20898 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:00.932777 20959 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.948218 20960 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:00.985242 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:00.954380 20978 raft_consensus.cc:697] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:00.964763 20956 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:00.939579 20876 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.968988 21028 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:00.936043 20966 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.938210 20970 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:01.051177 19661 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1131) took 1338 ms (client timeout 1533 ms). Trace:
I20260709 13:18:00.971678 20892 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:01.055038 19661 rpcz_store.cc:269] 0709 13:17:59.700442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.700551 (+   109us) service_pool.cc:224] Handling call
0709 13:18:01.038883 (+1338332us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b5400217ad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:01.039072 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777770240}
W20260709 13:18:01.061894 21036 log.cc:927] Time spent T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.178s	user 0.001s	sys 0.001s
W20260709 13:18:01.063771 21031 log.cc:927] Time spent T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:18:00.965160 21008 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:00.968933 20997 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:18:01.027607 20956 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:01.091648 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:00.984957 20967 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:01.094596 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:01.095350 19585 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.102249 19654 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:01.104562 19587 raft_consensus.cc:2368] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3.
I20260709 13:18:01.067353 21004 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:01.107017 20619 leader_election.cc:400] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for earlier term 4. Current term is 5.
I20260709 13:18:00.992710 20989 consensus_queue.cc:237] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:01.036559 21028 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:01.127585 20619 leader_election.cc:403] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:01.139429 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:01.126811 20964 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:01.138550 21009 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 1.220s	user 0.005s	sys 0.009s
I20260709 13:18:01.161240 19582 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:01.137637 21041 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:01.113333 20978 consensus_queue.cc:237] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:01.173247 21041 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:01.194121 19585 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:01.170367 20876 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:01.196229 20665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59442 (request call id 45) took 1591 ms. Trace:
I20260709 13:18:01.171861 21042 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:18:01.190407 21007 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.034s	sys 0.042s
I20260709 13:18:01.183786 21008 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:01.175498 21048 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:01.192341 20664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59430 (request call id 40) took 1111 ms. Trace:
I20260709 13:18:01.182332 20982 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:01.174088 20959 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:01.182540 20997 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:01.204526 21045 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for earlier term 4. Current term is 5.
I20260709 13:18:01.211091 20892 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:01.212209 21005 consensus_meta.cc:287] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.766s	user 0.012s	sys 0.000s
I20260709 13:18:01.231600 21005 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:01.231886 21048 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:01.214844 21028 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:01.215845 21032 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:01.236672 19581 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:01.206120 21042 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:01.215849 20965 consensus_meta.cc:287] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
W20260709 13:18:01.221521 20996 consensus_meta.cc:287] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.000s
I20260709 13:18:01.221525 20983 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4.
W20260709 13:18:01.223584 20922 consensus_meta.cc:287] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.580s	user 0.012s	sys 0.000s
I20260709 13:18:01.200783 20665 rpcz_store.cc:276] 0709 13:17:59.624189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.626364 (+  2175us) service_pool.cc:224] Handling call
0709 13:17:59.626784 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:59.627240 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.627281 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:59.627803 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:17:59.719980 (+ 92177us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:59.970668 (+250688us) log.cc:844] Serialized 14 byte log entry
0709 13:17:59.970934 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.971020 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:01.056837 (+1085817us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:18:01.192039 (+135202us) raft_consensus.cc:1685] finished
0709 13:18:01.195961 (+  3922us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.196154 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":308982,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":7719,"raft.queue_time_us":4183,"raft.run_cpu_time_us":421,"raft.run_wall_time_us":14851,"spinlock_wait_cycles":6203136,"thread_start_us":288481,"threads_started":2,"wal-append.queue_time_us":261972}
I20260709 13:18:01.229008 20967 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:01.233388 20956 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:01.234982 21005 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:01.233574 19659 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
W20260709 13:18:01.204905 21007 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.034s	sys 0.042s
W20260709 13:18:01.238214 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 110278us
I20260709 13:18:01.239791 20996 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:01.238183 20845 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:01.224874 20664 rpcz_store.cc:276] 0709 13:18:00.082638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.082814 (+   176us) service_pool.cc:224] Handling call
0709 13:18:00.083151 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.083411 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:00.729963 (+646552us) log.cc:844] Serialized 14 byte log entry
0709 13:18:01.156402 (+426439us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.158976 (+  2574us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:01.166456 (+  7480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.170957 (+  4501us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.184453 (+ 13496us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88414,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":6669,"thread_start_us":387082,"threads_started":2,"wal-append.queue_time_us":421812}
I20260709 13:18:01.243314 21042 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:01.243696 21003 consensus_meta.cc:287] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.614s	user 0.003s	sys 0.010s
I20260709 13:18:01.238935 20965 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:01.245414 21032 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:01.252919 19504 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:01.255017 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:01.258147 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:01.259040 20845 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:01.259980 19583 raft_consensus.cc:2368] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6.
I20260709 13:18:01.261152 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:01.259714 21003 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:18:01.264546 20996 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:01.265341 19578 raft_consensus.cc:2393] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 4: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:01.265718 19512 raft_consensus.cc:2368] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3.
I20260709 13:18:01.265790 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:01.247828 20922 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:01.267942 21003 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:01.268828 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:01.269027 20922 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:01.269973 20965 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:01.270119 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:01.270972 21048 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:01.271216 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:01.272017 19583 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:01.273824 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:01.282601 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 492023us
I20260709 13:18:01.284389 19551 leader_election.cc:400] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5.
I20260709 13:18:01.284749 19551 leader_election.cc:403] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:01.282944 21050 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:01.290280 21048 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:01.296764 20965 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5.
W20260709 13:18:01.320461 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 232040us
I20260709 13:18:01.289860 21050 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:01.325260 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:01.326890 21003 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:01.321753 21048 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:01.327414 21003 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:01.328397 21003 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:01.329242 21048 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:01.330336 21048 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:01.330875 21048 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:01.333048 21048 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:01.334233 20996 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:01.335032 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:01.334883 20996 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:01.335813 19583 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:01.340361 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:01.340988 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:01.341132 19660 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:01.345592 19583 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:01.345671 20996 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:01.351176 21038 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:01.352947 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 68690.9us
I20260709 13:18:01.353899 19551 leader_election.cc:400] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5.
I20260709 13:18:01.354226 19551 leader_election.cc:403] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:01.351897 21038 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:18:01.364230 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:01.365267 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:01.366164 19508 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:18:01.373193 21006 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:01.373991 21006 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:01.378540 21021 log.cc:927] Time spent T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.908s	user 0.005s	sys 0.000s
W20260709 13:18:01.385078 19505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1356) took 1867 ms (client timeout 1560 ms). Trace:
I20260709 13:18:01.385330 19507 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:01.385694 19505 rpcz_store.cc:269] 0709 13:17:59.517573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.518044 (+   471us) service_pool.cc:224] Handling call
0709 13:18:01.384793 (+1866749us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b5400402754. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:01.384961 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2104890624}
I20260709 13:18:01.387223 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:01.364117 20897 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5.
I20260709 13:18:01.390378 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:01.387952 19508 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:18:01.391584 19627 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:01.393021 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:01.393949 19508 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:01.395223 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:01.396770 19627 leader_election.cc:400] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6.
I20260709 13:18:01.397166 19627 leader_election.cc:403] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:18:01.397426 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:01.400293 19478 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:01.402027 20845 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:01.402449 20845 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.402782 20845 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:01.405248 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:01.403584 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:01.410290 20971 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:01.410812 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:01.376605 21006 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:01.411916 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:01.742700 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:01.743578 19657 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:01.451988 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:01.606891 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:01.437322 20845 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:01.746584 19507 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:18:01.510471 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:01.747835 20845 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:01.597882 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1321) took 1080 ms. Trace:
I20260709 13:18:01.749099 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:01.750187 19660 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:18:01.752099 19654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1142) took 1370 ms (client timeout 1692 ms). Trace:
I20260709 13:18:01.754086 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1384) took 1019 ms. Trace:
I20260709 13:18:01.754568 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1138) took 1381 ms. Trace:
I20260709 13:18:01.517984 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:01.532509 19661 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:01.533010 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:01.771868 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1324) took 1249 ms. Trace:
I20260709 13:18:01.517493 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:01.475839 19653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1090) took 1785 ms (client timeout 1674 ms). Trace:
W20260709 13:18:01.469280 19476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.030s	sys 0.029s
W20260709 13:18:01.774183 19476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.034s	sys 0.029s
I20260709 13:18:01.748371 19586 rpcz_store.cc:276] 0709 13:18:00.517768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.518024 (+   256us) service_pool.cc:224] Handling call
0709 13:18:01.597574 (+1079550us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400268c54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:01.597781 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493356928}
I20260709 13:18:01.760514 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:01.775172 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 834005us
W20260709 13:18:01.599587 19506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1373) took 1436 ms (client timeout 1608 ms). Trace:
I20260709 13:18:01.612080 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:01.747879 19658 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
W20260709 13:18:01.981973 19585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.027s	sys 0.032s
W20260709 13:18:02.114559 19585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.030s	sys 0.035s
I20260709 13:18:01.754588 19512 rpcz_store.cc:276] 0709 13:18:00.734316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.734439 (+   123us) service_pool.cc:224] Handling call
0709 13:18:01.753823 (+1019384us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54001e0d54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:01.754006 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208284928}
I20260709 13:18:01.784191 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:01.752725 19654 rpcz_store.cc:269] 0709 13:18:00.381660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.382074 (+   414us) service_pool.cc:224] Handling call
0709 13:18:01.751857 (+1369783us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b54000adf54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:01.752025 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1654079232}
I20260709 13:18:02.116503 19511 raft_consensus.cc:2393] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 4: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:01.778934 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:01.817051 19408 catalog_manager.cc:5697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 2, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 2 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:01.851227 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 333310us
I20260709 13:18:01.806247 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1385) took 1071 ms. Trace:
W20260709 13:18:01.773304 19653 rpcz_store.cc:269] 0709 13:17:59.690133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.693024 (+  2891us) service_pool.cc:224] Handling call
0709 13:18:01.475548 (+1782524us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54002189d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:01.475744 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148541440}
W20260709 13:18:02.113580 19506 rpcz_store.cc:269] 0709 13:18:00.162822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.166494 (+  3672us) service_pool.cc:224] Handling call
0709 13:18:01.599326 (+1432832us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b540012f554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:01.599509 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1795463936}
I20260709 13:18:01.855885 20845 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:02.120069 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:01.772236 19587 rpcz_store.cc:276] 0709 13:18:00.522000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.522108 (+   108us) service_pool.cc:224] Handling call
0709 13:18:01.771682 (+1249574us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b5400101154. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:01.771812 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1308711296}
I20260709 13:18:01.769271 19659 rpcz_store.cc:276] 0709 13:18:00.373186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.373361 (+   175us) service_pool.cc:224] Handling call
0709 13:18:01.754346 (+1380985us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b5400102f54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:01.754492 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864633728}
I20260709 13:18:02.118517 19504 rpcz_store.cc:276] 0709 13:18:00.734612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.735851 (+  1239us) service_pool.cc:224] Handling call
0709 13:18:01.805960 (+1070109us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b540003d4d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:01.806167 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1172696832}
I20260709 13:18:01.777040 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1075) took 1099 ms. Trace:
I20260709 13:18:02.120209 20845 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:01.408157 21048 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:01.925895 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:02.127004 19507 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:01.411158 20959 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:02.125428 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:02.121856 19584 rpcz_store.cc:276] 0709 13:18:00.652524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.653376 (+   852us) service_pool.cc:224] Handling call
0709 13:18:00.653790 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.837135 (+183345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:00.837183 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:00.837219 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:00.837246 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.751336 (+914090us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54002fc454. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:01.751402 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.751571 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421209472}
W20260709 13:18:01.773046 20989 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.011s	sys 0.011s
I20260709 13:18:01.426458 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:18:02.041497 21003 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.000s	sys 0.013s
W20260709 13:18:02.042181 20970 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.005s	sys 0.009s
I20260709 13:18:01.411258 20973 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:01.445868 21038 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:01.604487 21015 raft_consensus.cc:3055] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:02.117446 19508 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:02.131561 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:01.759205 21050 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:01.469137 21000 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:02.147933 20845 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:01.758948 20961 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:02.151232 19476 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:02.161737 20970 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.006s	sys 0.010s
I20260709 13:18:02.180521 19476 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:02.154222 20959 raft_consensus.cc:697] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:02.182370 19625 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.016s	sys 0.032s
W20260709 13:18:02.182757 19625 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.016s	sys 0.032s
I20260709 13:18:02.150290 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:01.860008 20876 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:01.967765 21033 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:01.859545 21054 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:02.112272 21046 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:01.927767 20995 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:01.439999 21012 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.720s
I20260709 13:18:02.158913 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:02.148866 20989 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.012s	sys 0.014s
I20260709 13:18:02.167419 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:02.169723 19653 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:01.850895 21006 consensus_queue.cc:1059] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.308s
W20260709 13:18:02.155520 21003 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.000s	sys 0.015s
I20260709 13:18:02.173064 20845 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:01.771189 21045 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:02.187507 19511 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 3: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:18:02.183073 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 847105us
I20260709 13:18:02.171823 21038 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:02.207146 19512 raft_consensus.cc:2368] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4.
I20260709 13:18:02.206943 20845 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.208602 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:02.212761 19654 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:02.177416 21015 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:02.177927 21050 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:02.183032 20930 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:02.219444 19625 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:02.213989 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:02.223146 19652 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:02.192853 20964 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:02.226588 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:02.227340 19659 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:02.229276 19625 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:02.232944 20845 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:02.237322 19653 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:02.207437 20986 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:02.183620 20961 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.232831 21043 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:02.224624 21050 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.247063 21043 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:02.221995 21033 raft_consensus.cc:697] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:02.222744 21028 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:02.229369 20996 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:02.189687 21000 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.199589 20876 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:02.215677 21046 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.286144 19652 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:02.218674 21038 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.266464 21015 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.254750 20986 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.291030 20979 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:02.290853 21028 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.238998 21057 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:18:02.220391 21054 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.254271 20959 consensus_queue.cc:237] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.294531 19659 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:02.232234 20995 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.220106 21045 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:02.230715 20930 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.266734 20996 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:02.373823 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 255387us
W20260709 13:18:02.374598 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 194162us
I20260709 13:18:02.389796 19509 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:02.385289 21072 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:02.308457 20957 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:02.308683 20984 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:02.368456 21077 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:02.379879 21015 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:02.389848 21064 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:18:02.392743 20996 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.390066 21067 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:18:02.437950 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 208719us
I20260709 13:18:02.441431 19625 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:02.393018 20978 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:02.414108 21074 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:02.440455 21079 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
W20260709 13:18:02.464386 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 70979us
I20260709 13:18:02.479808 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:02.413846 20957 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.417148 20984 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:02.491305 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 98368.5us
I20260709 13:18:02.492101 19476 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:02.492252 20983 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:02.493394 19476 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:02.411906 21072 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.476382 20979 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:02.290895 21043 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.510957 21069 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:02.514482 20983 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.420188 21077 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:02.511833 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:02.514509 21093 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:02.515750 21087 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:02.518114 21062 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.249s	user 0.000s	sys 0.003s
W20260709 13:18:02.520035 21061 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.301s	user 0.001s	sys 0.001s
I20260709 13:18:02.458860 20978 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.471964 20973 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:18:02.475821 21080 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:18:02.569267 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 127916us
I20260709 13:18:02.507050 21073 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:02.493659 21012 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 13:18:02.553231 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:02.554534 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:02.412254 21033 consensus_queue.cc:237] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.445605 21067 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.564121 21000 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.564958 20957 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.565302 21006 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:18:02.609830 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 56699.3us
I20260709 13:18:02.565887 20983 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.511301 21071 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:02.571192 19625 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:02.490897 21028 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:02.568213 20961 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.552376 20995 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.477586 21074 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.561909 21082 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:02.483980 21079 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:02.557152 21050 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:02.613591 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:02.614375 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:02.567840 21086 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:02.617890 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:02.618261 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 47192.8us
I20260709 13:18:02.619616 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:02.620726 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:02.575330 20973 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:02.614584 20957 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:02.598191 21038 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.572813 21080 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.559489 21069 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.600982 21085 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:02.602063 19584 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 4.
I20260709 13:18:02.644042 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1331) took 1394 ms. Trace:
I20260709 13:18:02.664435 21050 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:02.664510 19652 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:02.617033 21000 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:02.610529 20964 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:02.665704 19656 raft_consensus.cc:2393] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 4: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:02.665309 19653 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:02.687687 21046 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.666939 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1332) took 1416 ms. Trace:
I20260709 13:18:02.668756 19658 raft_consensus.cc:2393] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:02.648871 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:02.648164 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:02.666167 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:02.665024 20876 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:02.670537 19625 leader_election.cc:400] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3.
I20260709 13:18:02.663661 21087 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:02.671165 21086 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.637427 21082 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.671742 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:02.637693 20986 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.672465 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:02.664374 21083 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:02.674566 21072 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:02.602151 21073 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.650488 21071 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.620870 21028 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.635080 20979 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:02.677211 21048 consensus_meta.cc:287] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.548s	user 0.001s	sys 0.007s
I20260709 13:18:02.618268 21081 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:02.665355 20930 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.627581 20983 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:02.644148 21090 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:02.622835 21094 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:02.623901 21054 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:02.645663 21077 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:02.621156 20961 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:02.621516 20995 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:02.678879 20984 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.618682 21006 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.769507 20983 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.778661 21006 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.679975 20973 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.778863 21067 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.687624 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:02.763427 21048 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6.
I20260709 13:18:02.763005 21081 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:02.711426 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:02.740628 19410 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48826 (request call id 176) took 3320 ms. Trace:
I20260709 13:18:02.751950 19625 leader_election.cc:403] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:02.711944 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:02.719024 19652 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:02.785732 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:02.786056 21069 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.786415 20973 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.752045 21045 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.760331 21087 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.772598 21090 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.787207 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:02.718806 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:02.788857 21090 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.757555 21086 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:02.757202 19659 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:02.759939 21082 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:02.759931 21084 log.cc:927] Time spent T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:18:02.760381 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 151932us
I20260709 13:18:02.755226 19582 rpcz_store.cc:276] 0709 13:18:01.250566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.250728 (+   162us) service_pool.cc:224] Handling call
0709 13:18:01.251105 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.251533 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.251562 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.252148 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.746224 (+494076us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:01.746265 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.746337 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.666641 (+920304us) raft_consensus.cc:1685] finished
0709 13:18:02.666670 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.666850 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":73,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":265229,"threads_started":1,"wal-append.queue_time_us":868809}
I20260709 13:18:02.698776 21085 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.750144 20959 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.753528 20964 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.774551 19476 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:02.705367 21050 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.779098 20983 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.780690 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:02.796468 19654 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:02.699627 19585 rpcz_store.cc:276] 0709 13:18:01.249598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.249810 (+   212us) service_pool.cc:224] Handling call
0709 13:18:01.256353 (+  6543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.256817 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.256865 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.257465 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.115062 (+857597us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:02.115105 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.115178 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.517479 (+402301us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:18:02.634040 (+116561us) raft_consensus.cc:1685] finished
0709 13:18:02.634065 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.643953 (+  9888us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":671,"raft.queue_time_us":99,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":2767,"spinlock_wait_cycles":255958784,"thread_start_us":852169,"threads_started":1,"wal-append.queue_time_us":946532}
W20260709 13:18:02.601585 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 121900us
I20260709 13:18:02.798591 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:02.798668 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:02.681588 21079 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:02.799608 19659 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
W20260709 13:18:02.801852 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 135538us
I20260709 13:18:02.788914 21087 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:02.710016 20631 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:18:02.750572 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:18:02.808836 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 104590us
I20260709 13:18:02.775437 20961 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.775784 20995 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:02.791038 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:02.813338 19652 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
W20260709 13:18:02.814992 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.804049 19476 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:02.801291 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:02.760218 21028 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.772387 21094 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.808785 21095 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.802647 19625 leader_election.cc:400] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5.
I20260709 13:18:02.816787 19476 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:02.817407 21070 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:02.806819 21048 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3.
I20260709 13:18:02.820410 19625 leader_election.cc:403] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:02.821450 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:02.821705 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:02.819494 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:02.822858 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:02.805748 21000 raft_consensus.cc:697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:02.823282 19476 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:02.807927 20983 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:02.823246 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:02.811832 21069 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:02.833705 21085 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.833946 21069 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.834342 21069 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:02.815634 20995 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:02.826292 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:02.819062 21045 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:02.801165 20964 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.830299 20961 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.831317 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:02.831630 20996 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.832525 20930 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.827000 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:02.826205 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:02.828047 19625 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:02.827430 19584 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:02.828473 20984 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:02.869783 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:02.783847 19410 rpcz_store.cc:276] 0709 13:17:59.402022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.402198 (+   176us) service_pool.cc:224] Handling call
0709 13:18:02.722120 (+3319922us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:59.683364 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:59.867999 (+184635us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:59.871516 (+  3517us) write_op.cc:435] Acquired schema lock
0709 13:17:59.874807 (+  3291us) tablet.cc:662] Decoding operations
0709 13:17:59.918569 (+ 43762us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:59.922017 (+  3448us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:59.927014 (+  4997us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:59.953738 (+ 26724us) tablet.cc:701] Row locks acquired
0709 13:17:59.953766 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:17:59.953966 (+   200us) write_op.cc:270] Start()
0709 13:17:59.954116 (+   150us) write_op.cc:276] Timestamp: P: 1783603079953910 usec, L: 0
0709 13:17:59.954147 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:18:00.059492 (+105345us) log.cc:844] Serialized 543 byte log entry
0709 13:18:00.597243 (+537751us) op_driver.cc:464] REPLICATION: finished
0709 13:18:01.065653 (+468410us) write_op.cc:301] APPLY: starting
0709 13:18:01.083182 (+ 17529us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:01.090034 (+  6852us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:01.109424 (+ 19390us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:01.115817 (+  6393us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:01.116048 (+   231us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:01.116121 (+    73us) write_op.cc:312] APPLY: finished
0709 13:18:01.116390 (+   269us) log.cc:844] Serialized 22 byte log entry
0709 13:18:01.116621 (+   231us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:01.116732 (+   111us) write_op.cc:454] Released schema lock
0709 13:18:01.116789 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:01.245045 (+128256us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b54002ec7d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c31755e28 00007f6c35190581 00007f6c3518fd58 00007f6c351949f1 00007f6c351949a9 00007f6c35194939 00007f6c35194901 00007f6c35193b2d 000000000038f354 000000000038f199
0709 13:18:01.245271 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:01.245302 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":451766,"apply.run_cpu_time_us":2648,"apply.run_wall_time_us":62106,"num_ops":1,"prepare.queue_time_us":191376,"prepare.run_cpu_time_us":16537,"prepare.run_wall_time_us":1575560,"raft.queue_time_us":52248,"raft.run_cpu_time_us":216461,"raft.run_wall_time_us":345056,"replication_time_us":642891,"spinlock_wait_cycles":43361536,"thread_start_us":682195,"threads_started":4,"wal-append.queue_time_us":255660,"wal-append.run_cpu_time_us":25029,"wal-append.run_wall_time_us":1798710}]]}
I20260709 13:18:02.873709 19584 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:02.850837 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:02.822132 21090 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:02.860323 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:02.863968 19659 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:02.877815 19652 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:02.838819 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:02.868350 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:02.870791 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:02.871378 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:02.795418 20959 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.827353 21071 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.855111 21045 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:02.860401 21041 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:02.837378 21077 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5.
I20260709 13:18:02.826063 21092 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:02.876189 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:02.826166 21095 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.827107 21070 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:02.854182 21081 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.333678 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.103595 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:02.879958 19506 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:02.949429 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:03.343868 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:02.895340 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.105098 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:03.107005 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1395) took 1600 ms. Trace:
I20260709 13:18:02.862949 21104 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:02.882352 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:03.104404 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:03.348611 19509 rpcz_store.cc:276] 0709 13:18:01.506696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.115389 (+608693us) service_pool.cc:224] Handling call
0709 13:18:03.106750 (+991361us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b5400081454. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:03.106920 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618722176}
I20260709 13:18:03.350618 19656 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:03.351261 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.351951 19509 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:18:03.351557 21092 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.352800 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:02.956384 21003 raft_consensus.cc:3055] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:03.349285 19503 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:18:02.871807 20964 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.958407 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:03.354454 19660 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:03.108047 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:03.067224 21102 log.cc:927] Time spent T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:18:03.353863 21003 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:02.860235 20986 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:03.355338 19503 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:03.355921 20986 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:03.356398 20986 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.356166 21003 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.357259 21003 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.359786 21092 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:03.360419 21092 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.360554 21070 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:03.360925 21092 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.125849 21050 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:03.363044 21092 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:02.873800 20930 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.344234 19659 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:18:03.355157 19504 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.347515 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:03.367753 21094 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:03.095371 20996 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:03.367321 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.102645 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.344875 19508 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:03.389281 19507 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:03.389901 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.390218 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.391153 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.391373 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.391901 19508 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:18:03.393293 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.250190 21088 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:03.393736 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.250401 21082 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.377568 21041 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:03.377866 21057 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.879323 19511 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:03.397960 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.398641 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.364297 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.399871 19508 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:18:03.044916 21058 log.cc:927] Time spent T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.743s	user 0.000s	sys 0.003s
W20260709 13:18:03.135443 21109 log.cc:927] Time spent T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:18:03.291285 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 490041us
I20260709 13:18:03.381078 21045 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.011119 21073 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:02.942384 20973 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.438233 20973 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.369145 19510 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:03.259408 21086 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.391919 19507 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:03.000725 21000 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.401688 21092 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:03.375533 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.395224 19503 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:03.386041 19625 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.129:38645 timed out after 1.973s (SENT) [suppressed 3 similar messages]
I20260709 13:18:02.875159 21033 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.889070 20979 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:03.355541 21028 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:03.058274 20978 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:03.410187 19505 raft_consensus.cc:2368] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3.
I20260709 13:18:02.907534 21080 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:03.428896 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:03.441537 19551 connection.cc:256] RPC call timeout handler was delayed by -1.5280569040000955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
I20260709 13:18:03.460727 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.327929 21074 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:02.943590 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 81490.4us
I20260709 13:18:03.436964 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:03.395388 20876 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:03.435140 20989 raft_consensus.cc:1064] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:18:03.394134 21088 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:18:03.455981 19504 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:03.473347 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.473441 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:03.475953 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:03.469774 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:03.461170 19551 connection.cc:256] RPC call timeout handler was delayed by -1.3471569040000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
I20260709 13:18:03.478295 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:03.481346 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:03.485165 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:03.402580 21041 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.487342 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:03.488932 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:03.502712 20995 consensus_meta.cc:287] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.001s
I20260709 13:18:03.480379 20876 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.490571 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.491365 20930 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:03.455160 21033 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.464917 20959 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:03.480894 21071 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:03.495110 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.504734 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.404585 21057 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.402902 21082 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:03.503600 21015 consensus_meta.cc:287] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 1.064s	user 0.008s	sys 0.004s
I20260709 13:18:03.511691 21113 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:03.531034 19652 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:18:03.512326 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:03.504213 20973 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:03.518900 21086 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:03.520331 21063 log.cc:927] Time spent T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 1.231s	user 0.003s	sys 0.000s
I20260709 13:18:03.520929 21088 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:03.511929 21069 consensus_meta.cc:287] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.002s
I20260709 13:18:03.527704 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:03.528334 19660 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:03.466113 21092 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:03.531459 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 145442us
W20260709 13:18:03.514392 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 60164.6us
I20260709 13:18:03.503628 20995 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.536842 19654 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.548192 21057 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:03.537851 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:03.549849 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:03.550503 19659 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:03.553912 21082 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:03.556177 21092 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:03.538416 19625 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:03.528384 19511 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:03.652601 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:03.659478 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 121011us
I20260709 13:18:03.661137 19625 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
W20260709 13:18:03.667505 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 177239us
I20260709 13:18:03.677560 20845 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:03.677937 20978 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:03.678934 20978 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:03.679178 20845 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:03.679575 20978 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:03.680205 20845 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.542570 20876 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:03.682585 20911 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.683136 20876 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:03.683357 20911 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.684005 20876 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.691995 20876 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:03.721029 19654 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:03.729197 19657 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:18:03.740984 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 79925.7us
I20260709 13:18:03.745572 20911 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:03.748047 20845 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:03.741580 19510 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:03.531243 21071 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.537675 21069 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.542716 21095 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:03.760440 20995 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:03.787663 21057 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.788074 21069 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:03.788509 21057 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.789049 21069 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.791803 20978 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.782339 21041 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:03.794396 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.795696 21071 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:03.797451 21045 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:03.797828 20986 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.762987 21033 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:03.780022 19625 leader_election.cc:400] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4.
I20260709 13:18:03.808806 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:03.809454 21045 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:03.810775 19625 leader_election.cc:403] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:03.812649 19582 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.821969 21041 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4.
I20260709 13:18:03.820464 21069 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.828542 21069 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:03.830505 20989 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:03.834134 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 78173.9us
I20260709 13:18:03.812013 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:03.834517 21057 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:03.825359 21124 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:18:03.842666 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.843799 21124 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:03.852726 21078 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 1.485s	user 0.004s	sys 0.000s
I20260709 13:18:03.852892 19582 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 5.
I20260709 13:18:03.856793 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:03.858449 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:03.859432 19660 raft_consensus.cc:2368] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
I20260709 13:18:03.862774 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:03.869266 20631 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:18:03.870918 19656 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:03.872054 19659 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:03.873023 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:03.869503 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:03.938915 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.939888 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:03.922693 20986 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:03.921468 21124 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:03.948887 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:03.948866 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:03.950661 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:03.947680 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 166168us
I20260709 13:18:03.942288 19625 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:03.973723 20903 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.974522 20903 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:03.975193 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1399) took 1109 ms. Trace:
I20260709 13:18:03.975658 19506 rpcz_store.cc:276] 0709 13:18:02.865863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.866039 (+   176us) service_pool.cc:224] Handling call
0709 13:18:02.866393 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.343105 (+476712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.974712 (+631607us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b5400207bd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:03.975008 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13696256}
I20260709 13:18:03.977191 20903 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:03.978505 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.979063 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:03.979885 19585 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:03.973488 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:03.956679 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 87700us
I20260709 13:18:03.980846 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:03.981048 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1121) took 1105 ms. Trace:
I20260709 13:18:03.981805 21123 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:03.982126 19580 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:03.983395 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:03.983592 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:03.983944 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1406) took 1116 ms. Trace:
I20260709 13:18:03.984503 19578 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:18:03.981510 19583 rpcz_store.cc:276] 0709 13:18:02.881685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.945881 (+1064196us) service_pool.cc:224] Handling call
0709 13:18:03.980979 (+ 35098us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:03.984311 19505 rpcz_store.cc:276] 0709 13:18:02.867811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.333292 (+465481us) service_pool.cc:224] Handling call
0709 13:18:03.983549 (+650257us) spinlock_profiling.cc:243] Waited 67.4 ms on lock 0x7b54002aadd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:03.983764 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154985728}
I20260709 13:18:03.920015 21046 raft_consensus.cc:2764] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:03.998596 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:03.941574 21081 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:04.000706 19582 raft_consensus.cc:2368] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
I20260709 13:18:03.981549 19585 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:04.001372 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:04.012552 20978 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:04.014086 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 71965.6us
I20260709 13:18:04.015074 19625 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:04.016738 19625 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:04.016904 19553 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:04.017151 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:04.017942 20978 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:04.018460 20978 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:04.018721 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.018985 20978 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:04.019541 19583 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:04.020592 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.020823 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.021196 19583 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:04.002756 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:04.029841 19656 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.986395 19579 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:04.005517 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:04.031512 21124 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:04.003405 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:04.035463 20973 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:04.034072 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:04.021790 19584 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:18:04.023432 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 97618.8us
I20260709 13:18:04.014137 21028 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:04.038815 21028 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:04.039242 20973 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:04.025132 21054 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:04.039654 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:04.026795 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:04.027652 19580 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:04.042438 19580 pending_rounds.cc:85] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 1
I20260709 13:18:04.042714 19580 pending_rounds.cc:107] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:04.016294 21049 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:04.043459 21049 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:04.043990 21049 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:04.021214 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1117) took 1194 ms. Trace:
I20260709 13:18:04.010687 21123 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 5 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:18:04.002354 19578 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:04.000356 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:04.037524 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:04.009305 19476 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:04.039333 21028 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.028585 19652 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:04.043025 19580 raft_consensus.cc:2889] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:04.025018 19625 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:04.045742 19586 rpcz_store.cc:276] 0709 13:18:02.826551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.871751 (+ 45200us) service_pool.cc:224] Handling call
0709 13:18:04.020123 (+1148372us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635eee 0000000000375939 00007f6c366a91e0 00007f6c367720c4 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:18:04.020402 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:04.020746 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:04.020772 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:04.020833 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:04.020860 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.020914 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:04.021022 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14406912}
I20260709 13:18:04.059162 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.055825 20986 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:04.072002 19625 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:04.073491 21043 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:04.073650 19625 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:04.073984 21043 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:04.074393 21043 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.065488 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:04.081952 21115 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:04.082499 21115 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:04.083033 21115 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.088646 20964 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:04.060933 21054 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:04.079782 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:04.099097 19586 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:04.103700 19625 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:04.107694 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 98810.3us
I20260709 13:18:04.108382 19551 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:04.112340 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.114938 19656 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:04.119700 21111 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:04.120348 21111 raft_consensus.cc:697] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:04.121639 21111 consensus_queue.cc:237] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:18:04.122962 19476 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:04.123947 20903 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:04.131523 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.116972 21054 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:04.143639 19625 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:04.140551 21054 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:04.151618 19580 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:18:04.155128 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 64036.2us
I20260709 13:18:04.151322 21054 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.160434 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.138492 21123 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:04.166513 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.168649 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:04.158353 20989 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:04.170403 20986 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:04.171128 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:04.174611 20986 raft_consensus.cc:697] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:18:04.176759 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 46694.4us
I20260709 13:18:04.175943 20666 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEARNER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:04.175982 20986 consensus_queue.cc:237] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:04.186112 19406 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 39) took 3591 ms. Trace:
I20260709 13:18:04.186583 19406 rpcz_store.cc:276] 0709 13:18:00.594537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.597821 (+  3284us) service_pool.cc:224] Handling call
0709 13:18:01.375661 (+777840us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54002ec7d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c4090 00007f6c31762f3a 00007f6c375191cc 00007f6c3761737e 00007f6c35ad82a4 00007f6c35ad8232 00007f6c35ad8161 00007f6c35ad80dc 00007f6c35ad7392 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:04.185893 (+2810232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":470099,"reported_tablets":1,"spinlock_wait_cycles":779918208}
I20260709 13:18:04.202155 19408 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48840 (request call id 163) took 4722 ms. Trace:
I20260709 13:18:04.207118 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.202005 21114 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:18:04.211972 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.214457 21046 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:04.215189 21046 raft_consensus.cc:697] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:04.216334 21046 consensus_queue.cc:237] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:04.222854 19627 leader_election.cc:336] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.553s (SENT)
I20260709 13:18:04.203589 19408 rpcz_store.cc:276] 0709 13:17:59.406037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.406982 (+   945us) service_pool.cc:224] Handling call
0709 13:18:04.118007 (+4711025us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:02.876393 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:03.055952 (+179559us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:03.056006 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:18:03.056033 (+    27us) tablet.cc:662] Decoding operations
0709 13:18:03.056487 (+   454us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:03.056585 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:03.056637 (+    52us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:03.056865 (+   228us) tablet.cc:701] Row locks acquired
0709 13:18:03.056886 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:18:03.057081 (+   195us) write_op.cc:270] Start()
0709 13:18:03.057216 (+   135us) write_op.cc:276] Timestamp: P: 1783603083057027 usec, L: 0
0709 13:18:03.057249 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:18:03.062430 (+  5181us) log.cc:844] Serialized 543 byte log entry
0709 13:18:03.451452 (+389022us) op_driver.cc:464] REPLICATION: finished
0709 13:18:03.495839 (+ 44387us) write_op.cc:301] APPLY: starting
0709 13:18:03.495926 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:03.496032 (+   106us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:03.496149 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:03.496389 (+   240us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:03.496560 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:03.496612 (+    52us) write_op.cc:312] APPLY: finished
0709 13:18:03.496826 (+   214us) log.cc:844] Serialized 22 byte log entry
0709 13:18:03.497824 (+   998us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:03.497908 (+    84us) write_op.cc:454] Released schema lock
0709 13:18:03.497944 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:03.921305 (+423361us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b180038d4c0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d522 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:18:03.922531 (+  1226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:03.922592 (+    61us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1078746,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":44094,"apply.run_cpu_time_us":1621,"apply.run_wall_time_us":2431,"num_ops":1,"prepare.queue_time_us":86059,"prepare.run_cpu_time_us":13144,"prepare.run_wall_time_us":532967,"raft.queue_time_us":56793,"raft.run_cpu_time_us":10832,"raft.run_wall_time_us":47232,"replication_time_us":393946,"spinlock_wait_cycles":5726464,"thread_start_us":446118,"threads_started":4,"wal-append.queue_time_us":330033}]]}
I20260709 13:18:04.225780 21114 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:04.226598 21114 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:04.201083 19625 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:04.231292 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:04.201979 20978 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:04.233852 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.234530 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:04.235337 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 61649.4us
I20260709 13:18:04.236147 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.236258 21083 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:04.237751 19625 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:04.232066 21114 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:04.237941 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:04.231159 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 60249.5us
I20260709 13:18:04.173751 20989 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:18:04.248364 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:04.253677 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51932.6us
I20260709 13:18:04.271672 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:04.271654 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:04.273972 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:04.285400 19580 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:04.245477 20989 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.289140 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:04.290326 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:04.292498 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.299453 20619 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:04.245158 21028 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:04.311641 21028 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:04.272677 21115 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:04.308753 19476 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:04.301465 21129 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:04.319082 19625 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:04.324218 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.331008 20664 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 5 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:04.330874 20974 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:04.319387 21114 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:04.322293 20903 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:04.312721 21083 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:18:04.334784 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.334547 21114 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:04.345332 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.349489 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:04.340672 20974 raft_consensus.cc:697] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:04.361955 20974 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:04.364154 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:04.359216 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 66051.2us
I20260709 13:18:04.350603 21114 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:04.369724 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.368186 21111 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:04.401867 19586 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:18:04.381048 20978 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:04.384500 21111 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.421882 21111 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:04.432962 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:04.434056 20903 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:04.434500 20903 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:04.434934 20903 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:04.434979 19476 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:04.442168 21057 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:04.442736 21057 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:04.443173 21057 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.443401 20903 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:04.445850 20903 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:04.446341 19476 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:04.447185 20903 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:04.447885 20903 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:04.449396 19625 leader_election.cc:400] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3.
I20260709 13:18:04.449812 19625 leader_election.cc:403] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:04.451954 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:04.452900 21077 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3.
I20260709 13:18:04.453193 19504 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:04.452157 20970 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:18:04.448853 20903 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.459652 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:04.459988 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:04.460274 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:04.461119 19505 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:18:04.463550 20903 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:04.417944 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.419579 21049 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:04.464486 19503 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:04.465912 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:04.410368 21115 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:04.475335 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 68157.7us
I20260709 13:18:04.494316 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:04.492471 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 45149us
I20260709 13:18:04.501924 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:04.507875 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:04.509722 19509 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:04.510028 20903 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:04.511359 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:04.497735 21115 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.517771 20986 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:04.517562 21115 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:04.518236 20986 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:04.518711 20986 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.520586 21115 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:04.522747 19658 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:04.524300 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.524967 19586 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:04.525295 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.525995 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.526655 19587 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:04.527272 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.528374 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.528575 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.529752 19581 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:04.530004 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.531876 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:04.530745 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:04.535674 19581 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:04.537438 19586 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:04.541811 19583 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:18:04.542850 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:04.543497 19504 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.543989 19579 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:04.546705 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.549891 21049 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:04.553099 19504 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:04.558826 19587 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:04.560472 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.563076 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:04.573503 19584 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:04.578473 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:04.580084 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 46150.7us
I20260709 13:18:04.566047 21115 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:04.586864 21115 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:04.581940 21144 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:18:04.595486 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:04.596472 21114 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:04.597803 21111 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:04.586243 21134 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.308s	user 0.002s	sys 0.004s
I20260709 13:18:04.597890 19510 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:04.584118 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:04.586817 21043 consensus_meta.cc:287] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.008s
I20260709 13:18:04.617152 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.601845 21115 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:04.608925 20973 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:04.645727 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1171) took 1227 ms. Trace:
I20260709 13:18:04.645448 19476 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:04.648530 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 53159.6us
I20260709 13:18:04.646342 19658 rpcz_store.cc:276] 0709 13:18:03.411470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.985551 (+574081us) service_pool.cc:224] Handling call
0709 13:18:04.048063 (+ 62512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:04.523161 (+475098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.630905 (+107744us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b5400103454. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:04.639168 (+  8263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1009069824}
W20260709 13:18:04.634084 21141 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.118s	user 0.000s	sys 0.005s
I20260709 13:18:04.606365 21054 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:04.658898 21157 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:04.643648 20973 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:04.656729 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:04.617967 21043 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:04.664849 20974 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:18:04.666381 21146 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:04.683485 21057 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:04.675055 21114 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:04.661798 20973 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.683487 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.686676 19476 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:04.683773 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.680779 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.682839 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.679965 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:04.682088 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:04.694960 19627 leader_election.cc:336] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.961s (SENT)
I20260709 13:18:04.678978 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.655354 21115 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:04.685853 21148 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:04.702418 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:04.677136 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.738766 20970 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.748637 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:04.752995 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:04.754455 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:04.753510 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 66950.3us
I20260709 13:18:04.758884 20970 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:04.759949 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:04.760103 21057 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:04.760605 19510 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:04.763012 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:04.764110 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 106347us
I20260709 13:18:04.671833 21149 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:18:04.689532 20964 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:18:04.786825 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:04.792631 21043 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:04.774417 21115 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:04.799050 20970 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:04.799057 21111 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:04.757589 21148 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:04.840216 21148 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:04.841436 20973 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:04.842752 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:04.843403 19508 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:04.843595 20973 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:04.845175 19579 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:04.848626 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:04.814560 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 71781.2us
I20260709 13:18:04.816299 19476 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:04.818809 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 123877us
I20260709 13:18:04.738915 20986 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:04.822741 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:04.828676 19510 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:04.742334 20974 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:04.831321 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 55885.6us
I20260709 13:18:04.834844 21054 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:04.836602 21115 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:04.837220 21149 consensus_queue.cc:1243] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer 068c03c9dcc848e6bf909131b1f83065 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:18:04.823191 20989 consensus_meta.cc:287] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.008s
I20260709 13:18:04.838325 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:04.855461 19625 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:04.859925 19506 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:04.860165 21151 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:04.860652 21124 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:04.871243 20666 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 1 LEARNER]: Advancing to term 3
I20260709 13:18:04.869948 21153 raft_consensus.cc:2764] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:04.891144 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:04.891584 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:04.892885 19507 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:04.872184 19476 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:04.894986 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:04.895166 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:04.897127 19625 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:04.897676 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:04.897819 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:04.864310 21151 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:04.900154 21083 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:04.901047 21083 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:04.897403 20974 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:04.900071 21150 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:04.909200 19625 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:04.909493 21150 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:04.910140 21150 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.915446 20986 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:04.918018 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:04.919574 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:04.920984 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:04.923993 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:04.866087 20989 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:04.927480 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.928630 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.929721 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:04.930348 19655 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:04.908494 21151 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:04.933022 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.934194 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.899215 21115 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:04.935812 21115 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:04.936228 21115 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:04.939004 19408 catalog_manager.cc:5697] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 1 to 3, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 3 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:04.944311 19408 catalog_manager.cc:5697] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:04.949249 19408 catalog_manager.cc:5697] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 4 to 5, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 5 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:04.932175 20666 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEARNER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:04.954547 19408 catalog_manager.cc:5697] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 3 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:04.899085 21043 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:18:04.927328 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:04.965148 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.940559 19476 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:04.945676 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:04.946460 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:04.947124 19582 raft_consensus.cc:2393] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:04.947716 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:04.948153 20903 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:04.925297 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:04.956178 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:04.957692 19656 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:04.958699 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:04.962188 20974 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:04.962644 21114 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:04.974658 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 52848.7us
I20260709 13:18:04.929396 20989 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:04.960623 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 49732.7us
I20260709 13:18:04.966622 21150 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:04.976598 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 47329.6us
I20260709 13:18:04.982919 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:04.984361 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.985004 19586 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:18:04.980585 19653 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
W20260709 13:18:04.988363 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 47993.9us
I20260709 13:18:04.986440 19478 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:04.993638 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:04.998054 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:05.007169 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:05.009454 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:04.973690 20903 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:05.013433 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:05.015159 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:05.018489 21150 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:05.019479 19476 leader_election.cc:400] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
I20260709 13:18:05.019827 19476 leader_election.cc:403] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:04.964061 21148 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:04.985967 20974 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:04.994875 21153 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.025859 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:05.038105 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:05.013111 21057 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:05.048087 19660 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:05.050112 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:05.053102 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:04.988430 21111 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
W20260709 13:18:05.055001 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 73317.8us
I20260709 13:18:05.055997 19625 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:05.025532 21148 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:05.058570 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:05.040210 21152 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:05.063745 21156 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:05.060580 20970 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:05.070785 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:05.072340 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:05.072690 19658 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:05.073691 19656 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:05.051574 21057 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:05.054937 21150 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
I20260709 13:18:05.094189 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:05.096266 19652 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:05.056941 21153 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.108026 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:05.127490 21149 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:05.092033 20986 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:05.095685 21057 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:05.094767 21168 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:05.109413 21167 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:05.159813 21159 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:05.158268 21043 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:18:05.180968 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 121908us
I20260709 13:18:05.106594 20903 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:05.176710 21054 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:05.191833 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:05.192019 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 84083.9us
I20260709 13:18:05.135412 20974 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.194145 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:05.202248 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 76805.2us
I20260709 13:18:05.190138 20970 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:05.178270 21115 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.209136 20903 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.213562 21083 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:05.216827 21151 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:05.217638 21166 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.099s	user 0.001s	sys 0.001s
I20260709 13:18:05.199288 21043 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.227131 19660 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:05.206913 21159 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:05.229657 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 250026us
I20260709 13:18:05.220944 21153 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:05.205365 21054 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:18:05.230670 21159 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:05.253949 19476 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:05.250250 21159 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.259541 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:05.260545 21179 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:05.260986 21179 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:05.261359 21179 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:05.261706 21111 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:05.263463 21168 consensus_queue.cc:1059] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:05.264530 21111 raft_consensus.cc:3055] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:05.264900 21111 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:05.264997 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:05.265792 21168 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:05.265991 21111 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.267086 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:05.267894 21168 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:05.267464 21111 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.273130 21054 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:05.273590 21179 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.275388 21115 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:05.275765 21179 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:05.268533 19551 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:05.279232 21179 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:05.280406 20973 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:05.280681 21179 consensus_queue.cc:1059] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:05.281610 21168 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:05.282156 21168 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:05.282320 21179 raft_consensus.cc:3055] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:05.282771 21179 raft_consensus.cc:740] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:05.283557 21179 consensus_queue.cc:260] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.283798 21168 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.284914 21179 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.285856 21168 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:05.287509 21043 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:05.291460 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:05.300997 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:05.317308 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 79240.8us
I20260709 13:18:05.318231 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:05.332747 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 142825us
I20260709 13:18:05.332108 21046 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:05.335568 19627 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:05.336836 19627 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:05.322203 20986 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:05.337406 21054 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:05.352370 19478 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:05.356801 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:05.330716 21149 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:05.365512 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:05.365584 19627 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:05.366683 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:05.362324 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:05.369973 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:05.370234 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:05.371053 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:05.371845 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:05.372674 19503 raft_consensus.cc:2393] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 4: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:05.343500 21152 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:05.374397 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:05.300091 21159 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.335615 21177 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:05.358057 21054 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:05.386816 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:05.382494 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:05.384876 19504 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:05.387991 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:05.389039 21176 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:05.389343 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:05.390107 19658 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 4: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:05.390336 19660 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:05.385716 21149 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.396181 21149 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:05.396588 19627 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:05.396797 21153 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:05.398402 21159 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:05.385941 21081 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:05.398926 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:05.376055 21152 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.399823 21152 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.399241 21081 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:05.403890 21114 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:05.404377 21114 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.404767 21114 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.323979 20970 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.406558 19509 raft_consensus.cc:2410] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:05.374015 20964 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:05.412199 19656 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.375555 20986 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:05.410003 21148 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.419780 21178 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:05.414705 21157 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:05.419824 21185 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.420717 21157 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:05.419994 21148 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.423218 21148 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:05.423138 21176 consensus_queue.cc:1059] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:18:05.423939 19508 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.424867 21111 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:05.425235 21111 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:05.381505 21177 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:05.410472 21081 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.427187 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:05.426098 20989 raft_consensus.cc:3055] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:05.402074 21054 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:05.405429 21115 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:05.413170 21159 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:05.476176 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:05.436683 21177 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.419945 21043 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:05.476893 19509 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:05.473837 20964 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.447501 21153 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:05.501050 19656 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:05.503851 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:05.481501 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 80152.1us
I20260709 13:18:05.440165 20989 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:05.505831 19656 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:05.506250 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:05.507148 19652 raft_consensus.cc:2393] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 4: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:05.513593 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:05.514544 20964 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:05.515050 21183 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.097s	user 0.001s	sys 0.001s
I20260709 13:18:05.509042 21151 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:05.519572 19509 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.520833 19508 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:05.526427 21046 raft_consensus.cc:1064] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
W20260709 13:18:05.526950 21046 raft_consensus.cc:1068] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Unable to promote non-voter 068c03c9dcc848e6bf909131b1f83065: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:18:05.503129 21111 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.531056 20989 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.532191 20989 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.532289 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:05.532824 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:05.536151 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:05.540936 21152 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.542039 19510 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:05.542104 21153 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.420766 21185 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.510344 21043 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.558655 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:05.561489 19504 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:18:05.555999 19509 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:05.556380 19478 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:05.555238 19655 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:05.586151 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:05.595628 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:05.596666 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.597891 19656 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:05.565027 21057 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.581822 21172 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:05.594988 21149 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:05.622634 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:05.622959 19656 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:05.634949 19511 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 2: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:18:05.636060 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 222279us
I20260709 13:18:05.596966 21049 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:18:05.627602 21173 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:05.644873 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.645813 21181 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:05.646456 21181 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:05.646966 21181 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:05.650568 21185 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:05.655812 20964 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:05.656040 21057 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:05.657835 21179 consensus_queue.cc:1059] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:05.659431 21152 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:05.686262 19504 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:05.686537 19509 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:05.614514 21148 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:18:05.677333 19659 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:05.677820 21157 consensus_queue.cc:1059] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:05.679072 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:05.681067 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:05.691608 19661 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:18:05.693578 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 93111.8us
I20260709 13:18:05.689383 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:05.699121 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:05.707195 19508 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:05.707989 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:05.708762 19505 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:05.710632 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:05.679874 21071 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:18:05.713801 21071 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:05.714318 21071 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:05.712252 21081 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.718616 19625 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:05.718679 19661 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:05.671103 21167 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:18:05.724833 21057 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.725680 21057 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.728097 21054 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.728425 21057 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:05.729599 19653 raft_consensus.cc:2410] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:05.735302 19657 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:05.696919 21111 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.733902 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:05.739185 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:05.737800 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 129093us
I20260709 13:18:05.762784 19655 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.738312 19625 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:05.696904 21123 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:05.673933 21176 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
W20260709 13:18:05.762641 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 61799.7us
I20260709 13:18:05.748840 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:05.763438 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:05.762436 19656 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:05.767973 19625 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:05.771970 20974 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:05.772528 20974 raft_consensus.cc:697] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:18:05.782371 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 48562.9us
I20260709 13:18:05.715447 21071 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.784543 19656 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:05.761909 21193 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:05.681847 21172 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:05.719491 21173 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:18:05.790534 19661 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:05.786537 19653 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:05.793355 19512 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:05.771596 21043 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:05.773401 20970 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:05.810489 20970 raft_consensus.cc:697] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:05.811803 20970 consensus_queue.cc:237] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.809231 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:05.820325 21071 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.822732 21167 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:05.789793 21185 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:18:05.762367 21157 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:05.827155 21157 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:05.783517 21123 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:05.835578 21123 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:05.839413 21159 raft_consensus.cc:3055] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:05.839900 21159 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:05.801097 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:05.806890 19507 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:05.807482 19504 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:05.842360 19505 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:05.794819 21179 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:05.808292 21172 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:05.792335 21193 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:05.847405 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 47378.7us
I20260709 13:18:05.795307 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:05.829288 21198 raft_consensus.cc:3055] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:05.784868 20964 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:05.885670 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 90419.1us
I20260709 13:18:05.858935 19655 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:05.889784 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:05.891613 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:05.893052 19510 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:05.825403 21207 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:05.907480 21203 log.cc:927] Time spent T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 13:18:05.853034 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 51658.9us
I20260709 13:18:05.912757 21169 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:05.912907 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:05.913329 21169 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:05.914324 21169 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.889636 21168 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:05.915784 21169 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.918790 21081 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:05.919304 21202 log.cc:927] Time spent T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:18:05.840831 21159 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:05.925985 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 156731us
I20260709 13:18:05.927529 19627 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:05.921000 19476 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:05.931456 19476 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:05.935509 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:05.855252 21193 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.886698 21198 raft_consensus.cc:740] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:18:05.954069 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 172056us
I20260709 13:18:05.963706 19506 raft_consensus.cc:1240] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:05.967092 19627 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:05.934607 21043 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:05.937677 21172 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:05.965346 19625 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:05.897214 21179 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.974233 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:05.935125 21157 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:05.943120 21159 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.960546 21204 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:05.990291 21199 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:05.990772 21199 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:05.991287 21199 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.990944 21198 consensus_queue.cc:260] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.992380 21198 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.992419 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:05.993021 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:05.894433 20974 consensus_queue.cc:237] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:05.950637 20964 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:05.932839 21081 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:18:05.988356 19627 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:05.983927 21168 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:05.936975 21207 raft_consensus.cc:697] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:05.974239 21054 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:05.964911 21167 consensus_queue.cc:1059] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:18:06.003113 19506 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:18:06.007202 19506 pending_rounds.cc:85] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 2
I20260709 13:18:06.007472 19506 pending_rounds.cc:107] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:18:06.007754 19506 raft_consensus.cc:2889] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:05.982336 21115 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:06.001672 19659 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:05.976768 21172 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:05.998558 20964 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:06.023480 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:06.004374 21043 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:05.973446 21046 consensus_queue.cc:1059] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 13:18:06.015821 21114 consensus_meta.cc:287] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.000s
I20260709 13:18:06.029665 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:06.012445 21172 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:06.013252 21204 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:06.033761 19507 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:06.016361 20989 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:06.049383 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:06.059132 19660 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:06.047223 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:06.003914 20986 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:18:06.030620 20964 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:06.006851 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:06.061882 21181 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:06.073285 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 56561.7us
I20260709 13:18:06.073509 19661 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:06.074203 19627 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:06.035605 21114 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.060012 21204 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.091204 19656 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:06.091698 21114 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:06.092502 21210 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:18:06.035655 21043 raft_consensus.cc:697] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:06.094077 21181 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:06.094379 21043 consensus_queue.cc:237] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:06.097903 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 98476.5us
I20260709 13:18:06.098132 21182 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:06.113273 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:06.119861 19476 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:06.122704 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:06.124595 19657 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:06.121676 20903 consensus_queue.cc:1059] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:18:06.119040 20986 consensus_queue.cc:1243] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:18:06.134600 21177 consensus_meta.cc:287] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.634s	user 0.007s	sys 0.004s
I20260709 13:18:06.122678 21179 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:06.149833 21221 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:18:06.150312 21179 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:06.150853 21179 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.152042 21221 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:06.152495 21221 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:06.142298 19627 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:06.144080 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:06.145478 21071 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:06.145346 21167 consensus_queue.cc:1059] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:06.146031 21180 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:06.146457 21225 raft_consensus.cc:1064] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:18:06.147228 21153 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:06.142062 21081 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.135969 21168 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:06.116911 21124 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:18:06.153262 21179 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:06.170645 21222 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:06.163220 21223 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:06.177875 19627 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:06.164328 21071 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:06.189251 21153 raft_consensus.cc:3055] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:06.153540 21221 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.172552 21148 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:06.172487 21180 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.176090 21167 consensus_queue.cc:1243] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:06.174439 21115 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:06.183751 21081 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:06.210389 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 201973us
I20260709 13:18:06.211269 19627 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:06.212069 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 177755us
I20260709 13:18:06.213589 19627 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:06.215216 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:06.208406 21071 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.216216 21212 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:06.216529 21071 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:06.216634 21212 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:06.217249 21212 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.217907 21221 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:06.220491 19627 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:06.222136 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:06.214375 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:06.164757 21177 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.226512 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:06.202600 21190 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:06.230908 21226 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:06.122437 21207 consensus_queue.cc:237] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.202527 21153 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:06.208528 21148 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.212634 21180 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:06.220974 21081 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:06.213822 20989 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:06.200407 21168 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.273394 19656 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:06.275647 19652 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:06.207543 21172 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.278370 19478 leader_election.cc:400] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3.
I20260709 13:18:06.278578 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:06.235688 21167 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:06.267081 21148 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:06.283838 21224 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:06.284674 19478 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:06.285568 21149 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:06.286906 19478 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:06.277385 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 157803us
I20260709 13:18:06.273739 21124 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:06.288687 21172 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:06.288805 21124 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:06.289595 21149 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:06.283778 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:06.299739 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 133639us
I20260709 13:18:06.319440 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:06.322966 19627 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:06.324019 21172 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:06.324587 19627 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:06.325685 21230 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:06.326608 21173 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:06.328580 21167 raft_consensus.cc:697] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:18:06.329176 21225 raft_consensus.cc:1068] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Unable to promote non-voter 068c03c9dcc848e6bf909131b1f83065: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:18:06.332886 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:06.334419 19478 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:06.338016 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:06.338515 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.344027 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:06.344750 19581 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:18:06.300858 21149 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:06.339310 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:06.366060 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.371722 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:06.375316 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:06.380590 19584 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:06.381007 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:06.381862 19579 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:06.341878 21204 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:06.386492 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:06.383095 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 48748.2us
I20260709 13:18:06.368598 21149 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:06.394168 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:06.397954 19585 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:06.202654 21222 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.406348 19627 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:06.382762 21043 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:06.375614 21238 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:06.338202 21153 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.465245 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:06.326260 21230 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:06.468976 19579 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:06.468441 21049 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:06.478164 21049 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:06.478615 21049 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:06.482358 21236 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:18:06.482739 21168 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:06.483541 21237 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:06.483994 21237 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:06.484356 21237 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:06.484462 21124 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:06.468040 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 61814.1us
W20260709 13:18:06.468984 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 66062.5us
I20260709 13:18:06.485505 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:06.329689 21167 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.488003 19578 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:06.458241 21231 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:06.507638 21231 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:06.508088 21231 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:06.501072 19627 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:06.502871 21193 consensus_meta.cc:287] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.004s
I20260709 13:18:06.504020 21222 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:06.512166 19627 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:06.513833 19586 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:06.523530 19478 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:06.527412 21193 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:18:06.529358 19660 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:06.530246 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:06.502908 21240 log.cc:927] Time spent T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:18:06.531147 19586 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 2: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:06.531741 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:06.543723 21172 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:06.544821 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.550000 19652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1179) took 1017 ms. Trace:
I20260709 13:18:06.551010 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:06.556844 20974 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:06.559382 21230 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:06.563481 20964 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.513185 21190 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:06.577242 19408 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 40) took 1877 ms. Trace:
I20260709 13:18:06.550629 19652 rpcz_store.cc:276] 0709 13:18:05.532132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.534254 (+  2122us) service_pool.cc:224] Handling call
0709 13:18:05.537195 (+  2941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:06.276141 (+738946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.549578 (+273437us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b5400021554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:06.549910 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1697893248}
I20260709 13:18:06.520972 21153 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:06.512953 21177 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:06.530615 21224 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:06.592012 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 68553.3us
I20260709 13:18:06.593242 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:06.510350 21212 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.524233 21176 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:18:06.581141 19408 rpcz_store.cc:276] 0709 13:18:04.667839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.668268 (+   429us) service_pool.cc:224] Handling call
0709 13:18:06.545537 (+1877269us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:05.235717 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:05.266970 (+ 31253us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:05.267025 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:18:05.267042 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:05.267794 (+   752us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:05.267885 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:05.267915 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:18:05.268423 (+   508us) tablet.cc:701] Row locks acquired
0709 13:18:05.268470 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:18:05.268641 (+   171us) write_op.cc:270] Start()
0709 13:18:05.268786 (+   145us) write_op.cc:276] Timestamp: P: 1783603085268577 usec, L: 0
0709 13:18:05.268825 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:18:05.269539 (+   714us) log.cc:844] Serialized 1757 byte log entry
0709 13:18:05.607408 (+337869us) op_driver.cc:464] REPLICATION: finished
0709 13:18:05.831884 (+224476us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c2e6500ac 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c35190ef0
0709 13:18:05.984606 (+152722us) write_op.cc:301] APPLY: starting
0709 13:18:05.984720 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:05.984882 (+   162us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:05.984918 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:05.990688 (+  5770us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:05.991041 (+   353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:18:05.991112 (+    71us) write_op.cc:312] APPLY: finished
0709 13:18:05.991502 (+   390us) log.cc:844] Serialized 40 byte log entry
0709 13:18:05.991741 (+   239us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:05.991871 (+   130us) write_op.cc:454] Released schema lock
0709 13:18:05.991947 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:05.992378 (+   431us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:05.992414 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"spinlock_wait_cycles":30976,"child_traces":[["op",{"apply.queue_time_us":366609,"apply.run_cpu_time_us":2954,"apply.run_wall_time_us":7738,"num_ops":4,"prepare.queue_time_us":181455,"prepare.run_cpu_time_us":45490,"prepare.run_wall_time_us":227333,"raft.queue_time_us":62164,"raft.run_cpu_time_us":25441,"raft.run_wall_time_us":331831,"replication_time_us":338391,"spinlock_wait_cycles":4418944,"thread_start_us":555194,"threads_started":4,"wal-append.queue_time_us":184396}]]}
I20260709 13:18:06.605438 20964 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:06.602020 21198 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:06.606056 21212 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:06.512923 21238 consensus_queue.cc:1059] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:18:06.606225 21198 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.607115 20964 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:06.610857 21198 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:06.585932 21225 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:06.614447 21225 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.616770 21225 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:06.622421 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:06.619720 20664 raft_consensus.cc:2955] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:06.629181 21204 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:06.630213 21049 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.632225 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:06.632985 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:06.633994 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:06.635203 21199 consensus_meta.cc:287] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.643s	user 0.011s	sys 0.000s
I20260709 13:18:06.635527 21152 raft_consensus.cc:3055] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:06.619750 21238 raft_consensus.cc:3055] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:06.637414 21148 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.639134 19578 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
W20260709 13:18:06.640224 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.634600 21156 raft_consensus.cc:3055] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:06.721412 19579 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:06.602157 21071 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:06.724056 19655 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:06.726006 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:06.732316 19508 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:06.642697 21225 consensus_queue.cc:1059] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 13:18:06.744858 21237 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.747164 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:06.722755 21157 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:06.762773 21156 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:06.791512 21222 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.792395 21222 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.792531 21156 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.642782 21228 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.806674 21228 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.808982 21228 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:06.809360 19408 catalog_manager.cc:5697] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:18:06.750097 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:06.812731 19585 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 5.
I20260709 13:18:06.760751 19627 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:06.764252 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:06.765542 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:06.772846 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:06.754153 21049 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:06.776825 21224 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:06.781289 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:06.817157 19504 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:06.750501 21199 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.751019 21238 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:06.786358 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:06.789424 21244 consensus_queue.cc:1059] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:18:06.790778 21237 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:06.794597 21222 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:06.637462 21193 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:06.786747 21071 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.797871 21211 raft_consensus.cc:2955] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:06.799293 21149 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.802273 21157 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:06.802498 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 55425.6us
I20260709 13:18:06.807056 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:06.831938 19587 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:06.731575 21152 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:06.823117 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 62492.4us
I20260709 13:18:06.834580 21233 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.836206 21071 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:06.838155 19627 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:06.828236 21212 raft_consensus.cc:2764] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:06.845575 19627 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:06.846735 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:06.830425 21156 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.855031 19585 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.862371 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:06.863166 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:06.863934 19503 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:06.865530 19507 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:06.869527 19625 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:06.869776 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:06.876230 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.876915 19507 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:06.854097 21193 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:06.879060 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:06.880386 19504 raft_consensus.cc:2410] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:06.881358 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:06.825428 21231 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.867313 19505 raft_consensus.cc:2955] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:06.862712 21199 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:06.866701 21224 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:06.884080 21244 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:06.875677 21049 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:06.952840 19503 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:06.948495 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:06.846918 20631 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:18:06.868716 21071 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
W20260709 13:18:06.958184 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 365048us
I20260709 13:18:06.958766 19582 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:06.960490 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:06.962903 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:06.869041 21222 consensus_queue.cc:1059] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:18:06.937932 21193 raft_consensus.cc:697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:06.845700 21233 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.941504 21111 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:06.968063 19587 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:06.930339 21198 consensus_queue.cc:1059] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:18:06.931655 21212 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:18:06.925028 21226 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:18:06.958830 21204 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:06.959791 21224 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:06.965678 21244 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:06.967199 21123 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:06.974294 21246 log.cc:927] Time spent T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:18:06.970063 21111 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:18:06.965332 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 122784us
I20260709 13:18:06.958658 21115 consensus_queue.cc:1059] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:18:06.952988 21228 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:18:06.986687 21217 raft_consensus.cc:3055] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:18:06.988824 21180 consensus_meta.cc:287] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.707s	user 0.000s	sys 0.010s
I20260709 13:18:06.979524 21244 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.936987 21238 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.979976 21204 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:06.972517 21148 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:06.992820 21159 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:06.995777 19478 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:06.996596 21247 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:06.997660 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:06.997792 21168 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.000237 21190 raft_consensus.cc:3055] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:06.996627 21149 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.034715 19510 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:06.994252 21217 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:07.002449 21193 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.005357 21231 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.008185 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:07.042647 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 46942.8us
I20260709 13:18:07.042771 19579 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.012533 19658 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:07.013372 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:07.043532 19478 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:06.942535 21152 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.024300 21167 raft_consensus.cc:3055] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:07.015996 21244 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:07.014174 21180 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.020192 19656 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:06.982704 21254 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:07.006389 21245 raft_consensus.cc:3055] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:07.026683 21148 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.027100 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:07.070312 21245 raft_consensus.cc:740] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:07.072355 21152 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:07.072921 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:07.070425 21159 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.031387 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:07.074113 21159 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.075106 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:07.075685 19661 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:07.076400 21159 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.076630 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:07.070573 21071 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.077293 19661 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:07.039362 19654 raft_consensus.cc:1240] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:07.082525 21233 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.016494 21111 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.083256 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:07.083771 21111 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:07.084088 19654 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:07.041023 19507 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:07.015849 21220 raft_consensus.cc:3055] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:07.059417 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:07.060500 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:07.066273 21198 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.982432 21123 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:07.066604 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:07.027810 21190 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:07.033990 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:07.077407 21071 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.061704 21057 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:07.078325 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:07.078608 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:07.027514 21168 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.074141 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:07.085376 19654 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:07.066226 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:07.062103 21167 raft_consensus.cc:740] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:07.064627 21201 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.090020 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:07.096983 19511 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:07.085320 21204 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.073103 21245 consensus_queue.cc:260] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.090320 21123 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.105026 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:07.117283 19509 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 4: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:07.118491 19652 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:07.119199 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:07.091277 21220 raft_consensus.cc:740] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:07.126945 19509 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:07.129027 19511 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:07.122431 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:07.133456 19504 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:07.135558 21190 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.136910 19509 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:07.138171 21259 log.cc:927] Time spent T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:18:07.120661 21233 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:07.116721 21057 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:07.139151 19509 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:07.139369 21057 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.140621 21212 consensus_queue.cc:1059] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:07.138914 19505 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:07.126883 21217 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.058910 21224 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.143595 19509 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:07.125133 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:07.145680 19579 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:07.091773 21198 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.152426 19585 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:18:07.121114 21226 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.153017 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:07.141475 21057 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.101292 21114 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:18:07.142437 21159 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:07.136914 21190 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:07.152227 21233 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:07.179911 19585 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:07.178761 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:07.161417 21245 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:07.162401 21221 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:07.164347 21217 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:07.113992 21201 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.200299 19504 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:07.158041 21222 consensus_queue.cc:1059] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:18:07.207820 21201 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.208556 21180 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.171480 21167 consensus_queue.cc:260] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.263613 21167 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:07.192870 21221 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:07.265841 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:07.267654 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:07.209688 21264 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:18:07.192924 21081 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:07.268679 19659 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:07.269047 21081 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.269644 21081 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:07.218228 19657 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:07.265877 21221 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:07.274614 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:07.275779 21242 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.766s	user 0.004s	sys 0.007s
I20260709 13:18:07.276311 19657 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:07.277674 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:07.219201 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.219033 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:07.219775 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:07.220405 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.168475 21226 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.224277 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:07.227993 21148 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:07.231007 19658 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:07.232028 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1173) took 1377 ms. Trace:
I20260709 13:18:07.232067 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:07.284622 19508 rpcz_store.cc:276] 0709 13:18:05.854327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.854453 (+   126us) service_pool.cc:224] Handling call
0709 13:18:05.903365 (+ 48912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:06.771247 (+867882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.231755 (+460508us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b54001833d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:07.231971 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1905891200}
I20260709 13:18:07.240104 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:07.242086 21198 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.244067 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:07.289476 19661 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:07.249214 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.246251 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:07.255237 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:07.255519 19509 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:07.248456 21071 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.249665 21168 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:07.281857 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.294414 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 62447.9us
I20260709 13:18:07.292364 19512 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:07.306860 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:07.312306 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:07.308856 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:07.262184 21123 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:07.318564 21226 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:07.305496 21201 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:07.323364 21255 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.324297 21255 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.326581 21255 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:07.308220 21265 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:18:07.330771 21159 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:07.331393 21159 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.332091 21046 raft_consensus.cc:1064] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
W20260709 13:18:07.332554 21046 raft_consensus.cc:1068] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Unable to promote non-voter 068c03c9dcc848e6bf909131b1f83065: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:18:07.334210 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:07.335417 19583 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:07.346657 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:07.350623 19585 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:07.328943 19655 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:07.335258 21201 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:07.360642 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:07.361691 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:07.354483 21198 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:07.366385 21198 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.366850 21198 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:07.355259 21235 consensus_queue.cc:1059] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:18:07.355464 21071 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.370801 21168 raft_consensus.cc:3055] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:07.371232 21168 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:07.372339 19506 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:07.372109 21168 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.373306 21148 consensus_queue.cc:1059] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:07.374851 21148 raft_consensus.cc:3055] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:07.375214 21148 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:07.374991 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:07.376119 21148 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.376570 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:07.377280 21148 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.383296 21245 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:07.383512 21049 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:07.384133 21049 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:07.384009 21245 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.378767 19583 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:18:07.391542 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:07.397097 19587 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:07.398567 21159 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.402228 21123 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:07.335418 21180 consensus_queue.cc:1059] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:18:07.370843 21071 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.404978 21180 raft_consensus.cc:3055] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:07.407416 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:07.413555 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51178.4us
I20260709 13:18:07.411687 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:07.417033 19584 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:07.418610 19661 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:07.418841 19627 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:07.421977 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:07.355444 21156 consensus_queue.cc:1059] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:18:07.427551 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:07.407181 21168 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:07.409888 20970 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:07.417567 21256 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.441s	user 0.001s	sys 0.004s
I20260709 13:18:07.433970 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:07.433912 20970 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.434803 19657 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:07.435263 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1427) took 1055 ms. Trace:
I20260709 13:18:07.436216 20970 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:07.435649 19586 rpcz_store.cc:276] 0709 13:18:06.379618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.578240 (+198622us) service_pool.cc:224] Handling call
0709 13:18:06.590007 (+ 11767us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:06.590483 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:06.590522 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:06.625874 (+ 35352us) log.cc:844] Serialized 572 byte log entry
0709 13:18:06.935475 (+309601us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:06.935530 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.935619 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.407243 (+471624us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b240009a328. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e4f39c4 00007f6c2e4f1acb 00007f6c2e6acdc9 00007f6c2e6aca55 00007f6c2e6ac09d 00007f6c312de10e 00007f6c312f588c 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221
0709 13:18:07.434965 (+ 27722us) raft_consensus.cc:1685] finished
0709 13:18:07.434984 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.435202 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12761984,"thread_start_us":309173,"threads_started":1,"wal-append.queue_time_us":342935}
I20260709 13:18:07.437707 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:07.438880 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:07.440282 21081 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.441597 19586 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 4: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:07.442567 19580 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:07.443009 21071 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.401445 21221 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.385272 21049 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.443778 19580 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:07.444240 21049 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:07.444995 19580 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:07.408133 21157 raft_consensus.cc:3055] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:07.445609 21221 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.445870 21157 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:07.437242 19406 catalog_manager.cc:5697] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:07.448120 21212 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.448599 21212 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.448686 19406 catalog_manager.cc:5697] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:07.451143 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:07.429930 19584 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.431519 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:07.451890 19578 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 3.
I20260709 13:18:07.452080 19655 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:07.410224 21226 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:07.432886 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:07.446913 21157 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.455322 19506 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:07.456763 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:07.431448 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:07.462188 19660 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:07.406863 21180 raft_consensus.cc:740] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:07.461454 19511 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:07.451810 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:07.466280 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:07.466754 19656 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:07.467041 19661 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:07.421990 21176 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:07.426280 21173 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:07.470449 19509 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:07.473675 19584 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 6.
I20260709 13:18:07.475987 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:07.476539 19587 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:18:07.467670 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:07.477432 19503 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:07.480540 19508 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:07.480487 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:07.484057 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:07.484563 19580 raft_consensus.cc:2393] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:07.485397 19584 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 4: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:07.468861 21221 raft_consensus.cc:3055] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:07.470134 21178 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:07.469679 21238 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.389596 21244 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.557930 19582 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:07.558465 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:07.451241 19406 catalog_manager.cc:5697] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:07.547835 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 52656.1us
I20260709 13:18:07.542289 19476 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:07.566113 19476 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:07.546974 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 52355us
I20260709 13:18:07.487432 21157 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:07.541901 21255 consensus_queue.cc:1059] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:18:07.542992 21173 raft_consensus.cc:697] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:07.554957 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:07.491086 21221 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:07.541715 21180 consensus_queue.cc:260] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.483319 21114 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.465822 21207 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:18:07.579433 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:07.563241 19581 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:07.580991 19625 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
W20260709 13:18:07.564483 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.568444 21231 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:07.454545 21220 consensus_queue.cc:260] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.613559 21220 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.470449 21226 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:07.543179 21081 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.500128 21176 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:07.574977 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:07.622779 19586 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:07.623643 19579 raft_consensus.cc:2410] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:07.623775 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:07.624812 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:07.576056 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.568871 21178 raft_consensus.cc:697] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:07.571807 21083 consensus_queue.cc:1059] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:18:07.584115 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:07.571237 21172 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:07.585597 19406 catalog_manager.cc:5697] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:07.586246 20970 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:07.569183 20631 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:18:07.586975 21211 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:18:07.639655 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 76096.2us
I20260709 13:18:07.640029 21211 raft_consensus.cc:3055] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:07.640475 21211 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:07.583348 21114 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.589860 21115 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:07.597530 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:07.598407 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:07.644615 19581 raft_consensus.cc:2410] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:07.598934 21049 consensus_queue.cc:1059] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:07.599624 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:07.604547 21212 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:07.548369 20974 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:18:07.576874 21043 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:18:07.611717 21231 raft_consensus.cc:697] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:07.620421 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.620623 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:07.655247 19583 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:07.619855 21156 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:07.620275 21244 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.659897 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:07.660153 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:07.660689 19653 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 4: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:18:07.649374 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 63864.8us
I20260709 13:18:07.660712 19511 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:07.661986 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:07.663600 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:07.663667 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:07.650727 19587 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:07.651731 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:07.664768 19512 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:07.656715 19583 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:07.665567 19587 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:07.667040 19587 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:07.667104 19583 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:07.668152 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:07.668495 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:07.669133 19508 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:07.670501 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:07.671523 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.672122 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.628057 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:07.633675 21180 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:07.645366 19655 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:07.676884 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:07.665578 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:07.665704 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:07.681927 19586 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:07.683137 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:07.683771 19586 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:07.673969 19583 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:07.685954 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:07.675051 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:07.643234 21182 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:07.644981 21224 raft_consensus.cc:3055] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:07.686113 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:07.692938 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:07.693554 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:07.693883 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:07.694298 19512 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:07.617098 21198 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.695403 19586 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:07.695845 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 108314us
I20260709 13:18:07.697396 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:07.699337 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:07.700471 19587 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:07.699582 19583 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:07.712647 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:07.713289 19504 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:07.675947 21201 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:07.712850 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:07.668327 21172 raft_consensus.cc:697] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:07.675783 21114 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:07.668668 21115 raft_consensus.cc:697] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:07.708652 21123 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:07.717026 21167 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:07.687418 21083 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:18:07.688802 21173 consensus_queue.cc:237] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.770255 21167 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.712924 21244 consensus_queue.cc:1059] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
W20260709 13:18:07.771857 21277 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:18:07.662688 21193 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:18:07.695101 21081 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:07.745914 19507 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:07.751506 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:07.774274 21168 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:07.641428 21211 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.692480 21224 raft_consensus.cc:740] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:07.770763 21167 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:07.771377 21178 consensus_queue.cc:237] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.756299 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:07.753119 19585 raft_consensus.cc:2368] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4.
I20260709 13:18:07.756644 19506 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:07.689036 21156 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.746289 21176 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.814908 19509 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:07.819789 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 63588.2us
I20260709 13:18:07.822599 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:07.710093 21182 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 6 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:18:07.781024 21168 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.834522 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:07.836746 19504 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:07.836897 21071 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:07.837297 21071 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.837661 21071 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:07.838013 21244 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:07.838519 21244 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.838964 21244 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:07.842840 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.843569 21254 raft_consensus.cc:3055] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:07.843997 21254 raft_consensus.cc:740] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:07.845551 21071 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.845942 21115 consensus_queue.cc:237] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:18:07.847184 21157 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:07.847582 21157 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.847640 21071 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.848016 21157 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:07.849408 21198 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.835441 21168 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:07.853742 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.854960 21156 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.856225 21224 consensus_queue.cc:260] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.857406 21224 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.857831 21168 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.859954 21168 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:07.863005 19625 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:07.864353 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.864805 21280 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:07.866755 21226 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:07.831462 21231 consensus_queue.cc:237] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.877076 21211 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:07.877348 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:07.878456 19652 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:07.879691 19510 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:18:07.880056 19510 pending_rounds.cc:85] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 1
I20260709 13:18:07.880270 19510 pending_rounds.cc:107] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:18:07.880514 19510 raft_consensus.cc:2889] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:07.830952 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 231466us
I20260709 13:18:07.885643 21182 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:07.864240 19625 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:07.887454 20974 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:07.887881 20974 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.888258 20974 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:07.888774 20970 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:07.892917 19406 catalog_manager.cc:5697] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 1 to 2, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 2 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:07.894853 19406 catalog_manager.cc:5697] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:07.896485 19406 catalog_manager.cc:5697] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:07.896871 20974 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.900697 19408 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 41) took 1288 ms. Trace:
I20260709 13:18:07.902266 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:07.903072 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:07.914004 19584 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:07.904072 19582 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:18:07.904392 19579 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:07.905157 19478 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:07.844950 21254 consensus_queue.cc:260] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.905404 21148 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:07.926537 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:07.906080 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:07.923204 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 85556.6us
I20260709 13:18:07.911267 19408 rpcz_store.cc:276] 0709 13:18:06.612536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.642837 (+ 30301us) service_pool.cc:224] Handling call
0709 13:18:07.900636 (+1257799us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:07.070874 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:07.082302 (+ 11428us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:07.082336 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:18:07.082354 (+    18us) tablet.cc:662] Decoding operations
0709 13:18:07.082691 (+   337us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:07.082742 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:07.082778 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:07.082974 (+   196us) tablet.cc:701] Row locks acquired
0709 13:18:07.082991 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:18:07.083141 (+   150us) write_op.cc:270] Start()
0709 13:18:07.083262 (+   121us) write_op.cc:276] Timestamp: P: 1783603087083099 usec, L: 0
0709 13:18:07.083282 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:18:07.083941 (+   659us) log.cc:844] Serialized 602 byte log entry
0709 13:18:07.450720 (+366779us) op_driver.cc:464] REPLICATION: finished
0709 13:18:07.630248 (+179528us) write_op.cc:301] APPLY: starting
0709 13:18:07.630365 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:07.630513 (+   148us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:07.630682 (+   169us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:07.630999 (+   317us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:07.631216 (+   217us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:07.631280 (+    64us) write_op.cc:312] APPLY: finished
0709 13:18:07.631539 (+   259us) log.cc:844] Serialized 22 byte log entry
0709 13:18:07.631780 (+   241us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:07.631891 (+   111us) write_op.cc:454] Released schema lock
0709 13:18:07.631942 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:07.638026 (+  6084us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:07.638062 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":179212,"apply.run_cpu_time_us":2191,"apply.run_wall_time_us":7805,"num_ops":1,"prepare.queue_time_us":230013,"prepare.run_cpu_time_us":32039,"prepare.run_wall_time_us":94597,"raft.queue_time_us":118230,"raft.run_cpu_time_us":73069,"raft.run_wall_time_us":118767,"replication_time_us":367303,"thread_start_us":384725,"threads_started":4,"wal-append.queue_time_us":115403}]]}
I20260709 13:18:07.865425 21238 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:07.936637 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:07.937889 21233 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:07.938387 21233 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.938833 21233 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:07.939365 19579 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:07.943169 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:07.944252 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:07.951769 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:07.953572 21081 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:07.954147 21280 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:07.962236 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:07.967057 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.968092 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:07.984213 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:07.994433 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:08.006819 19658 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:07.948235 21083 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:08.005852 21081 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:08.029110 21244 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.030332 21148 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:07.949234 21238 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.996722 21156 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:07.950356 20970 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:07.961629 21168 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:08.022342 21222 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:07.952138 21201 consensus_queue.cc:1059] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 13:18:07.906138 21172 consensus_queue.cc:237] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:07.952736 21226 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
I20260709 13:18:08.034456 21083 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:08.111248 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 183046us
I20260709 13:18:08.117460 20663 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 6 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:08.068677 19406 catalog_manager.cc:5697] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.118772 21178 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:08.118939 19406 catalog_manager.cc:5697] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.120682 21294 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:08.122264 21294 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:08.046679 21238 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:08.020025 21071 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:18:08.054510 20970 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.122336 21244 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:08.070762 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:08.114504 21083 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:08.055023 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 43903.1us
W20260709 13:18:08.136807 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 98376.8us
W20260709 13:18:08.136205 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 231108us
I20260709 13:18:08.139765 19478 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:08.141254 19478 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:08.126694 21294 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:08.131040 20970 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:08.143704 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:08.146443 19659 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:08.145112 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:08.147152 19660 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:08.148761 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:08.149309 19657 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:08.149905 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:08.151098 19655 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:08.132866 21182 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:08.157456 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:08.148118 21148 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:08.146025 21180 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:08.167784 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 250925us
I20260709 13:18:08.149765 21201 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:08.173065 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:08.181099 21293 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:08.183140 19660 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:08.184466 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:08.155586 21081 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.174077 20974 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:08.185668 21245 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:08.203368 21244 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:08.255714 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 68513.2us
I20260709 13:18:08.166749 21198 consensus_queue.cc:1059] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:18:08.266086 19508 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:08.266883 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:08.271064 19505 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:18:08.268455 21290 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.158s	user 0.000s	sys 0.003s
I20260709 13:18:08.159783 21182 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:08.278745 21289 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:18:08.176230 21201 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:08.286576 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 124593us
I20260709 13:18:08.297163 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:08.285246 19505 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:08.203186 21224 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:18:08.206440 21081 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.308673 21201 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:08.175031 21294 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.281476 21083 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.324349 21294 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:08.328824 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:08.329660 19660 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 5: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:08.330823 19659 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:08.336112 19478 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:08.285018 21198 consensus_queue.cc:1243] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:08.286986 21244 raft_consensus.cc:697] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:08.294589 21303 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:08.356101 19655 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 5: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:08.354569 21305 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:08.363077 19478 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:08.363692 21212 raft_consensus.cc:3055] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:08.364084 21212 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:08.364400 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:08.365646 21255 raft_consensus.cc:2764] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:08.366456 21255 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:08.366789 21292 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:08.365554 19478 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:08.370998 21151 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:08.372362 21083 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:08.374094 19478 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:08.342453 21220 consensus_meta.cc:287] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.001s
I20260709 13:18:08.379801 19625 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:08.380327 19504 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:08.383885 21306 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:18:08.387187 21221 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.388646 21221 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:08.391434 21298 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:08.391991 21298 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:08.392856 21298 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:08.412276 21287 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 13:18:08.397073 21054 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:18:08.431672 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57645.7us
I20260709 13:18:08.300377 21167 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.299701 21157 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.456717 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:08.473594 19652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1203) took 1256 ms (client timeout 1648 ms). Trace:
W20260709 13:18:08.474259 19652 rpcz_store.cc:269] 0709 13:18:07.216998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.218798 (+  1800us) service_pool.cc:224] Handling call
0709 13:18:08.473308 (+1254510us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b5400217ad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:08.473479 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345917312}
I20260709 13:18:08.461020 21305 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:08.478057 21305 consensus_queue.cc:1059] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:08.479112 21305 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:08.469687 21293 consensus_queue.cc:1059] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:18:08.481348 21217 raft_consensus.cc:3055] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:08.481921 21217 raft_consensus.cc:740] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:08.484020 21231 raft_consensus.cc:3055] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:08.484445 21231 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:08.481391 21293 raft_consensus.cc:3055] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:08.485129 21293 raft_consensus.cc:740] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:08.457149 21156 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.486157 21293 consensus_queue.cc:260] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.487742 21293 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:08.488416 19476 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:08.489806 21306 consensus_queue.cc:1059] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:08.491982 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:08.492838 19580 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:08.431293 21255 raft_consensus.cc:697] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:08.358284 21233 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.502777 19578 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:08.458405 21054 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.486101 21156 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.498693 21180 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:08.557566 19579 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:08.557474 19657 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:08.511863 21148 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:08.560158 21148 raft_consensus.cc:697] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:08.558197 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.564967 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:08.485294 21231 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.376482 21303 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:08.597354 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.599018 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 126293us
I20260709 13:18:08.600622 19478 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:08.522320 21168 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:08.614982 21172 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:08.616420 21172 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:18:08.622903 21312 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.223s	user 0.002s	sys 0.000s
I20260709 13:18:08.623806 19507 raft_consensus.cc:3055] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:08.601969 21225 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:08.624221 19507 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:08.624467 21225 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.600252 21306 consensus_queue.cc:1243] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:08.628165 19627 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:08.628988 21043 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.629433 21043 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.630842 21255 consensus_queue.cc:237] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.631857 21279 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:08.632097 21148 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:08.634354 21311 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:08.634366 21225 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:08.631397 21043 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:08.625114 19507 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:08.638463 21225 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.681998 21225 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.684283 21225 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:08.688040 21167 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:08.688752 21180 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.689862 21182 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:08.691501 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:08.692307 19579 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:08.646278 21306 consensus_queue.cc:1059] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:18:08.510870 21244 consensus_queue.cc:237] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.695915 19585 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:08.697342 19507 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:08.697999 19579 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:08.661701 19587 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:08.649559 19586 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:18:08.625653 21307 log.cc:927] Time spent T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:18:08.582607 21280 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:08.726670 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:08.735113 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.646526 19584 raft_consensus.cc:2955] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:08.758688 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:08.759330 19510 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:08.760246 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:08.646880 21172 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:08.761847 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:08.771242 19512 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:08.743696 21238 consensus_meta.cc:287] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.000s
I20260709 13:18:08.769124 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:08.720719 21151 raft_consensus.cc:3055] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:08.777664 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:08.725481 21207 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:08.784845 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:08.787128 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 175484us
I20260709 13:18:08.753228 21201 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.659157 21168 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.771443 21081 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:08.801079 19478 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:08.774556 21305 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.775677 21225 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.779903 21151 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:08.807332 19510 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
W20260709 13:18:08.768821 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 152629us
I20260709 13:18:08.782204 21182 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:18:08.754027 21280 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.791582 21315 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.778668 21238 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.843966 19478 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:08.799388 21207 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.801668 21201 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.809128 21305 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.819567 21225 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.898079 19512 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:08.857321 21180 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:08.860172 21054 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:08.923065 21318 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:08.925031 21328 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.872606 21212 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.860162 21255 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:08.920329 21043 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:08.926642 19509 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:08.935590 19507 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:08.859534 21156 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:08.873903 21316 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:18:08.929523 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 61007.9us
I20260709 13:18:08.872430 21207 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:08.938030 21328 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.939797 19512 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:08.841224 21315 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.940665 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:08.941435 19505 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 5: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:08.943636 19478 leader_election.cc:400] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4.
I20260709 13:18:08.943980 19478 leader_election.cc:403] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:08.860311 21322 consensus_queue.cc:1059] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:18:08.925827 21280 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:08.950827 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:08.951442 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:08.951871 19510 raft_consensus.cc:2393] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 4: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:08.952605 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:08.944070 21212 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:08.945782 21221 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:08.950094 21299 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:18:08.881253 21151 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.942061 21255 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:08.988027 21332 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4.
I20260709 13:18:08.995158 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:08.997655 19582 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:08.999042 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:09.000020 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.942780 21331 consensus_queue.cc:1059] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:18:09.003857 20666 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEARNER]: Advancing to term 4
I20260709 13:18:08.988926 21217 consensus_queue.cc:260] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:18:08.989903 21316 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:09.007014 19509 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:18:08.982321 21168 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:09.011274 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.012581 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:09.019717 19582 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:09.002611 21151 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:08.981823 21221 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:09.029389 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:09.006204 21211 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:08.996690 21303 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:09.042572 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:09.043572 19510 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:09.022383 21238 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:09.028863 21207 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.053146 21207 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:09.053712 21293 consensus_meta.cc:287] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.003s
W20260709 13:18:09.056051 20970 consensus_meta.cc:287] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.902s	user 0.009s	sys 0.003s
I20260709 13:18:09.056533 20970 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:09.057819 19656 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:18:09.058343 21330 log.cc:927] Time spent T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:18:09.058842 20970 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:09.059686 21295 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.032279 21217 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:09.066702 21325 log.cc:927] Time spent T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:18:09.067862 21333 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.068405 21333 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:09.035336 21201 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:09.051856 21211 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:09.071142 21329 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:18:09.072223 21211 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:09.069394 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:09.075399 19510 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
W20260709 13:18:09.076488 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.073518 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:09.078270 19583 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:09.079854 21305 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:09.079164 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:09.086548 19659 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:09.099762 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:09.100556 19583 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:18:09.101792 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:09.090718 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.102407 19583 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:09.087862 19625 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:09.078603 21225 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:09.084156 21255 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:09.087540 21211 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:09.087146 21238 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.112507 21176 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:09.113708 19583 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:18:09.118877 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:09.123989 19583 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:09.128139 19587 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
W20260709 13:18:09.148061 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.148737 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.154299 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:09.116096 21315 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:09.180344 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:09.180578 19587 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:18:09.174243 19478 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.884s (SENT) [suppressed 20 similar messages]
I20260709 13:18:09.088670 21295 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:09.107147 21328 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:09.122728 21182 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
W20260709 13:18:09.232461 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.191219 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:09.220494 19579 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:18:09.465199 19579 pending_rounds.cc:85] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 2
I20260709 13:18:09.465685 19579 pending_rounds.cc:107] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:18:09.466090 19579 raft_consensus.cc:2889] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:09.248950 19583 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:18:09.341846 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.216056 19587 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:18:09.119484 21176 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:09.178054 21225 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:09.478544 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.496047 19507 raft_consensus.cc:3055] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:09.498469 19507 raft_consensus.cc:740] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:09.500828 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1465) took 1059 ms. Trace:
I20260709 13:18:09.501395 19578 rpcz_store.cc:276] 0709 13:18:08.435914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.436044 (+   130us) service_pool.cc:224] Handling call
0709 13:18:09.494619 (+1058575us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b54002274d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:09.494835 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98141952}
I20260709 13:18:09.130856 21238 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:09.505146 21238 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:09.178051 21083 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.455874 20666 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 4 LEARNER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:18:09.306357 21217 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.119725 21211 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:09.306499 21321 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:09.275080 21114 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:09.453859 21221 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:09.275969 21279 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:09.512414 21302 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.512563 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:09.466317 21201 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:09.497709 21054 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.520788 19507 consensus_queue.cc:260] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:09.505870 21225 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:09.535795 20666 pending_rounds.cc:85] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065: Aborting all ops after (but not including) 2
I20260709 13:18:09.582374 19507 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:09.558816 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1462) took 1124 ms. Trace:
W20260709 13:18:09.560708 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.619026 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.617594 19585 rpcz_store.cc:276] 0709 13:18:08.434711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.434836 (+   125us) service_pool.cc:224] Handling call
0709 13:18:08.695565 (+260729us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:08.696454 (+   889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.558499 (+862045us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54001fbb50. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:09.558727 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549821312}
W20260709 13:18:09.632617 19586 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.017s	sys 0.017s
W20260709 13:18:09.655004 19586 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.017s	sys 0.021s
I20260709 13:18:09.561187 20666 pending_rounds.cc:107] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:18:09.552232 21201 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:09.512578 21176 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:09.541543 21083 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:09.543349 21217 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:09.598575 21254 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.608721 21221 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:09.548067 21114 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:09.656633 20989 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:09.662679 20666 raft_consensus.cc:2889] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 4 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:09.550287 21279 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:09.552455 21054 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:09.731341 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.741300 19507 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:09.743103 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:09.756119 19507 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:09.757344 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:09.767935 19507 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
W20260709 13:18:09.794179 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.693094 21169 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.677588 21221 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:09.896780 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1224) took 1311 ms. Trace:
I20260709 13:18:09.696602 21295 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:09.680317 20989 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:09.903479 19659 rpcz_store.cc:276] 0709 13:18:08.396229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.396355 (+   126us) service_pool.cc:224] Handling call
0709 13:18:09.086288 (+689933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.087138 (+   850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.707633 (+620495us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b5400020dd0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:09.707882 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1585917312}
I20260709 13:18:09.553642 21333 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:09.693019 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 478323us
W20260709 13:18:09.922655 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.614436 21302 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:09.927640 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.895278 21292 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:09.913968 21169 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:09.895717 21178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.034s	sys 0.068s
I20260709 13:18:09.933634 21333 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:09.952284 21114 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:09.949554 21298 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.544s	user 0.011s	sys 0.032s
I20260709 13:18:09.939697 21292 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:09.984548 21225 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:10.002916 19505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.046s	sys 0.066s
W20260709 13:18:10.003345 19505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.046s	sys 0.066s
W20260709 13:18:10.000825 19503 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.048s	user 0.031s	sys 0.082s
W20260709 13:18:10.005002 19503 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.054s	user 0.031s	sys 0.083s
W20260709 13:18:10.001202 21298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.596s	user 0.012s	sys 0.032s
I20260709 13:18:09.990263 21245 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:09.997836 21178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.034s	sys 0.069s
I20260709 13:18:09.999446 21201 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.030081 21054 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:10.030817 19510 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.950s	user 0.044s	sys 0.094s
W20260709 13:18:10.031194 19510 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.044s	sys 0.094s
W20260709 13:18:10.028748 19478 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.052s	sys 0.125s
W20260709 13:18:10.032227 19478 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.053s	sys 0.125s
W20260709 13:18:10.032694 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 858472us
I20260709 13:18:10.012914 21225 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.008594 21217 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.008221 21083 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:10.030463 21207 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.032450 21182 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:10.024071 21245 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.062916 19659 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:10.042748 21279 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:10.036845 21201 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.074910 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:10.075620 21212 consensus_meta.cc:287] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 1.107s	user 0.005s	sys 0.007s
I20260709 13:18:10.075790 19654 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:10.077251 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.078056 19653 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:10.079191 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:10.079906 19652 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:10.080330 21313 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:18:10.080838 21313 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:10.082602 21349 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:18:10.085403 21292 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.086211 21292 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.086762 21292 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.088999 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1549) took 1150 ms. Trace:
I20260709 13:18:10.071725 21221 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.017089 21333 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.052675 21217 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.067358 21182 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:10.057785 21345 log.cc:927] Time spent T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:18:10.076932 21201 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.044087 21225 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.127573 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.166244 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.128113 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.128895 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:10.129669 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:10.141067 19511 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:10.132005 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.147202 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.171064 19657 raft_consensus.cc:2410] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:18:10.153638 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.089535 19509 rpcz_store.cc:276] 0709 13:18:08.938438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.942413 (+  3975us) service_pool.cc:224] Handling call
0709 13:18:10.088786 (+1146373us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b54002aa3d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:10.088902 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107724032}
W20260709 13:18:10.159968 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.101019 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1546) took 1170 ms. Trace:
I20260709 13:18:10.146319 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.190760 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.194041 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.099435 21198 raft_consensus.cc:1064] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:18:10.106348 21333 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.110931 21302 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:10.546793 21151 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.546928 21233 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.547147 21364 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.156651 21245 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.170276 21305 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.081346 21313 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.101950 21157 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.097775 20989 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:10.099891 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:10.089534 21292 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:10.211917 21344 log.cc:927] Time spent T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.515s	user 0.000s	sys 0.004s
I20260709 13:18:10.554981 21233 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.152245 21225 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.111408 21201 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.554888 20663 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:10.557443 21201 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.126384 21182 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.106900 21217 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.560340 21233 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.562440 21217 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:10.398922 19460 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.536s	user 0.021s	sys 0.019s
I20260709 13:18:10.562687 21233 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:10.563019 19460 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.700s	user 0.022s	sys 0.019s
I20260709 13:18:10.152935 19652 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:10.548959 21255 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:10.486341 19550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.005s	sys 0.005s
W20260709 13:18:10.564373 19550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.006s	sys 0.006s
I20260709 13:18:10.564102 21255 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:10.487075 19507 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.004s	sys 0.007s
I20260709 13:18:10.523078 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1544) took 1596 ms. Trace:
W20260709 13:18:10.565402 19507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.004s	sys 0.007s
I20260709 13:18:10.566263 21225 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.565471 19503 rpcz_store.cc:276] 0709 13:18:08.926253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.927581 (+  1328us) service_pool.cc:224] Handling call
0709 13:18:08.927886 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.933270 (+  5384us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:10.005401 (+1072131us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.394561 (+389160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.522244 (+127683us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:10.522382 (+   138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.522540 (+   158us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.522931 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":730823,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":6459,"raft.run_cpu_time_us":21335,"raft.run_wall_time_us":128077,"thread_start_us":1443205,"threads_started":2,"wal-append.queue_time_us":550190}
I20260709 13:18:10.566996 21225 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.567775 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:10.568552 19503 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 4: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:10.569026 21225 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.569481 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:10.525756 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 313439us
I20260709 13:18:10.526793 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:10.115576 21049 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:10.528770 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.529351 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1559) took 1467 ms. Trace:
I20260709 13:18:10.112578 21193 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:18:10.530581 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.582527 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.582700 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.583189 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.101204 20666 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 4 LEARNER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:10.133920 21071 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.530186 21176 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:10.185519 19512 rpcz_store.cc:276] 0709 13:18:08.930572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.931148 (+   576us) service_pool.cc:224] Handling call
0709 13:18:08.931461 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.940147 (+  8686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.100692 (+1160545us) spinlock_profiling.cc:243] Waited 8.01 ms on lock 0x7b54001b03d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:10.100944 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18419584}
I20260709 13:18:10.581557 19509 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:18:10.585752 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:10.535298 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1232) took 2095 ms. Trace:
I20260709 13:18:10.536598 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.104219 21221 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.581836 19510 rpcz_store.cc:276] 0709 13:18:09.062293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.077840 (+ 15547us) service_pool.cc:224] Handling call
0709 13:18:09.080301 (+  2461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.080604 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:10.031599 (+950995us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.407422 (+375823us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.527530 (+120108us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:10.529089 (+  1559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.529161 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.529298 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":584053,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":76781,"spinlock_wait_cycles":56055040,"thread_start_us":1319392,"threads_started":2,"wal-append.queue_time_us":502374}
I20260709 13:18:10.542178 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.542811 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.589704 19653 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:10.543159 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1561) took 1429 ms. Trace:
I20260709 13:18:10.535851 19625 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:10.542011 21280 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:10.542225 21279 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:10.544855 21054 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:10.545863 21172 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.092820 21211 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:10.596218 21221 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.549908 21151 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.598279 21280 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.591789 21176 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.599807 21221 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.553431 21305 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.600405 21280 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:10.600533 21221 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:10.600673 21176 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:10.553110 21333 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.601032 21279 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.601994 21333 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.596086 20989 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:10.603766 20989 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.604022 21333 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.604130 20989 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:10.548621 21367 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.604749 21367 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.589118 21193 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.605950 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:10.606554 19510 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:10.607043 21193 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:10.607508 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:10.608023 19510 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:10.589236 21233 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.608515 21233 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.554879 21313 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.569535 21225 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:10.601326 21172 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.557297 21157 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.560048 21201 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.590328 21217 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.610877 21157 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.611089 21217 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.611816 21172 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.612265 21201 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.612538 19512 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 4: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:10.612892 21157 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.566313 21255 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.615068 21217 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.615469 21367 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.615767 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:10.616384 19512 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:10.601032 21221 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:10.612888 21198 raft_consensus.cc:1068] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Unable to promote non-voter 068c03c9dcc848e6bf909131b1f83065: Illegal state: Replica 2cfd02601ea44976833027665abc93bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:18:10.610553 21233 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.100725 21321 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:10.618148 19408 catalog_manager.cc:5697] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 2 to 5, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:10.618705 21321 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:10.617201 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:10.620174 19512 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:10.620430 19408 catalog_manager.cc:5697] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 5 to 6, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 6 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.621352 19510 raft_consensus.cc:2410] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:10.584172 19478 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:10.630115 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 46009.6us
I20260709 13:18:10.631062 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:10.631907 19478 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:10.586676 19657 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:10.587476 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:10.591652 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 55898.4us
I20260709 13:18:10.592695 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1542) took 1702 ms. Trace:
I20260709 13:18:10.593319 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.591347 19508 rpcz_store.cc:276] 0709 13:18:09.113564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.551818 (+438254us) service_pool.cc:224] Handling call
0709 13:18:09.611486 (+ 59668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.611752 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:10.054703 (+442951us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.519887 (+465184us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.541764 (+ 21877us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:10.541838 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.542977 (+  1139us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.543102 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":53102,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":136,"spinlock_wait_cycles":3725568,"thread_start_us":907181,"threads_started":2,"wal-append.queue_time_us":499279}
I20260709 13:18:10.556180 21245 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:10.597699 21362 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.550581 21364 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.599823 21151 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.596189 21071 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.633760 19506 rpcz_store.cc:276] 0709 13:18:08.890126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.890338 (+   212us) service_pool.cc:224] Handling call
0709 13:18:08.890704 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:08.935790 (+ 45086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:08.935819 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:08.945198 (+  9379us) log.cc:844] Serialized 26 byte log entry
0709 13:18:09.402287 (+457089us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:09.402343 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.112996 (+710653us) spinlock_profiling.cc:243] Waited 9.58 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:18:10.117733 (+  4737us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b540037c3d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:10.117811 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.592507 (+474696us) raft_consensus.cc:1685] finished
0709 13:18:10.592525 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.592639 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15013,"raft.queue_time_us":26749,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":4414,"spinlock_wait_cycles":104477696,"thread_start_us":434700,"threads_started":1,"wal-append.queue_time_us":704952}
I20260709 13:18:10.647163 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:10.610041 21225 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:10.621142 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:10.649582 19512 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:10.650264 21071 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.649362 20631 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:10.650570 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:10.578820 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.651197 21225 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:10.651062 20989 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.651638 21283 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:10.652522 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.653080 21364 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.622548 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.638592 21255 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:10.653944 21255 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.654044 19585 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 3.
I20260709 13:18:10.654352 21255 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.623178 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1562) took 1486 ms. Trace:
W20260709 13:18:10.623370 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.651190 19512 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
W20260709 13:18:10.656028 21370 log.cc:927] Time spent T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:18:10.656203 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:10.657368 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:10.636324 21299 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:10.657979 21299 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.658349 21299 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:10.659085 21356 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:18:10.659375 19585 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:10.660172 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:10.625195 21221 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.660771 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:10.661968 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:10.661895 21148 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:10.662540 21151 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:10.663023 21151 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.662873 21148 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:10.663458 21151 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:10.663813 21352 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.576s	user 0.012s	sys 0.012s
I20260709 13:18:10.663859 21333 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:10.664333 21333 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:10.665354 21368 log.cc:927] Time spent T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:18:10.635398 21233 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:10.665798 21292 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:10.666083 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1193) took 1679 ms. Trace:
I20260709 13:18:10.666004 21233 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.655156 19507 rpcz_store.cc:276] 0709 13:18:09.136906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.850715 (+713809us) service_pool.cc:224] Handling call
0709 13:18:09.851145 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.851412 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.851445 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:09.901116 (+ 49671us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.565885 (+664769us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:10.565927 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.565990 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.622987 (+ 56997us) raft_consensus.cc:1685] finished
0709 13:18:10.623007 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.623124 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":623962,"threads_started":1,"wal-append.queue_time_us":618251}
I20260709 13:18:10.667552 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:10.668068 21233 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.668609 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:10.638917 21245 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.669199 19507 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:10.525143 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1468) took 2079 ms. Trace:
I20260709 13:18:10.576045 19503 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:10.635674 21361 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.669854 19580 rpcz_store.cc:276] 0709 13:18:08.446144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.493564 (+ 47420us) service_pool.cc:224] Handling call
0709 13:18:08.567976 (+ 74412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.819140 (+251164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:08.819185 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:08.819244 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:08.819288 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.212167 (+1392879us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54002283d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:10.524882 (+312715us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.525056 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":577063808}
I20260709 13:18:10.670516 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:10.670848 21361 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.671577 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:10.672334 19503 raft_consensus.cc:2410] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:10.626081 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1557) took 1575 ms. Trace:
I20260709 13:18:10.673349 21172 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:10.633944 19625 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:10.673162 19505 rpcz_store.cc:276] 0709 13:18:09.051065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.075767 (+ 24702us) service_pool.cc:224] Handling call
0709 13:18:09.076140 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.105692 (+ 29552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.105751 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:09.113356 (+  7605us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.003794 (+890438us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:10.003853 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.003946 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.625832 (+621886us) raft_consensus.cc:1685] finished
0709 13:18:10.625858 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.626011 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27015,"raft.queue_time_us":27998,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":10812,"thread_start_us":887441,"threads_started":1,"wal-append.queue_time_us":1468546}
I20260709 13:18:10.674682 19625 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:10.675205 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:10.586434 19658 rpcz_store.cc:276] 0709 13:18:08.440043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.450898 (+ 10855us) service_pool.cc:224] Handling call
0709 13:18:08.451222 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.451443 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:10.103044 (+1651601us) spinlock_profiling.cc:243] Waited 871 us on lock 0x7b180036b440. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c313024bc 00007f6c2e65048b 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66a455 00007f6c351523c7 00007f6c317649a7 00007f6c317740bf
0709 13:18:10.103208 (+   164us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.517901 (+414693us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.535001 (+ 17100us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:10.535066 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.535129 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.535244 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":278207,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":9437,"raft.queue_time_us":752,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":107,"spinlock_wait_cycles":25471104,"thread_start_us":734331,"threads_started":2,"wal-append.queue_time_us":428029}
I20260709 13:18:10.676146 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.676334 19625 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:10.676527 21280 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:10.630208 21367 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.643112 21362 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.585748 21359 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:10.648447 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:10.657586 21355 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:18:10.675282 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1550) took 1736 ms. Trace:
I20260709 13:18:10.686786 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1564) took 1063 ms. Trace:
I20260709 13:18:10.677332 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.098436 21169 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:10.676915 19585 raft_consensus.cc:2410] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:10.686494 19511 rpcz_store.cc:276] 0709 13:18:08.938767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.939578 (+   811us) service_pool.cc:224] Handling call
0709 13:18:08.939996 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.170072 (+1230076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.675068 (+504996us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54001838d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:10.675227 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2761171200}
I20260709 13:18:10.673012 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.689980 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:10.688007 19625 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:10.585608 21049 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.679473 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.661876 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:10.692279 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:10.701678 19587 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:10.702154 19512 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:10.680126 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.681038 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.702811 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.634560 19509 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:10.703197 19583 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:10.676873 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1563) took 1486 ms. Trace:
I20260709 13:18:10.683038 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:10.687388 19507 rpcz_store.cc:276] 0709 13:18:09.623087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.685986 (+1062899us) service_pool.cc:224] Handling call
0709 13:18:10.686296 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.686461 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.686486 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.686531 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:10.686560 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.686613 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.686732 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.690016 19584 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:10.673035 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:10.676926 21280 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.677335 19506 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 5: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:10.712422 19579 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:10.690748 19585 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:10.702823 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.623973 21321 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.727223 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.728123 19510 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:10.670527 21245 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.704758 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1566) took 1053 ms. Trace:
I20260709 13:18:10.666532 19582 rpcz_store.cc:276] 0709 13:18:08.986668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.020686 (+ 34018us) service_pool.cc:224] Handling call
0709 13:18:09.025481 (+  4795us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.049717 (+ 24236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.049765 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:09.063057 (+ 13292us) log.cc:844] Serialized 26 byte log entry
0709 13:18:09.401902 (+338845us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:09.466695 (+ 64793us) log.cc:844] Serialized 14 byte log entry
0709 13:18:09.466987 (+   292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.143875 (+676888us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b1800369be0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:18:10.148467 (+  4592us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b1800369be0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e63b2a6 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419
0709 13:18:10.665799 (+517332us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b54002279d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:10.665846 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.665890 (+    44us) raft_consensus.cc:1685] finished
0709 13:18:10.665903 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.666030 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":69177,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":64,"raft.queue_time_us":191,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":27618,"spinlock_wait_cycles":177083392,"thread_start_us":334136,"threads_started":1,"wal-append.queue_time_us":613539}
I20260709 13:18:10.662699 20666 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:10.674062 21172 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:10.704104 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.734479 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1228) took 2331 ms. Trace:
I20260709 13:18:10.749429 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:10.689016 21211 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:10.684067 21322 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.708217 21212 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.733541 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.764027 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1218) took 2004 ms. Trace:
I20260709 13:18:10.764469 19579 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:10.686299 21364 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.738670 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.729336 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:10.749887 19654 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:10.764654 19585 raft_consensus.cc:2410] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:10.767755 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.768661 21245 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:10.686061 21293 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.769081 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:10.751955 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.770663 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.771278 19583 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:10.771123 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:10.772291 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.773417 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.774498 19583 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:10.775506 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.734387 19584 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:10.776959 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.777520 19584 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:10.777604 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.778373 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.731177 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:10.778929 19585 raft_consensus.cc:2393] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:10.772850 19551 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:10.779286 19580 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.731091 19587 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:10.726464 19505 rpcz_store.cc:276] 0709 13:18:09.190043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.676155 (+1486112us) service_pool.cc:224] Handling call
0709 13:18:10.676438 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.676593 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.676615 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.676653 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:10.676682 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.676728 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.676823 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.730508 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1565) took 1107 ms. Trace:
I20260709 13:18:10.748562 19509 rpcz_store.cc:276] 0709 13:18:09.651608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.703834 (+1052226us) service_pool.cc:224] Handling call
0709 13:18:10.704134 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.704365 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.704403 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.704455 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:10.704483 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.704540 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.704673 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.730677 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1567) took 1075 ms. Trace:
I20260709 13:18:10.752305 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.751099 19656 rpcz_store.cc:276] 0709 13:18:08.397279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.403144 (+  5865us) service_pool.cc:224] Handling call
0709 13:18:08.403557 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.058347 (+654790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.728190 (+1669843us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b540032a5d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:10.728402 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1503852928}
I20260709 13:18:10.781495 19582 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:10.672928 21361 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.780912 19506 rpcz_store.cc:276] 0709 13:18:09.654896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.729908 (+1075012us) service_pool.cc:224] Handling call
0709 13:18:10.730188 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.730351 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.730387 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.730426 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:10.730453 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.730501 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.730623 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.755970 21172 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.732354 21280 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.665302 21333 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.764492 19504 rpcz_store.cc:276] 0709 13:18:08.759437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.762540 (+  3103us) service_pool.cc:224] Handling call
0709 13:18:09.600415 (+837875us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:18:09.600677 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.601148 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.601188 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:09.601828 (+   640us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.023417 (+421589us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:10.023464 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.023542 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.656998 (+633456us) spinlock_profiling.cc:243] Waited 6.11 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:18:10.763798 (+106800us) raft_consensus.cc:1685] finished
0709 13:18:10.763825 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.763961 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3161,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":127,"spinlock_wait_cycles":31807744,"thread_start_us":421130,"threads_started":1,"wal-append.queue_time_us":942616}
I20260709 13:18:10.789345 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.780426 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.690268 21054 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:18:10.780447 19512 rpcz_store.cc:276] 0709 13:18:09.623436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.729715 (+1106279us) service_pool.cc:224] Handling call
0709 13:18:10.730029 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.730199 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.730225 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.730271 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:10.730300 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.730356 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.730456 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.756075 21211 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.763324 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1569) took 1095 ms. Trace:
I20260709 13:18:10.797026 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.689159 21367 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.787488 19510 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:10.689128 21359 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:10.797571 19586 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.133s	user 0.071s	sys 0.112s
W20260709 13:18:10.798652 19586 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.134s	user 0.071s	sys 0.112s
I20260709 13:18:10.755874 21193 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:10.653080 20989 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:10.790969 19585 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:10.791338 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:10.831218 19660 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:10.819738 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.832723 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.820353 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.820693 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.819303 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.834483 19659 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:10.834920 19585 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:10.835287 19656 raft_consensus.cc:2410] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:10.790489 19587 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:18:10.728729 21371 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:10.797438 19508 rpcz_store.cc:276] 0709 13:18:09.667852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.734825 (+1066973us) service_pool.cc:224] Handling call
0709 13:18:10.762794 (+ 27969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.763003 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.763029 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.763065 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:10.763102 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.763155 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.763265 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.782994 21212 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.775619 21322 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.785669 21364 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.785892 21221 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:10.790717 19584 raft_consensus.cc:1275] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:10.707777 21176 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:10.763447 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:10.848824 19655 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:10.849542 21372 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:10.849912 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.851969 21362 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.852623 21299 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.854780 21367 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.860055 21255 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.819826 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.862910 19657 raft_consensus.cc:1275] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:10.865736 21176 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:18:10.839069 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.772320 21233 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:10.792902 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.867399 19582 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:10.840046 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 41) took 1891 ms. Trace:
I20260709 13:18:10.840941 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.868662 19661 raft_consensus.cc:2410] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:10.810844 21193 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.769675 21293 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.869596 21193 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:10.868204 19586 rpcz_store.cc:276] 0709 13:18:08.948268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.948405 (+   137us) service_pool.cc:224] Handling call
0709 13:18:08.957521 (+  9116us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:08.965607 (+  8086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:08.965666 (+    59us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:08.993976 (+ 28310us) log.cc:844] Serialized 52 byte log entry
0709 13:18:09.658157 (+664181us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:10.799005 (+1140848us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.839739 (+ 40734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.839816 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.839854 (+    38us) raft_consensus.cc:1685] finished
0709 13:18:10.839864 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.839997 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40455,"prepare.queue_time_us":485982,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":41391,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":18294,"thread_start_us":1764645,"threads_started":2,"wal-append.queue_time_us":920753}
I20260709 13:18:10.871157 21293 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.810322 21211 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:10.845649 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 54359.1us
I20260709 13:18:10.872584 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:10.874078 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:10.874871 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:10.875538 21361 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:10.875917 21361 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.876220 21225 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:10.876437 21071 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:10.876884 21071 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.877256 21071 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:10.877324 21193 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.877766 19503 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.845768 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.850055 21372 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.876686 21225 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.879686 21193 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:10.879935 21225 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:10.848740 21371 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:10.876274 21361 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.881304 21377 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.881392 21371 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.881989 21377 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.879900 21372 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:10.786614 21245 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:10.886880 19655 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:10.808467 19579 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:10.886446 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:10.893958 19580 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:10.844184 21333 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:10.897480 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:10.899909 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:10.900605 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.890365 21245 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.901455 19582 raft_consensus.cc:2393] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 4: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:10.901659 21245 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:10.892686 20989 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:10.902415 21198 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:10.897415 21231 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.902722 20989 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.903229 21198 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:10.903717 21198 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:10.904574 21198 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.905237 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.902467 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:10.906279 19586 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:10.906783 21364 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.907306 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.889972 21172 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.907964 19660 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:10.909389 21172 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.886059 21054 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.866235 21176 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.846200 21221 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.847229 21313 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.911582 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.914392 19661 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:10.915352 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.924731 21371 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.925765 21371 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.905201 20989 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:10.892910 21302 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:10.945092 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.935333 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.896284 21233 raft_consensus.cc:697] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:10.932224 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:10.911111 21362 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:10.945314 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:10.952567 19652 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:10.902508 21322 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.913445 21364 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.958492 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:10.958606 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 262229us
I20260709 13:18:10.935395 21221 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.910521 21054 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.951517 21305 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.954892 21362 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.955950 21212 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:10.971421 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:10.960753 21157 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:10.939018 21376 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:10.978017 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:10.939484 21313 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.977151 19625 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:10.972489 21362 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:10.978708 19476 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:10.966401 21233 consensus_queue.cc:237] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.983775 19655 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:18:10.979200 21384 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.968309 21255 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.996066 21384 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.956291 21302 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.998590 21384 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.986274 21299 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.998832 21245 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.999511 21302 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:10.977967 21305 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.999958 21388 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:11.000277 21305 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:11.001257 21377 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:10.969580 21383 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:10.988505 21359 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.984532 21371 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:10.988583 21376 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:10.985060 21211 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.010136 21313 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.010898 19653 raft_consensus.cc:2368] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4.
I20260709 13:18:11.010821 21376 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:11.011358 21211 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:11.011602 21302 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:11.012099 21302 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:11.012494 21302 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:11.013149 19406 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48852 (request call id 171) took 6086 ms. Trace:
I20260709 13:18:11.019784 21306 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.005735 21383 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:10.965382 21364 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:10.969931 21071 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.004184 21375 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.982944 21225 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.026734 19657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:18:11.038359 19657 raft_consensus.cc:606] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:11.027410 21359 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.027602 21245 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:11.029574 21365 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.495s	user 0.000s	sys 0.003s
I20260709 13:18:11.030730 21305 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:11.036852 19503 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:11.044215 19625 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:10.988022 21151 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.029361 21364 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.049683 19476 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.025309 21383 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:11.015455 21280 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:11.055583 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 154850us
I20260709 13:18:11.056092 19476 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.056504 21305 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:11.056660 21385 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:11.062804 21071 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.054124 21364 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:11.064591 19478 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:11.078707 19658 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:11.047472 21148 consensus_queue.cc:1059] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:18:11.081154 21377 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:11.046885 21378 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:18:11.046715 21359 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.081708 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:11.034071 21306 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.084563 19627 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:11.081655 21225 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.074513 21293 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:11.082209 21313 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:11.091396 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:11.091342 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 51808.8us
I20260709 13:18:11.099612 21148 raft_consensus.cc:3055] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:11.100044 21148 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:11.013576 19406 rpcz_store.cc:276] 0709 13:18:04.926960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.927174 (+   214us) service_pool.cc:224] Handling call
0709 13:18:11.013071 (+6085897us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:08.323628 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:08.409427 (+ 85799us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:08.409488 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:18:08.409517 (+    29us) tablet.cc:662] Decoding operations
0709 13:18:08.619078 (+209561us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:08.619148 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:08.619181 (+    33us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:18:08.619986 (+   805us) tablet.cc:701] Row locks acquired
0709 13:18:08.620008 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:18:08.620158 (+   150us) write_op.cc:270] Start()
0709 13:18:08.620284 (+   126us) write_op.cc:276] Timestamp: P: 1783603088620113 usec, L: 0
0709 13:18:08.620313 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:18:08.621051 (+   738us) log.cc:844] Serialized 3672 byte log entry
0709 13:18:08.872837 (+251786us) op_driver.cc:464] REPLICATION: finished
0709 13:18:09.036465 (+163628us) write_op.cc:301] APPLY: starting
0709 13:18:09.041861 (+  5396us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:09.104301 (+ 62440us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:09.112628 (+  8327us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:09.218354 (+105726us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:09.218562 (+   208us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:18:09.218604 (+    42us) write_op.cc:312] APPLY: finished
0709 13:18:09.218879 (+   275us) log.cc:844] Serialized 70 byte log entry
0709 13:18:09.219048 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:09.219170 (+   122us) write_op.cc:454] Released schema lock
0709 13:18:09.219216 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:09.219588 (+   372us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:09.219620 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":198202,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":132463,"apply.run_cpu_time_us":3933,"apply.run_wall_time_us":192876,"num_ops":9,"prepare.queue_time_us":139532,"prepare.run_cpu_time_us":5018,"prepare.run_wall_time_us":297762,"replication_time_us":252349,"thread_start_us":90043,"threads_started":2}]]}
I20260709 13:18:11.100864 21148 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.102075 21148 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:11.102845 21362 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.104557 21361 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.104928 21362 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.106356 19478 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:11.106980 21364 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:11.107246 19478 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.107415 21364 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.107831 21364 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:11.108439 19478 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.114863 19627 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:11.117911 21392 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:11.118400 21392 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:11.118782 21392 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:11.089511 21211 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:11.120543 21211 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.120899 21211 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:11.059437 21299 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:18:11.128216 21151 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.129830 21391 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:11.133352 21384 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:11.134342 21384 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:11.135212 19476 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:11.135087 21384 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:11.135923 21372 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.136713 21367 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:11.137069 21367 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:11.137249 21231 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:11.130340 21391 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:11.137564 19478 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:11.137873 21367 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.138451 21391 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:11.139041 21367 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:11.139007 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:11.140560 21372 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.141155 21293 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:11.141534 21322 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:11.141976 21322 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:11.142341 21322 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:11.142678 21361 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.136207 19476 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:11.141531 21293 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:11.078434 21376 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:18:11.137801 21231 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.111501 21313 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.152695 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1290) took 1006 ms. Trace:
W20260709 13:18:11.144796 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 46386.9us
I20260709 13:18:11.150540 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.154454 19657 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:11.136375 21384 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:11.152402 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.156096 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.156426 19656 raft_consensus.cc:2393] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 4: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:11.159104 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:11.160296 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:11.153264 19654 rpcz_store.cc:276] 0709 13:18:10.146739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.146892 (+   153us) service_pool.cc:224] Handling call
0709 13:18:11.152490 (+1005598us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b54002c88d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:11.152605 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1330989440}
I20260709 13:18:11.162287 19476 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:11.163265 21151 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:11.163914 21151 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.165076 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.163324 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.168428 21221 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:11.169302 21231 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.170387 21280 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:11.171327 21221 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:18:11.172195 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 204297us
I20260709 13:18:11.173662 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.166144 19657 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:11.174769 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:11.174997 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:11.175629 19656 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:11.176688 19661 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:11.093910 21377 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.178786 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.179103 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.180313 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.144754 21305 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.121555 21193 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:18:11.148190 21293 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:11.149117 21255 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:11.181830 19661 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:11.183697 19652 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:11.196961 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.189343 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.197885 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.191198 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.192741 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:11.198923 19504 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:11.201038 19656 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:11.193348 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.194839 19509 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:11.189913 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.202405 19512 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:11.154615 21313 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:11.154773 21381 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:11.178208 21151 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:11.184702 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.180371 21321 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:11.172842 21384 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.206036 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.198354 19476 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:11.223064 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.224678 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.225322 19509 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:11.182111 21372 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:11.227409 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 79762.8us
I20260709 13:18:11.228211 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.225983 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.189888 21225 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:11.196943 21255 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.233198 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:11.233886 19508 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:11.236346 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.183105 21207 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:18:11.240607 19504 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:11.241041 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.243927 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:11.244530 19510 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:11.204977 21381 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:11.226682 21233 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:11.254734 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:11.227002 21384 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:11.234230 21299 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:11.262084 19510 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:11.262302 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:11.238232 21255 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:11.265702 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:11.268150 19510 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:11.274627 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.276583 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.278349 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.279523 19656 raft_consensus.cc:2410] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:11.280090 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.284237 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.285169 19661 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:11.286375 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.287783 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.288807 19656 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:18:11.291668 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.292948 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.294052 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.257539 21381 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:11.301604 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.258117 21361 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:11.252323 21397 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:11.264577 21299 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.306481 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.314232 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.264457 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:11.323325 21385 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:18:11.327474 21322 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.329656 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.303061 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.317552 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.268723 21221 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:11.306142 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:11.302094 21399 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:18:11.331259 19652 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:11.299964 21233 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:11.332718 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.264308 21280 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
W20260709 13:18:11.344141 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 81194.4us
I20260709 13:18:11.345556 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.346227 19657 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:11.307840 19656 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:11.269392 21176 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.349903 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.339648 19508 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:11.351039 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.351733 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.351600 19510 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:11.352382 19656 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:18:11.352890 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.340160 19661 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:11.323896 21299 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:11.349220 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.364784 19510 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 4: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:11.347744 19625 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:11.341468 21233 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:11.320828 21359 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.371423 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:11.371605 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57134.7us
W20260709 13:18:11.356809 21394 log.cc:927] Time spent T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:18:11.358341 21279 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:11.338294 20663 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:11.358778 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 217603us
I20260709 13:18:11.380121 19478 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.360952 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.380384 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:11.367427 21397 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.367710 21372 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.368186 21362 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.368521 21245 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.369185 21071 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.367756 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.355618 20989 consensus_queue.cc:1059] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:18:11.372720 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.411849 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.412896 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:11.373253 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.413568 19510 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 5: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:11.376395 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.354777 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.382332 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.390060 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.350580 21322 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.347486 21221 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:18:11.405560 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 57883.7us
I20260709 13:18:11.371481 21233 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:11.409498 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.383277 21359 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:11.414919 19506 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:11.415750 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.416374 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:11.421984 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.422465 19661 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 5: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:11.418385 19652 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:11.417308 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.422849 19506 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:11.423794 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:11.408757 19478 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.423923 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.422070 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:11.425446 21371 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:11.425268 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:11.427538 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.420485 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.425249 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.428578 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.429693 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:11.430845 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:11.431856 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 51604.6us
I20260709 13:18:11.432699 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:11.433424 19627 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:11.436101 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:11.436589 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:11.437477 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:11.435891 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:11.431401 19582 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:11.440032 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:11.416635 21386 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:11.441378 19627 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:11.442274 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:11.445680 19584 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:18:11.446482 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:11.446182 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:11.418380 21225 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:11.443130 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:11.443240 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:11.411882 21292 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:11.427065 21377 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:11.415227 21054 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:11.449419 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.449213 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:11.438541 21207 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:11.473206 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.438854 21198 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:11.425859 21371 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:11.454948 19659 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:11.455000 19582 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:11.443570 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:11.455546 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:11.454005 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:11.456372 19661 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 5: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:11.449154 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:11.432135 21361 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.443853 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:11.438512 21382 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:11.480556 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:11.482843 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:11.478700 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:11.480815 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:11.442386 21279 consensus_queue.cc:1059] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:18:11.464645 21417 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:11.465865 21419 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:11.467496 19625 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:11.421222 21359 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.417200 21071 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:18:11.491331 19625 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:11.474524 19506 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:11.458129 21049 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:11.476841 19578 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:11.462219 21292 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:11.410503 21362 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.383235 21397 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.478029 19585 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:11.483459 19661 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:11.406889 21372 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.482719 21382 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.463433 21414 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:11.484876 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:11.550679 19508 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 5: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:11.481046 19478 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:11.551954 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 71014.3us
I20260709 13:18:11.553195 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.482161 21302 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.445281 21386 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:11.409319 21245 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.461020 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:11.494241 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.492487 19625 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:11.495216 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 53920.4us
I20260709 13:18:11.461402 21401 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:11.501274 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:11.446542 21364 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.503362 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:11.479595 21371 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:11.484002 19587 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:11.477560 21405 raft_consensus.cc:3055] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:11.543325 19583 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:11.492913 21359 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:11.547464 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:11.490463 21417 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:11.588168 21397 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.592669 21333 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:11.589813 19586 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:18:11.593628 21386 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:11.501842 21292 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:11.502637 21279 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:11.617776 19585 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:18:11.594367 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 165844us
I20260709 13:18:11.814754 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.490604 21419 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:11.504563 21049 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:11.592608 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 100196us
I20260709 13:18:11.623221 19627 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:11.542174 21382 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:11.589555 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
W20260709 13:18:11.822695 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 233231us
W20260709 13:18:11.822813 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 199662us
I20260709 13:18:11.823737 19478 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:11.593200 21376 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:11.590297 19582 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:11.707774 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:11.503216 21221 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.766775 19583 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:11.823915 21279 raft_consensus.cc:697] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:11.758100 19578 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:11.834020 21279 consensus_queue.cc:237] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.648330 21176 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:11.636807 21417 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:11.749874 21211 consensus_meta.cc:287] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.619s	user 0.014s	sys 0.001s
I20260709 13:18:11.841177 21211 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.835750 21231 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:11.842182 21231 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:11.842552 21231 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:11.842896 21392 consensus_meta.cc:287] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.724s	user 0.012s	sys 0.000s
I20260709 13:18:11.617213 21401 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:11.843541 21401 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:11.843317 21392 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.649885 21333 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:11.625300 21393 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:11.632124 21405 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:11.734352 21306 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.791703 19659 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
W20260709 13:18:11.790045 21413 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:18:11.800619 19658 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:11.823985 21245 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.822304 21415 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:11.835685 21305 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:11.805742 21313 consensus_meta.cc:287] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.000s
I20260709 13:18:11.772045 19503 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:11.734030 21071 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.589422 21293 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:11.877359 21406 log.cc:927] Time spent T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.241s	user 0.000s	sys 0.004s
I20260709 13:18:11.816605 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:11.818712 21255 consensus_meta.cc:287] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.005s
I20260709 13:18:11.826591 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:11.827191 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.827500 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.828800 21049 raft_consensus.cc:697] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:11.829289 21376 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.824874 19478 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:11.888767 21383 consensus_meta.cc:287] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.828s	user 0.009s	sys 0.003s
I20260709 13:18:11.844921 19653 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:11.814836 21302 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:11.818075 21419 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:11.802475 19580 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:11.878712 19582 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
W20260709 13:18:11.880465 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.769686 19661 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:11.828504 21364 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.885241 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:11.909559 19507 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:18:11.882563 21394 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.003s	sys 0.017s
W20260709 13:18:11.875046 21367 consensus_meta.cc:287] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.735s	user 0.005s	sys 0.008s
I20260709 13:18:11.873493 21233 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.800073 21362 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:11.876719 21151 consensus_meta.cc:287] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.002s
I20260709 13:18:11.843343 21211 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:11.864846 21333 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:11.890664 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 74099.6us
I20260709 13:18:11.892321 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:11.872973 21054 raft_consensus.cc:3055] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:11.827661 21169 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:11.839975 21391 consensus_meta.cc:287] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.000s
W20260709 13:18:11.902532 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 77718.2us
I20260709 13:18:11.905010 21305 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:11.884779 21385 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:11.904152 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 77635.1us
I20260709 13:18:11.907660 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:11.927944 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:11.887879 21393 raft_consensus.cc:697] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:11.894485 21071 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:11.914441 19512 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:11.915482 19503 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:11.893290 21255 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.943212 21255 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.943639 19627 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:11.944802 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:11.922474 19478 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:11.889917 21384 consensus_meta.cc:287] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.626s	user 0.004s	sys 0.007s
I20260709 13:18:11.889102 21313 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.949080 21384 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.951246 21384 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.945818 21385 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.951839 21367 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:11.952081 19478 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.952867 19505 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 5: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:11.953541 19510 raft_consensus.cc:2393] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:18:11.911446 21394 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.003s	sys 0.017s
I20260709 13:18:11.956358 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:11.922994 21169 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.923311 21054 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:11.928750 21305 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:11.903777 21376 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:11.928077 19509 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:11.929298 21233 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.933029 21293 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.916512 21364 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.934464 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:11.938740 21299 consensus_meta.cc:287] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.001s
I20260709 13:18:11.940585 21372 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:11.952271 21367 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:11.921972 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:11.981599 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:11.928225 21412 consensus_queue.cc:1059] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:18:11.941154 21231 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.946280 21071 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:11.953269 21385 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:11.913761 21420 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:11.909107 21383 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.983486 19503 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:11.920491 21151 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.015015 19476 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:11.987589 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:11.962232 21279 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:11.987736 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:11.956130 21193 raft_consensus.cc:2764] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:11.989548 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:11.996047 21313 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.062454 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:12.020857 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:12.063822 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:12.064209 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 49258.1us
I20260709 13:18:11.975960 21305 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.067956 19509 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:11.967072 21392 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:11.927989 21391 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:11.979952 21384 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:11.962855 21211 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:11.961993 21169 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.015638 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:12.027136 19583 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:11.997960 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45955.9us
I20260709 13:18:12.021989 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.066639 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:11.989890 21407 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:11.985828 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 63962.4us
I20260709 13:18:12.068100 19627 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:12.069815 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:12.071616 19511 raft_consensus.cc:2393] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 7: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:11.985188 21367 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.015589 21071 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.076356 19580 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:11.914132 21405 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.079545 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:12.079586 19503 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:12.081193 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:12.013243 21372 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:11.985344 21280 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 13:18:12.076860 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:12.062336 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 46091.4us
I20260709 13:18:11.985266 21049 consensus_queue.cc:237] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.086097 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.076917 19585 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:12.086350 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:11.989188 21364 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.090752 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:12.093128 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.094698 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.089517 19478 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:12.094805 19627 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:12.096679 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.096848 19478 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:11.988879 21299 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.101920 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:12.122198 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:12.078044 21384 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:12.127638 19627 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:12.127842 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.084111 21221 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:12.073154 21371 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.088830 21293 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:12.111137 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:12.152732 19660 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:12.015445 21435 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:18:12.112151 21151 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:12.112321 21434 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:18:12.116699 21383 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.118147 21231 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.157315 21293 raft_consensus.cc:697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:12.118484 21386 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.076210 21437 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:12.130841 21148 raft_consensus.cc:2764] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:18:12.120110 19507 raft_consensus.cc:2393] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 4: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:12.110766 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:12.103336 19653 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:12.122978 19512 raft_consensus.cc:2368] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6.
W20260709 13:18:12.085150 20663 consensus_meta.cc:287] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.676s	user 0.009s	sys 0.006s
I20260709 13:18:12.124228 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:12.085316 21362 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:12.129572 19582 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:12.108935 21305 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.086557 21372 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:12.110728 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:12.104758 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:12.084378 21279 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:12.149506 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:12.166550 21425 log.cc:927] Time spent T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:18:12.156301 19627 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:12.155205 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:12.095434 21217 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:12.149268 21359 consensus_meta.cc:287] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.509s	user 0.003s	sys 0.007s
I20260709 13:18:12.078306 21393 consensus_queue.cc:237] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.171305 19586 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:12.070608 21054 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.119318 21364 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.175830 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:12.181861 21362 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:12.176097 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:12.091347 21245 consensus_queue.cc:1059] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:18:12.193136 21049 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:12.198623 21293 consensus_queue.cc:237] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.184255 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:12.154038 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57253.1us
I20260709 13:18:12.188993 19585 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:12.126686 21414 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
W20260709 13:18:12.189193 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 84545.8us
I20260709 13:18:12.210273 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:12.199600 21437 raft_consensus.cc:697] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:12.222930 19658 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:12.201033 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:12.224741 21367 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.126679 21313 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:12.181773 20663 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:12.227849 20663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59444 (request call id 55) took 1041 ms. Trace:
I20260709 13:18:12.197881 21211 consensus_queue.cc:1059] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:18:12.228353 20663 rpcz_store.cc:276] 0709 13:18:11.204694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.226767 (+ 22073us) service_pool.cc:224] Handling call
0709 13:18:12.227733 (+1000966us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:12.229168 21211 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:12.189885 21372 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.205686 19512 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 4: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:12.233843 21391 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:12.200059 21381 consensus_meta.cc:287] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.880s	user 0.014s	sys 0.005s
I20260709 13:18:12.191988 21383 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:12.153278 21390 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:12.208025 21424 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:12.205319 21417 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.191901 19627 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:12.245636 21417 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:12.245721 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 53941.5us
I20260709 13:18:12.246289 21417 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:12.246493 19627 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:12.212157 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:12.238674 21313 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:12.247579 21313 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.214046 21371 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.214150 21245 raft_consensus.cc:3055] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:12.214737 21414 consensus_queue.cc:1243] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:12.217890 21054 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.248924 21245 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:12.202389 21217 raft_consensus.cc:697] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:12.250233 21245 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.209524 21292 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.220332 21382 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.201982 21384 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.199828 21359 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.223155 21437 consensus_queue.cc:237] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.192121 21419 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.233894 19512 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:12.246654 21417 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.237659 21381 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.264701 19584 raft_consensus.cc:2368] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5.
W20260709 13:18:12.264972 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 54306.5us
I20260709 13:18:12.206372 21362 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.242149 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:12.131878 21407 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:12.248034 19510 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:12.248608 21412 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:12.253649 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:12.157693 21377 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:12.248638 21424 raft_consensus.cc:697] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:12.251113 21217 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.255072 21245 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.198511 19578 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:12.257345 19587 raft_consensus.cc:1240] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:12.263532 21382 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.263783 20989 raft_consensus.cc:993] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:18:12.255244 21302 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:12.229578 21211 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:12.265702 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:12.271013 19512 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:12.301288 19512 pending_rounds.cc:85] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 2
I20260709 13:18:12.301556 19512 pending_rounds.cc:107] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:12.301940 19512 raft_consensus.cc:2889] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:12.217417 21169 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.304136 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:12.289149 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 47129.1us
I20260709 13:18:12.296952 19657 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:12.269167 21417 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.263603 21367 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.293658 21383 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:12.294842 21049 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:12.312848 21377 raft_consensus.cc:1081] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Signalling peer d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:18:12.313275 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:12.297880 21386 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:12.315531 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 49940.1us
I20260709 13:18:12.294411 21440 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:12.319059 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:12.326511 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:12.325796 21148 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.327425 21148 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.328156 21071 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.320091 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.315655 21364 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:12.330005 19582 raft_consensus.cc:2393] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:12.304633 21299 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.325016 21372 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.334013 21383 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:12.364583 21383 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:12.365051 21383 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.366751 21362 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.336282 21148 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.338006 21071 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.339303 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.341357 21231 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:12.340885 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.380276 21313 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.380999 21362 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:12.382774 21444 log.cc:927] Time spent T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:12.380342 21372 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.344264 21376 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.344533 21419 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:12.346285 21364 raft_consensus.cc:697] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:12.346287 21233 raft_consensus.cc:3055] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:12.352012 21169 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:12.353259 21292 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.353756 21424 consensus_queue.cc:237] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.326062 21415 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:12.354848 21211 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.396101 21211 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.356581 21381 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:12.356977 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.398679 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.359696 21333 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.399339 19579 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.361410 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:12.401643 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 69108.3us
I20260709 13:18:12.402364 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:12.404549 19551 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:12.405500 19579 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:12.316680 21359 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.335024 21305 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.371269 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.373962 19625 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:12.399245 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.406517 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.412142 19506 raft_consensus.cc:2393] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 7: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:12.407647 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:12.387809 21313 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.401451 21333 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.412596 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.414250 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.415053 19581 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.417950 21376 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.410581 21415 raft_consensus.cc:2764] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:12.415041 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.389354 21233 raft_consensus.cc:740] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:12.423718 19476 leader_election.cc:400] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4.
I20260709 13:18:12.331794 21440 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.443274 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.443980 19583 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:12.444301 21440 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.332320 21401 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.449424 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1590) took 1226 ms. Trace:
I20260709 13:18:12.449753 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:12.450428 19504 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:12.450068 19511 rpcz_store.cc:276] 0709 13:18:11.222741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.222845 (+   104us) service_pool.cc:224] Handling call
0709 13:18:12.449201 (+1226356us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b5400081e54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:12.449344 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1949684480}
I20260709 13:18:12.451439 21401 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:12.425693 21359 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:12.454685 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1242) took 1181 ms. Trace:
I20260709 13:18:12.455003 21383 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.455250 19506 rpcz_store.cc:276] 0709 13:18:11.273165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.493405 (+220240us) service_pool.cc:224] Handling call
0709 13:18:12.454412 (+961007us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b540012f554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:12.454592 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1885098880}
I20260709 13:18:12.456175 19585 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:12.456470 19583 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:12.460150 19507 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:12.461766 20664 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:12.462512 19507 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:12.431073 21417 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.465327 21417 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:12.427670 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 53821.4us
I20260709 13:18:12.480072 19625 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:12.480629 21422 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:12.429072 21233 consensus_queue.cc:260] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.430446 21280 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:12.430859 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.430791 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.409183 21071 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:12.410101 21372 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:12.433667 21364 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.463645 19504 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:12.485992 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:12.486848 19510 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 5: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:18:12.487506 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.487666 21378 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:12.465463 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:12.466557 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:12.499293 19506 raft_consensus.cc:2368] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7.
I20260709 13:18:12.500135 21376 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.500370 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:12.500654 21376 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.467639 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:12.468660 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:12.424736 19581 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:12.503481 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.504189 19581 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.423928 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.505944 19579 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.457475 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:12.507031 19583 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 1.
I20260709 13:18:12.508174 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.470662 21176 consensus_queue.cc:1059] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:12.474663 21384 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:12.477871 21221 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:12.481319 19625 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:12.483415 19587 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.520453 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:12.489144 19582 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.424657 19551 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:12.491230 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:12.492522 19658 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:12.521664 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 97091.8us
I20260709 13:18:12.522243 19660 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:12.522557 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:12.522707 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:12.523424 19658 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:12.492967 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:12.524158 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:12.524801 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:12.525305 19656 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.501099 19652 raft_consensus.cc:2393] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:12.471773 21383 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.509531 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:12.518888 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:12.510188 19511 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:50822
I20260709 13:18:12.531023 19653 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:12.531363 19511 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:12.531764 19511 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.531915 19625 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:12.532629 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:12.533192 19660 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.533353 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:12.534427 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:12.534729 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1598) took 1295 ms. Trace:
I20260709 13:18:12.535274 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:12.536346 19582 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:12.520220 21233 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.538089 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.538748 19583 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.540068 19551 leader_election.cc:400] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6.
I20260709 13:18:12.540417 19551 leader_election.cc:403] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:18:12.540277 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:12.541021 19581 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:12.541893 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:12.542480 19581 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:12.542732 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:12.543412 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.544516 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:12.545584 19581 raft_consensus.cc:2410] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:12.552456 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:12.522642 21378 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:12.520244 21221 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:12.556355 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:12.719628 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.807652 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.611639 19583 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:12.829161 19583 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:12.565120 19507 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:12.639426 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:12.536162 21372 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:12.536032 21071 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:12.542037 21359 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:12.572146 19587 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:12.540028 21415 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:12.556725 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:12.831092 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:12.775501 19656 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
W20260709 13:18:12.826273 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 294411us
I20260709 13:18:12.839291 19653 raft_consensus.cc:2410] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:12.832211 19583 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:12.839955 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:12.541951 21417 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:12.538105 21217 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:12.810405 19585 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:12.835203 19579 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:12.837680 19587 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:12.574110 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:12.842422 19660 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:12.696007 19511 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.566301 21362 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6.
I20260709 13:18:12.860787 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:12.861485 19583 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:12.573581 21401 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:12.636621 21280 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:12.702704 21407 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.832029 21405 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:12.866876 19655 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:12.867784 19587 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:12.877928 21280 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:12.831532 21361 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:18:12.882681 21280 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.883435 19587 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:12.883181 21407 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.883875 21280 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.884559 19587 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:12.880417 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:12.885713 19652 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.868319 21359 consensus_queue.cc:1059] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:12.842960 21415 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.870045 19660 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:12.869059 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:12.885347 21407 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:12.859398 21437 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:12.864758 21381 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:18:12.864887 21169 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 13:18:12.875098 21451 log.cc:927] Time spent T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:18:12.911087 19657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1328) took 1213 ms. Trace:
I20260709 13:18:12.876017 21417 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:12.828944 21176 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:12.875842 19579 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:12.565706 21383 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:12.845218 21448 log.cc:927] Time spent T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:18:12.878211 19625 leader_election.cc:400] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7.
I20260709 13:18:12.923413 19625 leader_election.cc:403] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:18:12.923768 19585 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:12.924049 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 46624.2us
I20260709 13:18:12.880611 19581 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:12.888872 21376 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.894908 21437 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:12.890941 21415 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.876904 21401 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.947393 21401 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.875994 21302 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:18:12.952073 21302 raft_consensus.cc:3055] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:12.952486 21302 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:12.953341 21302 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.955876 21401 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.957101 21217 raft_consensus.cc:3055] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:12.957500 21217 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:12.958415 21217 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.927350 21176 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:12.954540 21302 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.963853 19661 raft_consensus.cc:2410] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:12.891896 21306 consensus_queue.cc:1059] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:12.911614 19657 rpcz_store.cc:276] 0709 13:18:11.697982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.698222 (+   240us) service_pool.cc:224] Handling call
0709 13:18:12.910897 (+1212675us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54000e83d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:12.911022 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083121920}
I20260709 13:18:12.875180 21416 raft_consensus.cc:3055] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:12.925275 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:12.929848 19511 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:12.930712 19578 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:12.943374 21437 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:12.901482 19476 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:12.962685 21176 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:12.971967 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:12.972802 20664 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 4: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:12.973222 21417 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.972165 21401 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:12.975607 21148 raft_consensus.cc:3055] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:12.978367 19579 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:12.980120 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:12.980729 19658 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:12.985809 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 155994us
W20260709 13:18:12.989332 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 87934.8us
I20260709 13:18:12.989521 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:12.990806 19478 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:12.990747 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:12.994534 19652 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:12.998255 19652 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:13.003430 19579 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:13.004642 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:13.005400 19579 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 4: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:13.006408 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:13.006470 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:13.007138 19581 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:13.008687 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:12.976052 21148 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:12.535076 19508 rpcz_store.cc:276] 0709 13:18:11.239676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.596057 (+356381us) service_pool.cc:224] Handling call
0709 13:18:11.596467 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.618598 (+ 22131us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:12.390858 (+772260us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b180023ef00. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c313024bc 00007f6c2e65048b 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66a455 00007f6c351523c7 00007f6c317649a7 00007f6c317740bf
0709 13:18:12.391972 (+  1114us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.534401 (+142429us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.534456 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:12.534495 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.534555 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.534679 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18876,"prepare.queue_time_us":120978,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":1330,"raft.queue_time_us":7875,"spinlock_wait_cycles":58012928,"thread_start_us":247665,"threads_started":2}
I20260709 13:18:13.024753 19657 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:13.026940 19478 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:13.027555 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:13.027765 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:13.028087 19508 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:13.028213 19478 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:13.028348 19507 raft_consensus.cc:2368] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7.
I20260709 13:18:13.028288 19511 raft_consensus.cc:2368] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5.
I20260709 13:18:13.035254 19581 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
W20260709 13:18:13.037789 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 112603us
I20260709 13:18:13.038359 19581 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:12.967418 21416 raft_consensus.cc:740] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:12.970307 21391 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:12.928213 21383 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.045496 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:13.046654 19506 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:13.060065 19510 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:13.060667 19503 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:13.061031 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:13.004060 21211 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7.
I20260709 13:18:13.052304 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:13.052868 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:13.069670 19657 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:13.044600 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:13.054075 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:13.054436 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:13.045044 19511 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:13.021032 21362 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:13.058902 19509 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:13.062224 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:13.047675 19508 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 5. Ops: []
I20260709 13:18:13.064821 19503 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:18:13.026010 21438 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:13.067577 19652 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:13.025748 21333 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:13.053557 21364 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:13.053755 21176 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:13.061472 21391 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:12.966791 21378 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.021068 21361 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:18:13.071043 19659 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:13.045087 19658 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:13.098129 19579 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:13.092650 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:13.071250 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:13.088235 19507 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:13.058476 21440 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:13.102626 19506 raft_consensus.cc:2410] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:13.101490 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:13.113638 19509 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:13.120602 19510 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:13.073583 21437 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:13.090880 21333 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.096632 21383 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:13.097239 21407 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:18:13.111923 21364 raft_consensus.cc:697] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:13.133670 19408 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 42) took 4513 ms. Trace:
I20260709 13:18:13.099243 21386 consensus_queue.cc:1059] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:18:13.106868 21176 raft_consensus.cc:697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:13.100282 21377 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:18:13.096598 21422 consensus_queue.cc:1059] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:18:13.106952 21393 consensus_queue.cc:1059] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:18:13.146458 19509 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:13.137877 19408 rpcz_store.cc:276] 0709 13:18:08.620503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.620668 (+   165us) service_pool.cc:224] Handling call
0709 13:18:13.133589 (+4512921us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:10.936515 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:10.937362 (+   847us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:10.937415 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:18:10.937444 (+    29us) tablet.cc:662] Decoding operations
0709 13:18:10.938137 (+   693us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:10.938244 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:10.938303 (+    59us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:10.938666 (+   363us) tablet.cc:701] Row locks acquired
0709 13:18:10.938695 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:18:10.943400 (+  4705us) write_op.cc:270] Start()
0709 13:18:10.953379 (+  9979us) write_op.cc:276] Timestamp: P: 1783603090943332 usec, L: 0
0709 13:18:10.953411 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:18:10.954207 (+   796us) log.cc:844] Serialized 984 byte log entry
0709 13:18:12.262651 (+1308444us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b180038dd60. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c3519141d 00007f6c3519371a 00007f6c351936a8 00007f6c35193628 00007f6c351935e3 00007f6c351927fc 00007f6c375c5626 00007f6c375bfdd8 00007f6c31766310
0709 13:18:12.262739 (+    88us) op_driver.cc:464] REPLICATION: finished
0709 13:18:12.415196 (+152457us) write_op.cc:301] APPLY: starting
0709 13:18:12.415300 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:12.415441 (+   141us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:12.415461 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:12.415824 (+   363us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:12.416001 (+   177us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:18:12.416046 (+    45us) write_op.cc:312] APPLY: finished
0709 13:18:12.416252 (+   206us) log.cc:844] Serialized 28 byte log entry
0709 13:18:12.416432 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:12.416520 (+    88us) write_op.cc:454] Released schema lock
0709 13:18:12.416557 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:12.416928 (+   371us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:12.416955 (+    27us) write_op.cc:454] Released schema lock
0709 13:18:12.436162 (+ 19207us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b54002ec7d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175732a 00007f6c316dcf14 00007f6c316dcec3 00007f6c316dce38 00007f6c316dcdf3 00007f6c316dc0dc 00007f6c31705e16 00007f6c316edcbb 00007f6c316d839d 00007f6c316dbd75
Metrics: {"mutex_wait_us":494127,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":140312,"apply.run_cpu_time_us":1770,"apply.run_wall_time_us":7066,"num_ops":2,"prepare.queue_time_us":312718,"prepare.run_cpu_time_us":30557,"prepare.run_wall_time_us":213622,"raft.queue_time_us":550180,"raft.run_cpu_time_us":22983,"raft.run_wall_time_us":507700,"replication_time_us":1006553,"spinlock_wait_cycles":42796544,"thread_start_us":969731,"threads_started":4,"wal-append.queue_time_us":231088}]]}
I20260709 13:18:13.137025 21333 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:13.094933 21148 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.127234 21401 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:18:13.115856 21416 consensus_queue.cc:260] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:13.206117 21416 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:13.205927 21176 consensus_queue.cc:237] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.192737 21386 raft_consensus.cc:3055] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:13.210093 21386 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:13.211287 21386 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.213048 21386 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:13.111693 21306 consensus_queue.cc:1059] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:18:13.174162 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:13.215096 21438 raft_consensus.cc:3055] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:13.215505 21438 raft_consensus.cc:740] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:13.215912 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:13.216354 21438 consensus_queue.cc:260] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.216835 21233 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:13.217135 19551 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:13.217474 21233 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.137274 21169 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:18:13.188814 21455 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.218756 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:13.201783 21364 consensus_queue.cc:237] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.218091 21233 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:13.219291 21071 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:18:13.222105 21458 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:13.223708 21362 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:13.198119 21148 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:13.145475 19581 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:13.226366 21455 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.235715 19581 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:13.218154 21419 consensus_queue.cc:1175] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d56df3728fc04e37b2d29a3bcd91d167" responder_term: 3 status { last_received { term: 3 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 3 index: 5 } }
I20260709 13:18:13.240716 21455 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:13.226588 21415 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.249249 21415 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:13.250542 19580 raft_consensus.cc:2368] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6.
I20260709 13:18:13.261257 19476 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:13.285580 19476 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:13.309455 19476 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:13.319777 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.322474 19581 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:13.325120 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:13.326447 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:13.327544 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:13.333892 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1517) took 1310 ms. Trace:
W20260709 13:18:13.336218 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 280056us
I20260709 13:18:13.337284 19478 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:13.339071 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1532) took 1046 ms. Trace:
W20260709 13:18:13.346021 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.346964 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.347761 19627 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:13.349279 19627 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:13.339567 19583 rpcz_store.cc:276] 0709 13:18:12.293053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.867091 (+574038us) service_pool.cc:224] Handling call
0709 13:18:12.867400 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.867604 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.867633 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:12.868131 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.107290 (+239159us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:13.338367 (+231077us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.338630 (+   263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.338707 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.338782 (+    75us) raft_consensus.cc:1685] finished
0709 13:18:13.338819 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.338991 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":135983,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"thread_start_us":400385,"threads_started":2,"wal-append.queue_time_us":353517}
I20260709 13:18:13.370559 19627 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:13.390755 21422 consensus_queue.cc:1243] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:13.391004 21440 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:13.391261 21384 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:13.405573 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 220781us
I20260709 13:18:13.395921 21302 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.394373 21376 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:13.413283 19625 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:13.402833 20666 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:13.416833 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 198162us
I20260709 13:18:13.407924 21407 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:13.438118 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 126723us
W20260709 13:18:13.453441 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.454548 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1271) took 1008 ms. Trace:
I20260709 13:18:13.454963 19585 rpcz_store.cc:276] 0709 13:18:12.446027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.972124 (+526097us) service_pool.cc:224] Handling call
0709 13:18:12.972419 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.972618 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:13.288647 (+316029us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.454204 (+165557us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.454257 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:13.454299 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.454376 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.454492 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14757,"prepare.queue_time_us":261153,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":6588,"thread_start_us":466031,"threads_started":2}
I20260709 13:18:13.413506 21361 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:13.413398 21422 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:13.416195 21440 raft_consensus.cc:697] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:13.443045 19476 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:13.424710 21416 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:18:13.460654 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 90193.8us
I20260709 13:18:13.472667 19627 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:13.473839 19627 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:13.422649 21384 raft_consensus.cc:697] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:13.469955 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:13.483767 19583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:60828
I20260709 13:18:13.484503 19583 raft_consensus.cc:606] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:13.484994 19583 raft_consensus.cc:614] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:13.459802 21407 raft_consensus.cc:697] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:13.424381 21302 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.501413 19658 raft_consensus.cc:3055] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:13.501824 19658 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:13.492946 19551 leader_election.cc:400] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7.
I20260709 13:18:13.472784 21466 raft_consensus.cc:2764] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:18:13.505501 19551 leader_election.cc:403] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:18:13.512290 19551 leader_election.cc:400] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5.
I20260709 13:18:13.422202 21467 consensus_queue.cc:1059] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:18:13.495630 19627 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:13.512611 19551 leader_election.cc:403] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:13.494328 21377 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:13.511505 19658 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.503822 21422 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:13.508319 21469 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:13.492820 21478 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:13.518361 19627 leader_election.cc:400] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5.
W20260709 13:18:13.522341 21465 log.cc:927] Time spent T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:18:13.523044 21464 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 13:18:13.523509 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.523626 21459 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:18:13.525938 21407 consensus_queue.cc:237] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.526861 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1514) took 1504 ms. Trace:
I20260709 13:18:13.526952 21377 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:13.527863 19658 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:13.528553 21391 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:13.528638 21176 raft_consensus.cc:2764] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:13.506561 21071 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
W20260709 13:18:13.527875 21461 log.cc:927] Time spent T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:18:13.542917 21422 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:13.574759 19655 raft_consensus.cc:3055] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:13.575335 19655 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:13.562680 19658 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:13.550896 19584 rpcz_store.cc:276] 0709 13:18:12.022714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.811938 (+789224us) service_pool.cc:224] Handling call
0709 13:18:12.826339 (+ 14401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.106033 (+279694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.106063 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.106486 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.395132 (+288646us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:13.411339 (+ 16207us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.411624 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.411747 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.526617 (+114870us) raft_consensus.cc:1685] finished
0709 13:18:13.526638 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.526799 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2984,"prepare.queue_time_us":15311,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":6703,"raft.queue_time_us":29746,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":15337,"thread_start_us":564486,"threads_started":2,"wal-append.queue_time_us":418424}
I20260709 13:18:13.567615 21475 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.568928 19582 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:13.541373 21359 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5.
I20260709 13:18:13.505507 21435 consensus_queue.cc:1059] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:18:13.590487 19504 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:13.543124 21376 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:13.539402 21480 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:13.569716 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 65733.6us
I20260709 13:18:13.576377 19655 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.760838 19655 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:18:13.586225 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 249046us
W20260709 13:18:13.586486 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 74350.3us
I20260709 13:18:13.659168 21176 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:13.765362 19478 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:13.634460 21483 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:18:13.619199 19652 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:18:13.768666 19652 pending_rounds.cc:85] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 2
I20260709 13:18:13.635490 21221 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.542526 21440 consensus_queue.cc:237] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.568624 21169 consensus_queue.cc:1059] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:18:13.669996 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:13.773433 19658 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:13.617950 21422 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.642328 21302 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:13.660243 21386 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:13.774686 21359 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:18:13.566125 21492 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.783219 21492 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.635591 21233 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.785305 21500 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:13.334558 19586 rpcz_store.cc:276] 0709 13:18:12.023614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.828844 (+805230us) service_pool.cc:224] Handling call
0709 13:18:12.829093 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.829312 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:13.002383 (+173071us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.333366 (+330983us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.333449 (+    83us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:13.333513 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.333592 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.333807 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":356428,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":127,"thread_start_us":493904,"threads_started":2}
I20260709 13:18:13.627164 21377 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.549729 21333 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.785233 21407 raft_consensus.cc:3055] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:13.787529 19505 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 5: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:13.633314 21472 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:18:13.651690 21381 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:13.788573 21381 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:13.789534 21381 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.790153 19586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
new_leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
 from {username='slave'} at 127.0.0.1:60828
I20260709 13:18:13.731381 19409 catalog_manager.cc:5697] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.790937 19586 raft_consensus.cc:606] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Received request to transfer leadership to TS e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:13.791455 19586 raft_consensus.cc:614] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:13.791882 19409 catalog_manager.cc:5697] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:13.616036 19661 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1334) took 1514 ms (client timeout 1773 ms). Trace:
W20260709 13:18:13.676000 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.607204 21071 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.673789 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1537) took 1315 ms. Trace:
I20260709 13:18:13.828130 19580 rpcz_store.cc:276] 0709 13:18:12.358179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.639051 (+280872us) service_pool.cc:224] Handling call
0709 13:18:13.673517 (+1034466us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b5400227ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:13.673699 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965869952}
I20260709 13:18:13.685195 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1513) took 1664 ms. Trace:
I20260709 13:18:13.829452 19582 rpcz_store.cc:276] 0709 13:18:12.022256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.810940 (+788684us) service_pool.cc:224] Handling call
0709 13:18:12.811256 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.580742 (+769486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.684819 (+104077us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b5400226fd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:13.685109 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1741792000}
I20260709 13:18:13.567040 21384 consensus_queue.cc:237] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.573303 21478 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
W20260709 13:18:13.573997 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 102229us
I20260709 13:18:13.833958 19580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:60828
I20260709 13:18:13.834328 21458 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.834609 19580 raft_consensus.cc:606] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:13.835096 19580 raft_consensus.cc:614] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:13.834903 21458 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:13.795290 19661 rpcz_store.cc:269] 0709 13:18:12.101424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.101584 (+   160us) service_pool.cc:224] Handling call
0709 13:18:13.615645 (+1514061us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b5400021554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:13.615944 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1937774336}
I20260709 13:18:13.864465 21405 raft_consensus.cc:3055] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:13.865072 21405 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:13.866143 21405 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.868571 21401 raft_consensus.cc:3055] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:13.869091 21401 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:13.870136 21401 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.871860 21401 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:13.828130 21071 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.875425 21467 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:13.901062 21467 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.859973 21493 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:13.924573 21493 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:13.955721 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:13.986552 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1274) took 1001 ms. Trace:
I20260709 13:18:13.987133 19579 rpcz_store.cc:276] 0709 13:18:12.984802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.008471 (+ 23669us) service_pool.cc:224] Handling call
0709 13:18:13.986295 (+977824us) spinlock_profiling.cc:243] Waited 76.5 ms on lock 0x7b54003bef54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:13.986469 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175858944}
I20260709 13:18:13.987890 21435 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:13.989107 21417 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:18:13.990356 21435 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:13.992204 19476 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:13.994194 21466 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:13.994874 21466 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:13.995834 21466 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.999094 21148 raft_consensus.cc:3055] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:13.999614 21148 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:14.000557 21148 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.003132 21381 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:14.007323 21364 raft_consensus.cc:3055] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:14.007876 21364 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:14.008852 21364 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:14.083127 19506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.037s	sys 0.083s
W20260709 13:18:14.083789 19506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.038s	sys 0.083s
W20260709 13:18:14.087911 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 401379us
I20260709 13:18:14.101905 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:14.102957 19653 raft_consensus.cc:2368] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7.
I20260709 13:18:14.104657 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:14.105427 19653 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:14.118700 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.768040 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 108805us
I20260709 13:18:13.682242 21306 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.769150 19652 pending_rounds.cc:107] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:18:13.776437 21481 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.142217 21481 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:13.774565 21372 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:18:13.777777 21221 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:14.144683 21494 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:13.781924 21437 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:14.164666 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.168371 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:13.608238 21376 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.169679 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:14.163410 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 398153us
I20260709 13:18:13.568838 21469 raft_consensus.cc:697] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:14.173372 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:13.787483 21407 raft_consensus.cc:740] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:13.794886 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:14.176750 19509 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:14.176956 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:13.689554 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.827525 21333 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.134451 19652 raft_consensus.cc:2889] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:14.141347 21503 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.778044 21362 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:14.168923 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:14.170715 19478 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:14.454404 19460 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.001s	sys 0.011s
I20260709 13:18:14.163748 19409 catalog_manager.cc:5697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 2 to 3, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 3 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.182703 19503 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:14.525157 19509 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:18:14.525698 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:14.185254 19508 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:14.529593 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:14.532094 19508 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:18:14.467554 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.468398 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:14.257781 21054 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.023s	sys 0.046s
W20260709 13:18:14.535202 21054 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.024s	sys 0.046s
I20260709 13:18:14.469130 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:14.172986 19512 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:14.470445 19551 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.016s	sys 0.033s
W20260709 13:18:14.536769 19551 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.016s	sys 0.033s
W20260709 13:18:14.537362 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 593227us
I20260709 13:18:14.538766 19512 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:14.470958 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:14.540401 19506 raft_consensus.cc:2410] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:14.468423 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:14.541703 19511 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 5: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:14.541996 19503 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:14.542411 21424 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:14.211854 19652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1315) took 1157 ms. Trace:
I20260709 13:18:14.543450 21424 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:14.543596 19652 rpcz_store.cc:276] 0709 13:18:13.054687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.093775 (+ 39088us) service_pool.cc:224] Handling call
0709 13:18:13.618835 (+525060us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.180154 (+561319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.211635 (+ 31481us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b5400021550. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:14.211793 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1191190784}
I20260709 13:18:14.231977 19655 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
W20260709 13:18:14.546391 19655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1311) took 1495 ms (client timeout 1962 ms). Trace:
W20260709 13:18:14.546396 21280 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
W20260709 13:18:14.547013 19655 rpcz_store.cc:269] 0709 13:18:13.051004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.051144 (+   140us) service_pool.cc:224] Handling call
0709 13:18:13.574548 (+523404us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b5400406da0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316d1dc0 00007f6c3175de18 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:14.546085 (+971537us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762033024}
I20260709 13:18:14.548979 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:14.171499 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:14.551357 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 379804us
I20260709 13:18:14.552115 21424 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:14.491709 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:14.211937 19659 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:14.558209 19659 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:18:14.175130 21148 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:14.176859 21217 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:14.174546 21306 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.190963 21362 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:14.163345 21364 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:14.568557 21517 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.569460 21517 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.570369 21306 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.570055 21362 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:14.571559 19460 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.003s	sys 0.017s
I20260709 13:18:14.572403 21517 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.572857 21362 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:14.145346 21388 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.189476 21416 consensus_queue.cc:1059] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:18:14.578999 21388 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.579397 21416 consensus_queue.cc:1243] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:14.189649 21405 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.582178 19657 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:14.357357 21437 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:14.595579 21388 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:14.184226 21438 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.597019 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:14.300843 21458 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.336366 21467 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.179991 21468 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 13:18:14.289305 21469 consensus_queue.cc:237] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:14.367314 21480 consensus_meta.cc:287] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.000s
I20260709 13:18:14.324169 21481 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.295581 21492 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.611829 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:14.158850 21494 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:14.612857 19512 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:14.613046 19659 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:14.332985 21493 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.224027 21503 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.613988 21494 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.616119 21494 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:14.617108 21503 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:14.513185 21361 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:14.514818 21176 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.515698 21211 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:18:14.254079 20663 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.015s	sys 0.051s
I20260709 13:18:14.521533 21245 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:14.637063 21361 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.637729 21245 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.640431 21245 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:13.761999 21393 consensus_queue.cc:1175] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2cfd02601ea44976833027665abc93bf" responder_term: 4 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:14.522965 21233 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.531862 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:14.534066 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.224231 19510 raft_consensus.cc:1275] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:18:14.187880 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.553120 21504 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:14.176162 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:14.553669 21510 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:18:14.666265 21233 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.665882 21211 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:14.176640 21376 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:14.667002 21233 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.559549 21455 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:14.668833 21455 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.670163 21468 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:14.670652 21468 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:14.671029 21468 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:14.673167 21455 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.673908 21455 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.681936 21455 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.686041 21455 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.605044 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:14.609724 19508 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:14.608136 21480 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7.
W20260709 13:18:14.612087 21511 log.cc:927] Time spent T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.194s	user 0.002s	sys 0.000s
I20260709 13:18:14.697727 19660 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:14.606043 21169 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.511945 21359 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:14.698742 21071 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:13.785946 21500 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.618134 21458 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.699126 21359 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.699975 21458 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.701543 21500 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.702176 21458 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.618916 21481 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:14.698735 21169 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.703003 21481 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.705029 21481 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.599428 21424 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.705766 21233 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.705716 21424 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.706498 21359 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.707152 19652 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:14.708187 21424 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.708360 21504 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:14.709195 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 425593us
I20260709 13:18:14.709074 21504 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.711061 19476 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:14.711427 21393 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.712119 21393 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.713078 19476 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:14.714311 21364 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:14.714802 21364 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:14.714852 21467 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:18:14.636955 20663 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.016s	sys 0.051s
I20260709 13:18:14.641741 19579 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 3.
I20260709 13:18:14.656469 19627 leader_election.cc:400] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6.
I20260709 13:18:14.718904 19627 leader_election.cc:403] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:18:14.629276 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:14.660291 21245 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:14.640457 21361 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:14.676122 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 505367us
I20260709 13:18:14.597015 21437 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.676904 21176 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.677929 19658 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:14.679685 19657 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:14.689479 21376 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.732841 19504 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:14.606364 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:14.733865 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:14.734500 19660 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:18:14.734501 19506 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
I20260709 13:18:14.733896 21376 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.736228 21211 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:14.715334 21364 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:14.736814 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:14.737783 21376 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:14.738220 21376 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:14.738668 21376 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:14.675238 21407 consensus_queue.cc:260] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:14.742130 19653 consensus_meta.cc:287] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.617s	user 0.015s	sys 0.007s
I20260709 13:18:14.742969 19653 raft_consensus.cc:2410] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:14.719516 19659 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 3.
I20260709 13:18:14.729918 21280 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.744588 19503 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:14.744541 21280 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.729995 21245 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:14.731220 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 122407us
I20260709 13:18:14.731775 21176 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:14.605695 19655 raft_consensus.cc:2410] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:14.742867 21407 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.726878 19512 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:14.764338 20663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59442 (request call id 59) took 2466 ms. Trace:
I20260709 13:18:14.778692 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:14.779608 19659 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:14.795063 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:14.790652 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:14.798592 19652 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:14.798713 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:14.790606 21148 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:14.810407 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 73765.8us
I20260709 13:18:14.810623 19503 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:14.812531 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:14.813143 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.814221 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.826233 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:14.826093 21492 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.808280 21503 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6.
I20260709 13:18:14.829505 19653 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:14.831745 21176 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:14.832031 21372 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.832384 21176 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.832505 21372 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.833142 21504 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:14.834628 21176 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:14.835009 21364 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.835619 21280 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:14.815600 21148 raft_consensus.cc:697] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:14.837774 21221 consensus_meta.cc:287] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.693s	user 0.010s	sys 0.013s
I20260709 13:18:14.837949 21438 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:14.837270 21148 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.838395 21362 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.835700 21376 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.842159 21217 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:14.837383 21364 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.838615 21438 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:14.842916 21217 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:14.851677 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.853225 21393 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:14.766340 20663 rpcz_store.cc:276] 0709 13:18:12.297478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.298231 (+   753us) service_pool.cc:224] Handling call
0709 13:18:12.892878 (+594647us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b5800042f98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635eee 0000000000375939 00007f6c366a91e0 00007f6c367720c4 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:18:12.900301 (+  7423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.900780 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.900826 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:12.901430 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.317805 (+416375us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:13.747843 (+430038us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b18003b87e0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66a455 00007f6c351523c7 00007f6c317649a7 00007f6c317740bf 00007f6c31774038
0709 13:18:14.717531 (+969688us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.763186 (+ 45655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.763441 (+   255us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.763598 (+   157us) raft_consensus.cc:1685] finished
0709 13:18:14.763642 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.763963 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1022199,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":319,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":339,"spinlock_wait_cycles":38512640,"thread_start_us":1394930,"threads_started":3,"wal-append.queue_time_us":465554,"wal-append.run_cpu_time_us":3152,"wal-append.run_wall_time_us":1259798}
I20260709 13:18:14.855294 19551 leader_election.cc:400] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7.
I20260709 13:18:14.856630 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:14.857553 21221 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.857772 21455 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.858258 21221 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.858409 21455 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.861608 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:14.867496 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:14.871963 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:14.872725 19503 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:14.865789 21494 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.874500 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:14.873871 21494 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.875933 21372 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.877283 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:14.877557 21494 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.878029 19655 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:14.878115 21169 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:14.878311 21468 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.880843 21468 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.880942 20631 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:14.886195 21182 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:14.886629 21182 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:14.886823 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:14.887042 21182 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:14.887130 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:14.887614 19660 raft_consensus.cc:2393] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:14.887825 19653 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:14.870038 21424 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:18:14.889751 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 111854us
I20260709 13:18:14.890151 19504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:18:14.890960 19504 raft_consensus.cc:606] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:18:14.891400 19504 raft_consensus.cc:614] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:14.870819 21245 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.894309 21424 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.895363 21217 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.860965 21280 consensus_queue.cc:1059] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:18:14.895769 21221 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:14.896242 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 56853.4us
I20260709 13:18:14.839409 21492 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.897171 21376 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.869160 19656 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:14.899245 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:14.899660 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:14.900204 19655 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:14.900691 21523 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:14.843604 21362 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.903244 21438 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:14.904194 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:14.890870 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:14.917111 19652 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:14.892884 21193 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.908334 21503 raft_consensus.cc:3055] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:14.908960 19661 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:14.869100 21364 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.918135 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:14.916534 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:14.922574 21193 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.923238 21492 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.929026 19504 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 1.
I20260709 13:18:14.938546 19506 raft_consensus.cc:2410] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:18:14.943141 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.944064 19478 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:14.926390 21455 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:14.923964 21503 raft_consensus.cc:740] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:14.953480 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:14.954960 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:14.957146 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:14.929406 21424 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.939271 21438 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:14.968896 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:14.947589 21221 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:14.972641 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.962277 19476 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:14.943591 21364 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.965984 21376 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:14.968384 21176 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.987268 21405 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:14.977793 21492 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:15.007025 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:15.007468 21492 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.007889 21492 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:15.009164 19652 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:14.999027 19476 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:15.000586 21182 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:15.001807 21217 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:15.002358 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:15.016186 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 87292.4us
I20260709 13:18:15.001260 21455 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:15.006080 21503 consensus_queue.cc:260] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.988821 21504 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.033557 21504 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:15.039405 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:15.010033 21378 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.040729 21333 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:15.040889 21378 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.041862 21467 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:15.024780 21405 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.042380 21467 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.042786 21467 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.042675 21384 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:15.043407 21378 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:15.044267 21405 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:15.010519 21054 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:15.045010 21455 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.046567 21496 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:15.046963 21362 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:15.047291 21455 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:15.049088 19625 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:15.010968 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:15.012183 21169 raft_consensus.cc:1064] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:18:15.013305 21364 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:15.014189 21176 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.998647 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:15.062377 21467 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:14.935298 21523 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.016796 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:15.017467 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:15.065441 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 159699us
I20260709 13:18:15.021337 19656 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:15.027860 21217 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.028780 21376 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:15.030594 21424 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:15.053593 19653 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:15.054927 19659 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
W20260709 13:18:15.056934 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.058045 21503 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:15.058804 21169 consensus_queue.cc:237] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:15.059489 19478 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:15.060015 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:15.060509 19579 raft_consensus.cc:1275] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:18:15.063910 21054 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:15.066112 19661 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:15.082454 19579 pending_rounds.cc:85] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 2
I20260709 13:18:15.058074 21193 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:15.078660 21376 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.085676 19579 pending_rounds.cc:107] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:18:15.093994 19579 raft_consensus.cc:2889] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:15.026768 21438 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:15.086079 21054 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.098860 21416 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:15.091068 20663 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 4: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:18:15.101908 21467 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:15.103048 21523 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:15.096752 21376 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.101522 21054 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:15.122129 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:15.124173 20666 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:15.126027 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:15.126657 19586 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:15.130023 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 70682.7us
I20260709 13:18:15.130669 19584 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:15.130971 19478 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:15.131651 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.132477 19478 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:15.132936 21333 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:15.132992 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.124312 21182 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:15.134884 19584 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:15.110002 21504 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:15.100809 21393 consensus_queue.cc:1059] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:18:15.142445 21217 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:15.145606 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:15.142462 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:15.147156 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.119875 21496 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:15.133644 21333 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:15.194072 21333 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:15.199499 21542 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:18:15.199718 21424 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:15.201795 21217 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:15.203354 19587 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:15.204586 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.205185 19587 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:15.199527 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:15.120401 21364 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:15.144461 21176 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:15.192797 21534 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 13:18:15.217769 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.140180 21384 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:15.221724 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.221521 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:15.224772 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 79495.9us
I20260709 13:18:15.230733 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.231532 19587 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:15.201352 21424 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:18:15.230082 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:15.236210 19586 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 4.
I20260709 13:18:15.239264 19584 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:15.243535 21424 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:15.244132 21424 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.244503 21424 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.243441 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:15.246217 21217 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.247427 19585 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:15.247792 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:15.248525 21217 raft_consensus.cc:2764] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:15.249401 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:15.249994 19661 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.252061 19476 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:15.252236 21467 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:15.229889 21503 raft_consensus.cc:3055] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:15.253132 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:15.253808 21503 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:15.252547 19658 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:15.253185 21437 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:15.254992 21437 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:15.254797 21503 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.256081 21503 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:15.255959 21437 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.232007 21364 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.259857 21364 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:15.238191 21455 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:15.264400 21455 raft_consensus.cc:697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:15.265475 21455 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.245203 21376 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.268822 21523 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.269400 21523 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.270393 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:15.270583 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 64765.6us
I20260709 13:18:15.271430 21362 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:15.271559 21523 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:15.271732 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:15.272065 21362 raft_consensus.cc:697] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:15.274744 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:15.278466 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.279476 19587 raft_consensus.cc:2410] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:15.273085 19625 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:15.252923 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:15.285552 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.285562 21492 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.289487 21492 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:15.272645 21523 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:15.290882 21523 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.291270 21523 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:15.273247 21176 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.269542 21376 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:15.298328 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:15.299808 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 46965.1us
I20260709 13:18:15.300009 19661 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:15.299996 19625 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:15.237597 21384 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:15.272670 21438 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:15.305262 19476 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:15.313949 19625 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:15.316406 21526 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:15.316994 21526 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.317433 21526 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.311463 21364 consensus_queue.cc:1059] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:18:15.320313 19581 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:18:15.320784 19581 pending_rounds.cc:85] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 2
I20260709 13:18:15.321060 19581 pending_rounds.cc:107] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:18:15.321332 19581 raft_consensus.cc:2889] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:15.324023 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:15.273099 21211 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:18:15.308421 21176 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.312788 21416 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:15.326989 19627 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:15.301141 21393 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:15.325604 19478 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:15.336694 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.335691 19582 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:15.280792 21467 consensus_queue.cc:1059] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:18:15.415477 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.416451 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:15.336337 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:15.415195 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.338076 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.273098 21362 consensus_queue.cc:237] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.308764 21504 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.305392 21500 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:15.415030 19585 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
W20260709 13:18:15.443315 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 129583us
W20260709 13:18:15.343391 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 46814us
I20260709 13:18:15.337141 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.310925 21221 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.313055 21492 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:15.405009 21193 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:15.455756 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 130216us
I20260709 13:18:15.456664 19587 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:15.461263 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:15.395581 21176 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:15.327720 21496 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:15.414014 21393 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.405197 21211 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:15.416288 21361 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.334463 21416 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.463786 19584 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:15.469558 19581 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:15.414216 21321 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:15.459520 21182 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:15.462383 21492 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.327235 21148 consensus_queue.cc:1059] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.138s
I20260709 13:18:15.463904 21193 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.479143 21193 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.480813 21469 raft_consensus.cc:3055] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:15.481256 21469 raft_consensus.cc:740] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:15.482378 21455 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:15.482197 21469 consensus_queue.cc:260] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.482827 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:15.483067 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.483280 19507 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:15.416524 21054 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.473930 21221 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.471988 19578 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:15.467401 21416 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:15.468276 21393 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.472501 21364 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:15.476004 21492 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:15.452997 21504 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.473385 21500 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:15.494043 19627 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:15.516819 19503 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:18:15.484191 21388 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:18:15.526870 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:15.519145 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:15.528316 19585 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:15.519943 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:15.525959 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:15.518308 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:15.474300 21437 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:18:15.532956 21280 consensus_queue.cc:1059] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:18:15.555063 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:15.556634 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.557945 19584 raft_consensus.cc:2410] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:15.484912 21361 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.559926 21280 raft_consensus.cc:3055] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:15.490959 21321 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:15.557080 21407 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:15.526702 21378 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:18:15.563086 19508 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:15.568478 19507 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:15.569536 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:15.570251 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:15.584630 19578 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:15.587031 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.533723 21169 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:15.598508 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 131959us
I20260709 13:18:15.568711 21321 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:15.580574 21416 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.603647 19585 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:15.560428 21469 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.604595 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.564697 21438 raft_consensus.cc:3055] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:15.566182 21504 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:15.620267 19586 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:15.592847 21217 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:15.583668 21378 consensus_queue.cc:1243] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:15.582998 21407 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.624083 19579 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:15.565920 21280 raft_consensus.cc:740] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:15.582201 21054 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:15.624307 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.565189 21467 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:18:15.605434 21221 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:15.634284 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:15.676774 19580 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:15.567260 21361 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:15.580072 21424 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.637482 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:15.627190 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.681370 19585 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:15.574966 21503 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:18:15.574388 21388 consensus_queue.cc:1059] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:18:15.565670 21376 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:18:15.661918 19512 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:15.600135 21169 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:15.518790 21384 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.664615 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:15.626168 21438 raft_consensus.cc:740] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:15.679816 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 193557us
I20260709 13:18:15.679991 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:15.669531 21553 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.057s	user 0.001s	sys 0.003s
W20260709 13:18:15.684280 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 157491us
I20260709 13:18:15.684840 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.686304 19511 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:15.718116 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.718883 19585 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:15.719933 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.721115 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:15.714251 21496 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:15.687336 21388 raft_consensus.cc:3055] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:15.687731 19510 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:15.690222 21280 consensus_queue.cc:260] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.691133 21440 raft_consensus.cc:3055] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:15.691570 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:15.685568 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:15.671345 21407 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.676564 21504 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:15.685937 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.704846 21416 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:15.705327 21169 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:15.706375 21438 consensus_queue.cc:260] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.707330 21557 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.723702 19583 raft_consensus.cc:2393] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:15.707782 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:15.708344 21552 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:18:15.708902 21550 log.cc:927] Time spent T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.115s	user 0.002s	sys 0.004s
I20260709 13:18:15.669265 21500 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.713198 19507 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:15.738374 19586 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:15.738948 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:15.707257 21393 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.722981 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.739957 19585 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.725878 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:15.741530 19584 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:15.729305 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:15.729935 21504 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.744140 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:15.745222 19578 raft_consensus.cc:2410] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:15.745015 21523 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.745784 21504 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:15.746990 21438 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.747246 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:15.685869 21549 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.094s	user 0.000s	sys 0.004s
I20260709 13:18:15.721582 21364 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:15.748246 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:15.773414 19586 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.773337 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:15.774089 19504 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.748394 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:15.725057 21440 raft_consensus.cc:740] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:15.695365 20663 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:15.737775 21526 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.753252 21496 raft_consensus.cc:697] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:15.753899 21466 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.730873 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:15.798281 19579 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:15.723892 21388 raft_consensus.cc:740] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:15.724531 21405 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:15.735261 21557 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.723402 21424 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:15.737121 21193 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.704995 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:15.735958 21211 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:15.759452 21393 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:15.762073 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:15.724924 21280 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:15.762722 19581 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:15.764381 19584 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:15.765108 19625 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:15.728937 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:15.826661 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 97816.9us
I20260709 13:18:15.827210 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:15.714382 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51834.9us
I20260709 13:18:15.797053 19582 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:15.801798 19505 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:15.769816 21558 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:15.813643 19580 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:15.723845 20631 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:15.833317 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 85007.9us
I20260709 13:18:15.813037 21560 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:18:15.829466 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 64468.5us
I20260709 13:18:15.779377 21492 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.841076 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:15.841573 19625 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:15.841953 19657 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.830627 21416 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:15.843041 21416 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:15.833081 21405 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:15.843346 21211 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:15.843746 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:15.844389 21564 log.cc:927] Time spent T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:15.845961 21388 consensus_queue.cc:260] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.846743 21176 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:15.847174 21176 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.847545 21176 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.847581 21393 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:15.849810 21054 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:15.853888 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:15.855692 21557 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:15.843485 21416 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:15.858595 19503 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 4: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:15.864986 19657 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:15.862149 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:15.870036 19652 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:15.877054 19586 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:15.879917 19657 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:15.830883 21504 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:15.863094 19478 connection.cc:256] RPC call timeout handler was delayed by -1.1745920539999588s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
I20260709 13:18:15.836331 21503 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:15.864435 21405 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:15.806907 21466 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.884131 19657 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:15.836185 21467 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.888029 21321 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:15.887804 19585 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:15.879604 21221 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:15.909780 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 186039us
I20260709 13:18:15.888705 21468 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:15.889515 21504 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:15.895975 21503 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.898334 21559 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.878949 21424 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 13:18:15.969228 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 66716us
I20260709 13:18:15.933907 21492 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:15.988153 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 131149us
I20260709 13:18:15.948906 21504 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.991773 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:15.969867 21503 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.997437 19658 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:15.994199 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:16.000464 19655 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:16.003785 21526 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:16.004482 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.007503 19652 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
W20260709 13:18:16.009184 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 125655us
I20260709 13:18:15.996407 19476 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:15.896917 21558 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.931770 21467 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.012054 19655 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:15.902621 21440 consensus_queue.cc:260] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.899330 21496 consensus_queue.cc:237] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:15.929374 21560 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
W20260709 13:18:16.039825 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 43520.7us
I20260709 13:18:16.049830 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:16.024469 21523 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:15.998631 21468 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:16.065687 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 89971.6us
W20260709 13:18:16.063526 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 86523.4us
I20260709 13:18:16.078220 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:15.996387 21556 consensus_queue.cc:1059] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:18:16.051937 21557 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:15.973220 21559 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.064237 21193 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:16.090679 19625 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:16.079737 21578 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:16.096339 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:16.100620 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 50880.1us
I20260709 13:18:16.083313 21384 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:16.090104 21492 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
W20260709 13:18:16.109805 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 66564.7us
I20260709 13:18:16.131243 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:16.140208 19585 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:16.118124 21577 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:16.131647 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:16.143988 19584 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:16.149880 19585 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:16.169782 21572 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 13:18:16.170979 21566 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 13:18:16.160835 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 64649.1us
W20260709 13:18:16.186221 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 84819.2us
I20260709 13:18:16.157778 21217 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:16.167603 21578 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:16.200731 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.126525 21384 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.206912 19504 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:16.207760 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.166132 21557 raft_consensus.cc:697] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:16.210325 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:16.190598 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 100018us
W20260709 13:18:16.248883 21169 consensus_meta.cc:287] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.508s	user 0.004s	sys 0.008s
I20260709 13:18:16.212201 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:16.257864 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.212679 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:16.228070 21407 consensus_meta.cc:287] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
I20260709 13:18:16.267099 19511 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:16.267060 19655 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 7: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:16.248337 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:16.268078 19658 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:16.228847 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:16.227960 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:16.269228 19579 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:16.253347 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:16.270179 19657 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:16.212273 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.213220 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:16.278849 19505 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 1.
W20260709 13:18:16.283620 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 95834.3us
I20260709 13:18:16.285332 19627 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:16.290709 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:16.263355 21574 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
W20260709 13:18:16.258423 21567 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:18:16.282262 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:16.188410 21556 consensus_queue.cc:1059] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:18:16.310942 19507 raft_consensus.cc:2393] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 3: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:16.211432 21578 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:16.312944 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 170010us
I20260709 13:18:16.313654 19627 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:16.287801 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:16.212052 21466 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:16.317966 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:16.319989 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.321939 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:16.263985 21468 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:16.322208 19657 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:16.211653 21217 raft_consensus.cc:697] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:16.323247 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.324774 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:16.278017 21467 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:16.326706 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:16.327087 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:16.327279 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:16.327731 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:16.330878 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.333788 19509 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 5: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:16.323475 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:16.343139 21592 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:18:16.266322 21169 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.321170 21424 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.343943 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.346691 19579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
new_leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
 from {username='slave'} at 127.0.0.1:60828
I20260709 13:18:16.348114 19579 raft_consensus.cc:606] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Received request to transfer leadership to TS e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:16.348517 19579 raft_consensus.cc:614] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:16.321760 21578 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:16.282512 21407 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.331523 21560 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:16.350467 19478 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:16.360522 21579 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:18:16.352346 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:16.364312 19660 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:16.346537 21362 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:16.383911 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.380081 21557 consensus_queue.cc:237] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.381307 21217 consensus_queue.cc:237] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.386806 19661 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:16.446693 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 96289.9us
I20260709 13:18:16.450170 19478 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:16.357451 21560 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:16.470289 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.354786 21424 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.387583 21362 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:16.448763 21579 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.069s	user 0.009s	sys 0.000s
I20260709 13:18:16.479395 21593 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.131s
W20260709 13:18:16.481386 21590 log.cc:927] Time spent T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:18:16.486891 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.459409 21560 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:16.488284 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:16.478462 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 164950us
I20260709 13:18:16.455363 21559 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:16.497054 19627 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:16.498520 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 48454us
I20260709 13:18:16.499697 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.500352 19658 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:16.478245 21362 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.489488 21467 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:16.510592 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:16.514838 19627 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:16.514914 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.519512 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:16.522159 21595 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:16.522651 21595 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:16.523034 21595 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:16.525843 21597 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:18:16.527207 21575 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:16.531571 19579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
new_leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
 from {username='slave'} at 127.0.0.1:60828
I20260709 13:18:16.532197 19579 raft_consensus.cc:606] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Received request to transfer leadership to TS e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:16.532521 19579 raft_consensus.cc:614] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:16.533737 21601 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:18:16.541913 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.542703 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:16.543643 19551 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:16.545241 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:16.546379 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:16.546670 19478 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:16.548664 21523 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:16.549264 19580 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:18:16.525358 21503 consensus_meta.cc:287] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.003s
I20260709 13:18:16.514530 21435 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:16.555624 19586 pending_rounds.cc:85] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 4
I20260709 13:18:16.574373 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:16.575033 19581 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:16.564498 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:16.566890 21407 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:16.567209 21388 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.567816 21424 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:16.557897 21437 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:16.571895 19478 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:16.572865 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:16.518735 21592 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:16.577509 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.580282 19586 pending_rounds.cc:107] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:18:16.587656 19583 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:16.587669 19658 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:16.587994 19586 raft_consensus.cc:2889] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:16.582274 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:16.568950 21176 consensus_meta.cc:287] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.008s
I20260709 13:18:16.559270 21211 raft_consensus.cc:2764] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:16.551573 21455 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:16.565150 21416 consensus_meta.cc:287] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.000s
I20260709 13:18:16.575385 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:16.586118 19478 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:16.551753 21384 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:16.583921 21469 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.577044 21526 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:16.595904 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:16.595611 21280 consensus_meta.cc:287] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.764s	user 0.020s	sys 0.002s
I20260709 13:18:16.595186 19478 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:16.601765 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:16.601959 21384 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:16.602542 19582 raft_consensus.cc:2393] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:16.603351 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:16.600464 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:16.603696 21384 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:16.596076 21378 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:16.600611 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.605039 21384 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:16.605435 19658 raft_consensus.cc:2410] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:16.592809 21176 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.606348 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.607630 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.609882 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.611157 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.589252 21593 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:16.618582 19478 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:16.621832 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 110040us
I20260709 13:18:16.593600 21424 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:16.622138 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:16.580173 21503 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:16.598670 21438 consensus_meta.cc:287] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.820s	user 0.016s	sys 0.002s
I20260709 13:18:16.594712 21148 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:16.594575 21523 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:16.636425 19584 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:16.597942 21526 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.638254 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:16.640166 21576 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:16.640897 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:16.641718 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:18:16.599668 21583 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:16.600106 21169 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:16.644586 19656 raft_consensus.cc:2393] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:16.643714 21468 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:18:16.631194 21384 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:16.642949 19478 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:16.650776 21526 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:16.657303 19657 raft_consensus.cc:2368] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6.
W20260709 13:18:16.636960 21504 consensus_meta.cc:287] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.001s
I20260709 13:18:16.629464 21424 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.660909 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.649648 21523 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.596493 21416 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.644415 21455 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:16.655479 21576 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:16.629105 21435 consensus_queue.cc:1059] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:18:16.725724 21611 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:16.728581 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:16.729246 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:16.745404 19656 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:16.674053 21384 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.748649 21384 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:16.748804 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:16.739706 21416 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:16.694060 20664 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 4 LEARNER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:16.749547 19658 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:16.736985 19659 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:16.661665 21558 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:16.741128 21586 raft_consensus.cc:3055] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:16.761341 21586 raft_consensus.cc:740] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:16.747861 21466 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.748080 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.765530 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:16.765604 19656 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:18:16.766804 19587 raft_consensus.cc:2393] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 4: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:16.741955 21455 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.728778 21424 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:16.784953 19581 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:16.784281 19658 raft_consensus.cc:2410] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:16.667609 21583 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.786144 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:16.674618 21610 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.786510 19658 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:16.680142 21148 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:16.795837 19652 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:18:16.799679 19656 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:16.743299 21576 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.762576 21466 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.807127 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:16.808151 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:16.738060 21504 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.796564 21469 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:16.826799 19658 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:16.775250 21611 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.803462 21148 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:16.814958 21217 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:16.831610 19653 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:16.819675 21388 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.791396 21595 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.829200 21193 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:16.847921 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.839248 21148 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.842278 19581 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:18:16.846460 21612 log.cc:927] Time spent T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:18:16.797035 21610 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.838721 21217 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:16.873291 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:16.877547 19476 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:16.879302 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.902344 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:16.924055 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:16.864259 21455 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:16.880404 21615 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.931632 19656 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:16.850865 21503 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:16.903677 21416 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.865636 21466 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:16.904057 21559 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:16.918043 21469 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:16.941975 19658 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:16.920208 21606 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:16.924065 21593 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.862758 21362 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.928036 21378 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:16.868769 21384 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.890928 21193 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:16.974177 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 71915.3us
I20260709 13:18:16.874061 21388 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.978780 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:16.979442 21378 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.979948 21362 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:16.980786 21388 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:16.981545 21378 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:16.982012 21611 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:16.980832 19580 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:16.982409 19657 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:16.860881 21578 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:16.944720 21455 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:17.003829 21611 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:17.004959 21611 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:17.006387 21592 raft_consensus.cc:3055] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:17.006781 21592 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:17.007615 21592 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.008773 21592 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:17.010459 21455 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.011036 21455 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:16.977771 21469 raft_consensus.cc:697] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:16.974934 21606 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.942946 21615 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:16.946825 21416 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.058043 21617 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.059015 21416 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:16.998699 21583 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:17.059790 19658 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:16.970522 21559 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.062419 21595 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:17.062592 21559 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:16.992455 21593 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.064987 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1371) took 1095 ms. Trace:
I20260709 13:18:17.057514 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1369) took 1138 ms. Trace:
W20260709 13:18:17.048843 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 46115.9us
I20260709 13:18:17.052418 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:17.067039 19660 rpcz_store.cc:276] 0709 13:18:15.919600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.920249 (+   649us) service_pool.cc:224] Handling call
0709 13:18:15.972462 (+ 52213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.364905 (+392443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.057247 (+692342us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b540032b9d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:17.057431 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900615040}
I20260709 13:18:17.067698 19503 raft_consensus.cc:2393] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 2: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:17.053481 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:17.054226 21610 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:17.056454 21466 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:17.058657 21617 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.068195 19505 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:16.992782 21623 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:17.065392 19659 rpcz_store.cc:276] 0709 13:18:15.970149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.970318 (+   169us) service_pool.cc:224] Handling call
0709 13:18:15.970573 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.757888 (+787315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.064751 (+306863us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b5400021554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:17.064922 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1762217728}
I20260709 13:18:17.072084 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:17.005400 21611 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:17.078190 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:17.079087 19506 raft_consensus.cc:2410] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:18:17.083057 19627 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.010s	sys 0.011s
W20260709 13:18:17.083737 19627 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.010s	sys 0.011s
I20260709 13:18:17.066278 21526 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.087062 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:17.090559 19511 raft_consensus.cc:2410] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:17.088932 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:17.082005 20663 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:17.084828 21623 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.108289 21623 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.112295 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:17.113014 21523 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:17.096508 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:17.050918 21221 consensus_queue.cc:1059] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:18:17.104955 21626 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.106587 21424 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.088546 21492 consensus_queue.cc:1059] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:18:17.090557 21559 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.110723 21623 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:17.145123 19582 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:17.151899 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:17.149642 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:17.159116 19511 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:17.085372 21362 consensus_queue.cc:1059] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:18:17.166275 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:17.168901 19505 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:17.169584 21424 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:17.114101 21595 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.170300 21626 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.170729 21595 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.172245 21629 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.172835 21626 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:17.172794 21629 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.173662 21217 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:17.145064 21384 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:17.173967 21595 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:17.175292 21629 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:17.178013 21621 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:18:17.180140 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:17.180831 19586 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:17.181847 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:17.182407 19586 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:17.182466 21455 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.183632 19579 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:17.186097 21455 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:17.185923 21611 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.187356 21611 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:17.188709 21504 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:17.198603 19586 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:17.199331 19511 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:17.200235 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:17.089056 21557 consensus_queue.cc:1059] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:18:17.203222 19586 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:17.150127 21625 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:17.146015 21606 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:17.217959 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:17.218681 19586 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:17.162855 21559 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.216892 21625 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:18:17.159657 21576 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.146298 21469 consensus_queue.cc:237] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:17.236980 21560 consensus_meta.cc:287] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.001s
I20260709 13:18:17.231315 19625 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:17.232462 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:17.375468 19658 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:17.376672 21193 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:17.364756 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:17.234424 21578 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:17.245858 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:17.378093 20663 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:17.379032 19660 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:17.380069 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:17.380275 21559 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:17.205042 21492 raft_consensus.cc:3055] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:17.380919 21492 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:17.363844 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:17.215610 21572 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.167s
I20260709 13:18:17.229048 21440 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:17.383014 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:17.239528 19506 raft_consensus.cc:2410] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:17.383777 19580 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:17.205250 21217 raft_consensus.cc:3055] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:17.231791 21617 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:17.384382 21217 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:17.233084 21526 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:17.384922 19661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1358) took 1550 ms. Trace:
I20260709 13:18:17.385540 19581 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:17.385288 21217 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.226583 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:17.386839 21576 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:17.387033 21217 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:17.235944 21575 consensus_meta.cc:287] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.708s	user 0.012s	sys 0.000s
I20260709 13:18:17.387745 21575 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:17.366220 21593 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:17.383031 19408 catalog_manager.cc:5697] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 3 to 4, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 4 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:18:17.388759 21560 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.237763 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1370) took 1308 ms. Trace:
I20260709 13:18:17.389966 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:17.390584 19579 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:17.390823 21560 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:17.390991 19578 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:17.224295 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:17.394199 21586 consensus_queue.cc:260] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:17.395362 19655 raft_consensus.cc:2393] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 5: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:18:17.395610 19409 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48826 (request call id 177) took 11685 ms (client timeout 15000 ms). Trace:
I20260709 13:18:17.392225 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:17.396624 19655 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:17.396778 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:17.397415 19585 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:17.219547 21606 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:17.398212 19579 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:17.398501 21606 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:17.399111 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:17.399619 19579 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:17.400547 21606 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:17.401724 21504 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:17.402666 21610 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:17.403250 21610 raft_consensus.cc:697] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:17.404203 21610 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.404685 21176 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:17.405681 19476 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:17.385300 19661 rpcz_store.cc:276] 0709 13:18:15.834267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.839122 (+  4855us) service_pool.cc:224] Handling call
0709 13:18:15.864583 (+ 25461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.387282 (+522699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.384675 (+997393us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b5400102054. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:17.384854 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1200613760}
I20260709 13:18:17.410697 21626 raft_consensus.cc:3055] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:17.411279 21626 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:17.412487 21626 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.414213 21526 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
W20260709 13:18:17.414510 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 183281us
I20260709 13:18:17.415036 21526 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:17.337553 21627 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.135s	user 0.000s	sys 0.003s
I20260709 13:18:17.416692 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:17.417306 19581 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:17.420888 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.395774 21586 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:17.423560 19654 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:17.421568 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:17.425442 19652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1382) took 1084 ms. Trace:
I20260709 13:18:17.425943 19652 rpcz_store.cc:276] 0709 13:18:16.340793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.487976 (+147183us) service_pool.cc:224] Handling call
0709 13:18:17.425294 (+937318us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b5400122fd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:17.425387 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":688850816}
I20260709 13:18:17.426599 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:17.427651 19512 raft_consensus.cc:2393] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:17.394338 21625 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:17.435230 21626 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:17.242058 19505 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:17.240151 19587 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:17.442818 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:17.444142 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:17.445834 21557 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.446286 21589 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.446691 21580 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:17.412890 19409 rpcz_store.cc:269] 0709 13:18:05.710159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.710680 (+   521us) service_pool.cc:224] Handling call
0709 13:18:06.552408 (+841728us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54002ec7d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c4090 00007f6c31762f3a 00007f6c375191cc 00007f6c3761737e 00007f6c35ad82a4 00007f6c35ad8232 00007f6c35ad8161 00007f6c35ad80dc 00007f6c35ad7392 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:17.395411 (+10843003us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:14.835489 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:14.836199 (+   710us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:14.836256 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:18:14.836289 (+    33us) tablet.cc:662] Decoding operations
0709 13:18:14.836972 (+   683us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:14.837058 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:14.837092 (+    34us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:18:14.837568 (+   476us) tablet.cc:701] Row locks acquired
0709 13:18:14.841818 (+  4250us) write_op.cc:260] PREPARE: finished
0709 13:18:14.867749 (+ 25931us) write_op.cc:270] Start()
0709 13:18:14.904647 (+ 36898us) write_op.cc:276] Timestamp: P: 1783603094862323 usec, L: 0
0709 13:18:14.904693 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:18:14.978515 (+ 73822us) log.cc:844] Serialized 1325 byte log entry
0709 13:18:15.563245 (+584730us) op_driver.cc:464] REPLICATION: finished
0709 13:18:15.708540 (+145295us) write_op.cc:301] APPLY: starting
0709 13:18:15.708642 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:15.708792 (+   150us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:15.708955 (+   163us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:15.709555 (+   600us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:15.712270 (+  2715us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:18:15.712341 (+    71us) write_op.cc:312] APPLY: finished
0709 13:18:15.712671 (+   330us) log.cc:844] Serialized 34 byte log entry
0709 13:18:15.712870 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:15.712960 (+    90us) write_op.cc:454] Released schema lock
0709 13:18:15.713022 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:15.713496 (+   474us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:15.713527 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":16,"spinlock_wait_cycles":568419712,"child_traces":[["op",{"apply.queue_time_us":144975,"apply.run_cpu_time_us":2647,"apply.run_wall_time_us":4937,"num_ops":3,"prepare.queue_time_us":126431,"prepare.run_cpu_time_us":19269,"prepare.run_wall_time_us":268164,"raft.queue_time_us":275342,"raft.run_cpu_time_us":14235,"raft.run_wall_time_us":59961,"replication_time_us":658374,"thread_start_us":384434,"threads_started":4,"wal-append.queue_time_us":239494,"wal-append.run_cpu_time_us":56314,"wal-append.run_wall_time_us":1455267}]]}
I20260709 13:18:17.222548 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:17.496950 19586 raft_consensus.cc:2393] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:17.450764 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:17.497285 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:17.451601 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.453553 21393 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:17.453742 21575 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.453845 21054 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:17.454834 21376 raft_consensus.cc:3055] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:17.456226 19581 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:17.544164 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:17.450783 19478 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:17.458323 19578 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:17.458571 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:17.545333 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 94649.7us
I20260709 13:18:17.458730 21193 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.459648 21405 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:17.460412 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:17.463059 21615 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:17.242674 19509 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:17.465663 19583 pending_rounds.cc:85] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 2
I20260709 13:18:17.550114 19583 pending_rounds.cc:107] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:17.550411 19583 raft_consensus.cc:2889] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:17.466965 19585 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
W20260709 13:18:17.468240 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 62682.5us
I20260709 13:18:17.468412 21586 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:17.471621 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:17.473270 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:17.474553 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:17.477908 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 392503us
I20260709 13:18:17.389966 19653 rpcz_store.cc:276] 0709 13:18:15.928965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.929091 (+   126us) service_pool.cc:224] Handling call
0709 13:18:15.929387 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.835383 (+905996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.237433 (+402050us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54001eb254. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:17.237675 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2074393984}
I20260709 13:18:17.476672 19582 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:17.486876 19587 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:17.449302 21435 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.417363 21526 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:17.552265 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:17.530633 21560 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.554592 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:17.623513 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 68933.2us
I20260709 13:18:17.653120 19586 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:17.653275 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:17.655043 19587 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:17.655222 19551 leader_election.cc:400] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6.
I20260709 13:18:17.624609 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:17.655877 19551 leader_election.cc:403] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:17.655975 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:17.657698 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:17.658357 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 198022us
I20260709 13:18:17.495592 21557 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.511044 19579 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:17.556895 19476 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:17.659920 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:17.560253 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:17.673471 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:17.668421 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:17.652928 21560 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.681371 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:17.674415 19507 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:17.683940 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:17.676478 19578 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:17.690009 19627 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:17.547425 21467 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:17.542554 21376 raft_consensus.cc:740] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:17.553661 21586 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:17.698009 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 145829us
W20260709 13:18:17.669775 21634 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:18:17.654435 21559 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:17.498118 21589 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.702639 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:17.703537 19627 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:17.722597 19627 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:17.723631 19627 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:17.547441 21592 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:17.706687 19587 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:17.707669 19585 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:17.708004 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:17.489063 21492 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.548058 21054 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.718436 19578 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 13:18:17.718990 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:17.654736 21556 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:18:17.657730 21333 consensus_queue.cc:1059] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:18:17.762152 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:17.744658 19507 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:17.704224 21625 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6.
I20260709 13:18:17.543071 21393 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:17.687959 21595 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:17.698387 21606 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:17.720892 21586 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:17.751500 21592 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:17.761907 21601 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.790601 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:17.791206 19654 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:17.791086 21601 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.792531 21592 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:17.768818 21176 consensus_queue.cc:1059] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:18:17.793197 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:17.793533 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:17.793787 19656 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:17.794134 19507 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:17.756138 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:17.795077 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:17.795526 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:17.550046 21580 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.702070 21609 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.751448 21221 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:17.761023 21504 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:17.698554 21526 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:17.810132 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:17.810089 21526 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:17.762758 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.725153 19509 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:17.812043 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:17.812584 21557 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:17.755296 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:17.813820 21504 raft_consensus.cc:697] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:17.814158 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:17.668521 21384 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:18:17.814307 21609 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:17.814772 21504 consensus_queue.cc:237] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.765038 19581 raft_consensus.cc:2410] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:17.761205 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:17.756326 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:17.702316 20663 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:17.768361 19586 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:17.680660 21615 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:18:17.714293 21594 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:17.772786 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:17.778167 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:17.659623 21435 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.548081 21575 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:17.782444 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.746097 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:17.713639 21611 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:18:17.795161 21393 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:17.554215 21193 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.752424 21583 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:17.867066 21583 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.867520 21583 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:17.785043 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:17.868522 19659 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:17.869539 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:17.870690 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:17.871740 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:17.793229 21601 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:17.801605 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:17.802244 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:17.875625 21589 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:17.761679 21054 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:17.803507 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:17.805788 19652 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:17.766515 21629 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:17.766901 21364 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:17.899722 19506 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:17.807827 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:17.812758 19509 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 5: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:17.625751 21405 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:17.822520 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 66251.4us
I20260709 13:18:17.814162 21176 raft_consensus.cc:3055] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:17.835958 21595 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:17.854883 19661 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:18:17.860097 19585 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:18:17.817358 21609 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:17.878690 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:17.907828 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:17.884413 19625 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:17.819061 21221 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:17.813397 21586 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.819581 21652 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:17.876579 21645 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:17.903301 19627 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:17.868551 21193 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:17.925904 19654 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:17.895077 21467 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:17.920184 19656 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:17.919104 19627 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:17.927531 19585 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:17.927320 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:17.895715 21629 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.904269 21364 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.979725 21610 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:17.980089 21364 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:17.980463 21610 raft_consensus.cc:697] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:17.927809 19625 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:17.981536 21610 consensus_queue.cc:237] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:17.982378 21650 log.cc:927] Time spent T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:18:17.903143 21176 raft_consensus.cc:740] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:17.983299 21176 consensus_queue.cc:260] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.984658 21176 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.985986 21169 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:17.933180 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:17.990321 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 57277.8us
W20260709 13:18:17.942035 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 385199us
I20260709 13:18:17.904517 21594 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:18:17.915963 21440 consensus_meta.cc:287] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.002s
I20260709 13:18:17.882721 21333 consensus_queue.cc:1059] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:18:17.917498 21633 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:17.929402 21054 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:17.916950 21595 raft_consensus.cc:697] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:17.960330 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1597) took 1389 ms. Trace:
I20260709 13:18:17.930130 21601 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:17.858723 21376 consensus_queue.cc:260] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:17.930742 21467 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:17.969741 19510 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
W20260709 13:18:17.978193 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 59201.8us
I20260709 13:18:18.029584 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:18.030735 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:17.913770 21221 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.031790 19627 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:17.991106 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:18.002130 19584 rpcz_store.cc:276] 0709 13:18:16.558617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.639391 (+ 80774us) service_pool.cc:224] Handling call
0709 13:18:16.639701 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.646568 (+  6867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.646597 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.417161 (+770564us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b2c0002d418. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:18:17.417552 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 13:18:17.547735 (+130183us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:17.660350 (+112615us) log.cc:844] Serialized 14 byte log entry
0709 13:18:17.688845 (+ 28495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.688917 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.842256 (+153339us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b18003f5f80. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d522 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:18:17.947964 (+105708us) raft_consensus.cc:1685] finished
0709 13:18:17.947994 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.948188 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34711,"prepare.queue_time_us":112639,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":51,"raft.queue_time_us":113843,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":9857,"spinlock_wait_cycles":20621952,"thread_start_us":121014,"threads_started":1,"wal-append.queue_time_us":286373}
I20260709 13:18:18.033819 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:18.036068 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:17.975821 21557 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:18.021781 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 312421us
I20260709 13:18:17.977655 21625 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:17.982251 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 54623.6us
I20260709 13:18:18.039495 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:18.040035 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:17.979781 21629 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:18.040447 19511 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:17.991744 19476 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:18.042424 19627 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:17.992369 21580 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:17.995503 21611 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:17.995899 21576 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:18.048303 19625 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:18.042888 19585 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:18.024139 21649 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:18:18.001605 21054 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:18.059013 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 67345.3us
I20260709 13:18:18.059396 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59942 (request call id 66) took 1057 ms. Trace:
I20260709 13:18:18.059859 19476 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:17.997936 21437 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.058524 19627 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:18.060031 19655 rpcz_store.cc:276] 0709 13:18:17.002104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.397319 (+395215us) service_pool.cc:224] Handling call
0709 13:18:17.465424 (+ 68105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.795651 (+330227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.795679 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.795732 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:17.795771 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.059057 (+263286us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b54000ae454. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:18.059130 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.059307 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":758992128}
I20260709 13:18:18.040902 21626 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:18.048753 21193 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:18.052037 19657 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:18.053853 19585 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:18.043860 21615 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:18.040885 21578 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:18.046906 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.090828 19505 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:18.047590 21393 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:18.044965 19584 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:18.020516 21364 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.054664 21633 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:18.087664 19579 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:18.057850 21617 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:18.077533 21376 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:18.063740 21054 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:18.099350 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 63294us
I20260709 13:18:18.074852 21589 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.067291 21601 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:18.097195 19511 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:18.044054 21557 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.134490 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1600) took 1033 ms. Trace:
I20260709 13:18:18.124137 21654 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:18:18.047778 21625 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.089272 21193 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.088240 21559 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:18.118574 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:18.113117 21578 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:18.075101 21580 consensus_queue.cc:1059] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:18:18.100742 21393 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.123620 21586 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:18.074311 21437 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.142180 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:18:18.160462 21656 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:18.111634 21405 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:18.114650 21384 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:18:18.163836 21633 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:18.116482 21504 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:18.117805 21594 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.143332 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1325) took 1277 ms. Trace:
I20260709 13:18:18.127857 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:18.188660 21393 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:18.141187 19587 rpcz_store.cc:276] 0709 13:18:17.101142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.743170 (+642028us) service_pool.cc:224] Handling call
0709 13:18:17.743498 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.743699 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:18.028390 (+284691us) log.cc:844] Serialized 14 byte log entry
0709 13:18:18.133973 (+105583us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:18.134048 (+    75us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:18.134122 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.134223 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.134409 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21122,"prepare.queue_time_us":107244,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":605,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":139,"thread_start_us":342525,"threads_started":2}
I20260709 13:18:18.182878 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:18.102046 21440 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:18.164371 21655 log.cc:927] Time spent T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:18:18.162515 21617 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.221390 19582 rpcz_store.cc:276] 0709 13:18:16.866407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.687568 (+821161us) service_pool.cc:224] Handling call
0709 13:18:17.720708 (+ 33140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.720912 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:18.087209 (+366297us) log.cc:844] Serialized 14 byte log entry
0709 13:18:18.142992 (+ 55783us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:18.143042 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:18.143089 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.143153 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.143265 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22432,"prepare.queue_time_us":121473,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":85,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":10655,"thread_start_us":373252,"threads_started":2}
I20260709 13:18:18.128592 21601 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:18.115967 21664 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 13:18:18.124152 21595 consensus_queue.cc:237] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.082751 21467 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.171480 21193 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:18.142655 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 84225us
I20260709 13:18:18.258193 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:18:18.213503 21615 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.130450 19509 raft_consensus.cc:2368] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4.
W20260709 13:18:18.260092 21663 log.cc:927] Time spent T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:18:18.260077 21615 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.213717 21578 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.182030 21559 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:18.184578 21556 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.185462 21626 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:18.172482 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 53999.3us
I20260709 13:18:18.288585 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:18.232349 19507 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:18.290064 21672 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:18.290568 21672 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:18.290942 21672 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:18.290998 21668 log.cc:927] Time spent T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 13:18:18.291918 21217 consensus_meta.cc:287] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.904s	user 0.008s	sys 0.003s
I20260709 13:18:18.254685 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:18.251407 21601 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:18.214872 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1322) took 1413 ms. Trace:
W20260709 13:18:18.264145 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:18.299674 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.281255 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:18.233418 21575 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:18.233834 21504 raft_consensus.cc:697] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:18.240886 21593 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.234385 21557 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:18.289115 19395 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d05498e224814b9b8f31e3f965ab2583 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d56df3728fc04e37b2d29a3bcd91d167 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:18.294008 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:18.224722 21633 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.361250 19627 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:18.298969 19583 rpcz_store.cc:276] 0709 13:18:16.801681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.464628 (+662947us) service_pool.cc:224] Handling call
0709 13:18:17.465120 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:17.669029 (+203909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.669058 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.677082 (+  8024us) log.cc:844] Serialized 26 byte log entry
0709 13:18:17.938225 (+261143us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:17.938310 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.938458 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.214614 (+276156us) raft_consensus.cc:1685] finished
0709 13:18:18.214648 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.214804 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":179055,"threads_started":1,"wal-append.queue_time_us":314816}
I20260709 13:18:18.283612 21559 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:18.240741 21617 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.293319 21605 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:18.280493 21333 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
W20260709 13:18:18.363626 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 69723.1us
I20260709 13:18:18.298161 21652 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.361593 21405 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:18.370229 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.372395 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1323) took 1562 ms. Trace:
I20260709 13:18:18.395808 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:18.396809 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.397219 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:18.393471 19580 rpcz_store.cc:276] 0709 13:18:16.809898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.482206 (+672308us) service_pool.cc:224] Handling call
0709 13:18:17.495739 (+ 13533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:17.544120 (+ 48381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.544169 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.553995 (+  9826us) log.cc:844] Serialized 26 byte log entry
0709 13:18:17.852712 (+298717us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:17.866566 (+ 13854us) log.cc:844] Serialized 14 byte log entry
0709 13:18:17.878351 (+ 11785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.878432 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.372161 (+493729us) raft_consensus.cc:1685] finished
0709 13:18:18.372184 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.372331 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11495,"prepare.queue_time_us":15918,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":40,"raft.queue_time_us":14950,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":17088,"thread_start_us":147557,"threads_started":1,"wal-append.queue_time_us":342673}
I20260709 13:18:18.293524 21556 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.404284 19511 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:18.395470 19395 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 233325us
I20260709 13:18:18.410313 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:18.361523 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:18.419179 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:18.356119 21592 consensus_queue.cc:1059] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:18:18.369161 21217 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:18.370164 21606 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:18.372355 21605 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:18.365419 21593 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.432077 21593 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:18.425689 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.371942 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:18:18.424809 21671 log.cc:927] Time spent T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:18:18.434868 19505 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:18.430325 21605 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.433488 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.417166 21611 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:18.428896 21615 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:18.438292 21217 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:18.440569 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.441118 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:18.405813 21405 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.417259 21364 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:18.395892 21652 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:18.418246 21626 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:18.472429 21583 consensus_meta.cc:287] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.000s
I20260709 13:18:18.472932 21583 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.473075 21504 consensus_queue.cc:237] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.475154 21583 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:18.463593 21606 raft_consensus.cc:697] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:18.476919 21633 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:18.479043 21405 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:18.483309 21193 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.428017 21617 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:18.486377 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:18.487635 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.488178 19505 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:18.488978 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.492547 21560 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:18.494270 21393 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.466993 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.445993 21610 raft_consensus.cc:2955] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:18.505494 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.467927 19511 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:18.392277 21666 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:18:18.425205 20664 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:18.485105 21606 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:18.463703 19510 raft_consensus.cc:2410] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:18.451226 21169 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:18.517359 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:18.502233 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 92017.8us
I20260709 13:18:18.507082 21364 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:18.508857 21592 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.513470 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:18.515515 19625 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:18:18.517865 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:18.518280 19587 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:18.485491 21193 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:18.519260 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:18.521756 19584 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:18.522606 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:18.523558 19583 raft_consensus.cc:2410] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:18.526343 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:18.528680 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:18.529307 19580 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
W20260709 13:18:18.530624 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.530721 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:18.532541 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.533242 19510 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:18.532624 21611 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:18:18.534227 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.532426 20663 raft_consensus.cc:2955] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:18.535648 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:18.533366 21633 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:18.537662 21633 raft_consensus.cc:697] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:18.538547 21617 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:18.538985 21617 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:18.539629 21617 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:18.538914 21633 consensus_queue.cc:237] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.541822 21652 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.523447 21364 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:18.546950 21384 raft_consensus.cc:3055] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:18.547389 21384 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:18.547564 21364 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:18.547737 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.548512 19505 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:18.548200 21384 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.549201 21384 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:18.549437 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.550022 19505 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:18.528553 21560 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:18.554165 21601 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.530154 21592 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:18.556416 21601 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:18.556559 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1707) took 1067 ms. Trace:
I20260709 13:18:18.556934 19506 rpcz_store.cc:276] 0709 13:18:17.488831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.545985 (+ 57154us) service_pool.cc:224] Handling call
0709 13:18:18.556383 (+1010398us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54001847d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:18.556499 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559007616}
I20260709 13:18:18.558151 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.559213 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:18.559716 19506 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:18.565412 21672 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.565757 21629 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.567862 21672 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:18.568862 21629 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:18.570381 21440 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:18.571918 19510 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 4.
I20260709 13:18:18.573892 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.572834 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.574543 19510 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:18.575136 21592 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:18.575577 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:18.575834 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.576926 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.581821 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.583884 19625 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:18.640537 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:18.618271 19625 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:18.618134 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:18.594909 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:18.643484 19580 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:18.643990 19510 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:18.644855 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1709) took 1148 ms. Trace:
W20260709 13:18:18.619123 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 88510.8us
I20260709 13:18:18.645188 19625 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
W20260709 13:18:18.574337 21221 consensus_meta.cc:287] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.000s
I20260709 13:18:18.646278 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:18.646661 19625 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:18.648241 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:18.645294 19510 rpcz_store.cc:276] 0709 13:18:17.496437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.617846 (+1121409us) service_pool.cc:224] Handling call
0709 13:18:18.644807 (+ 26961us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.654088 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:18.654798 19505 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:18.655215 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:18.595438 21684 log.cc:927] Time spent T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:18:18.662858 19579 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:18:18.662823 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:18.663445 19579 pending_rounds.cc:85] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 2
I20260709 13:18:18.663916 19579 pending_rounds.cc:107] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:18:18.664191 19579 raft_consensus.cc:2889] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:18.526755 21393 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:18.664379 19551 leader_election.cc:400] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4.
I20260709 13:18:18.664831 19551 leader_election.cc:403] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:18.597168 21556 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:18.654989 21576 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:18:18.579008 21405 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.666361 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:18.621769 21629 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:18.655596 21595 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:18.676653 19508 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:18.615765 21526 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:18.669253 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:18.668085 21583 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.622021 21686 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:18.677395 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1702) took 1227 ms. Trace:
I20260709 13:18:18.690900 19508 rpcz_store.cc:276] 0709 13:18:17.451413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.674227 (+1222814us) service_pool.cc:224] Handling call
0709 13:18:18.674543 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.677134 (+  2591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.677335 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.677393 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:18.691818 19578 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:18.654255 21675 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:18.681304 19505 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:18.660588 21560 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:18.660725 21424 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:18.663368 21626 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:18.663861 21601 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:18.666893 21054 consensus_meta.cc:287] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.524s	user 0.005s	sys 0.006s
I20260709 13:18:18.685089 21492 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:18.686149 21500 raft_consensus.cc:3055] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:18.687033 21559 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.674654 21611 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.668215 21672 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:18.681413 21595 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:18.688632 21679 log.cc:927] Time spent T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Append to log took a long time: real 0.400s	user 0.004s	sys 0.004s
I20260709 13:18:18.696816 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:18.697724 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:18.967978 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:18.969406 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:18.969425 19478 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:18.698951 21583 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.697077 21675 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:18.698971 21526 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:18.948652 21500 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:18.959827 21672 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:18.975457 21526 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.975644 21672 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:18.975926 21526 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:18.719079 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:18.719333 21617 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:18.719785 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:18.724071 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:18.977106 19582 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:18.973277 21556 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:18.724902 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:18.978499 19580 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:18.978215 21556 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.980305 21556 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:18.949141 21054 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.725698 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:18.974097 21572 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:18.973556 21653 consensus_queue.cc:1059] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:18:18.676649 21629 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.726831 19587 raft_consensus.cc:2955] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:18.980504 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:18:18.981269 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.727932 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1331) took 1486 ms. Trace:
I20260709 13:18:18.981473 19654 raft_consensus.cc:2410] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:18.728155 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:18.729480 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:18.981894 19583 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:18.988312 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:18.729861 19508 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:18.732959 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:18.989199 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1339) took 1241 ms. Trace:
W20260709 13:18:18.989404 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 256523us
I20260709 13:18:18.734270 21652 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:18.714306 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1708) took 1224 ms. Trace:
I20260709 13:18:18.629102 21605 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:18.742973 19506 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:18.999125 21677 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:18.999634 21677 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.999990 21677 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:19.000334 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1717) took 1157 ms. Trace:
I20260709 13:18:18.959760 21384 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:18.734581 21589 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:18.747635 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:18.748131 21575 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:18.749502 19657 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:18.750859 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:18:18.773175 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.776695 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:18.657152 21221 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.715662 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:18.990546 21675 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:18.972159 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:19.043532 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:18.974031 19652 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:18.989647 19508 rpcz_store.cc:276] 0709 13:18:17.747620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.729273 (+981653us) service_pool.cc:224] Handling call
0709 13:18:18.729544 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.988935 (+259391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.989139 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.987408 19584 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:18.680511 21405 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:18.982627 21653 raft_consensus.cc:3055] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:19.000780 19658 raft_consensus.cc:2393] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 4: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:18.738344 21626 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:19.000734 19506 rpcz_store.cc:276] 0709 13:18:17.843006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.999588 (+1156582us) service_pool.cc:224] Handling call
0709 13:18:18.999868 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.000034 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:19.000059 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:19.000098 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:19.000129 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.000179 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.000281 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.744885 19578 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:19.002211 19580 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:18.993958 19505 rpcz_store.cc:276] 0709 13:18:17.489980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.697966 (+1207986us) service_pool.cc:224] Handling call
0709 13:18:18.698347 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.698571 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.698611 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:18.713836 (+ 15225us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:18.713915 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.714020 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.714215 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.966333 21595 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:18.985761 19503 rpcz_store.cc:276] 0709 13:18:17.241697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.246093 (+  4396us) service_pool.cc:224] Handling call
0709 13:18:17.475914 (+229821us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:18:17.476131 (+   217us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:18.056822 (+580691us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:18.122440 (+ 65618us) log.cc:844] Serialized 14 byte log entry
0709 13:18:18.219245 (+ 96805us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:18.219742 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:18:18.219877 (+   135us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:18.219910 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.727587 (+507677us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b540003eb54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:18.727638 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.727680 (+    42us) raft_consensus.cc:1685] finished
0709 13:18:18.727693 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.727842 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102888,"prepare.queue_time_us":95817,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":235842,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":19427,"spinlock_wait_cycles":551346816,"thread_start_us":408768,"threads_started":3,"wal-append.queue_time_us":327543}
I20260709 13:18:19.010537 19659 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:19.010596 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:18.976047 21500 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:18.961261 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 209956us
I20260709 13:18:18.982878 21629 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:18.757967 21601 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.016250 19579 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:19.114020 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1725) took 1268 ms. Trace:
I20260709 13:18:19.114048 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:19.000849 21556 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:19.062765 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:19.116451 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 98670us
I20260709 13:18:19.011152 21594 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.123521 19657 raft_consensus.cc:2368] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5.
I20260709 13:18:19.117609 19661 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.080168 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:19.125025 19653 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:19.120594 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:19.126240 19585 raft_consensus.cc:2410] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:18:19.119405 19581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1622) took 1556 ms (client timeout 1654 ms). Trace:
I20260709 13:18:19.129575 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:19.130417 19580 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
W20260709 13:18:19.127188 19581 rpcz_store.cc:269] 0709 13:18:17.527506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.543922 (+ 16416us) service_pool.cc:224] Handling call
0709 13:18:19.081795 (+1537873us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400247554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:19.081985 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502697344}
I20260709 13:18:19.129029 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:19.134291 19578 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 4.
I20260709 13:18:19.124382 19505 rpcz_store.cc:276] 0709 13:18:17.845264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.112993 (+1267729us) service_pool.cc:224] Handling call
0709 13:18:19.113367 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.113575 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:19.113609 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:19.113683 (+    74us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:19.113725 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.113798 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.113947 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:19.078802 21221 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:19.011776 21652 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.134s
I20260709 13:18:19.146003 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:19.003298 21572 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:19.148372 19579 raft_consensus.cc:1275] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:19.148629 21572 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:19.149544 19579 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:19.153072 19503 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:18:19.159080 21672 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:19.010179 21589 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:19.164000 19584 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:19.164767 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:19.166153 19653 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:19.170892 19661 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:19.010044 21592 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.158s
I20260709 13:18:19.015264 21384 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:19.043936 21440 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.166s
I20260709 13:18:19.039671 21575 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:19.320875 19583 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:19.111145 21626 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.128106 21601 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.115585 21653 raft_consensus.cc:740] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:19.773696 19581 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:19.306027 19582 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:19.783341 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1638) took 1065 ms. Trace:
I20260709 13:18:19.780146 19504 raft_consensus.cc:2955] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:19.774339 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1640) took 1055 ms. Trace:
I20260709 13:18:19.784408 19583 rpcz_store.cc:276] 0709 13:18:18.718789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.725418 (+  6629us) service_pool.cc:224] Handling call
0709 13:18:19.774269 (+1048851us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:19.468256 19507 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1347) took 1693 ms (client timeout 1619 ms). Trace:
I20260709 13:18:19.073655 21605 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:19.336397 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:19.697933 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:19.464080 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:19.701174 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:19.698510 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:19.196897 19503 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:18:19.703004 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:19.561067 21492 consensus_meta.cc:287] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.001s
I20260709 13:18:19.217873 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:19.791883 19657 raft_consensus.cc:2393] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:18:19.777251 19508 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.000s	sys 0.013s
W20260709 13:18:19.792577 19508 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.000s	sys 0.013s
I20260709 13:18:19.783792 19582 rpcz_store.cc:276] 0709 13:18:18.718012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.723763 (+  5751us) service_pool.cc:224] Handling call
0709 13:18:19.783276 (+1059513us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:19.471104 21437 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:19.676297 20619 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.131:33295 timed out after 1.839s (SENT) [suppressed 1 similar messages]
W20260709 13:18:19.678053 21698 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:18:19.188678 21504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.064s	sys 0.158s
I20260709 13:18:19.787127 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1742) took 1057 ms. Trace:
I20260709 13:18:19.780310 21500 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:19.789379 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:19.376595 21689 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
W20260709 13:18:19.472206 21643 log.cc:927] Time spent T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 1.530s	user 0.000s	sys 0.011s
I20260709 13:18:19.790632 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1393) took 1057 ms. Trace:
W20260709 13:18:19.516613 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 392929us
I20260709 13:18:19.808373 19659 rpcz_store.cc:276] 0709 13:18:18.732978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.166060 (+433082us) service_pool.cc:224] Handling call
0709 13:18:19.790541 (+624481us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:19.371635 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:19.568594 21467 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:19.793954 19657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1398) took 1045 ms. Trace:
W20260709 13:18:19.700757 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.598356 21405 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:19.797585 21466 raft_consensus.cc:3055] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:19.459293 21583 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:19.677088 21672 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:19.805356 21437 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.861171 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:19.370595 21595 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:19.531651 21559 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:19.802426 19503 rpcz_store.cc:276] 0709 13:18:18.729991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.159190 (+429199us) service_pool.cc:224] Handling call
0709 13:18:19.196595 (+ 37405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.786827 (+590232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.787051 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:19.868860 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1384) took 2894 ms. Trace:
W20260709 13:18:19.785372 19507 rpcz_store.cc:269] 0709 13:18:17.774510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.795941 (+ 21431us) service_pool.cc:224] Handling call
0709 13:18:19.467994 (+1672053us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b5400207bd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:19.468136 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84412160}
I20260709 13:18:19.468817 21526 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:19.817276 19657 rpcz_store.cc:276] 0709 13:18:18.748658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.162757 (+414099us) service_pool.cc:224] Handling call
0709 13:18:19.793893 (+631136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:19.163932 21594 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:19.805506 21504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.185s	user 0.071s	sys 0.173s
W20260709 13:18:19.805853 21611 consensus_meta.cc:287] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.842s	user 0.008s	sys 0.004s
I20260709 13:18:19.519871 21699 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.204281 21677 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:19.809372 21556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.009s	sys 0.026s
W20260709 13:18:19.828125 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.464541 21675 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:19.804281 21492 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.827329 20664 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:19.857705 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:19.857991 21653 consensus_queue.cc:260] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:19.780779 21652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.001s	sys 0.012s
I20260709 13:18:19.227221 21589 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:19.466033 21617 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:19.869287 19660 rpcz_store.cc:276] 0709 13:18:16.968757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.380534 (+411777us) service_pool.cc:224] Handling call
0709 13:18:17.380886 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:17.410628 (+ 29742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.410678 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.411229 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:18:17.520603 (+109374us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:17.520658 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.520753 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:19.471521 (+1950768us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:18:19.858900 (+387379us) raft_consensus.cc:1685] finished
0709 13:18:19.858932 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.863075 (+  4143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29334,"raft.queue_time_us":71882,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":239,"spinlock_wait_cycles":23328640,"thread_start_us":108706,"threads_started":1,"wal-append.queue_time_us":465421}
I20260709 13:18:19.896636 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:19.869695 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:19.827754 21466 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:19.875758 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1413) took 1181 ms. Trace:
I20260709 13:18:19.874153 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:19.901873 19511 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1704) took 2449 ms (client timeout 2232 ms). Trace:
I20260709 13:18:19.902041 19507 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:19.884183 21611 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4.
I20260709 13:18:19.899142 19656 rpcz_store.cc:276] 0709 13:18:18.693827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.694418 (+   591us) service_pool.cc:224] Handling call
0709 13:18:18.694773 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:18.713927 (+ 19154us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:18.713948 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:18.751975 (+ 38027us) log.cc:844] Serialized 26 byte log entry
0709 13:18:19.136010 (+384035us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:19.136048 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.136114 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:19.875463 (+739349us) raft_consensus.cc:1685] finished
0709 13:18:19.875490 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.875669 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17239,"raft.queue_time_us":15081,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":211161,"thread_start_us":383629,"threads_started":1,"wal-append.queue_time_us":724348}
I20260709 13:18:19.883694 21594 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:19.886248 19653 raft_consensus.cc:2393] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:18:19.897035 21169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.036s	sys 0.013s
W20260709 13:18:19.873514 21629 consensus_meta.cc:287] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.000s
W20260709 13:18:19.892952 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.035712 19476 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:19.893363 19512 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
W20260709 13:18:19.884514 21556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.009s	sys 0.026s
I20260709 13:18:19.904253 19654 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:19.882085 21526 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:19.905320 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:19.894516 21652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.001s	sys 0.012s
W20260709 13:18:19.902285 19511 rpcz_store.cc:269] 0709 13:18:17.451944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.253974 (+802030us) service_pool.cc:224] Handling call
0709 13:18:19.901688 (+1647714us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54000fc654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:19.901806 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237913856}
I20260709 13:18:20.041510 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1744) took 1286 ms. Trace:
W20260709 13:18:19.897509 21679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.022s	sys 0.039s
W20260709 13:18:20.040088 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 703752us
I20260709 13:18:19.866034 21437 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.020185 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1722) took 2175 ms. Trace:
W20260709 13:18:19.980700 21693 log.cc:927] Time spent T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 1.297s	user 0.000s	sys 0.011s
I20260709 13:18:19.893697 21492 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.049408 21437 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:20.049690 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1628) took 1533 ms. Trace:
I20260709 13:18:20.050050 19586 rpcz_store.cc:276] 0709 13:18:18.516423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.516531 (+   108us) service_pool.cc:224] Handling call
0709 13:18:18.516795 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.516985 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:18.526001 (+  9016us) log.cc:844] Serialized 14 byte log entry
0709 13:18:18.691480 (+165479us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.049186 (+1357706us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b180012a5a0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e5e7c0a 00007f6c37d27219 00007f6c2e66fa40 00007f6c2e66a4e4 00007f6c2e66a455 00007f6c31752060 00007f6c31764716 00007f6c31775287 00007f6c31775208
0709 13:18:20.049342 (+   156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.049390 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:20.049434 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.049502 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.049634 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32267,"prepare.queue_time_us":18535,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":1363945,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":22552,"spinlock_wait_cycles":1048837120,"thread_start_us":164807,"threads_started":1,"wal-append.queue_time_us":489335}
I20260709 13:18:20.033795 21393 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:20.052845 19658 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1418) took 1356 ms (client timeout 1683 ms). Trace:
W20260709 13:18:20.053417 19658 rpcz_store.cc:269] 0709 13:18:18.696291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.696729 (+   438us) service_pool.cc:224] Handling call
0709 13:18:20.052649 (+1355920us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b54000ad554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:20.052783 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53396352}
I20260709 13:18:20.053982 21686 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.042572 21629 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.054466 21686 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.054904 19658 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:18:20.055481 21424 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.055994 21629 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:20.056137 21424 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.057065 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1642) took 1337 ms. Trace:
I20260709 13:18:19.907807 21435 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:20.057888 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.057930 21217 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.058212 21633 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:20.058534 21217 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.058784 21633 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.056335 21221 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.059937 21221 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.060617 21217 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:20.060940 21633 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:20.044404 21609 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:20.057518 19587 rpcz_store.cc:276] 0709 13:18:18.719437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.726126 (+  6689us) service_pool.cc:224] Handling call
0709 13:18:18.726445 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.726712 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:19.177395 (+450683us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.056774 (+879379us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.056820 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:20.056862 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.056919 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.057017 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":879119,"raft.queue_time_us":880122,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76}
I20260709 13:18:20.062043 21221 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:19.951534 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:20.030313 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1723) took 2185 ms. Trace:
I20260709 13:18:20.039450 21556 raft_consensus.cc:697] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:20.063648 21686 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:20.064570 19656 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:20.064285 21556 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:20.044632 21679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.023s	sys 0.039s
I20260709 13:18:20.066020 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1394) took 1332 ms. Trace:
I20260709 13:18:20.066362 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:20.045099 19508 rpcz_store.cc:276] 0709 13:18:17.844505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.044709 (+1200204us) service_pool.cc:224] Handling call
0709 13:18:19.045079 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.045325 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:19.128833 (+ 83508us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.019683 (+890850us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.019774 (+    91us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:20.019843 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.019937 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.020095 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":97407,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":48,"raft.queue_time_us":69554,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":5813,"thread_start_us":890367,"threads_started":2,"wal-append.queue_time_us":796051}
I20260709 13:18:20.063135 19506 rpcz_store.cc:276] 0709 13:18:17.844733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.111714 (+1266981us) service_pool.cc:224] Handling call
0709 13:18:19.112039 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.112419 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:19.598033 (+485614us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.029512 (+431479us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.029562 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:20.030029 (+   467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.030113 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.030251 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19128,"prepare.queue_time_us":30592,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":37,"thread_start_us":876955,"threads_started":2}
W20260709 13:18:20.034114 21696 log.cc:927] Time spent T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.139s	user 0.003s	sys 0.010s
I20260709 13:18:19.862514 21583 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:20.068545 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:20.066409 19656 rpcz_store.cc:276] 0709 13:18:18.733234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.065203 (+1331969us) service_pool.cc:224] Handling call
0709 13:18:20.065537 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.065731 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.065755 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.065798 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:20.065830 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.065878 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.065970 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:20.069976 21576 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:20.070791 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1395) took 1337 ms. Trace:
I20260709 13:18:20.071168 19656 rpcz_store.cc:276] 0709 13:18:18.733480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.069860 (+1336380us) service_pool.cc:224] Handling call
0709 13:18:20.070286 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.070456 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.070483 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.070534 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:20.070582 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.070636 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.070739 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:20.072531 19656 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:20.073177 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1396) took 1337 ms. Trace:
W20260709 13:18:20.039645 21695 log.cc:927] Time spent T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:18:20.073921 21611 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:20.047709 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:20.055545 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1392) took 1322 ms. Trace:
I20260709 13:18:20.075248 19658 rpcz_store.cc:276] 0709 13:18:18.732725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.054318 (+1321593us) service_pool.cc:224] Handling call
0709 13:18:20.054687 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.055312 (+   625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.055492 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:20.076701 19658 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:18:20.077225 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1399) took 1328 ms. Trace:
I20260709 13:18:20.057170 19655 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:20.055935 21615 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.077994 21615 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.078780 21424 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:20.079408 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1412) took 1386 ms. Trace:
I20260709 13:18:20.062304 21609 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:20.080009 21615 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:20.079768 19655 rpcz_store.cc:276] 0709 13:18:18.693443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.694338 (+   895us) service_pool.cc:224] Handling call
0709 13:18:18.716453 (+ 22115us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.077800 (+1361347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.079171 (+  1371us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54000e88d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:20.079351 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3082913024}
I20260709 13:18:20.066748 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1338) took 1345 ms. Trace:
I20260709 13:18:20.039501 21592 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.075296 19660 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:20.081823 21592 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.082662 21609 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:20.082799 19660 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:20.083400 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1403) took 1333 ms. Trace:
I20260709 13:18:20.083683 19660 rpcz_store.cc:276] 0709 13:18:18.749967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.082237 (+1332270us) service_pool.cc:224] Handling call
0709 13:18:20.082506 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.083178 (+   672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.083355 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:20.084697 21592 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:20.084872 19660 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:20.042061 19511 rpcz_store.cc:276] 0709 13:18:18.754656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.040519 (+1285863us) service_pool.cc:224] Handling call
0709 13:18:20.040887 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.041106 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.041142 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.041197 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:20.041247 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.041315 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.041445 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:20.085907 19655 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:20.086890 21221 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.087009 21615 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.087498 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1401) took 1338 ms. Trace:
I20260709 13:18:20.087461 21221 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.087913 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:20.088023 19655 rpcz_store.cc:276] 0709 13:18:18.749420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.081209 (+1331789us) service_pool.cc:224] Handling call
0709 13:18:20.081531 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.086313 (+  4782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.087425 (+  1112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:19.890404 21699 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:20.089516 19655 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 13:18:20.091831 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1408) took 1340 ms. Trace:
I20260709 13:18:20.086915 21611 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:20.092516 21653 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:20.092417 21611 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:20.094388 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 58750.4us
I20260709 13:18:20.094550 21611 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:20.089731 21686 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:20.089556 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:20.089529 21221 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:20.096242 21626 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.096801 21709 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.097077 21686 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:19.938885 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:20.097384 21709 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.098258 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:20.099310 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:20.099443 21709 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:20.095942 19476 leader_election.cc:400] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5.
I20260709 13:18:20.103717 19476 leader_election.cc:403] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:20.103938 21575 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:20.105108 19476 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:20.105921 21384 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:20.106287 19476 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:20.106530 21384 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:20.100512 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:20.105957 21713 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5.
I20260709 13:18:20.101014 19509 raft_consensus.cc:2410] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:18:20.108196 19508 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:18:20.109269 19509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1344) took 2335 ms (client timeout 2145 ms). Trace:
I20260709 13:18:20.099826 21221 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:20.052893 21393 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.102619 19655 rpcz_store.cc:276] 0709 13:18:18.751325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.088916 (+1337591us) service_pool.cc:224] Handling call
0709 13:18:20.089264 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:20.091585 (+  2321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.091780 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:20.106638 21675 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:20.107167 21705 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:20.100669 21706 log.cc:927] Time spent T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:18:20.065775 21680 log.cc:927] Time spent T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 1.664s	user 0.005s	sys 0.003s
I20260709 13:18:20.081600 19581 rpcz_store.cc:276] 0709 13:18:18.721005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.141938 (+420933us) service_pool.cc:224] Handling call
0709 13:18:19.773393 (+631455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:19.783167 (+  9774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.066564 (+283397us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b5400247f50. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:20.066683 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1451263232}
I20260709 13:18:20.087504 21615 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.110550 19627 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:20.111097 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 420481us
I20260709 13:18:20.077533 19658 rpcz_store.cc:276] 0709 13:18:18.748920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.076117 (+1327197us) service_pool.cc:224] Handling call
0709 13:18:20.076491 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.077009 (+   518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.077174 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:20.113075 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:20.085457 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1406) took 1334 ms. Trace:
I20260709 13:18:20.073561 19656 rpcz_store.cc:276] 0709 13:18:18.735876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.072049 (+1336173us) service_pool.cc:224] Handling call
0709 13:18:20.072358 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.072849 (+   491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.073125 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:20.211962 19660 rpcz_store.cc:276] 0709 13:18:18.750763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.084318 (+1333555us) service_pool.cc:224] Handling call
0709 13:18:20.084592 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.085259 (+   667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.085413 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:20.114903 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:20.212901 19587 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:20.115752 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:20.214450 19584 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:18:20.109768 19509 rpcz_store.cc:269] 0709 13:18:17.773800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.513223 (+739423us) service_pool.cc:224] Handling call
0709 13:18:20.109072 (+1595849us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540012fa54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:20.109190 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3632038784}
I20260709 13:18:20.131362 21221 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.218320 21221 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.218830 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:20.218976 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:20.219558 19658 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:20.219659 21615 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:20.220331 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:20.220523 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:20.220809 21492 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:20.221060 19581 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:20.110687 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:20.220578 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:20.221994 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 111377us
I20260709 13:18:20.131608 21703 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.132225 21686 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:20.135316 19579 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:20.245321 21686 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:20.246245 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:20.135463 19510 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:20.246608 21633 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:20.105604 21601 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:20.247154 21633 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:20.248090 21633 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.135908 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:20.249935 19580 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:20.133404 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:20.186214 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:20.253433 19655 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:18:20.197173 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:20.254521 19585 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:20.105024 21595 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:20.200008 19582 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:18:20.039196 21169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.036s	sys 0.013s
I20260709 13:18:20.256192 19659 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 5: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:20.105924 21677 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:20.259164 21575 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:20.259595 21575 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:20.260097 21575 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.261817 21711 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.255954 21703 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.107199 21384 raft_consensus.cc:697] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:20.262374 21711 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.263293 21626 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:20.263077 21384 consensus_queue.cc:237] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.264647 21711 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:20.265656 21221 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.226641 19551 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:20.200724 19578 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:20.244597 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:20.268784 19581 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:20.254585 19586 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
W20260709 13:18:20.257576 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 581310us
W20260709 13:18:20.258478 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 147996us
I20260709 13:18:20.272238 19583 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:20.272544 19627 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:20.233824 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1411) took 1481 ms. Trace:
I20260709 13:18:20.265957 21601 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:20.277000 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1414) took 1275 ms. Trace:
I20260709 13:18:20.273218 19658 rpcz_store.cc:276] 0709 13:18:18.752165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.221525 (+1469360us) service_pool.cc:224] Handling call
0709 13:18:20.221844 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.222016 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.222056 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.233320 (+ 11264us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:20.233396 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.233496 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.233736 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:20.273684 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:20.278671 19656 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:20.269174 19625 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:20.279794 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:20.275681 21424 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.276540 19627 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:20.285358 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:20.286022 19656 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:20.277379 19655 rpcz_store.cc:276] 0709 13:18:19.002103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.254165 (+1252062us) service_pool.cc:224] Handling call
0709 13:18:20.276485 (+ 22320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.276668 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.276708 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.276747 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:20.276776 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.276827 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.276944 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:20.275027 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:20.280751 19506 raft_consensus.cc:2393] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 2: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:20.286855 19660 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:20.287629 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1413) took 1318 ms. Trace:
I20260709 13:18:20.288028 19660 rpcz_store.cc:276] 0709 13:18:18.969630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.253807 (+1284177us) service_pool.cc:224] Handling call
0709 13:18:20.286657 (+ 32850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.287337 (+   680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.287553 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:20.288240 19551 connection.cc:256] RPC call timeout handler was delayed by -1.0678437659998963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
I20260709 13:18:20.289698 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:20.291134 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:20.291750 19506 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:20.297369 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:20.297451 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:20.297888 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:20.298233 19660 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:20.298632 19658 raft_consensus.cc:2393] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 5: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:20.299037 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:20.299585 19507 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:20.299933 19625 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:20.303745 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:20.304381 19509 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:20.305238 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:20.305770 19509 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 5.
I20260709 13:18:20.306820 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:20.274406 21626 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:20.318665 19656 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:20.319113 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:20.289744 21677 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:20.319579 19506 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:20.322481 19625 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:20.289481 21652 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:20.294480 21662 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.326304 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:20.324446 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:20.294807 21672 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:20.328863 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:20.317962 21601 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:20.284976 21615 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 13:18:20.332084 19652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1416) took 1636 ms (client timeout 1978 ms). Trace:
W20260709 13:18:20.344909 19652 rpcz_store.cc:269] 0709 13:18:18.695631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.696554 (+   923us) service_pool.cc:224] Handling call
0709 13:18:20.331916 (+1635362us) spinlock_profiling.cc:243] Waited 7.3 ms on lock 0x7b54000adf54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:20.332027 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16800000}
W20260709 13:18:20.346535 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.349143 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:20.335443 19506 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:18:20.246285 21686 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.331126 19507 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:20.334050 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:20.320967 21711 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:20.288858 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1743) took 1534 ms. Trace:
I20260709 13:18:20.326654 21169 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:18:20.323824 21626 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.327852 21675 consensus_queue.cc:1059] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:18:20.338505 21662 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:20.382791 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 71690.5us
I20260709 13:18:20.899204 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:20.355158 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:20.899881 20619 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:20.860749 19509 consensus_meta.cc:287] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.000s
I20260709 13:18:20.901794 19509 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:20.335464 21610 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:20.695084 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.910982 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:20.911214 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:20.344954 21601 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:18:20.616559 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 168731us
I20260709 13:18:20.912366 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1354) took 1122 ms. Trace:
I20260709 13:18:20.327790 21707 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:20.930682 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:20.866928 21679 log.cc:927] Time spent T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 13:18:20.837065 21717 log.cc:927] Time spent T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.355s	user 0.000s	sys 0.000s
I20260709 13:18:20.902820 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:20.969278 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:20.970636 19660 raft_consensus.cc:2410] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:20.970788 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:20.971434 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:20.928659 19511 rpcz_store.cc:276] 0709 13:18:19.789712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.086013 (+296301us) service_pool.cc:224] Handling call
0709 13:18:20.086338 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:20.101383 (+ 15045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.101416 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:20.102038 (+   622us) log.cc:844] Serialized 52 byte log entry
0709 13:18:20.322809 (+220771us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:20.322848 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.322918 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:20.507610 (+184692us) raft_consensus.cc:1685] finished
0709 13:18:20.507644 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.912282 (+404638us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14639,"raft.queue_time_us":14761,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":220259,"threads_started":1,"wal-append.queue_time_us":313087}
I20260709 13:18:20.904603 19504 rpcz_store.cc:276] 0709 13:18:18.754269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.684485 (+930216us) service_pool.cc:224] Handling call
0709 13:18:19.779817 (+ 95332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.780016 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:19.856636 (+ 76620us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.288546 (+431910us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.288598 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:20.288641 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.288706 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.288807 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":399,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":8186,"thread_start_us":431095,"threads_started":1,"wal-append.queue_time_us":529507}
I20260709 13:18:20.972461 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:20.902508 21711 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:20.892697 21424 consensus_meta.cc:287] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.000s
I20260709 13:18:20.931492 19507 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:20.903573 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.482144 21699 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:20.908077 20631 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.001s	sys 0.020s
I20260709 13:18:20.971835 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:20.502939 21724 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.972898 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:20.973479 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:20.383122 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 410684us
I20260709 13:18:20.387030 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:20.998188 19509 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:20.976338 19506 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:20.354648 21677 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:20.414992 21556 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:20.842164 21576 consensus_meta.cc:287] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.772s	user 0.002s	sys 0.007s
I20260709 13:18:20.981482 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.012132 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:20.502508 21393 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:20.504485 21625 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:20.481104 21718 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:20.929216 21601 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:20.992584 21424 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:20.446936 21615 raft_consensus.cc:3055] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:21.001277 19504 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
W20260709 13:18:21.002003 19395 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d05498e224814b9b8f31e3f965ab2583 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d56df3728fc04e37b2d29a3bcd91d167 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:21.033869 19652 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:18:20.616870 21705 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.684594 21578 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.334s
W20260709 13:18:20.978293 21575 consensus_meta.cc:287] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.718s	user 0.011s	sys 0.000s
I20260709 13:18:20.349669 21217 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:20.983285 21711 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:20.922883 21384 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:20.971621 21523 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.004390 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:21.063552 21384 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.063616 21523 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.064388 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.065016 19511 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:21.065897 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.066334 21523 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.066866 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.067003 21523 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.067929 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.012205 19655 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:21.069047 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.070101 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.070667 19655 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
W20260709 13:18:21.071530 21726 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.567s	user 0.000s	sys 0.020s
W20260709 13:18:21.003400 20631 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.002s	sys 0.023s
I20260709 13:18:21.019932 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:20.933501 21708 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 13:18:21.077127 19660 raft_consensus.cc:1275] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:20.922555 21490 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:21.077893 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1416) took 1908 ms. Trace:
I20260709 13:18:21.024350 19507 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:21.078614 21626 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.079138 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.080118 21662 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.080690 21662 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.028322 19509 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:20.347671 21672 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:21.082358 19509 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:21.004655 21699 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:21.087824 21699 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:21.052433 21705 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.089972 21699 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.004097 21732 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:21.055119 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.090946 19656 raft_consensus.cc:1240] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:21.091634 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59942 (request call id 69) took 1744 ms. Trace:
I20260709 13:18:21.091679 19504 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:18:21.092077 19504 pending_rounds.cc:85] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 3
I20260709 13:18:21.092375 19504 pending_rounds.cc:107] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:18:21.092023 19656 rpcz_store.cc:276] 0709 13:18:19.347689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.090509 (+1742820us) service_pool.cc:224] Handling call
0709 13:18:21.090794 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.091377 (+   583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.091580 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.092757 19504 raft_consensus.cc:2889] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:21.015065 21221 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.018612 21576 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:21.033370 21615 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:21.024495 21393 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:21.094439 21393 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:21.094867 21393 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:21.094820 21615 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.095543 21715 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:21.096172 21615 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:21.096057 21715 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.067342 21054 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:21.058414 21217 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.099215 21217 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.081308 21662 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.103854 21662 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.016665 21556 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.067607 21523 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:20.502071 21611 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:21.003741 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:21.080588 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.106280 19506 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:21.106608 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1400) took 2357 ms. Trace:
I20260709 13:18:21.107080 21523 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:21.113199 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 185378us
I20260709 13:18:21.113201 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:21.087221 21672 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:21.090659 21732 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.083375 21575 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.079157 21626 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.034996 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.093521 19656 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:21.114207 19587 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 5.
I20260709 13:18:21.106956 19653 rpcz_store.cc:276] 0709 13:18:18.749179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.171557 (+422378us) service_pool.cc:224] Handling call
0709 13:18:21.106425 (+1934868us) spinlock_profiling.cc:243] Waited 99.6 ms on lock 0x7b54000807d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:21.106553 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229023616}
I20260709 13:18:21.078265 19660 rpcz_store.cc:276] 0709 13:18:19.169167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.076488 (+1907321us) service_pool.cc:224] Handling call
0709 13:18:21.076789 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.077529 (+   740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.077841 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.116154 19509 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:21.128147 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59942 (request call id 70) took 1723 ms. Trace:
I20260709 13:18:21.130259 19583 raft_consensus.cc:1240] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:21.134495 19656 rpcz_store.cc:276] 0709 13:18:19.404309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.093122 (+1688813us) service_pool.cc:224] Handling call
0709 13:18:21.093371 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.127846 (+ 34475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.128074 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:21.132041 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.145826 19660 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:21.146740 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1425) took 1036 ms. Trace:
W20260709 13:18:21.146853 19654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1405) took 2396 ms (client timeout 2244 ms). Trace:
I20260709 13:18:21.147154 19660 rpcz_store.cc:276] 0709 13:18:20.110075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.142153 (+1032078us) service_pool.cc:224] Handling call
0709 13:18:21.142560 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.146438 (+  3878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.146675 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.011270 21724 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:21.147450 19654 rpcz_store.cc:269] 0709 13:18:18.750485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.170176 (+419691us) service_pool.cc:224] Handling call
0709 13:18:21.146612 (+1976436us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b540039a654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:21.146753 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272062208}
I20260709 13:18:21.151878 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:21.149114 19660 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:21.154493 19656 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:21.114655 19625 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:21.090993 21705 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.157725 19655 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:21.163357 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.157639 19625 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:21.148245 19551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.017s	sys 0.034s
I20260709 13:18:21.160111 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.167728 19653 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 5.
W20260709 13:18:21.168630 19551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.017s	sys 0.034s
W20260709 13:18:21.173090 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 824068us
I20260709 13:18:21.174057 19551 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:21.180188 19506 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:21.181792 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:18:21.170312 19625 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:21.157843 21556 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.184355 21217 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:21.178213 21715 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.184741 21666 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:21.184995 21611 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:21.130990 21626 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.224689 19625 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:21.177065 21615 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:21.187361 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:21.169723 21633 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.017s	sys 0.034s
I20260709 13:18:21.188985 21576 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:18:21.235131 21054 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.236865 21626 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.183298 20631 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:21.254724 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 67416.1us
I20260709 13:18:21.260197 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:21.192821 21666 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:21.240198 21633 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.017s	sys 0.034s
I20260709 13:18:21.267474 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:21.190003 21217 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
W20260709 13:18:21.266350 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 911267us
I20260709 13:18:21.271610 19627 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:21.273609 19627 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:21.276044 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:21.270844 21610 raft_consensus.cc:697] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:21.264030 21578 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:21.278282 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:21.279318 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:21.279620 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:21.277936 19584 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.005s	sys 0.011s
I20260709 13:18:21.280236 19583 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:21.279960 19587 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:21.270375 21626 raft_consensus.cc:2764] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:18:21.271102 21217 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:21.286989 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:21.273694 21728 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:21.292953 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:21.268620 21672 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:21.269912 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 100706us
I20260709 13:18:21.241859 21615 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.337715 19587 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:21.266076 21054 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.280979 21523 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:21.275784 21738 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:21.343951 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:21.282289 21578 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.285791 21677 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:21.266547 21711 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.291692 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:21.346338 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 54716.7us
I20260709 13:18:21.288585 21742 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:21.281157 21611 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:21.277824 21707 raft_consensus.cc:697] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:18:21.280503 19584 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.005s	sys 0.011s
I20260709 13:18:21.358882 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1360) took 1239 ms. Trace:
I20260709 13:18:21.358928 21707 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.359316 19584 rpcz_store.cc:276] 0709 13:18:20.137528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.251650 (+114122us) service_pool.cc:224] Handling call
0709 13:18:20.252029 (+   379us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:20.256614 (+  4585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.256642 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:20.286322 (+ 29680us) log.cc:844] Serialized 52 byte log entry
0709 13:18:20.361704 (+ 75382us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:20.362524 (+   820us) log.cc:844] Serialized 14 byte log entry
0709 13:18:21.358541 (+996017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.358629 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.358676 (+    47us) raft_consensus.cc:1685] finished
0709 13:18:21.358690 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.358826 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51937,"prepare.queue_time_us":237,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":86287,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":35491,"thread_start_us":971607,"threads_started":2,"wal-append.queue_time_us":141256}
I20260709 13:18:21.339097 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:21.342083 19506 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:21.287149 21633 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:21.286198 21556 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:21.378165 21556 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.379280 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.380406 21556 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.381438 21633 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.383764 21633 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.347764 21578 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:21.286254 21705 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:21.405499 21589 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:21.405568 21699 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:21.405879 21705 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.406796 21699 raft_consensus.cc:3055] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:21.407166 21699 raft_consensus.cc:740] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:18:21.292290 21652 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:21.332304 21575 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:21.286793 21731 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:21.331893 21662 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:21.292969 21728 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.347483 21737 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:21.432627 19505 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:18:21.432741 21737 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.361713 19586 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:18:21.350946 21615 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.351123 21729 consensus_queue.cc:1059] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:18:21.361209 21725 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:21.433789 21662 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.365861 21466 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.435106 21466 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:21.436472 21662 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.437222 21728 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:21.437280 19587 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:21.366974 21601 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.439311 21601 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:21.367792 21217 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:21.343551 21523 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.368572 21745 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:18:21.350167 21694 log.cc:927] Time spent T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 1.833s	user 0.013s	sys 0.008s
I20260709 13:18:21.352716 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:21.371146 19512 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1703) took 3919 ms (client timeout 2213 ms). Trace:
W20260709 13:18:21.371922 19659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1417) took 2131 ms (client timeout 1621 ms). Trace:
I20260709 13:18:21.372119 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:21.453758 19584 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 4.
W20260709 13:18:21.453508 19659 rpcz_store.cc:269] 0709 13:18:19.240465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.857321 (+616856us) service_pool.cc:224] Handling call
0709 13:18:21.371734 (+1514413us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54002c74d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:21.371859 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839208320}
I20260709 13:18:21.372529 21054 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:21.372792 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1745) took 2421 ms. Trace:
I20260709 13:18:21.452812 19660 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
W20260709 13:18:21.453222 19512 rpcz_store.cc:269] 0709 13:18:17.451691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.751564 (+299873us) service_pool.cc:224] Handling call
0709 13:18:21.370929 (+3619365us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54001b03d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:21.371047 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4548792064}
I20260709 13:18:21.455080 19510 rpcz_store.cc:276] 0709 13:18:18.951700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.064124 (+1112424us) service_pool.cc:224] Handling call
0709 13:18:20.064448 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.246883 (+182435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.372516 (+1125633us) spinlock_profiling.cc:243] Waited 70.7 ms on lock 0x7b540012f554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:21.372722 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162586496}
I20260709 13:18:21.376011 21393 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.377230 19408 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 43) took 6454 ms. Trace:
I20260709 13:18:21.290717 21666 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.353008 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.456910 21384 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.352417 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.353717 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:21.457656 20631 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:21.353375 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.425407 21575 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:21.352069 21732 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.354023 21743 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:21.457998 20664 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:21.460453 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.460611 21703 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.460915 21743 raft_consensus.cc:697] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:21.461568 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:21.462322 19659 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:21.461854 21743 consensus_queue.cc:237] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.462505 21384 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.460453 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:21.462985 21384 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.364784 21738 raft_consensus.cc:697] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:21.465072 21384 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.392452 21724 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.355691 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1415) took 2314 ms. Trace:
I20260709 13:18:21.465574 19661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1390) took 2733 ms. Trace:
I20260709 13:18:21.467622 19661 rpcz_store.cc:276] 0709 13:18:18.732291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.173176 (+440885us) service_pool.cc:224] Handling call
0709 13:18:19.173573 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.793221 (+619648us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:20.024685 (+231464us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.258074 (+233389us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.258665 (+   591us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:20.271641 (+ 12976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.465364 (+1193723us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b5400103454. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:21.465404 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.465519 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":273012,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":56682,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":1424557312,"thread_start_us":396494,"threads_started":2,"wal-append.queue_time_us":302750}
I20260709 13:18:21.459340 21697 consensus_queue.cc:1059] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:18:21.465703 21738 consensus_queue.cc:237] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.470978 21393 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:21.471926 21753 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:21.472359 21753 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.472712 21753 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:21.466053 19655 rpcz_store.cc:276] 0709 13:18:19.041331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.071294 (+2029963us) service_pool.cc:224] Handling call
0709 13:18:21.071580 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.161097 (+ 89517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.355480 (+194383us) spinlock_profiling.cc:243] Waited 85.9 ms on lock 0x7b5400102a54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:21.355642 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197658368}
I20260709 13:18:21.456311 19408 rpcz_store.cc:276] 0709 13:18:14.922912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.923185 (+   273us) service_pool.cc:224] Handling call
0709 13:18:15.287278 (+364093us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54002ec7d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c4090 00007f6c31762f3a 00007f6c375191cc 00007f6c3761737e 00007f6c35ad82a4 00007f6c35ad8232 00007f6c35ad8161 00007f6c35ad80dc 00007f6c35ad7392 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:21.377101 (+6089823us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:17.967324 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:17.984095 (+ 16771us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:17.984133 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:18:17.984150 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:17.984489 (+   339us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:17.984545 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:17.984583 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:17.984781 (+   198us) tablet.cc:701] Row locks acquired
0709 13:18:17.984795 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:18:17.984946 (+   151us) write_op.cc:270] Start()
0709 13:18:17.985050 (+   104us) write_op.cc:276] Timestamp: P: 1783603097984899 usec, L: 0
0709 13:18:17.985067 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:18:18.099293 (+114226us) log.cc:844] Serialized 602 byte log entry
0709 13:18:18.544415 (+445122us) spinlock_profiling.cc:243] Waited 9.68 ms on lock 0x7b54002ec7d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c31755e28 00007f6c35190581 00007f6c3518fd58 00007f6c351949f1 00007f6c351949a9 00007f6c35194939 00007f6c35194901 00007f6c35193b2d 000000000038f354 000000000038f199
0709 13:18:18.617064 (+ 72649us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:18:20.102874 (+1485810us) op_driver.cc:464] REPLICATION: finished
0709 13:18:20.444221 (+341347us) write_op.cc:301] APPLY: starting
0709 13:18:20.445878 (+  1657us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:20.445986 (+   108us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:20.446011 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:20.501901 (+ 55890us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:20.502117 (+   216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:20.502178 (+    61us) write_op.cc:312] APPLY: finished
0709 13:18:20.502391 (+   213us) log.cc:844] Serialized 22 byte log entry
0709 13:18:20.502566 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:20.502650 (+    84us) write_op.cc:454] Released schema lock
0709 13:18:20.502703 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:20.997195 (+494492us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:21.003215 (+  6020us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1641214,"reported_tablets":2,"spinlock_wait_cycles":391389440,"child_traces":[["op",{"apply.queue_time_us":329566,"apply.run_cpu_time_us":19735,"apply.run_wall_time_us":538582,"num_ops":1,"prepare.queue_time_us":534919,"prepare.run_cpu_time_us":17738,"prepare.run_wall_time_us":599911,"raft.queue_time_us":818660,"raft.run_cpu_time_us":29623,"raft.run_wall_time_us":391268,"replication_time_us":1966081,"spinlock_wait_cycles":30530688,"thread_start_us":1327564,"threads_started":4,"wal-append.queue_time_us":175806}]]}
I20260709 13:18:21.367827 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.477375 19657 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:18:21.478031 21728 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:21.481246 21728 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:21.409412 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.408028 21705 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:21.411793 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 138251us
I20260709 13:18:21.488081 19627 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:21.423466 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 198859us
I20260709 13:18:21.489657 19625 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:21.424679 20619 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:21.404470 21686 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:21.426991 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.425097 21742 raft_consensus.cc:697] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:21.421502 21652 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:21.410269 21440 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:21.421177 21733 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.433091 19505 pending_rounds.cc:85] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 3
I20260709 13:18:21.512576 19505 pending_rounds.cc:107] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:18:21.508808 19476 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:21.512930 19505 raft_consensus.cc:2889] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:21.337054 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:21.433370 21737 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:21.440012 19652 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:21.347215 21672 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.448885 21523 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:21.408074 21699 consensus_queue.cc:260] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:21.450724 21217 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:21.531950 19583 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:21.458647 19654 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:21.355020 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1746) took 1935 ms. Trace:
I20260709 13:18:21.533284 19508 rpcz_store.cc:276] 0709 13:18:19.420129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.067438 (+647309us) service_pool.cc:224] Handling call
0709 13:18:20.067701 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.108549 (+ 40848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.354773 (+1246224us) spinlock_profiling.cc:243] Waited 40.2 ms on lock 0x7b54001ef5d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:21.354959 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92379008}
I20260709 13:18:21.474494 21575 raft_consensus.cc:697] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:18:21.483770 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.535734 19583 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:21.536823 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:21.384496 21610 consensus_queue.cc:237] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.559036 21652 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:21.494303 19658 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:21.502585 21176 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:21.503124 21054 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:21.503886 19410 catalog_manager.cc:5697] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.504485 21752 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:18:21.510186 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 85602.8us
I20260709 13:18:21.511178 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:21.519999 19476 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:21.586473 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 66537us
I20260709 13:18:21.587359 19476 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:21.520784 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 183775us
I20260709 13:18:21.526072 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:21.590457 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:21.525228 19584 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:21.521857 21739 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:21.542583 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.537174 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:21.517762 21715 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:18:21.559643 21490 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:18:21.560935 19581 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:21.560549 21753 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:21.514065 21741 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.561533 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:21.517094 21492 consensus_queue.cc:1059] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:18:21.515340 21742 consensus_queue.cc:237] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.517200 21705 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:18:21.609539 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:21.564321 19612 heartbeater.cc:646] Failed to heartbeat to 127.17.251.190:33289 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.251.190:33289 timed out after 15.000s (SENT)
I20260709 13:18:21.565929 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:21.566190 21575 consensus_queue.cc:237] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.566669 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:21.518757 21686 raft_consensus.cc:697] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:21.514539 21697 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:21.347062 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:21.615512 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 268514us
I20260709 13:18:21.615782 19652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1433) took 1334 ms. Trace:
I20260709 13:18:21.567796 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.556809 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:21.616196 19652 rpcz_store.cc:276] 0709 13:18:20.281605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.151552 (+869947us) service_pool.cc:224] Handling call
0709 13:18:21.151895 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.515433 (+363538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.615540 (+100107us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54000e83d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:21.615712 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":662186880}
I20260709 13:18:21.569563 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:21.617856 19585 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:21.618059 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:21.516786 21675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.006s	sys 0.010s
I20260709 13:18:21.558598 21580 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.572260 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.575541 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1741) took 2911 ms. Trace:
I20260709 13:18:21.621939 19505 rpcz_store.cc:276] 0709 13:18:18.658912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.135440 (+476528us) service_pool.cc:224] Handling call
0709 13:18:19.135681 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.513501 (+2377820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.570470 (+ 56969us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b540003cad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:21.570650 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5281840512}
I20260709 13:18:21.622938 19510 raft_consensus.cc:2410] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:18:21.623243 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:21.623291 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:21.624014 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:21.579041 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:21.624887 19583 raft_consensus.cc:2368] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4.
I20260709 13:18:21.624936 19508 raft_consensus.cc:2410] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:18:21.625784 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:21.581084 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:21.530572 21740 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:21.591710 19478 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:21.594703 19509 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:21.555503 21672 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.513818 21440 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.596199 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:21.653803 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:21.654371 19586 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:21.598173 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:21.655296 19584 raft_consensus.cc:2410] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:18:21.515746 21733 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.521298 21384 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:18:21.505784 21677 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:21.603050 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.612253 19579 raft_consensus.cc:2393] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:21.521413 21747 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:18:21.652137 19504 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:21.597203 21558 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:21.624135 19505 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:21.616468 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:21.674762 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 58366.5us
I20260709 13:18:21.530115 21662 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:21.626588 19585 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:21.626768 19580 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 2.
I20260709 13:18:21.678829 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:21.679292 19584 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:21.679445 19580 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:21.620568 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:21.620972 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:21.658185 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:21.578814 21393 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:18:21.660878 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:21.661532 19583 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:21.608731 21466 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:21.653549 21176 raft_consensus.cc:697] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:21.663029 21740 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:21.622112 21697 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:21.630996 21732 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:21.677870 21558 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.657204 19410 catalog_manager.cc:5697] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:21.621428 21675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.007s	sys 0.010s
I20260709 13:18:21.711467 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:21.672986 19509 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:21.675691 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:21.712502 19585 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:21.580868 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:21.713275 19654 raft_consensus.cc:1240] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:21.681216 19579 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:21.684242 19586 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:21.689136 19505 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:21.690279 21715 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:21.691087 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 101481us
I20260709 13:18:21.628276 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:21.692126 21652 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:18:21.697645 21523 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.701864 21666 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:21.692502 19581 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:21.697464 20665 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:21.652437 21708 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.701782 19512 raft_consensus.cc:2376] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5. Re-sending same reply.
I20260709 13:18:21.733229 19410 catalog_manager.cc:5697] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 3 to 4, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 4 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.622641 21741 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.740376 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:21.740901 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.742266 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.742516 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.742839 21605 raft_consensus.cc:3055] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:21.743000 19653 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 4: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:21.743234 21605 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:21.743602 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.744177 19654 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:21.657310 21739 raft_consensus.cc:697] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:21.745385 21739 consensus_queue.cc:237] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.719477 21558 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:21.739787 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.747594 19658 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:21.741410 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.749794 21761 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:18:21.705905 21751 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:18:21.711184 21697 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:21.752925 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.659204 21711 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:21.737335 21466 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.753969 21729 raft_consensus.cc:3055] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:21.736903 21703 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:21.754441 21729 raft_consensus.cc:740] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:18:21.754740 21703 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.755170 21703 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:21.755306 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:21.706497 20619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.755501 21729 consensus_queue.cc:260] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:21.756147 19657 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:21.756508 21729 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:21.710500 19583 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:21.618971 21556 consensus_queue.cc:1059] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:18:21.760177 21556 raft_consensus.cc:3055] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:21.760533 21556 raft_consensus.cc:740] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:21.761340 21556 consensus_queue.cc:260] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.762542 21556 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:21.669739 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:21.714835 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:21.696324 21610 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:18:21.680831 21672 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:21.627830 21580 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.719806 21715 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:21.722342 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.722999 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:21.717099 21589 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.725024 21176 consensus_queue.cc:237] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:21.725451 19652 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:21.723330 21724 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:21.725896 21731 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:21.726080 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.725268 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.711251 21740 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:21.726272 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.725216 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:21.692469 19584 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:21.731360 19582 raft_consensus.cc:2368] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8.
I20260709 13:18:21.731626 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.809497 19655 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
W20260709 13:18:21.732164 19551 connection.cc:256] RPC call timeout handler was delayed by -1.2471528260000468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 13:18:21.737141 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:21.811559 19586 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:21.811959 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:21.738379 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.738616 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.757488 21725 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:21.814975 21725 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.817116 21725 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.677505 21169 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.765522 21708 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.758327 19512 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:21.758460 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:21.787715 21747 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:21.767724 19581 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:21.783509 21724 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.767995 19585 raft_consensus.cc:1240] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:21.726218 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:21.772177 21675 consensus_queue.cc:1059] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:18:21.774153 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.774469 21751 raft_consensus.cc:3055] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:21.842154 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:21.844439 19584 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 5: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:21.775681 19503 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:21.777113 21733 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:21.778409 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 63657.6us
I20260709 13:18:21.781253 21589 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:21.758322 21750 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:18:21.779261 19579 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:21.777302 21558 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.867165 21762 raft_consensus.cc:3055] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:21.867617 21762 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:21.868530 21558 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.738998 21728 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:21.868467 21762 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.817595 21725 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:21.789072 19504 raft_consensus.cc:2410] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:21.872318 21741 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.873118 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.819427 21708 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:21.874302 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.874640 21580 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.875419 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.789913 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.876242 19508 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:21.877274 19503 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:18:21.770702 21672 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.806854 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.881742 21672 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:21.881956 19511 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:21.730387 21732 raft_consensus.cc:697] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:21.882759 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:21.883394 21732 consensus_queue.cc:237] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.753998 21466 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:21.821720 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.823712 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:21.860751 19625 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:21.828284 19586 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:21.823144 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:21.887645 19625 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:21.887944 19657 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 5: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:21.822587 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:21.830492 21523 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.830916 21610 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:21.739461 21686 consensus_queue.cc:237] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.833921 21715 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.722231 19478 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:21.840597 19506 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:21.851013 19582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:60828
I20260709 13:18:21.898576 19582 raft_consensus.cc:606] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:21.899128 19582 raft_consensus.cc:614] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:21.861670 20662 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 5: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:18:21.863900 21605 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.869776 21762 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:21.791109 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.807961 21745 consensus_queue.cc:1059] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:18:21.877321 19508 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:18:21.843688 21751 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:21.837903 21753 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:21.895915 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 73392.2us
W20260709 13:18:21.902801 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 180691us
I20260709 13:18:21.903294 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:21.904841 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 81225.4us
I20260709 13:18:21.920670 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:21.840127 21724 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:21.915657 19508 pending_rounds.cc:85] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 4
I20260709 13:18:21.923529 19508 pending_rounds.cc:107] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:18:21.905423 21743 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:21.886049 21703 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.908025 19579 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:21.927996 19625 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:21.817869 21169 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.928639 21753 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:21.928496 21558 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:21.912992 21440 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.854012 21747 raft_consensus.cc:697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:21.917059 21605 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:21.923991 19508 raft_consensus.cc:2889] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:21.779078 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 158731us
I20260709 13:18:21.924803 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:21.925319 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:21.912389 21523 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:21.930274 19627 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:21.936652 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:21.906399 21741 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:21.937788 21615 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:21.938395 21611 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:21.939090 21611 raft_consensus.cc:697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:21.939551 21672 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.940225 21611 consensus_queue.cc:237] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.906569 21708 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:21.945942 21672 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:21.941792 21676 raft_consensus.cc:3055] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:21.946161 21751 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:21.936439 21666 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:18:21.948743 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:21.949707 21743 raft_consensus.cc:697] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:21.919735 21675 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:21.957928 21384 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:21.954291 21662 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:21.926983 21715 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:21.978180 19509 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 4: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:21.931123 21731 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:21.978307 21699 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:21.957748 21748 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:21.979363 19476 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:21.965050 19478 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:21.964690 21752 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:21.983192 21707 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:21.978070 21676 raft_consensus.cc:740] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:18:22.027021 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 47737.7us
I20260709 13:18:22.027711 19476 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:22.024129 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 59145us
I20260709 13:18:22.029314 19478 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.008348 21384 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:22.036480 19476 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.046748 19478 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.012130 21738 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:18:22.024830 21752 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.020787 21675 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:22.013902 21763 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:18:22.046027 21662 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:22.051812 21652 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:22.053217 19478 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.034106 21741 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:22.037106 21384 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.039045 21751 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.070188 21666 raft_consensus.cc:2764] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:22.049201 21440 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:22.028002 21748 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:22.076013 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 139467us
I20260709 13:18:22.083019 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:22.083859 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:22.084776 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:22.086438 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:22.087714 19660 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:22.055462 21752 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.120846 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:22.134097 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:22.134491 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.082132 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:22.051519 21743 consensus_queue.cc:237] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:22.055217 21705 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:22.124445 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:22.073444 21737 consensus_meta.cc:287] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.000s
W20260709 13:18:22.127415 21769 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:18:22.129995 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:22.130604 21578 consensus_meta.cc:287] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.000s
I20260709 13:18:22.130643 21676 consensus_queue.cc:260] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:22.059847 21741 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.146924 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:22.148157 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.078866 21169 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:22.079453 21440 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:22.152837 19656 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:22.033525 21747 consensus_queue.cc:237] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:22.158939 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:22.163226 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:22.157660 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 86901.9us
I20260709 13:18:22.169106 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:22.149207 21731 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:22.168798 21440 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.152180 21733 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:22.154306 21732 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:22.174233 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:22.133378 21580 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:18:22.163494 21741 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.125962 21697 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:22.173550 21672 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:22.264142 21676 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:22.262665 21760 log.cc:927] Time spent T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:18:22.307737 21703 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:22.158746 21578 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:22.227743 21523 consensus_queue.cc:1059] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.104s
I20260709 13:18:22.158767 21737 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:22.341974 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 167837us
I20260709 13:18:22.358842 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:22.332670 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 113084us
I20260709 13:18:22.320986 21732 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.171377 21675 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:22.363595 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.369886 19659 raft_consensus.cc:2393] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 3: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:22.344739 21556 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:22.354477 21767 log.cc:927] Time spent T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.306s	user 0.005s	sys 0.004s
I20260709 13:18:22.374207 21556 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:22.374513 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.374658 21556 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:22.383518 19587 raft_consensus.cc:2393] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:22.335273 21731 consensus_queue.cc:1059] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:18:22.389603 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:22.368865 21732 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:22.366670 21703 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:22.401245 21697 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:22.402884 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:22.410681 21744 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:22.415380 21739 raft_consensus.cc:3055] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:22.420356 21733 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:22.422976 21776 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:18:22.433867 21589 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:22.436079 21770 log.cc:927] Time spent T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 13:18:22.447626 21737 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:22.453368 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 73862.9us
I20260709 13:18:22.381909 21556 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:22.509202 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.518649 19509 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:22.539461 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:22.541008 19509 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:22.522786 19579 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:22.383255 21466 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:22.533769 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:22.465487 21705 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:22.544054 19508 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
W20260709 13:18:22.548520 19627 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.086s	sys 0.133s
W20260709 13:18:22.549041 19627 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.086s	sys 0.133s
I20260709 13:18:22.548868 19478 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:22.549863 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 619643us
I20260709 13:18:22.473491 21744 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:22.551460 19627 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:22.501751 21733 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.471663 21739 raft_consensus.cc:740] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:22.562363 19508 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:22.566159 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:22.566116 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:22.570948 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:22.571645 19578 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:22.570065 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:22.572403 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:22.527323 21615 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.524425 21748 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:22.559327 21755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.016s	sys 0.009s
I20260709 13:18:22.577477 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:22.583541 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:22.584146 19584 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:22.547968 21662 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.578178 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:22.543766 21589 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.577126 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:22.592562 19586 raft_consensus.cc:2368] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5.
I20260709 13:18:22.592978 19578 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:22.593614 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:22.585304 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:22.552752 21523 consensus_queue.cc:1243] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:22.548841 21705 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.584357 19581 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:22.577826 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:22.577160 21703 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:22.498720 21752 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:22.559104 21744 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.582221 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:22.594399 19586 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:22.611443 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:22.611897 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:22.612082 19586 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:22.590307 21169 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:22.600469 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:22.565290 21773 log.cc:927] Time spent T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.404s	user 0.001s	sys 0.000s
I20260709 13:18:22.600948 19585 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
W20260709 13:18:22.587337 21755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.016s	sys 0.009s
W20260709 13:18:22.604425 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 214883us
I20260709 13:18:22.578688 21677 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:22.604961 21703 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:22.607968 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:22.606460 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:22.613015 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:22.665221 19586 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:22.613034 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:22.666064 21784 log.cc:927] Time spent T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:18:22.666941 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:22.667325 21763 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:22.667693 19581 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 4: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:22.667889 21763 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:22.668551 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:22.594017 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:22.670331 21786 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:22.617359 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:22.671563 19584 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:22.671911 21217 raft_consensus.cc:3055] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:22.672358 21217 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:22.672817 19584 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:22.674171 19578 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:22.674350 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:22.615348 19627 leader_election.cc:400] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4.
I20260709 13:18:22.675026 19580 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
W20260709 13:18:22.675544 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 60387.5us
I20260709 13:18:22.676909 19627 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:22.654141 19582 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:22.603906 21705 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.597254 21662 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:22.655553 19657 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:22.657641 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:22.589217 21777 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.415s	user 0.001s	sys 0.001s
I20260709 13:18:22.585923 21783 consensus_queue.cc:1059] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:18:22.658288 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:22.615413 21780 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.353s	user 0.000s	sys 0.001s
I20260709 13:18:22.584663 21615 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:22.663098 19508 raft_consensus.cc:2393] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:22.656376 21610 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:22.655301 19510 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:22.600093 21589 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:22.686106 19627 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:22.687441 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:22.660503 21771 log.cc:927] Time spent T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 13:18:22.655136 21605 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.609958 21697 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 13:18:22.705044 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 46842.7us
I20260709 13:18:22.674965 21703 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.726557 19583 raft_consensus.cc:2393] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:22.659991 21677 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:22.715204 21589 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:22.643456 21761 consensus_queue.cc:1059] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:18:22.716219 19627 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:22.722039 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 125657us
I20260709 13:18:22.673225 21217 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:22.698207 21169 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:22.699043 21578 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:22.710708 21725 consensus_meta.cc:287] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.840s	user 0.009s	sys 0.003s
W20260709 13:18:22.737125 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 49802us
I20260709 13:18:22.738098 19578 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:22.748189 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:22.750981 19478 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.702507 21601 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:18:22.726575 21755 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:22.757717 19478 leader_election.cc:400] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5.
I20260709 13:18:22.760339 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:22.828157 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 75849.6us
I20260709 13:18:22.828200 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:22.758280 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:22.788702 21731 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:22.830058 21731 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:22.829007 19506 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.829073 19478 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.737154 21677 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.764389 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:22.835891 19656 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:22.734246 21748 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:18:22.755901 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:22.832782 19478 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.829069 19652 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:22.844413 21795 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:22.753588 21523 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:22.834220 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:22.753654 21725 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:22.790287 19655 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:22.733882 21605 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:22.682646 21739 consensus_queue.cc:260] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:22.746316 21558 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:22.749531 21707 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:22.843822 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 83608.4us
I20260709 13:18:22.843847 19510 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:22.788336 21783 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.834220 19512 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:22.855005 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.826342 21217 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.754755 21675 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 13:18:22.844993 21761 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:22.849431 19656 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:22.753003 21633 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 13:18:22.866289 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:22.867491 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:22.867949 19512 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:22.870102 21739 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.871407 20619 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:22.854218 21740 consensus_meta.cc:287] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 1.019s	user 0.010s	sys 0.002s
I20260709 13:18:22.851796 20662 raft_consensus.cc:1240] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:22.834867 21732 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:22.856215 21788 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:22.857492 21785 log.cc:927] Time spent T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:18:22.892237 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:22.895074 19653 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:22.859763 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.838203 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:22.899547 19654 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.846386 21731 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:22.847685 21523 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:18:22.882929 21699 consensus_meta.cc:287] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.860s	user 0.011s	sys 0.001s
I20260709 13:18:22.906143 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:22.873296 21707 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:22.908319 21793 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:22.909166 21775 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.788s	user 0.000s	sys 0.004s
I20260709 13:18:22.908819 21707 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:22.910791 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:22.911334 19511 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.914783 19586 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:22.921978 19654 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:22.846589 19478 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.880861 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:22.895028 21788 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.848047 21686 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:22.882103 19652 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:22.927201 19512 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:22.749955 21763 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:22.892002 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:22.851531 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 104713us
I20260709 13:18:22.865079 21725 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:22.903669 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.880841 19506 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:22.940604 19506 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:22.858386 21558 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:22.906730 21523 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.949664 19551 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.950374 19627 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:22.915186 21752 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:22.926524 21440 consensus_meta.cc:287] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.616s	user 0.007s	sys 0.006s
W20260709 13:18:22.923282 21384 consensus_meta.cc:287] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.833s	user 0.004s	sys 0.011s
I20260709 13:18:22.953895 19627 leader_election.cc:400] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8.
W20260709 13:18:22.945446 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 98918.6us
I20260709 13:18:22.959226 19511 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:22.951970 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:22.892537 21740 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:22.959170 19478 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:22.954099 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 82778.5us
I20260709 13:18:22.960934 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:22.962893 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 92150.3us
I20260709 13:18:22.970218 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.970970 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:22.972432 19511 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:22.973376 19627 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:22.930379 21686 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:22.943001 21558 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.929543 21788 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:22.943401 21662 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:22.952075 21793 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:22.995306 19627 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:22.997057 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.998103 21697 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:22.954772 21605 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:23.012213 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:22.956423 21606 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:23.007325 19505 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:23.008813 19478 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:22.968784 21751 consensus_meta.cc:287] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.891s	user 0.015s	sys 0.000s
I20260709 13:18:22.968452 21725 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:23.010628 21761 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:22.967207 21615 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.023957 19661 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:23.024510 19478 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:22.994529 21686 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:23.005580 21707 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:23.017076 21785 log.cc:927] Time spent T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:18:23.003829 21793 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.013741 21611 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:23.041471 21793 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.965509 21440 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.014529 21662 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:23.000216 21737 consensus_queue.cc:1059] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:18:23.021190 21743 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:22.999115 21601 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:18:23.022085 21752 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:22.969538 21384 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:23.047825 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 76118.4us
I20260709 13:18:23.057900 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:23.059494 19478 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:23.024070 21761 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:23.041013 21732 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.066854 21761 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:23.070979 21789 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:23.071508 21789 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:23.071925 21789 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:23.055927 21792 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:18:23.048188 21662 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:23.062318 21556 consensus_meta.cc:287] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.509s	user 0.015s	sys 0.000s
I20260709 13:18:23.044401 21807 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:23.078691 19510 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:23.068642 21752 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:18:23.084667 21798 log.cc:927] Time spent T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:18:23.099066 21810 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:23.104594 21744 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:23.106333 21762 consensus_meta.cc:287] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 1.192s	user 0.008s	sys 0.004s
I20260709 13:18:23.080027 21662 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:23.112316 21803 log.cc:927] Time spent T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:18:23.112565 21740 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.080331 21440 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.113164 21805 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:23.134581 21764 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:23.134450 21813 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:23.088227 21556 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.118917 21787 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.189s
W20260709 13:18:23.133566 21676 consensus_meta.cc:287] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.786s	user 0.013s	sys 0.000s
I20260709 13:18:23.131464 21810 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.159479 19509 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:23.170382 21703 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.177348 21703 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.177822 21752 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.179876 21558 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.152336 21725 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:23.170835 21799 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:18:23.183689 21725 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:23.149564 21764 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:23.185446 21764 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:23.158648 21724 consensus_meta.cc:287] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 1.224s	user 0.010s	sys 0.004s
W20260709 13:18:23.170404 21809 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.112s	user 0.000s	sys 0.002s
I20260709 13:18:23.162510 21810 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:23.174487 21795 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:23.207645 21774 log.cc:927] Time spent T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 1.115s	user 0.002s	sys 0.010s
I20260709 13:18:23.195765 21724 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:23.210330 21715 consensus_meta.cc:287] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 1.194s	user 0.013s	sys 0.000s
I20260709 13:18:23.210933 21384 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:23.195437 21733 consensus_meta.cc:287] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.616s	user 0.012s	sys 0.000s
I20260709 13:18:23.252913 21662 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.253548 21733 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.254925 21466 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.255568 21662 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.255662 21733 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.259557 21724 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.213052 21744 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.245879 21805 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.213795 21556 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:23.216143 21741 consensus_meta.cc:287] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.874s	user 0.009s	sys 0.002s
I20260709 13:18:23.222553 21725 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:23.224080 21677 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.225118 21686 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.278246 19503 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 5: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:23.248345 21728 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:23.252468 19504 raft_consensus.cc:2410] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:23.281291 19659 raft_consensus.cc:1240] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:23.252934 21794 raft_consensus.cc:3055] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:23.284312 21523 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:23.274807 21705 consensus_meta.cc:287] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.004s
I20260709 13:18:23.279479 21703 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.276093 21741 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.340075 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1784) took 1409 ms. Trace:
I20260709 13:18:23.340530 19507 rpcz_store.cc:276] 0709 13:18:21.930809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.933232 (+  2423us) service_pool.cc:224] Handling call
0709 13:18:21.933523 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:21.957846 (+ 24323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:21.958995 (+  1149us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:21.965182 (+  6187us) log.cc:844] Serialized 26 byte log entry
0709 13:18:22.006343 (+ 41161us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:22.006387 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.006462 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:22.681954 (+675492us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b4800270258. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c36683aa1 00007f6c3667ab37 00007f6c3667a9ca 00007f6c3677226f 00007f6c36771f37 00007f6c3678655c 00007f6c36786508 00007f6c36786488 00007f6c36786443 00007f6c367856ec 00007f6c356afa96
0709 13:18:23.203140 (+521186us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:18:23.339835 (+136695us) raft_consensus.cc:1685] finished
0709 13:18:23.339859 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.340008 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23148,"raft.queue_time_us":21943,"raft.run_cpu_time_us":2259,"raft.run_wall_time_us":727772,"spinlock_wait_cycles":59766912,"thread_start_us":40835,"threads_started":1,"wal-append.queue_time_us":72192}
I20260709 13:18:23.321748 21794 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:23.272104 21805 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.337826 21808 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.362293 19512 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:23.350836 21558 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.357079 21805 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.285926 21728 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:23.327913 21705 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.329854 21703 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.381076 21589 raft_consensus.cc:3055] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:23.382798 21705 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.387259 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1667) took 1789 ms. Trace:
I20260709 13:18:23.575763 19587 rpcz_store.cc:276] 0709 13:18:21.597581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.624128 (+ 26547us) service_pool.cc:224] Handling call
0709 13:18:23.387025 (+1762897us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b540011e9d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:23.387184 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1565318400}
I20260709 13:18:23.363822 21808 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:23.627703 21788 consensus_meta.cc:287] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.616s	user 0.011s	sys 0.002s
I20260709 13:18:23.575413 21589 raft_consensus.cc:740] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:23.578346 21672 raft_consensus.cc:3055] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:23.631040 21677 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:23.632355 21589 consensus_queue.cc:260] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.632557 21794 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.683432 21794 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:23.685467 21789 consensus_meta.cc:287] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.562s	user 0.003s	sys 0.009s
I20260709 13:18:23.633198 21672 raft_consensus.cc:740] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:23.628276 21788 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.635414 21589 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:23.703011 20664 consensus_meta.cc:287] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.752s	user 0.008s	sys 0.004s
I20260709 13:18:23.713054 21741 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.715307 21728 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.718688 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:23.721500 21783 consensus_meta.cc:287] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.857s	user 0.001s	sys 0.012s
I20260709 13:18:23.721702 21523 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.721998 21783 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:23.712363 21761 consensus_meta.cc:287] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.002s
I20260709 13:18:23.708076 21686 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.736840 19579 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:23.711146 20664 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:23.707145 21789 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:23.739056 21707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.011s	sys 0.049s
I20260709 13:18:23.739532 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60692 (request call id 75) took 1661 ms. Trace:
I20260709 13:18:23.918286 19503 rpcz_store.cc:276] 0709 13:18:22.078208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.154186 (+ 75978us) service_pool.cc:224] Handling call
0709 13:18:23.739259 (+1585073us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54001b0b54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:23.739451 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2538914560}
I20260709 13:18:23.743516 21672 consensus_queue.cc:260] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.921247 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:50816 (request call id 65) took 1260 ms. Trace:
I20260709 13:18:23.922011 19508 rpcz_store.cc:276] 0709 13:18:22.681157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.709058 (+ 27901us) service_pool.cc:224] Handling call
0709 13:18:23.920843 (+1211785us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54001b0b54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c31760735 00007f6c317589fa 00007f6c367204c9 00007f6c2fc9cc54 00007f6c2fc9cbe2 00007f6c2fc9cb11 00007f6c2fc9ca8c 00007f6c2fc9bd42 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:23.921110 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304052480}
I20260709 13:18:23.922924 21633 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.923574 21633 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:23.764676 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.805604 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1794) took 1289 ms. Trace:
W20260709 13:18:23.927095 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:23.927237 19478 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.010s	sys 0.052s
I20260709 13:18:23.831388 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1370) took 1264 ms. Trace:
I20260709 13:18:23.846451 19408 catalog_manager.cc:5697] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 2 to 4, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:23.802837 21686 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.928153 19579 rpcz_store.cc:276] 0709 13:18:22.567424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.576847 (+  9423us) service_pool.cc:224] Handling call
0709 13:18:22.867537 (+290690us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635eee 0000000000375939 00007f6c366a91e0 00007f6c367720c4 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:18:22.867674 (+   137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.741407 (+873733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.831034 (+ 89627us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b540011dfd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:23.831298 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2001986560}
W20260709 13:18:23.859094 19657 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1451) took 1722 ms (client timeout 1952 ms). Trace:
W20260709 13:18:23.856962 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:23.931035 19657 rpcz_store.cc:269] 0709 13:18:22.137155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.137304 (+   149us) service_pool.cc:224] Handling call
0709 13:18:23.858800 (+1721496us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b54001ebc54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:23.859019 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1132585344}
I20260709 13:18:23.931433 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:23.931763 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.896358 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:23.903609 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:23.901857 19582 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:18:23.905745 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.906538 19584 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:18:23.739248 19476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.005s	sys 0.055s
W20260709 13:18:23.935817 19476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.005s	sys 0.055s
W20260709 13:18:23.936216 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 875518us
I20260709 13:18:23.936767 19584 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:23.739820 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1371) took 2016 ms. Trace:
I20260709 13:18:23.938141 19505 rpcz_store.cc:276] 0709 13:18:21.723617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.723939 (+   322us) service_pool.cc:224] Handling call
0709 13:18:21.724633 (+   694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.013367 (+1288734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.738382 (+725015us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001842d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:23.739747 (+  1365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2949541248}
I20260709 13:18:23.747781 19587 raft_consensus.cc:2393] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:23.926880 19509 rpcz_store.cc:276] 0709 13:18:22.516606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.552782 (+ 36176us) service_pool.cc:224] Handling call
0709 13:18:22.553105 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.160047 (+606942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.805282 (+645235us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b540003d4d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:23.805519 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1393935104}
I20260709 13:18:23.941951 19584 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:23.825445 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1392) took 1065 ms. Trace:
I20260709 13:18:23.791916 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:23.944303 19583 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 4.
I20260709 13:18:23.932022 19579 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:23.886216 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:23.942775 19512 rpcz_store.cc:276] 0709 13:18:22.760360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.928321 (+167961us) service_pool.cc:224] Handling call
0709 13:18:22.956011 (+ 27690us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:23.362933 (+406922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.825031 (+462098us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b5400402c54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:23.825356 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":933506816}
I20260709 13:18:23.945412 20665 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:23.765568 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1379) took 2032 ms. Trace:
I20260709 13:18:23.946628 19504 rpcz_store.cc:276] 0709 13:18:21.732844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.875189 (+142345us) service_pool.cc:224] Handling call
0709 13:18:23.765332 (+1890143us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400073ad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:23.765502 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3164651904}
W20260709 13:18:23.848737 19410 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48840 (request call id 164) took 18240 ms (client timeout 15000 ms). Trace:
W20260709 13:18:23.927642 19478 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.010s	sys 0.052s
W20260709 13:18:23.959002 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 899913us
I20260709 13:18:23.799572 21699 raft_consensus.cc:3055] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:23.964406 19550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.024s	sys 0.036s
I20260709 13:18:23.965987 19586 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:23.960026 19478 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:23.792363 21810 consensus_meta.cc:287] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.006s
I20260709 13:18:23.970113 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:23.856817 21793 consensus_meta.cc:287] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.815s	user 0.008s	sys 0.004s
W20260709 13:18:23.972287 19550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.024s	sys 0.036s
W20260709 13:18:23.883947 21764 consensus_meta.cc:287] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.698s	user 0.007s	sys 0.003s
I20260709 13:18:23.876358 21778 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.868412 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:23.965008 21708 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:23.945457 21601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.000s	sys 0.042s
I20260709 13:18:23.761788 21788 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.977516 19582 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:23.982105 21589 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:23.793452 21492 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:23.842706 21703 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.937052 19476 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:23.791754 21808 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:23.797914 21711 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.749488 21789 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:18:23.926388 21707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.012s	sys 0.049s
W20260709 13:18:23.973201 20619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.006s	user 0.034s	sys 0.037s
W20260709 13:18:24.091976 20619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.125s	user 0.034s	sys 0.037s
W20260709 13:18:23.985951 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:24.022001 19625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.013s	sys 0.044s
W20260709 13:18:24.095019 19625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.014s	sys 0.044s
I20260709 13:18:24.095579 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:24.096503 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:24.097153 19505 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:24.023362 19551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.051s	user 0.048s	sys 0.132s
W20260709 13:18:24.097904 19551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.126s	user 0.048s	sys 0.133s
I20260709 13:18:24.098507 19508 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:23.981309 21672 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:23.843683 20664 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59442 (request call id 74) took 2246 ms (client timeout 2002 ms). Trace:
I20260709 13:18:23.984905 21810 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.974265 19478 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:24.038014 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:24.099740 19508 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:24.100083 19580 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:23.983848 20665 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:24.100239 21819 raft_consensus.cc:2764] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:23.971923 21783 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.040812 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:24.101559 19509 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:24.049340 19506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.007s	sys 0.015s
W20260709 13:18:24.049578 19627 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.008s	user 0.057s	sys 0.167s
I20260709 13:18:24.075016 21589 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:24.055553 20662 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:23.744241 21761 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:23.982453 21731 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.021s	sys 0.042s
I20260709 13:18:24.110394 19579 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:23.930423 21686 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.976218 21675 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:18:24.023000 21743 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.015s	sys 0.044s
W20260709 13:18:23.949101 19410 rpcz_store.cc:269] 0709 13:18:05.607954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.635232 (+ 27278us) service_pool.cc:224] Handling call
0709 13:18:06.048451 (+413219us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54002ec7d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c4090 00007f6c31762f3a 00007f6c375191cc 00007f6c3761737e 00007f6c35ad82a4 00007f6c35ad8232 00007f6c35ad8161 00007f6c35ad80dc 00007f6c35ad7392 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:23.848625 (+17800174us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:22.038579 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:22.336866 (+298287us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:22.342100 (+  5234us) write_op.cc:435] Acquired schema lock
0709 13:18:22.342131 (+    31us) tablet.cc:662] Decoding operations
0709 13:18:22.448417 (+106286us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:22.448476 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:22.448504 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:18:22.448863 (+   359us) tablet.cc:701] Row locks acquired
0709 13:18:22.448877 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:18:22.449033 (+   156us) write_op.cc:270] Start()
0709 13:18:22.449148 (+   115us) write_op.cc:276] Timestamp: P: 1783603102448982 usec, L: 0
0709 13:18:22.449168 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:18:22.449904 (+   736us) log.cc:844] Serialized 1321 byte log entry
0709 13:18:22.874641 (+424737us) op_driver.cc:464] REPLICATION: finished
0709 13:18:23.091125 (+216484us) write_op.cc:301] APPLY: starting
0709 13:18:23.093810 (+  2685us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:23.105550 (+ 11740us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:23.105724 (+   174us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:23.106314 (+   590us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:23.106565 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:18:23.106613 (+    48us) write_op.cc:312] APPLY: finished
0709 13:18:23.106884 (+   271us) log.cc:844] Serialized 34 byte log entry
0709 13:18:23.107087 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:23.107185 (+    98us) write_op.cc:454] Released schema lock
0709 13:18:23.107225 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:23.107648 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:23.107686 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":471391,"reported_tablets":17,"spinlock_wait_cycles":515446144,"child_traces":[["op",{"apply.queue_time_us":198753,"apply.run_cpu_time_us":2416,"apply.run_wall_time_us":16493,"num_ops":3,"prepare.queue_time_us":255305,"prepare.run_cpu_time_us":13745,"prepare.run_wall_time_us":670345,"raft.queue_time_us":112666,"raft.run_cpu_time_us":39775,"raft.run_wall_time_us":201481,"replication_time_us":400195,"spinlock_wait_cycles":42752,"thread_start_us":509841,"threads_started":4,"wal-append.queue_time_us":264340}]]}
W20260709 13:18:24.085318 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 148374us
W20260709 13:18:24.050868 21601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.000s	sys 0.043s
W20260709 13:18:24.098438 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 1.12828e+06us
W20260709 13:18:24.098941 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.972167 21699 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:18:23.994364 21793 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:23.970482 21755 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:24.102029 19505 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:24.100100 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 125926us
W20260709 13:18:24.102402 19506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.007s	sys 0.015s
I20260709 13:18:24.103370 19512 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:23.987321 20631 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:18:24.079155 21492 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:24.022964 21764 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:24.102254 19627 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.061s	user 0.057s	sys 0.168s
I20260709 13:18:24.112388 19580 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:24.112676 19581 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:24.054895 21708 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.090070 21703 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:24.085713 21825 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:24.098726 21707 raft_consensus.cc:697] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:24.101308 21808 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.118343 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:24.150480 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:24.100994 21810 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:24.117653 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:24.121348 19625 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:24.162201 20665 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:24.107985 21589 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:24.152910 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:24.117913 21731 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.104s	user 0.021s	sys 0.048s
W20260709 13:18:24.159583 21743 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.017s	sys 0.045s
I20260709 13:18:24.146858 21699 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:24.172788 21697 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:24.099475 20664 rpcz_store.cc:269] 0709 13:18:21.596793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.599083 (+  2290us) service_pool.cc:224] Handling call
0709 13:18:23.843414 (+2244331us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54006cc5d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:23.843567 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2746005248}
I20260709 13:18:24.180063 21575 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:24.162143 21819 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:18:24.158738 21738 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:24.149037 21755 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.162712 21633 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:24.152459 21492 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.151501 21169 consensus_queue.cc:1059] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:18:24.158622 21820 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.200237 21782 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:24.168088 21675 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.198145 21697 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.148769 21793 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:24.160571 21788 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.187465 19586 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:18:24.178967 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 57708.6us
I20260709 13:18:24.091734 21711 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:24.190018 19395 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d05498e224814b9b8f31e3f965ab2583 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d56df3728fc04e37b2d29a3bcd91d167 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:18:24.240535 19395 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 50596.3us
I20260709 13:18:24.147310 21686 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:24.110460 21783 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:24.193874 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:24.259516 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 65756.3us
W20260709 13:18:24.195623 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 78079.2us
W20260709 13:18:24.195714 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 77474.8us
I20260709 13:18:24.262444 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:24.264701 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:24.156489 21708 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:24.266036 21686 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:24.266848 21686 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:24.268517 21686 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:24.153957 21764 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:24.055904 21778 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:24.168217 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 197164us
I20260709 13:18:24.188658 21703 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:24.151355 21739 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:18:24.191820 21743 raft_consensus.cc:697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:24.230159 21633 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:24.201681 21575 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.295997 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:24.300976 19586 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:24.302207 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:24.302878 19586 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:24.191229 21813 consensus_queue.cc:1059] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:18:24.206359 21810 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.238481 21788 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.243230 21169 raft_consensus.cc:3055] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:24.236536 21820 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.246062 21711 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:24.247663 21761 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:24.249099 21054 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:24.249643 21748 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:24.250130 21707 consensus_queue.cc:237] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:24.392704 21820 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:24.252724 21755 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:24.207613 21738 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:24.398872 21738 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:24.173455 21825 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.401747 21825 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:24.240775 21731 consensus_queue.cc:1059] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:18:24.403352 21731 raft_consensus.cc:3055] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:24.403893 21731 raft_consensus.cc:740] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:24.230726 21781 consensus_queue.cc:1059] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:18:24.406298 21781 raft_consensus.cc:3055] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:24.406826 21781 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:24.407948 21781 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.188105 21808 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:24.412917 21808 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:24.199344 21821 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:18:24.262620 19476 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:24.415735 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 153192us
I20260709 13:18:24.416955 21819 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:24.116988 21824 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:24.418025 21824 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.418944 21819 consensus_queue.cc:1059] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:24.420076 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.421101 21703 raft_consensus.cc:3055] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:24.269924 19510 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:24.271159 21783 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:24.380738 21169 raft_consensus.cc:740] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:24.272611 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:24.274325 21605 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:24.284399 21739 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:24.284881 21778 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:24.286625 19661 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 4.
I20260709 13:18:24.287982 21751 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:24.289552 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1804) took 1419 ms. Trace:
W20260709 13:18:24.459066 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.295363 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:24.296627 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:24.421046 21824 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:24.383407 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:24.469650 19582 raft_consensus.cc:2393] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 2: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:24.379453 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:24.360318 21743 consensus_queue.cc:237] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.386127 21711 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.361742 21575 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:24.236977 21697 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:24.417447 19476 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:24.424714 21703 raft_consensus.cc:740] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:24.393874 21764 raft_consensus.cc:3055] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:24.424292 21781 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:24.468397 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:24.482626 19580 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:24.297811 19579 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:24.483919 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:24.470616 19587 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
W20260709 13:18:24.484493 19578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.017s	sys 0.080s
W20260709 13:18:24.484833 19578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.017s	sys 0.080s
I20260709 13:18:24.485230 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:24.485881 19587 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:24.484517 19579 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:24.488308 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:24.489522 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:24.490741 19579 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:24.469328 19506 rpcz_store.cc:276] 0709 13:18:22.869763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.941562 (+ 71799us) service_pool.cc:224] Handling call
0709 13:18:22.941949 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.126798 (+184849us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:23.145106 (+ 18308us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.150795 (+1005689us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:24.150843 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:24.150886 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.289332 (+138446us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54000fc654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:24.289375 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.289496 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18583,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":865,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":399978240,"thread_start_us":1005268,"threads_started":1}
I20260709 13:18:24.494228 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:24.495569 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:24.496196 19580 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:24.472528 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.380947 21810 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:24.430156 21763 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.356s	user 0.094s	sys 0.261s
W20260709 13:18:24.461357 21752 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.280s	user 0.035s	sys 0.073s
W20260709 13:18:24.476550 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 59209.7us
I20260709 13:18:24.271611 21675 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:24.522166 19587 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:24.404982 21731 consensus_queue.cc:260] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:24.478726 21821 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:24.492928 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:24.474478 21788 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:24.546654 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:24.505626 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.468469 20664 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:24.477537 21169 consensus_queue.cc:260] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.434187 21605 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:24.478891 21764 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:24.477864 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 182480us
I20260709 13:18:24.554801 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:24.484077 21824 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:24.521284 19586 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:24.516706 19580 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:24.536623 19579 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:24.547423 19587 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:24.477967 21711 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:24.521684 21763 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.443s	user 0.094s	sys 0.261s
W20260709 13:18:24.620635 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 374714us
I20260709 13:18:24.597869 21822 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:24.598220 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:24.598713 21810 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:24.600422 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:24.600693 19657 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:24.625197 19579 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:24.601277 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:24.601570 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:24.627435 19658 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:24.601876 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:24.628145 19582 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:24.602110 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:24.629076 19586 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:24.601231 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:24.630091 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:24.630635 19580 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:24.632016 19579 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:24.633154 19579 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:24.603482 21788 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:24.605471 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:24.634735 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:24.635865 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:24.636861 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:24.637353 19657 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:24.638109 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:24.639072 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:24.609230 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:24.609998 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:24.641505 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:24.610965 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:24.614077 21731 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:24.616232 21764 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.617792 21819 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.618820 21761 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:24.619390 19408 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.020s	sys 0.067s
W20260709 13:18:24.540009 21752 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.359s	user 0.036s	sys 0.076s
I20260709 13:18:24.570044 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:24.554004 21821 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.727371 19553 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:18:24.621814 19625 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:24.624159 19587 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:24.642940 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:24.616291 21672 consensus_meta.cc:287] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.001s
I20260709 13:18:24.531328 21782 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:24.654084 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:24.746704 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 176758us
W20260709 13:18:24.707300 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 446440us
W20260709 13:18:24.771046 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 149633us
I20260709 13:18:24.694190 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:24.771684 19625 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:24.771731 19655 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:24.655318 19659 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 2.
I20260709 13:18:24.656116 19580 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:24.773252 19579 raft_consensus.cc:1240] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:24.773494 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:24.655153 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:24.521714 21703 consensus_queue.cc:260] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.781762 19652 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:24.657967 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:24.746464 19582 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:24.634356 21169 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:24.785166 19582 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:24.786979 19582 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:24.687180 19478 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:24.657879 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:24.775668 19657 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:24.772297 19503 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 4.
I20260709 13:18:24.647234 21763 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.789122 19585 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:24.789477 19627 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:24.712520 19586 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:24.781287 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 53962.6us
I20260709 13:18:24.625149 21824 raft_consensus.cc:697] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:24.768817 21788 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:24.647468 21822 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:24.647598 21652 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:24.673046 21810 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.654093 21783 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:24.796914 21610 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:24.881423 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 92047.7us
I20260709 13:18:24.882465 19657 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:24.678351 21764 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:24.779842 21821 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:24.798357 21523 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:24.884028 21748 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:24.867110 21824 consensus_queue.cc:237] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.854182 21818 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:24.677845 21761 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:24.660461 21819 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.856711 21778 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:18:24.854718 21601 consensus_queue.cc:1059] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 13:18:24.886441 21788 raft_consensus.cc:697] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:24.788457 21782 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:24.857720 21633 consensus_queue.cc:1059] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:18:24.891075 21783 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.858955 21825 consensus_queue.cc:1059] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:18:24.875942 21738 consensus_queue.cc:1059] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:18:24.888455 21823 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:24.874316 21763 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.924938 21711 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:24.884622 21752 consensus_queue.cc:1059] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:18:24.924109 21748 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:24.891595 21755 consensus_queue.cc:1059] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 13:18:24.890952 21810 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:24.987684 21748 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:24.988107 21788 consensus_queue.cc:237] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.988705 21782 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:24.989732 21810 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:24.990319 21810 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:24.990384 21752 raft_consensus.cc:3055] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:24.990748 21810 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:24.990882 21752 raft_consensus.cc:740] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:24.991209 21810 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:24.991274 21761 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:24.991760 21752 consensus_queue.cc:260] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:24.992978 21752 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:24.993203 21783 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:24.972448 21826 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.025s	sys 0.078s
I20260709 13:18:24.958570 21818 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.996062 21818 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:24.999527 21831 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:18:24.995173 21826 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.025s	sys 0.079s
W20260709 13:18:24.656317 19408 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.020s	sys 0.067s
W20260709 13:18:25.038870 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.040807 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.042868 19550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.017s	sys 0.015s
W20260709 13:18:25.043545 19550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.018s	sys 0.015s
I20260709 13:18:25.043831 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1684) took 1146 ms. Trace:
W20260709 13:18:25.043051 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.809831 19580 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:25.046973 19583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.000s	sys 0.033s
W20260709 13:18:25.047528 19583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.000s	sys 0.033s
W20260709 13:18:25.047641 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 151000us
I20260709 13:18:24.810675 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:25.049772 19584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.013s	sys 0.011s
W20260709 13:18:25.050462 19584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.013s	sys 0.011s
I20260709 13:18:25.052366 19627 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:25.052529 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:24.894063 21054 consensus_queue.cc:1059] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.162s
I20260709 13:18:24.920423 21523 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.700274 21605 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:24.880945 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.900568 19655 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:24.747828 19658 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
W20260709 13:18:25.057780 20619 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.016s	sys 0.013s
I20260709 13:18:24.691572 21575 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.158478 19659 raft_consensus.cc:2393] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:25.159349 21575 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:24.953661 21610 raft_consensus.cc:697] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:18:25.161803 21697 consensus_meta.cc:287] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.680s	user 0.012s	sys 0.007s
I20260709 13:18:25.162695 21697 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:24.908100 21820 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:18:25.163187 21610 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.072389 19586 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:24.898152 21652 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.167734 19586 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:25.097396 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.044669 19578 rpcz_store.cc:276] 0709 13:18:23.896632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.896748 (+   116us) service_pool.cc:224] Handling call
0709 13:18:23.897097 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:23.897333 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.897361 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:23.897865 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:18:24.485200 (+587335us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:24.485240 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.485308 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.042889 (+557581us) raft_consensus.cc:1685] finished
0709 13:18:25.042987 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.043428 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":586930,"threads_started":1,"wal-append.queue_time_us":993782}
I20260709 13:18:25.074229 21711 consensus_queue.cc:1059] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:18:25.134847 21802 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.981223 21822 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:25.138908 21589 consensus_meta.cc:287] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.941s	user 0.015s	sys 0.000s
I20260709 13:18:25.174340 21675 raft_consensus.cc:3055] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:25.174193 21589 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.174969 21675 raft_consensus.cc:740] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:25.176079 19579 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:25.176585 21675 consensus_queue.cc:260] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:25.138723 21742 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.009s	sys 0.029s
W20260709 13:18:25.147253 20619 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.016s	sys 0.014s
I20260709 13:18:25.155121 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1812) took 1057 ms. Trace:
W20260709 13:18:25.163755 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 244995us
I20260709 13:18:25.177066 21589 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.139457 21707 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:18:25.172451 21802 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:25.202822 19510 rpcz_store.cc:276] 0709 13:18:24.097741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.098102 (+   361us) service_pool.cc:224] Handling call
0709 13:18:24.098399 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.424927 (+326528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.154246 (+729319us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b540003fa54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:25.154792 (+   546us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393724032}
W20260709 13:18:25.201694 19476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.008s	sys 0.009s
W20260709 13:18:25.213927 21742 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.009s	sys 0.030s
W20260709 13:18:25.229110 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 879326us
I20260709 13:18:25.233675 21739 consensus_queue.cc:1059] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:18:25.234977 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 424248us
I20260709 13:18:25.238263 21672 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:25.238842 19579 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:25.240731 21675 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:25.241137 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1694) took 1269 ms. Trace:
I20260709 13:18:25.241899 21834 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.241665 19584 rpcz_store.cc:276] 0709 13:18:23.971388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.983987 (+ 12599us) service_pool.cc:224] Handling call
0709 13:18:23.984391 (+   404us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:23.984824 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.984860 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:23.986558 (+  1698us) log.cc:844] Serialized 52 byte log entry
0709 13:18:24.398745 (+412187us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b1800323020. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa0d1 00007f6c31715a0f
0709 13:18:25.051446 (+652701us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:25.127678 (+ 76232us) log.cc:844] Serialized 14 byte log entry
0709 13:18:25.240553 (+112875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.240714 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.240795 (+    81us) raft_consensus.cc:1685] finished
0709 13:18:25.240896 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.241071 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94740,"prepare.queue_time_us":74112,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":44,"raft.queue_time_us":100499,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":13822,"spinlock_wait_cycles":6445952,"thread_start_us":727462,"threads_started":2,"wal-append.queue_time_us":959626}
I20260709 13:18:25.246713 19579 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:25.247678 21763 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.249905 21789 raft_consensus.cc:3055] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:25.250475 21789 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:18:25.226260 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 566346us
I20260709 13:18:25.251997 21789 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.253731 21837 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:25.254154 19476 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:25.215008 21708 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.004s	sys 0.045s
W20260709 13:18:25.255167 21708 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.004s	sys 0.045s
I20260709 13:18:25.255601 21748 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.257005 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:25.257272 19656 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:25.258103 21697 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.258910 21697 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.212534 21523 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:25.259546 21697 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:25.219233 21783 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.262379 21783 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:25.263592 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 576411us
I20260709 13:18:24.987123 21823 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:25.267736 21697 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.268611 21823 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:25.245420 19578 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:25.265416 21783 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.258123 21605 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:25.289532 21850 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:25.323608 21850 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:25.326035 21830 log.cc:927] Time spent T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.795s	user 0.000s	sys 0.004s
I20260709 13:18:25.327163 21763 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:25.327760 21763 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.328222 21763 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:25.289726 21652 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.330811 21652 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:25.243028 21834 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:25.332602 21652 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:25.333145 21652 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:25.335743 21834 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:25.302286 21819 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:25.303550 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.361027 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.303983 21589 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.362017 21802 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.362100 21589 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.363080 19653 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:25.306253 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.307328 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:25.308301 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.233381 21699 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:25.331012 19478 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:25.299070 19587 consensus_meta.cc:287] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.009s
I20260709 13:18:25.291203 21748 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:25.343814 21781 consensus_meta.cc:287] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.833s	user 0.015s	sys 0.002s
I20260709 13:18:25.343685 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:25.344409 19512 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:25.346655 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:25.437343 19503 raft_consensus.cc:2410] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:18:25.348687 19509 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:25.349339 21789 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:25.349226 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:25.354485 21850 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:25.428939 21821 consensus_meta.cc:287] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.000s
I20260709 13:18:25.444942 21821 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.445928 19510 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:18:25.357117 21818 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.264794 21810 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.361672 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.369758 19658 raft_consensus.cc:2410] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:25.370158 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.374975 21589 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.380879 19476 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:25.387547 21827 raft_consensus.cc:3055] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:18:25.392592 21169 consensus_meta.cc:287] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.579s	user 0.008s	sys 0.006s
I20260709 13:18:25.394833 19652 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:25.395596 19655 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 5.
W20260709 13:18:25.397881 20631 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.675s (SENT) [suppressed 12 similar messages]
I20260709 13:18:25.401777 19587 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:25.404521 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:25.456061 19507 raft_consensus.cc:2410] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:25.456398 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:25.456775 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:25.457156 19503 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:25.458173 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:25.458395 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:25.458696 21523 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:25.405866 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:25.459321 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:25.460203 19503 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:25.460394 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:25.406983 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:25.461189 19582 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
W20260709 13:18:25.461891 19552 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.351s	user 0.011s	sys 0.024s
W20260709 13:18:25.462338 19552 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.364s	user 0.012s	sys 0.024s
I20260709 13:18:25.462553 19511 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:25.463397 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 63946.5us
I20260709 13:18:25.408097 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:25.461207 19504 raft_consensus.cc:2410] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:18:25.416188 21731 consensus_meta.cc:287] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.760s	user 0.015s	sys 0.000s
I20260709 13:18:25.422008 21820 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:25.425889 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.426514 21652 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.447342 21821 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:25.429894 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 377885us
I20260709 13:18:25.438714 21819 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.468907 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:25.456910 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:25.404811 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:25.463666 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:25.462427 21850 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:25.467115 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:25.471377 19508 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:25.471479 21589 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:25.471402 19659 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 2.
I20260709 13:18:25.454391 21827 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:25.473685 19507 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:25.473381 21589 raft_consensus.cc:697] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:25.474992 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:25.475026 19505 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:25.475782 21819 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:25.476971 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 96256.9us
I20260709 13:18:25.478363 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1696) took 1478 ms. Trace:
I20260709 13:18:25.478050 20619 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:25.485394 21802 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:25.485882 21802 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.486294 21802 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:25.488577 19503 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:25.491571 21850 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.496134 21850 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.496783 21827 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.497514 19476 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:25.497638 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:25.498195 21827 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.499315 19510 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:25.505981 21850 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.499953 21764 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:25.507206 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.507525 21764 raft_consensus.cc:697] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:25.508091 19659 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:25.508021 21852 raft_consensus.cc:3055] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:25.508585 21852 raft_consensus.cc:740] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:25.508665 21764 consensus_queue.cc:237] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.509645 21852 consensus_queue.cc:260] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.509243 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.501754 19476 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:25.503481 21820 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.505504 21703 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:25.527628 19511 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 7: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:25.510710 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:25.526027 21852 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.529248 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.510951 19510 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:18:25.481055 19583 rpcz_store.cc:276] 0709 13:18:23.994530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.021947 (+ 27417us) service_pool.cc:224] Handling call
0709 13:18:24.022423 (+   476us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:24.055266 (+ 32843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.055317 (+    51us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:24.086976 (+ 31659us) log.cc:844] Serialized 78 byte log entry
0709 13:18:24.976815 (+889839us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b4800222258. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c36683aa1 00007f6c3667ab37 00007f6c3667a9ca 00007f6c3677226f 00007f6c36771f37 00007f6c3678655c 00007f6c36786508 00007f6c36786488 00007f6c36786443 00007f6c367856ec 00007f6c356afa96
0709 13:18:25.048532 (+ 71717us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:25.147004 (+ 98472us) log.cc:844] Serialized 14 byte log entry
0709 13:18:25.436659 (+289655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.450283 (+ 13624us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.454399 (+  4116us) raft_consensus.cc:1685] finished
0709 13:18:25.466908 (+ 12509us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.472434 (+  5526us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":245100,"prepare.queue_time_us":76621,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":74,"raft.queue_time_us":154872,"raft.run_cpu_time_us":9600,"raft.run_wall_time_us":881965,"spinlock_wait_cycles":6046592,"thread_start_us":1219802,"threads_started":3,"wal-append.queue_time_us":908929}
I20260709 13:18:25.532933 19507 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:25.534032 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 54389.2us
I20260709 13:18:25.531553 19510 pending_rounds.cc:85] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 3
I20260709 13:18:25.535213 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:25.541119 19508 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:25.505530 21810 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.539417 19505 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:25.536175 19510 pending_rounds.cc:107] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 4.4
W20260709 13:18:25.555189 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 224367us
I20260709 13:18:25.554827 19627 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:25.544214 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:25.545853 21821 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:25.543529 21589 consensus_queue.cc:237] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.543195 21742 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:18:25.562682 21821 raft_consensus.cc:697] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:25.550052 21861 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.564106 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.563798 21821 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.564849 19659 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:25.555011 21708 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:18:25.551525 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:25.568086 19476 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:25.569065 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.552117 21523 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:25.564514 21861 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.570338 21781 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:25.570995 21781 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:25.571991 21861 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.572422 19661 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:25.572577 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:25.574321 19660 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:25.541231 21763 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.575769 19660 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:25.576575 19586 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:25.576754 21763 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.550864 21818 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:25.578112 19508 raft_consensus.cc:2368] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8.
I20260709 13:18:25.554665 21819 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.572212 21781 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.580513 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.560477 19510 raft_consensus.cc:2889] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:25.566099 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:25.584051 19661 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:25.542147 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:25.587208 19655 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:18:25.547170 21752 consensus_meta.cc:287] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.554s	user 0.015s	sys 0.000s
I20260709 13:18:25.589996 19652 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 5.
I20260709 13:18:25.591672 19510 pending_rounds.cc:107] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:18:25.593102 19510 raft_consensus.cc:2889] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:25.594216 20619 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:25.599278 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.610460 21850 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.612910 21859 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.613559 21859 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:25.614540 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:25.615602 21850 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:25.616160 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:25.617017 21850 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:25.617341 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:25.623082 19509 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:25.624290 19509 pending_rounds.cc:85] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 4
I20260709 13:18:25.624557 19509 pending_rounds.cc:107] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:18:25.624797 19509 raft_consensus.cc:2889] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:25.617501 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:25.593724 21731 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.640201 19505 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:25.641996 19586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:60828
W20260709 13:18:25.642323 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 87603.2us
I20260709 13:18:25.643716 21822 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:25.628835 21169 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:25.645131 21169 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:25.645519 21523 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:25.645969 21523 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:25.646337 21523 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:25.646867 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:25.648177 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:25.649302 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:25.630551 21788 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:25.649890 20631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.649995 19503 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:25.650418 21788 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.651129 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:25.651839 19503 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:25.655230 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:25.632835 21789 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.632704 21699 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:25.670853 21699 raft_consensus.cc:697] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 5 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:18:25.672087 21699 consensus_queue.cc:237] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:25.672932 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1704) took 1127 ms. Trace:
I20260709 13:18:25.673374 19582 rpcz_store.cc:276] 0709 13:18:24.546055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.792021 (+245966us) service_pool.cc:224] Handling call
0709 13:18:25.460754 (+668733us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.461757 (+  1003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.672718 (+210961us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b54001013d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:25.672871 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1525541632}
I20260709 13:18:25.674656 21788 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.628408 21861 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:25.675334 21822 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:25.675828 21822 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.676343 21822 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:25.677253 21820 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:25.678114 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 60704.1us
I20260709 13:18:25.677727 21810 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:25.675948 21731 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.645552 21169 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:25.689150 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 55834.3us
I20260709 13:18:25.695068 19586 raft_consensus.cc:606] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:25.695461 19586 raft_consensus.cc:614] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:25.696161 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.675830 21861 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.702373 21492 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:25.703544 21836 raft_consensus.cc:3055] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:25.703730 21861 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.704061 21836 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:25.705302 21836 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.705991 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.706825 21836 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:25.707244 21745 consensus_queue.cc:1059] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:25.708453 19654 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:25.708225 21828 consensus_queue.cc:1059] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:25.709563 21855 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:25.711364 21855 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:25.711844 19508 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:25.712502 21852 raft_consensus.cc:3055] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:25.709561 21875 consensus_queue.cc:1059] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:25.712917 21852 raft_consensus.cc:740] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:25.713858 21601 raft_consensus.cc:3055] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:25.714947 19658 raft_consensus.cc:2410] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:18:25.713419 19508 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:18:25.698158 21711 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.000s	sys 0.013s
I20260709 13:18:25.685163 21802 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:25.718485 19478 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:25.724771 21824 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.730279 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.700016 21810 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:25.717878 21601 raft_consensus.cc:740] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:18:25.750684 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.734670 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.725514 21861 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:25.735585 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.736133 21820 consensus_queue.cc:1059] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:25.736454 21731 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.700246 21819 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.737933 21580 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.738253 21802 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.738006 21852 consensus_queue.cc:260] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.715699 21764 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:25.734088 19657 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:25.739701 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:25.742493 19625 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:25.743201 19627 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:25.765460 19508 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 7: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:25.737416 21782 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:25.743872 21850 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:25.744065 21848 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.746681 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.747442 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.748098 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.767084 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1483) took 1153 ms. Trace:
I20260709 13:18:25.748626 21589 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.749915 21633 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.694208 21789 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:25.723655 21711 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.000s	sys 0.013s
I20260709 13:18:25.752038 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.749990 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:25.769716 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 76184.9us
I20260709 13:18:25.775857 19503 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
W20260709 13:18:25.771452 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 74172us
I20260709 13:18:25.777684 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.777823 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:25.778601 19580 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 5.
I20260709 13:18:25.778697 19661 raft_consensus.cc:2410] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:25.779286 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:25.780159 19512 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 5: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:25.781956 21633 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.784698 21633 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.729727 21824 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.774734 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:25.777397 21580 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.767503 19656 rpcz_store.cc:276] 0709 13:18:24.613452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.857196 (+243744us) service_pool.cc:224] Handling call
0709 13:18:24.887739 (+ 30543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.257959 (+370220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.764661 (+506702us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54000e7ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:25.767027 (+  2366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848794368}
I20260709 13:18:25.778751 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1685) took 1880 ms. Trace:
I20260709 13:18:25.787381 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:25.787905 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:25.791013 19508 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 5.
I20260709 13:18:25.788805 19585 rpcz_store.cc:276] 0709 13:18:23.898680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.899401 (+   721us) service_pool.cc:224] Handling call
0709 13:18:23.899669 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.855606 (+955937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.774135 (+918529us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b5400248454. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:25.778590 (+  4455us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2044841216}
I20260709 13:18:25.777503 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:25.792240 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:25.792441 19503 raft_consensus.cc:2410] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:25.792943 19657 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:25.795210 21852 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:25.787977 21764 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.796545 21652 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.798281 21850 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:25.798949 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.800520 21850 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.775537 21745 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:25.801203 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
W20260709 13:18:25.804607 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 61553.8us
I20260709 13:18:25.808449 19503 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:25.808974 19625 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:25.810343 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:25.785871 21589 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.812244 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.813045 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:25.816609 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:25.817075 19478 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:25.817121 19583 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 5.
I20260709 13:18:25.803730 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:25.815897 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:25.813795 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:25.769071 21861 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:25.818900 19581 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:25.771049 21819 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.819185 19656 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:25.802738 21855 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:25.797510 21764 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.821565 19580 raft_consensus.cc:2393] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:25.823249 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:25.805048 21745 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.828670 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.827427 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:25.805353 21738 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.139s
I20260709 13:18:25.833477 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.838624 19660 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:25.834163 21054 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:18:25.841795 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:25.842092 19408 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 44) took 2587 ms. Trace:
I20260709 13:18:25.843008 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1472) took 1231 ms. Trace:
I20260709 13:18:25.843338 19587 raft_consensus.cc:2393] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:25.843405 19654 rpcz_store.cc:276] 0709 13:18:24.607978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.608194 (+   216us) service_pool.cc:224] Handling call
0709 13:18:24.608492 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.708138 (+1099646us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b540040aea0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316d1dc0 00007f6c3175c1c0 00007f6c3175d231 00007f6c31759d8f 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c
0709 13:18:25.708893 (+   755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.822458 (+113565us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b54001ecb54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:25.838886 (+ 16428us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521194112}
I20260709 13:18:25.844844 21580 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.845718 21838 raft_consensus.cc:3055] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:25.845918 21711 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:25.846230 21838 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:25.846577 21711 raft_consensus.cc:697] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:25.847365 21875 consensus_queue.cc:1059] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:25.847945 21589 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.848542 21708 raft_consensus.cc:3055] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:25.848958 21708 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:25.849859 21861 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:25.850449 21054 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:25.850847 21054 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:25.851775 21054 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.852984 21054 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:25.854454 21751 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:25.854964 21819 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.855347 21675 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:25.855808 21789 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.801735 21848 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.856034 21751 consensus_queue.cc:1059] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:25.857784 21778 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:25.858142 21848 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:25.849983 21708 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.847627 21859 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:25.821097 21633 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:25.868533 19656 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:25.864198 19657 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:25.865698 21778 consensus_queue.cc:1059] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:25.866334 21748 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:25.868353 20631 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:25.914697 19659 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:25.829422 21850 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:25.917845 19508 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:25.829064 21745 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.920317 21859 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:25.920697 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 52463.5us
I20260709 13:18:25.921633 19478 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:25.824831 20664 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:25.925556 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:25.878599 21855 raft_consensus.cc:697] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:18:25.948557 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.928642 21879 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:18:25.949681 19585 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 7.
I20260709 13:18:25.878898 21748 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:25.965584 19512 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:18:25.970310 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 48796.6us
I20260709 13:18:25.913534 21633 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.979889 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:25.983390 19478 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:25.954717 21708 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:25.829672 21810 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:25.987848 20631 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:18:25.989801 19511 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:25.965091 21850 raft_consensus.cc:697] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:25.968417 21819 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:25.994350 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:25.980330 21633 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:26.000557 19512 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
W20260709 13:18:26.003535 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.004864 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:26.007119 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:26.007423 21855 consensus_queue.cc:237] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.011083 21826 raft_consensus.cc:3055] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:26.011638 21826 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:26.011083 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:26.013415 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:26.014547 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:26.014647 21633 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.015687 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:26.016659 21828 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:26.017196 21633 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:26.017747 21699 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:26.018363 21699 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:26.018797 21877 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:18:26.018959 21699 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.021057 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:25.981794 21788 consensus_queue.cc:1059] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:18:26.022269 21788 raft_consensus.cc:3055] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:26.022356 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:26.022681 21788 raft_consensus.cc:740] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:26.023577 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:26.024186 19509 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:26.024602 21821 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:26.025058 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:26.025202 21821 raft_consensus.cc:697] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:26.018363 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:26.026178 19507 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:26.026254 21821 consensus_queue.cc:237] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.027297 19507 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:26.028890 19507 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:26.030267 21850 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.033120 21699 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:26.035530 21822 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.037335 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:26.037968 19582 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.042253 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:26.045773 19509 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
W20260709 13:18:26.048125 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 64823.3us
I20260709 13:18:26.000964 19512 pending_rounds.cc:85] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 2
I20260709 13:18:26.049254 19512 pending_rounds.cc:107] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:18:26.049527 19512 raft_consensus.cc:2889] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:26.051017 19507 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:26.051790 19508 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:25.927346 21789 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
W20260709 13:18:26.058233 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.913859 21601 consensus_queue.cc:260] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:26.066613 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:26.066730 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:25.847627 21711 consensus_queue.cc:237] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.062075 19478 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:26.074014 19504 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:26.062458 19657 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:18:25.997797 21819 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.842455 19408 rpcz_store.cc:276] 0709 13:18:23.254696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.255842 (+  1146us) service_pool.cc:224] Handling call
0709 13:18:25.841850 (+2586008us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:24.996607 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:25.258443 (+261836us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:25.258510 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:18:25.258548 (+    38us) tablet.cc:662] Decoding operations
0709 13:18:25.259238 (+   690us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:25.259382 (+   144us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:25.259441 (+    59us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:25.259874 (+   433us) tablet.cc:701] Row locks acquired
0709 13:18:25.259931 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:18:25.260205 (+   274us) write_op.cc:270] Start()
0709 13:18:25.260376 (+   171us) write_op.cc:276] Timestamp: P: 1783603105260109 usec, L: 0
0709 13:18:25.260413 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:18:25.261565 (+  1152us) log.cc:844] Serialized 602 byte log entry
0709 13:18:25.669932 (+408367us) op_driver.cc:464] REPLICATION: finished
0709 13:18:25.703471 (+ 33539us) write_op.cc:301] APPLY: starting
0709 13:18:25.703583 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:25.703707 (+   124us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:25.703868 (+   161us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:25.704184 (+   316us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:25.704534 (+   350us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:25.704580 (+    46us) write_op.cc:312] APPLY: finished
0709 13:18:25.704884 (+   304us) log.cc:844] Serialized 22 byte log entry
0709 13:18:25.705087 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:25.705207 (+   120us) write_op.cc:454] Released schema lock
0709 13:18:25.705269 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:25.705865 (+   596us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:25.705895 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":572720,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":29579,"apply.run_cpu_time_us":2360,"apply.run_wall_time_us":2360,"num_ops":1,"prepare.queue_time_us":1035808,"prepare.run_cpu_time_us":12422,"prepare.run_wall_time_us":480314,"raft.queue_time_us":59551,"raft.run_cpu_time_us":15719,"raft.run_wall_time_us":30079,"replication_time_us":409340,"spinlock_wait_cycles":291072,"thread_start_us":1240962,"threads_started":4,"wal-append.queue_time_us":183414}]]}
I20260709 13:18:26.081157 19655 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:26.068009 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:26.083099 19661 raft_consensus.cc:2393] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 5: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:18:26.069243 19512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:18:26.083632 19512 raft_consensus.cc:606] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:18:26.070523 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:25.929174 21861 consensus_queue.cc:1059] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.124s
I20260709 13:18:26.088743 21824 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:26.090031 21861 raft_consensus.cc:3055] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:26.090473 21861 raft_consensus.cc:740] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:26.091501 21861 consensus_queue.cc:260] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.092832 21861 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:26.093235 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:26.093981 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.094265 21169 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.047736 21699 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:26.096773 21169 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:26.097703 21820 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:26.098035 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:26.099282 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:26.100471 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:26.101295 19654 raft_consensus.cc:2410] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:26.101981 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:26.102542 19658 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:25.990312 21523 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.106511 19582 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 8.
I20260709 13:18:26.074206 21836 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:26.059137 21822 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:26.108011 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:26.109882 19581 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 7.
I20260709 13:18:26.080022 21819 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.118595 20631 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:18:26.111609 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:26.116305 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:26.119572 20631 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:18:26.104475 21741 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.118003 21751 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:18:26.123096 21802 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:26.123332 21751 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:26.108507 21823 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:26.124920 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 62928.9us
I20260709 13:18:26.112275 21699 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:26.135213 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.123802 21751 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:18:26.134481 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 59797.1us
I20260709 13:18:26.104503 21601 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.126506 19660 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:26.023588 21788 consensus_queue.cc:260] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.131775 21697 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:26.073901 21748 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.142405 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:26.115465 19508 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:26.135236 21699 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.141341 21589 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.143208 21054 consensus_queue.cc:1059] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:18:26.177693 21589 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.178355 21054 raft_consensus.cc:3055] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:26.178838 21054 raft_consensus.cc:740] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:26.179930 21054 consensus_queue.cc:260] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.180425 21589 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:26.182142 21788 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.182485 21675 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:18:26.185791 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 43767.4us
I20260709 13:18:26.186131 21580 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.186322 19476 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:26.186812 21652 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:26.186676 21580 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.187251 19478 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:26.187431 21652 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:26.187872 21821 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:26.188432 21821 raft_consensus.cc:697] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:26.188930 21580 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:26.189564 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 47260.9us
I20260709 13:18:26.191288 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:26.144320 21823 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:26.192466 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:26.192550 21764 consensus_queue.cc:1059] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:26.192894 21823 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.171972 21699 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:26.194012 21703 raft_consensus.cc:3055] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:26.167484 21818 raft_consensus.cc:3055] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:26.200713 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:26.132050 21741 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:26.202934 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 91340.9us
I20260709 13:18:26.167052 21802 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 8 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:18:26.206067 21615 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.207938 19582 raft_consensus.cc:1275] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:26.171015 21836 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:26.202243 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:26.181447 21054 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:26.187282 19476 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:26.204668 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:26.209508 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:26.215224 19585 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:26.144107 21752 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:18:26.150030 21708 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:18:26.182523 21859 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:26.201717 21834 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:26.167344 21850 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:18:26.228075 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:26.222370 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:26.189605 21652 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:26.222002 19476 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:26.200323 21703 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:26.189595 21580 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:26.201854 21818 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:26.199790 21822 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:26.229472 21782 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:26.234737 21834 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.234874 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:26.235026 21523 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:26.235522 19585 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:26.236249 20664 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:26.237844 21751 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.239493 19581 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:26.211622 21633 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:26.244036 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:26.243175 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:26.245723 19586 raft_consensus.cc:2393] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:26.246557 20665 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:26.249709 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:26.189471 21821 consensus_queue.cc:237] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.246721 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:26.257966 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:26.258559 19585 raft_consensus.cc:2368] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7.
I20260709 13:18:26.240594 21810 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.259382 19582 raft_consensus.cc:2393] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 3: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:26.259507 21703 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.263948 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:26.264305 21818 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.265756 21818 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.243285 21822 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.272428 21822 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:26.261057 21580 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:26.278012 21580 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.278381 21580 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:26.279814 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:26.280774 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.281186 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:26.257701 21893 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:18:26.283768 21731 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.254236 21697 raft_consensus.cc:697] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 7 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:18:26.285943 21897 raft_consensus.cc:993] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:18:26.286427 21897 raft_consensus.cc:1081] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:18:26.230564 21742 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:18:26.287123 21742 consensus_queue.cc:1243] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:26.286818 21819 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.287398 21810 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.288033 19510 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:26.285429 21697 consensus_queue.cc:237] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:26.291661 21745 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.293428 19508 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:18:26.261906 21589 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.299592 21589 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.301755 21751 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:26.260479 21523 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:26.306859 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:26.312476 19506 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:26.315132 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:26.315305 19627 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:26.335503 21054 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:26.336099 21054 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.336454 21054 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:26.258428 21675 consensus_queue.cc:1175] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2cfd02601ea44976833027665abc93bf" responder_term: 9 status { last_received { term: 6 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: [8.4-8.4]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:18:26.340361 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:26.338874 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 77117.5us
I20260709 13:18:26.341497 19478 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:26.338709 21745 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:26.347440 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 66317.7us
I20260709 13:18:26.348696 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:26.350312 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 128369us
I20260709 13:18:26.334846 21822 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:26.392261 19476 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:26.386847 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.394718 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:26.394971 19582 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:26.388075 21054 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:26.337071 21782 raft_consensus.cc:697] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:26.333818 21810 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:26.390777 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 55784.4us
W20260709 13:18:26.398298 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 49783.5us
I20260709 13:18:26.232995 21802 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:26.338709 21878 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:18:26.345937 21589 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:26.399077 19551 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:26.398335 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 56924.4us
I20260709 13:18:26.402789 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:26.407158 19584 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.402989 19579 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:26.400720 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:26.350208 21739 raft_consensus.cc:3055] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:26.405823 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:26.411167 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:26.412250 19582 raft_consensus.cc:2410] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:26.418105 19586 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:26.394865 21897 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:26.421953 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:26.424842 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:26.425755 21054 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:26.400831 21848 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.403564 21745 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:18:26.430763 21819 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:26.431296 19659 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:26.400940 21788 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:26.479722 19652 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:26.431833 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:26.433594 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:26.480506 19586 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.430791 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:26.481261 19657 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:26.436219 19653 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:26.406036 21821 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:26.410003 21739 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:26.479347 19627 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:26.484992 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:26.488058 19582 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:26.485394 19580 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:26.491503 19579 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:18:26.493527 21580 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.480595 21675 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.494596 21675 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.495958 21580 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:26.496573 21893 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.496822 21675 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:26.497116 21893 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:26.498221 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 58744.2us
I20260709 13:18:26.499907 19478 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:26.499997 21893 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:26.500429 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1401) took 1152 ms. Trace:
I20260709 13:18:26.500841 19506 rpcz_store.cc:276] 0709 13:18:25.348356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.348670 (+   314us) service_pool.cc:224] Handling call
0709 13:18:26.500239 (+1151569us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b54000fd554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:26.500345 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521688960}
I20260709 13:18:26.415915 21699 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:26.510304 19584 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:26.516216 19551 leader_election.cc:400] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8.
I20260709 13:18:26.516716 19551 leader_election.cc:403] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:26.502276 21850 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:26.524923 19661 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
W20260709 13:18:26.526070 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 46818us
I20260709 13:18:26.528100 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:26.484927 21821 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.487690 21897 raft_consensus.cc:697] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:26.487089 21861 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:26.534610 21054 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:26.538120 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:26.539299 19580 raft_consensus.cc:2368] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8.
I20260709 13:18:26.525166 21745 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:26.543695 21861 raft_consensus.cc:697] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:26.544269 21897 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.544348 21739 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.545915 20663 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:26.585901 21741 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:26.550578 19627 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:26.437103 21782 consensus_queue.cc:237] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:26.572191 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 88734.4us
I20260709 13:18:26.579083 19586 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:26.532909 21821 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:26.583971 21739 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.598363 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:26.601835 21819 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.602038 21781 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.602219 21589 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:26.602851 21589 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:26.602501 21781 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.603291 21589 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:26.601851 21789 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:18:26.605633 21838 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.606163 21789 raft_consensus.cc:3055] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:26.606760 21789 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:26.608204 21789 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.539996 21834 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.602458 21819 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.592872 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:26.611255 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:26.612246 21731 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.590668 21169 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:26.601401 21904 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.616763 21904 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.620048 19410 catalog_manager.cc:5697] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:26.622817 21826 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.624065 21826 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.540609 21850 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:26.625171 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:26.642320 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:26.627799 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.630297 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:26.648819 19627 leader_election.cc:400] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7.
I20260709 13:18:26.649293 19627 leader_election.cc:403] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:26.649139 19551 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:26.649538 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1819) took 1229 ms. Trace:
I20260709 13:18:26.652159 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:26.654273 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:26.650415 19504 rpcz_store.cc:276] 0709 13:18:25.420095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.482851 (+ 62756us) service_pool.cc:224] Handling call
0709 13:18:25.483236 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.074446 (+591210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.646490 (+572044us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54002a9ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:26.649469 (+  2979us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1317344000}
I20260709 13:18:26.664778 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:26.660550 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:26.666656 19661 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:26.660699 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:26.667922 19512 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:26.661482 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.662359 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:26.669162 19505 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.669396 21054 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:26.655653 21731 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:26.655500 21789 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.661955 21788 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:26.680236 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 92631.5us
I20260709 13:18:26.685664 19627 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:26.662128 21523 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:26.668689 21836 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.669199 21820 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:26.679229 21731 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.692914 21738 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.710175 19655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:18:26.583961 21861 consensus_queue.cc:237] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:26.691802 21788 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.716635 21169 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:26.697160 21836 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.720392 21589 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:26.691562 21523 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:26.724977 21748 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:26.726138 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 71932.2us
I20260709 13:18:26.704319 21818 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:26.761391 19627 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:26.704324 21731 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:26.760239 21742 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:26.729698 21788 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.736863 19505 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:26.776831 19627 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:26.747993 21820 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.787236 19580 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:26.748059 21523 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:26.775113 21819 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:26.805330 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 105947us
I20260709 13:18:26.779596 21742 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:26.802418 21699 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:26.729987 21850 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.793329 21751 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:18:26.829352 21054 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:26.834436 21054 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:26.904609 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1850) took 1052 ms. Trace:
I20260709 13:18:26.909373 19507 rpcz_store.cc:276] 0709 13:18:25.852473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.029584 (+177111us) service_pool.cc:224] Handling call
0709 13:18:26.046450 (+ 16866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.051473 (+  5023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.904200 (+852727us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b54001b0b50. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:26.904427 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37958912}
I20260709 13:18:26.833438 21919 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:26.914904 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 94838.1us
I20260709 13:18:26.836537 21601 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:18:26.915768 21738 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7.
W20260709 13:18:26.936761 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.942773 19512 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
W20260709 13:18:26.946950 21917 log.cc:927] Time spent T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:18:26.947103 21820 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:26.928184 21923 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.950193 21923 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:26.951472 21909 log.cc:927] Time spent T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:18:26.952432 21923 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:26.955030 21910 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:18:26.955571 21836 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:26.956156 21745 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.958106 21731 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.959060 21834 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8.
I20260709 13:18:26.960176 21731 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:26.961922 21589 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:26.965775 19655 raft_consensus.cc:606] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:26.966230 19655 raft_consensus.cc:614] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:26.966002 21821 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.968852 21821 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:26.923722 21742 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:26.987555 21742 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.989809 19656 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
W20260709 13:18:26.990885 21848 consensus_meta.cc:287] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.000s
I20260709 13:18:26.991496 21848 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:26.997908 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.002583 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.005733 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.008602 21822 raft_consensus.cc:476] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Not starting pre-election -- already a leader
W20260709 13:18:27.008662 21907 log.cc:927] Time spent T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.280s	user 0.000s	sys 0.003s
I20260709 13:18:27.043290 21523 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:27.032078 21926 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.036854 21930 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:27.075589 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.077975 21752 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.072180 21930 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:27.063244 21926 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:27.080538 21875 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.080610 21752 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:27.081060 21889 log.cc:927] Time spent T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.900s	user 0.005s	sys 0.003s
I20260709 13:18:27.081609 21818 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:27.081133 21875 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:27.080185 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.082655 21926 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:27.083231 21818 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.083751 21818 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:27.085975 21523 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:27.086371 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:27.087966 21752 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:27.090282 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:27.090974 19655 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.094451 21781 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:27.094981 21788 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:27.096580 21652 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:27.100116 21652 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:27.101135 21652 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:27.102492 21652 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.103240 21615 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:27.099373 21930 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:27.114555 19652 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:27.121464 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:27.121529 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:27.122299 19654 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:27.123971 19652 raft_consensus.cc:1275] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:27.126313 19655 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:27.106489 21788 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:27.191457 19656 raft_consensus.cc:2410] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:27.198107 21875 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:27.108270 21818 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:27.151535 21930 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.200500 21930 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:27.202732 21930 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:27.203447 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.203922 21838 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:27.206604 21937 log.cc:927] Time spent T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:18:27.117451 21834 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:18:27.120446 21615 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:27.211056 21615 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:27.214038 21891 log.cc:927] Time spent T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.924s	user 0.002s	sys 0.015s
I20260709 13:18:27.214895 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1715) took 1014 ms. Trace:
I20260709 13:18:27.120671 21523 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:27.215437 19581 rpcz_store.cc:276] 0709 13:18:26.200578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.208492 (+  7914us) service_pool.cc:224] Handling call
0709 13:18:27.214564 (+1006072us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b54003d18d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:27.214809 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5039488}
I20260709 13:18:27.216150 21523 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:27.224653 19627 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:27.226938 19478 leader_election.cc:400] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8.
I20260709 13:18:27.227506 19478 leader_election.cc:403] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:27.228363 21781 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.250653 21820 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:27.253038 21820 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:27.267869 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.239693 21523 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:27.257588 21820 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:27.279402 19503 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:27.348891 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 599788us
I20260709 13:18:27.780517 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:27.781579 19653 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:27.631378 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1488) took 1021 ms. Trace:
W20260709 13:18:27.617750 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.428344 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:27.332656 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.804540 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.533944 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1738) took 1119 ms. Trace:
I20260709 13:18:27.538482 19582 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:27.496754 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1728) took 1152 ms. Trace:
I20260709 13:18:27.628237 21054 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:27.812546 21054 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:27.552170 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
W20260709 13:18:27.291774 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.803288 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:27.833359 19511 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:27.787441 19660 rpcz_store.cc:276] 0709 13:18:26.609543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.609741 (+   198us) service_pool.cc:224] Handling call
0709 13:18:26.610102 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.614084 (+  3982us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:26.729828 (+115744us) log.cc:844] Serialized 14 byte log entry
0709 13:18:27.032262 (+302434us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.032319 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:27.032364 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.631042 (+598678us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b5400023fd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:27.631108 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.631296 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5466,"prepare.queue_time_us":172559,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":1801,"raft.queue_time_us":2966,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4127,"spinlock_wait_cycles":8452480,"thread_start_us":417272,"threads_started":2,"wal-append.queue_time_us":343454}
I20260709 13:18:27.844192 19503 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:27.892194 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:27.551571 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:27.807997 21855 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.892670 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:27.898458 19656 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:18:28.220145 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 990485us
I20260709 13:18:27.809717 19578 rpcz_store.cc:276] 0709 13:18:26.344096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.395816 (+ 51720us) service_pool.cc:224] Handling call
0709 13:18:26.400762 (+  4946us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:26.409417 (+  8655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.409467 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:26.432842 (+ 23375us) log.cc:844] Serialized 52 byte log entry
0709 13:18:26.673315 (+240473us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:26.777723 (+104408us) log.cc:844] Serialized 14 byte log entry
0709 13:18:27.496288 (+718565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.496395 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:27.496459 (+    64us) raft_consensus.cc:1685] finished
0709 13:18:27.496477 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.496672 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":391707,"prepare.queue_time_us":111679,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2874,"raft.queue_time_us":342747,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":11776,"spinlock_wait_cycles":44672,"thread_start_us":647554,"threads_started":3,"wal-append.queue_time_us":272263}
I20260709 13:18:27.957371 19652 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:27.893400 19659 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:18:28.217905 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.894078 19661 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:27.899135 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:28.223203 19476 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:28.149848 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.899044 21054 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:28.028155 19581 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:28.220402 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:28.077085 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:27.807273 19586 rpcz_store.cc:276] 0709 13:18:26.415013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.650671 (+235658us) service_pool.cc:224] Handling call
0709 13:18:26.651105 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.663246 (+ 12141us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:26.814327 (+151081us) log.cc:844] Serialized 14 byte log entry
0709 13:18:27.218414 (+404087us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b4800222258. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c36683aa1 00007f6c3667ab37 00007f6c3667a9ca 00007f6c3677226f 00007f6c36771f37 00007f6c3678655c 00007f6c36786508 00007f6c36786488 00007f6c36786443 00007f6c367856ec 00007f6c356afa96
0709 13:18:27.496028 (+277614us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.496092 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:27.533543 (+ 37451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.533687 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.533864 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":204105,"prepare.queue_time_us":32807,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":210997,"raft.run_cpu_time_us":1656,"raft.run_wall_time_us":95152,"spinlock_wait_cycles":2301696,"thread_start_us":579768,"threads_started":3,"wal-append.queue_time_us":128781}
W20260709 13:18:27.772920 21939 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:18:28.068390 19505 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.011s	sys 0.018s
I20260709 13:18:27.675860 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:18:28.096952 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 70140.7us
I20260709 13:18:28.326614 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:28.996850 19505 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.643s	user 0.013s	sys 0.046s
I20260709 13:18:27.902670 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1736) took 1488 ms. Trace:
W20260709 13:18:28.407521 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.924638 19512 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.606s	user 0.026s	sys 0.025s
W20260709 13:18:28.998171 19512 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.680s	user 0.027s	sys 0.026s
I20260709 13:18:28.328938 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:28.308135 19503 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 7: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:18:28.996690 19627 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.000s	sys 0.008s
I20260709 13:18:27.535552 21633 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:28.959450 19625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.000s	sys 0.026s
I20260709 13:18:27.745918 21904 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:27.294351 21169 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:28.966009 21946 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:18:29.000175 19478 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.000s	sys 0.009s
W20260709 13:18:28.985256 19626 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.013s	sys 0.016s
I20260709 13:18:28.176512 21861 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.273981 21054 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.085335 21054 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.000080 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1429) took 1142 ms. Trace:
I20260709 13:18:29.086687 19507 rpcz_store.cc:276] 0709 13:18:27.857711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.324099 (+466388us) service_pool.cc:224] Handling call
0709 13:18:29.000014 (+675915us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:28.997385 19585 rpcz_store.cc:276] 0709 13:18:26.414305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.429173 (+ 14868us) service_pool.cc:224] Handling call
0709 13:18:26.429545 (+   372us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:26.479883 (+ 50338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.479929 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:26.490636 (+ 10707us) log.cc:844] Serialized 52 byte log entry
0709 13:18:26.645783 (+155147us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:26.677160 (+ 31377us) log.cc:844] Serialized 14 byte log entry
0709 13:18:27.102556 (+425396us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b18002fcc80. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e5e7c0a 00007f6c37d27219 00007f6c2e66fa40 00007f6c2e66a4e4 00007f6c2e66a455 00007f6c31752060 00007f6c31764716 00007f6c31775287 00007f6c31775208
0709 13:18:27.482892 (+380336us) log.cc:844] Serialized 14 byte log entry
0709 13:18:27.816245 (+333353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.816418 (+   173us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:27.902362 (+ 85944us) raft_consensus.cc:1685] finished
0709 13:18:27.902396 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.902590 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":420896,"prepare.queue_time_us":29265,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":7748,"raft.queue_time_us":902075,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":18050,"spinlock_wait_cycles":2394368,"thread_start_us":534296,"threads_started":2,"wal-append.queue_time_us":208000,"wal-append.run_cpu_time_us":4266,"wal-append.run_wall_time_us":1880832}
I20260709 13:18:27.908699 20660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:29.004230 21943 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:29.000748 19627 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.000s	sys 0.009s
W20260709 13:18:28.109948 21652 consensus_meta.cc:287] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 1.007s	user 0.003s	sys 0.010s
W20260709 13:18:29.005638 19625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.000s	sys 0.027s
W20260709 13:18:27.904682 21781 consensus_meta.cc:287] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.676s	user 0.008s	sys 0.000s
W20260709 13:18:27.474689 21897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.004s	sys 0.022s
I20260709 13:18:28.271723 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1732) took 1926 ms. Trace:
I20260709 13:18:29.006311 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1430) took 1148 ms. Trace:
I20260709 13:18:29.106051 19503 rpcz_store.cc:276] 0709 13:18:27.858104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.895871 (+ 37767us) service_pool.cc:224] Handling call
0709 13:18:29.006206 (+1110335us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:29.106662 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.998991 19504 raft_consensus.cc:2410] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:18:29.107214 21054 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:29.107429 21897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.521s	user 0.026s	sys 0.043s
I20260709 13:18:29.107596 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1870) took 1824 ms. Trace:
I20260709 13:18:29.107800 21054 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.108479 19506 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:29.108348 21054 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.107223 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:27.317608 21850 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.333933 21820 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.008498 20664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59442 (request call id 86) took 1455 ms. Trace:
W20260709 13:18:28.064640 21615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.003s	sys 0.009s
W20260709 13:18:28.907981 21945 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.578s	user 0.001s	sys 0.000s
W20260709 13:18:27.808259 21931 log.cc:927] Time spent T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.690s	user 0.002s	sys 0.000s
W20260709 13:18:28.063606 21838 consensus_meta.cc:287] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.859s	user 0.003s	sys 0.009s
I20260709 13:18:28.307888 21834 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.108126 21897 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.016750 19626 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.013s	sys 0.016s
W20260709 13:18:29.016682 19478 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.001s	sys 0.009s
I20260709 13:18:28.331707 21948 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.121263 20664 rpcz_store.cc:276] 0709 13:18:27.552667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.553698 (+  1031us) service_pool.cc:224] Handling call
0709 13:18:27.554158 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.554703 (+   545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.554802 (+    99us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.648973 (+ 94171us) log.cc:844] Serialized 26 byte log entry
0709 13:18:28.037843 (+388870us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:28.063368 (+ 25525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.157165 (+ 93797us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.008170 (+851005us) raft_consensus.cc:1685] finished
0709 13:18:29.008199 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.008414 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":550,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":9945,"thread_start_us":166222,"threads_started":1,"wal-append.queue_time_us":1353992}
I20260709 13:18:29.167858 21948 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.169050 20660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59430 (request call id 71) took 1222 ms. Trace:
I20260709 13:18:29.169678 21834 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.170284 21948 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:29.170835 21948 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.171345 21948 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.171854 21834 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:29.172421 21834 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.172904 21834 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.017598 21169 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:29.104612 21861 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.175873 21169 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:28.271364 20663 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:28.239838 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:28.899688 21957 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.765573 21782 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:28.025547 21741 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.178114 21824 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.173410 21948 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:29.190881 21169 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.178709 21898 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.333590 21956 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.293741 21731 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.223732 21741 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.246755 21731 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.249099 21731 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:29.091969 19476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.006s	sys 0.010s
I20260709 13:18:29.192764 21838 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:29.272770 21838 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.274557 21963 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.275192 21963 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.276120 20663 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:29.276388 21956 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:29.277000 20663 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59442 (request call id 84) took 1728 ms (client timeout 2072 ms). Trace:
I20260709 13:18:29.278553 21963 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:29.281528 21861 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:29.195060 21782 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.282279 21782 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:29.224359 21820 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.165414 21850 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.285336 21820 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.287606 21850 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:29.192914 21897 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.288460 21820 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:29.289271 20663 rpcz_store.cc:269] 0709 13:18:27.548479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.549573 (+  1094us) service_pool.cc:224] Handling call
0709 13:18:29.276910 (+1727337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:29.290205 21897 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:29.104327 19624 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.015s	sys 0.026s
I20260709 13:18:28.982962 21944 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:29.107087 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.987586 21959 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:29.108012 19504 rpcz_store.cc:276] 0709 13:18:27.285456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.285927 (+   471us) service_pool.cc:224] Handling call
0709 13:18:28.326400 (+1040473us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:18:29.107529 (+781129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51176704}
I20260709 13:18:28.334583 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:27.906337 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:29.310483 20661 raft_consensus.cc:2368] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7.
I20260709 13:18:29.310918 20661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59430 (request call id 69) took 1502 ms. Trace:
I20260709 13:18:29.107060 21781 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8.
I20260709 13:18:29.105983 19583 rpcz_store.cc:276] 0709 13:18:26.345245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.405839 (+ 60594us) service_pool.cc:224] Handling call
0709 13:18:26.425442 (+ 19603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.487280 (+ 61838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.487329 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:26.501084 (+ 13755us) log.cc:844] Serialized 26 byte log entry
0709 13:18:27.379592 (+878508us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b18003858a0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa0d1 00007f6c31715a0f
0709 13:18:27.815753 (+436161us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:27.815815 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.815916 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:28.216585 (+400669us) raft_consensus.cc:1685] finished
0709 13:18:28.216603 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.271639 (+ 55036us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7854,"raft.queue_time_us":8064,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":13735,"spinlock_wait_cycles":2743040,"thread_start_us":435911,"threads_started":1,"wal-append.queue_time_us":1573408}
I20260709 13:18:29.122704 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:29.123538 21054 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:28.324136 19395 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d05498e224814b9b8f31e3f965ab2583 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d56df3728fc04e37b2d29a3bcd91d167 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:28.272311 21855 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.121411 20666 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:18:29.314729 21054 consensus_queue.cc:1059] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:29.107254 21964 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.121483 21615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.804s	user 0.016s	sys 0.037s
I20260709 13:18:29.181172 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:29.169503 20660 rpcz_store.cc:276] 0709 13:18:27.907138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.908227 (+  1089us) service_pool.cc:224] Handling call
0709 13:18:29.129018 (+1220791us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:29.194765 19511 raft_consensus.cc:2393] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 6: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:28.995988 21703 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:29.216662 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:29.218494 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:29.219026 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 51918.5us
I20260709 13:18:29.219659 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:29.278792 21956 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:28.986564 21961 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.166091 21930 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.224053 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:29.222986 21824 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.221555 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:29.321262 19656 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.321549 19661 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:29.225313 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:29.214123 21957 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:29.228823 21952 log.cc:927] Time spent T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.975s	user 0.010s	sys 0.015s
I20260709 13:18:29.230225 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1866) took 1956 ms. Trace:
W20260709 13:18:29.249980 19476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.006s	sys 0.010s
W20260709 13:18:29.326865 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 1.1037e+06us
I20260709 13:18:29.249997 19659 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:18:28.403702 21947 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.249508 21741 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:29.312539 20659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59430 (request call id 72) took 1070 ms. Trace:
I20260709 13:18:29.280642 21834 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:29.291375 19624 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.016s	sys 0.027s
I20260709 13:18:29.105039 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:29.306910 21820 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.308189 21633 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:29.308768 21960 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.119506 21943 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.275256 21838 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:27.676270 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:29.315613 21054 raft_consensus.cc:3055] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:29.230492 21948 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.316087 19395 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 1.10077e+06us
I20260709 13:18:29.316946 19503 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:18:29.318087 19511 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60692 (request call id 85) took 1406 ms (client timeout 1545 ms). Trace:
I20260709 13:18:29.319761 19655 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:29.311233 20661 rpcz_store.cc:276] 0709 13:18:27.808726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.905819 (+ 97093us) service_pool.cc:224] Handling call
0709 13:18:29.310855 (+1405036us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:29.374199 19511 rpcz_store.cc:269] 0709 13:18:27.911953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.029499 (+117546us) service_pool.cc:224] Handling call
0709 13:18:29.318026 (+1288527us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:29.327925 19659 pending_rounds.cc:85] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 4
I20260709 13:18:28.333297 21789 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.325225 19505 rpcz_store.cc:276] 0709 13:18:27.274062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.274289 (+   227us) service_pool.cc:224] Handling call
0709 13:18:27.274630 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.274848 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:28.997327 (+1722479us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.229654 (+232327us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:29.229720 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:29.229765 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.229847 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.230174 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59292,"prepare.queue_time_us":948007,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":56896,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":1862197,"threads_started":2,"wal-append.queue_time_us":219507}
W20260709 13:18:29.316820 20666 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59430 (request call id 68) took 1693 ms (client timeout 2096 ms). Trace:
I20260709 13:18:29.343776 19627 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:29.344362 21824 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:29.381989 20666 rpcz_store.cc:269] 0709 13:18:27.623154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.675329 (+ 52175us) service_pool.cc:224] Handling call
0709 13:18:29.316737 (+1641408us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:29.382819 21969 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:18:29.345270 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:29.386046 19504 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:29.386546 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1877) took 1051 ms. Trace:
I20260709 13:18:29.386611 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:29.386901 19504 rpcz_store.cc:276] 0709 13:18:28.335479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.320463 (+984984us) service_pool.cc:224] Handling call
0709 13:18:29.386492 (+ 66029us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:29.230307 21169 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:29.387387 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1427) took 1580 ms. Trace:
I20260709 13:18:29.366122 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1874) took 1141 ms. Trace:
I20260709 13:18:29.367040 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:29.341204 21699 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:18:29.369772 21968 log.cc:927] Time spent T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:18:29.369760 19652 raft_consensus.cc:2410] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:29.370347 21633 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:29.371318 21054 raft_consensus.cc:740] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:29.305332 21944 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.323943 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1864) took 2051 ms. Trace:
I20260709 13:18:29.376544 19659 pending_rounds.cc:107] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:18:29.313519 21898 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:29.379457 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1425) took 1573 ms. Trace:
I20260709 13:18:29.387307 21943 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:29.362994 19476 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:29.368433 19656 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:29.365454 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:29.362538 21741 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:18:29.329241 21961 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.368433 21963 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:18:29.314862 21959 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.329348 21930 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.363286 21947 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:29.368943 21781 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.117s
I20260709 13:18:29.324862 21964 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.651228 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:29.681459 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:29.688387 19505 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:29.688565 19503 rpcz_store.cc:276] 0709 13:18:27.805982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.122365 (+1316383us) service_pool.cc:224] Handling call
0709 13:18:29.379394 (+257029us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:29.681339 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 337620us
W20260709 13:18:29.686771 19625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.003s	sys 0.006s
W20260709 13:18:29.696461 19625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.003s	sys 0.006s
I20260709 13:18:29.388666 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:29.368952 21956 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.687767 19659 raft_consensus.cc:2889] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:29.693658 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 330710us
I20260709 13:18:29.698845 19476 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:29.690721 19507 rpcz_store.cc:276] 0709 13:18:28.224954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.104729 (+879775us) service_pool.cc:224] Handling call
0709 13:18:29.366055 (+261326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:29.700017 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:29.687739 19511 rpcz_store.cc:276] 0709 13:18:27.806609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.386348 (+1579739us) service_pool.cc:224] Handling call
0709 13:18:29.387335 (+   987us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:29.700996 19507 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:29.701530 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1875) took 1405 ms. Trace:
I20260709 13:18:29.701987 19507 rpcz_store.cc:276] 0709 13:18:28.296232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.699771 (+1403539us) service_pool.cc:224] Handling call
0709 13:18:29.701478 (+  1707us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:29.704551 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:29.704813 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:29.689427 19512 rpcz_store.cc:276] 0709 13:18:27.272468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.272587 (+   119us) service_pool.cc:224] Handling call
0709 13:18:27.272955 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.273220 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:27.318173 (+ 44953us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.313101 (+1994928us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.315320 (+  2219us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.323289 (+  7969us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:29.323394 (+   105us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:29.323463 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.323706 (+   243us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.323866 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7603,"prepare.queue_time_us":107603,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":1547,"raft.queue_time_us":130486,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":4703,"spinlock_wait_cycles":15734784,"thread_start_us":1994084,"threads_started":2,"wal-append.queue_time_us":1663549}
I20260709 13:18:29.697692 19661 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
W20260709 13:18:29.652024 21950 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 13:18:29.723443 19476 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:29.729790 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1873) took 2370 ms. Trace:
I20260709 13:18:29.730055 19653 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:29.730415 19507 rpcz_store.cc:276] 0709 13:18:27.359770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.702758 (+2342988us) service_pool.cc:224] Handling call
0709 13:18:29.720676 (+ 17918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.729367 (+  8691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.729401 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:29.729451 (+    50us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:29.729483 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.729550 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.729728 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8016}
I20260709 13:18:29.731529 19653 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:29.732227 19507 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:29.346647 20659 rpcz_store.cc:276] 0709 13:18:28.239778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.307636 (+ 67858us) service_pool.cc:224] Handling call
0709 13:18:29.309552 (+1001916us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:29.379113 21960 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.733750 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:29.734354 19659 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:18:29.734452 19505 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:29.734859 19659 pending_rounds.cc:85] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 3
I20260709 13:18:29.735165 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1879) took 1348 ms. Trace:
I20260709 13:18:29.735222 19659 pending_rounds.cc:107] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:18:29.735417 21960 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:29.735795 19659 raft_consensus.cc:2889] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:29.736176 21960 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.650661 21965 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.002s	sys 0.004s
I20260709 13:18:29.738415 19661 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:29.738956 19659 raft_consensus.cc:1275] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:29.739420 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:29.735683 19505 rpcz_store.cc:276] 0709 13:18:28.386988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.703826 (+1316838us) service_pool.cc:224] Handling call
0709 13:18:29.735102 (+ 31276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:29.704537 21054 consensus_queue.cc:260] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:29.742058 19657 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:29.370970 21820 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.737098 21960 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.379487 21948 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.431068 21789 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.755483 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:29.549011 20662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59430 (request call id 67) took 1916 ms. Trace:
I20260709 13:18:29.757269 21741 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:29.773713 21652 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:29.791441 19551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.009s	sys 0.012s
I20260709 13:18:29.795704 19658 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:18:29.794946 19510 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.012s	sys 0.009s
I20260709 13:18:29.733095 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1431) took 1507 ms. Trace:
W20260709 13:18:30.046449 19550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.003s	sys 0.027s
W20260709 13:18:30.046947 19550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.004s	sys 0.027s
W20260709 13:18:30.047536 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.719594 21956 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:29.388052 21838 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:29.742208 20665 raft_consensus.cc:2393] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:30.041644 21054 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.048180 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1858) took 3388 ms. Trace:
I20260709 13:18:30.059060 19506 rpcz_store.cc:276] 0709 13:18:26.628822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.631233 (+  2411us) service_pool.cc:224] Handling call
0709 13:18:26.662526 (+ 31293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.109005 (+2446479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.824067 (+715062us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b54001cff54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:30.017063 (+192996us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5624726784}
I20260709 13:18:29.895067 19512 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:30.060527 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1426) took 2254 ms. Trace:
I20260709 13:18:30.061182 19512 rpcz_store.cc:276] 0709 13:18:27.806322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.720875 (+1914553us) service_pool.cc:224] Handling call
0709 13:18:29.894782 (+173907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.060277 (+165495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.060472 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:30.043872 19655 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:30.045564 19510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.032s	sys 0.012s
I20260709 13:18:29.824074 21781 consensus_queue.cc:1059] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.219s
W20260709 13:18:30.044312 19551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.012s	sys 0.026s
W20260709 13:18:30.041046 21965 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.013s	sys 0.027s
I20260709 13:18:30.046487 19507 rpcz_store.cc:276] 0709 13:18:28.225968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.731570 (+1505602us) service_pool.cc:224] Handling call
0709 13:18:29.731920 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.732777 (+   857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.733032 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:30.041728 19511 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:29.804033 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 475207us
I20260709 13:18:29.788386 20663 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
W20260709 13:18:30.049461 19508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.011s	sys 0.034s
W20260709 13:18:30.094787 19508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.011s	sys 0.034s
I20260709 13:18:30.061677 19581 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:18:30.042771 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1878) took 1685 ms. Trace:
I20260709 13:18:30.095851 19505 rpcz_store.cc:276] 0709 13:18:28.357670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.041864 (+1684194us) service_pool.cc:224] Handling call
0709 13:18:30.042212 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.042396 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.042430 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:30.042476 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:30.042515 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.042579 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.042709 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:30.096616 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.097302 19581 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:29.718485 21971 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:29.890260 21972 log.cc:927] Time spent T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:18:30.098624 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.101346 19581 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:30.102998 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.103637 19581 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
W20260709 13:18:30.099586 19624 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.026s	sys 0.020s
I20260709 13:18:30.032677 21943 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.100647 19552 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.999s	user 0.021s	sys 0.033s
W20260709 13:18:30.114013 19552 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.022s	sys 0.033s
I20260709 13:18:30.105103 19582 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:30.106781 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.108140 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.096952 19585 pending_rounds.cc:85] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 2
I20260709 13:18:30.115875 19585 pending_rounds.cc:107] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:18:30.116284 19585 raft_consensus.cc:2889] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:30.023186 21855 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:30.104631 19624 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.027s	sys 0.020s
I20260709 13:18:30.043139 21789 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.117439 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.045133 21948 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.046869 21169 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:30.043514 21652 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:30.122390 19584 raft_consensus.cc:2410] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:18:30.139451 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.122782 19579 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:30.141918 19655 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
W20260709 13:18:30.128809 21782 consensus_meta.cc:287] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.846s	user 0.009s	sys 0.000s
I20260709 13:18:30.130092 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:30.147010 19586 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:30.147320 21948 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.107594 21957 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:30.105938 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.041958 20662 rpcz_store.cc:276] 0709 13:18:27.618228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.622199 (+  3971us) service_pool.cc:224] Handling call
0709 13:18:29.534411 (+1912212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:30.137104 19506 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:30.153527 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.154042 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1880) took 1164 ms. Trace:
I20260709 13:18:30.051702 21963 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:30.138199 19582 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:30.045656 21960 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:30.134693 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.112331 21971 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.154502 19506 rpcz_store.cc:276] 0709 13:18:28.990155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.094285 (+1104130us) service_pool.cc:224] Handling call
0709 13:18:30.132328 (+ 38043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.153725 (+ 21397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.153980 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:30.155349 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.162710 19584 raft_consensus.cc:2410] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:18:30.163262 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 467436us
I20260709 13:18:30.165864 19656 raft_consensus.cc:2410] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:18:30.167548 19579 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:18:30.129467 21943 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.142546 21652 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.141072 21855 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.170404 19586 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:30.167992 19579 pending_rounds.cc:85] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 3
I20260709 13:18:30.178551 19579 pending_rounds.cc:107] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:18:30.178884 19579 raft_consensus.cc:2889] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:30.173991 19581 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:30.147156 21789 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.121467 21633 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.148353 21975 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.181452 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.175158 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:30.182312 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.187821 19584 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:30.189344 19583 raft_consensus.cc:2410] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:30.189265 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.190898 19581 raft_consensus.cc:2368] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7.
I20260709 13:18:30.193593 19586 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:30.170256 21971 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:30.148384 21948 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.192087 21960 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.154687 21782 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.184685 21973 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.211640 21948 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.177382 21963 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.212411 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.193091 21820 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:30.195551 21966 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.222456 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:30.223071 19584 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:30.201581 21964 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:30.187245 21855 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.187146 21789 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.207916 21961 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:30.210588 19627 connection.cc:256] RPC call timeout handler was delayed by -1.6761087869997482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
W20260709 13:18:30.236541 19627 connection.cc:256] RPC call timeout handler was delayed by -1.60092984899984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 13:18:30.237022 19627 connection.cc:256] RPC call timeout handler was delayed by -1.4227472259999558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260709 13:18:30.237421 19627 connection.cc:256] RPC call timeout handler was delayed by -1.4155572299998767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260709 13:18:30.237816 19627 connection.cc:256] RPC call timeout handler was delayed by -1.4155572299998767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260709 13:18:30.238194 19627 connection.cc:256] RPC call timeout handler was delayed by -1.360937801999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260709 13:18:30.238587 19627 connection.cc:256] RPC call timeout handler was delayed by -1.2125701909999407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
W20260709 13:18:30.238987 19627 connection.cc:256] RPC call timeout handler was delayed by -1.0367762690000291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
I20260709 13:18:30.215435 21957 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.194077 21975 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:30.241648 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 483132us
I20260709 13:18:30.216554 21948 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.244889 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.246009 19581 raft_consensus.cc:2410] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:18:30.220252 21947 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:30.220494 21959 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:30.244637 19476 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:30.226771 21820 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.257506 19584 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:30.215287 21960 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.262292 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.262542 19476 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:30.269371 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1869) took 2986 ms. Trace:
I20260709 13:18:30.218174 21973 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.231655 21966 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.270218 21977 raft_consensus.cc:3055] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:30.257930 21961 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:30.242591 21944 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:30.269886 21955 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 2.017s	user 0.017s	sys 0.031s
I20260709 13:18:30.261293 21633 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.271996 19510 rpcz_store.cc:276] 0709 13:18:27.282949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.283062 (+   113us) service_pool.cc:224] Handling call
0709 13:18:29.012749 (+1729687us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:18:29.012961 (+   212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.014979 (+  2018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.015010 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:29.104975 (+ 89965us) log.cc:844] Serialized 26 byte log entry
0709 13:18:30.065366 (+960391us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:30.065405 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.065470 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.269017 (+203547us) raft_consensus.cc:1685] finished
0709 13:18:30.269041 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.269300 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1615,"raft.queue_time_us":116609,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":52379520,"thread_start_us":957729,"threads_started":1,"wal-append.queue_time_us":1073821}
I20260709 13:18:30.293488 21850 raft_consensus.cc:3055] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:30.295153 21963 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.289903 21898 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.283334 21974 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.265074 21820 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:30.285300 21977 raft_consensus.cc:740] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:30.303406 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.303815 21973 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.304160 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.333506 19581 raft_consensus.cc:2410] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:18:30.252170 21948 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:30.249562 21957 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.306039 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.269840 21956 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:30.321763 19626 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.018s	sys 0.041s
I20260709 13:18:30.326594 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.336818 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:30.320477 21850 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:30.341485 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:30.342397 21975 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:30.342188 21850 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.343255 21850 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.345376 21855 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:30.341487 19584 raft_consensus.cc:2410] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:30.345924 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.346928 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.347033 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:30.347219 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:30.347529 19581 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.347692 19584 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:18:30.347939 19626 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.018s	sys 0.041s
W20260709 13:18:30.348455 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.348560 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.349215 19584 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:30.325568 21963 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.353690 19579 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:30.358810 19511 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 6.
W20260709 13:18:30.359473 19511 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60692 (request call id 86) took 2447 ms (client timeout 2958 ms). Trace:
W20260709 13:18:30.359889 19511 rpcz_store.cc:269] 0709 13:18:27.912295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.718700 (+1806405us) service_pool.cc:224] Handling call
0709 13:18:30.359386 (+640686us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:30.339035 21943 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.363402 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.375322 19581 raft_consensus.cc:2410] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:18:30.377050 20619 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.223s	user 0.017s	sys 0.029s
W20260709 13:18:30.377517 20619 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.224s	user 0.017s	sys 0.029s
I20260709 13:18:30.354358 21855 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.329882 21974 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:30.387189 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.413096 19507 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:30.413488 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1741) took 3997 ms. Trace:
I20260709 13:18:30.416806 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.417600 19579 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:30.357853 21963 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.423230 21838 raft_consensus.cc:697] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:30.424268 21838 consensus_queue.cc:237] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:30.377866 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 1.22442e+06us
W20260709 13:18:30.378430 19509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.019s	sys 0.025s
I20260709 13:18:30.385389 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:30.427675 19509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.020s	sys 0.025s
I20260709 13:18:30.427965 19584 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:30.429118 19584 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:30.429946 20619 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.131:33295 timed out after 1.545s (SENT) [suppressed 19 similar messages]
I20260709 13:18:30.433514 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:30.434872 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.435670 19510 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:30.377357 21782 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.440120 19504 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:30.441031 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:30.442927 19507 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:30.413853 19580 rpcz_store.cc:276] 0709 13:18:26.415880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.788287 (+372407us) service_pool.cc:224] Handling call
0709 13:18:26.802776 (+ 14489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.497109 (+694333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.497165 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.497741 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:18:28.094481 (+596740us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:28.094532 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.094653 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.195226 (+2100573us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:18:30.386178 (+190952us) raft_consensus.cc:1685] finished
0709 13:18:30.386208 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.413419 (+ 27211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":287609,"raft.queue_time_us":300802,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":5340,"spinlock_wait_cycles":641746304,"thread_start_us":739734,"threads_started":2,"wal-append.queue_time_us":578182}
I20260709 13:18:30.444922 19579 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:30.441169 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:30.446699 19506 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:18:30.441874 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.447464 19512 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:30.449775 19584 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:30.399734 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.416929 21741 raft_consensus.cc:697] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:30.455595 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:30.452193 19581 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:30.458081 19654 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 5.
I20260709 13:18:30.462503 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.439137 21948 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:30.477548 19586 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:30.417717 21652 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.448213 21789 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.479333 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:30.417948 21855 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:30.494004 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 222617us
I20260709 13:18:30.481547 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.376834 21977 consensus_queue.cc:260] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.459583 21984 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:30.514151 21984 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.515105 21984 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:30.517429 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.516997 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:30.524274 19580 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
W20260709 13:18:30.553821 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 74606.5us
I20260709 13:18:30.476195 21987 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:30.562816 21974 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:30.562985 19625 connection.cc:256] RPC call timeout handler was delayed by -2.0167789639997409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260709 13:18:30.563429 19625 connection.cc:256] RPC call timeout handler was delayed by -1.9804501309997704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
W20260709 13:18:30.563858 19625 connection.cc:256] RPC call timeout handler was delayed by -1.9075079089998326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 13:18:30.564195 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.564502 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.564850 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.565127 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1863) took 3293 ms. Trace:
W20260709 13:18:30.559904 21703 consensus_meta.cc:287] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 1.239s	user 0.013s	sys 0.002s
I20260709 13:18:30.500401 21978 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:18:30.568506 21978 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:30.568704 21948 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.569423 21948 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.490787 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:30.572192 21998 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:30.572702 21998 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.573042 21998 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:30.573307 19503 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
W20260709 13:18:30.565233 19625 connection.cc:256] RPC call timeout handler was delayed by -1.7448912569998356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260709 13:18:30.574658 19625 connection.cc:256] RPC call timeout handler was delayed by -1.7280712909998783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260709 13:18:30.575161 19625 connection.cc:256] RPC call timeout handler was delayed by -1.5232005839998237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
W20260709 13:18:30.575625 19625 connection.cc:256] RPC call timeout handler was delayed by -1.3378079089998209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
W20260709 13:18:30.576114 19625 connection.cc:256] RPC call timeout handler was delayed by -1.2989366769998014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23490000000000003s for a response
W20260709 13:18:30.577965 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 228139us
W20260709 13:18:30.580804 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.581701 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.582584 19580 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:30.566236 21703 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.483903 21782 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:18:30.482693 21969 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:18:30.560171 21943 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.560079 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:30.611721 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.520020 21966 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.560312 21977 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:30.565721 19509 rpcz_store.cc:276] 0709 13:18:27.271940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.272100 (+   160us) service_pool.cc:224] Handling call
0709 13:18:29.379856 (+2107756us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:18:29.380060 (+   204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.380440 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.380472 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:29.722855 (+342383us) log.cc:844] Serialized 26 byte log entry
0709 13:18:30.428193 (+705338us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:30.428251 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.428346 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.564815 (+136469us) raft_consensus.cc:1685] finished
0709 13:18:30.564836 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.565065 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":237,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":53225,"spinlock_wait_cycles":51131648,"thread_start_us":624342,"threads_started":1,"wal-append.queue_time_us":709475}
I20260709 13:18:30.574070 19587 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60808
I20260709 13:18:30.574358 21904 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.572224 21948 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.635028 21948 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:30.635538 21948 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.638648 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.639585 19511 raft_consensus.cc:2410] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 10 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:30.640513 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.641826 21999 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:30.596967 21987 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:30.643339 19410 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 45) took 4527 ms. Trace:
I20260709 13:18:30.613716 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.615238 19625 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:30.646092 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.641573 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.651767 19511 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
W20260709 13:18:30.617502 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.621942 19587 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:30.653049 19587 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.627244 21947 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.634016 21904 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.644388 21987 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.660964 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:30.664573 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 139791us
I20260709 13:18:30.667670 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.667842 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.668440 19582 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:30.669727 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.675096 21820 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:30.658875 21789 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.676395 21789 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.650609 21948 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.664994 21947 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.604452 21741 consensus_queue.cc:237] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.679898 21947 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.680675 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:30.681468 19582 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:30.682695 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:30.683099 19406 catalog_manager.cc:5697] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 5 to 8, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 8 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.603920 21975 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:18:30.684562 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.685297 19580 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
W20260709 13:18:30.685881 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 70739.5us
I20260709 13:18:30.686331 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:30.686507 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1871) took 3400 ms. Trace:
I20260709 13:18:30.686862 19580 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:30.687253 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.687316 19625 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:30.688325 19625 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:30.688489 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.663018 21973 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.689242 21973 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.689805 21961 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:30.690196 21961 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:30.690564 21961 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:30.691332 21973 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.692423 21956 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:30.692843 21956 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.693182 21956 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:30.686901 19508 rpcz_store.cc:276] 0709 13:18:27.286324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.680948 (+394624us) service_pool.cc:224] Handling call
0709 13:18:29.105155 (+1424207us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:18:29.105381 (+   226us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.095188 (+989807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.095219 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:30.102233 (+  7014us) log.cc:844] Serialized 26 byte log entry
0709 13:18:30.537259 (+435026us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:30.537344 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.537446 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.686225 (+148779us) raft_consensus.cc:1685] finished
0709 13:18:30.686247 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.686449 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":68567,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":86,"spinlock_wait_cycles":42607360,"thread_start_us":1372402,"threads_started":2,"wal-append.queue_time_us":546508}
I20260709 13:18:30.696453 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.697501 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.689399 19625 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:30.695752 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.698038 19508 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:30.699585 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.700196 19508 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:30.700938 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.701471 19508 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:30.702211 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.702705 19508 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:30.703410 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.703909 19508 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:30.680576 21998 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.712996 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.713747 21959 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:30.713949 19505 raft_consensus.cc:2368] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10.
I20260709 13:18:30.714253 21959 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.714707 21959 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:30.714956 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.716616 21960 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:30.712735 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.722755 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:30.722930 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.723356 21982 raft_consensus.cc:3055] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:30.723627 19508 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:30.723789 21982 raft_consensus.cc:740] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:30.712513 21998 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.724751 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.725555 19585 raft_consensus.cc:2410] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:30.726270 19585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:60828
I20260709 13:18:30.726780 19585 raft_consensus.cc:606] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:30.727082 19585 raft_consensus.cc:614] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:30.728194 21971 consensus_meta.cc:287] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.000s
I20260709 13:18:30.705075 22004 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.019s
W20260709 13:18:30.730028 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 69197.7us
I20260709 13:18:30.730553 21966 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:18:30.731912 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:30.732833 21652 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.618256 21943 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.735567 21943 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.736054 21943 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:30.612833 21703 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.737079 21947 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:30.739221 21947 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:30.739540 21947 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:30.739882 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:30.740399 21947 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.741604 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:30.737962 19551 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:30.730171 21991 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:30.741966 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:30.743038 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:30.743656 20662 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:30.741992 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.745756 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:30.748363 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:30.753014 19585 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:30.753656 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:30.643921 19410 rpcz_store.cc:276] 0709 13:18:26.138975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.185972 (+ 46997us) service_pool.cc:224] Handling call
0709 13:18:26.618371 (+432399us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b54002ec7d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c4090 00007f6c31762f3a 00007f6c375191cc 00007f6c3761737e 00007f6c35ad82a4 00007f6c35ad8232 00007f6c35ad8161 00007f6c35ad80dc 00007f6c35ad7392 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:30.643218 (+4024847us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:26.923423 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:26.953074 (+ 29651us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:26.953109 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:18:26.953126 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:26.953463 (+   337us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:26.953521 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:26.953545 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:26.953773 (+   228us) tablet.cc:701] Row locks acquired
0709 13:18:26.953788 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:18:26.953933 (+   145us) write_op.cc:270] Start()
0709 13:18:26.954043 (+   110us) write_op.cc:276] Timestamp: P: 1783603106953885 usec, L: 0
0709 13:18:26.954057 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 13:18:26.982176 (+ 28119us) log.cc:844] Serialized 538 byte log entry
0709 13:18:27.087875 (+105699us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b1800204280. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:18:28.776067 (+1688192us) op_driver.cc:464] REPLICATION: finished
0709 13:18:29.008516 (+232449us) write_op.cc:301] APPLY: starting
0709 13:18:29.008602 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:29.008703 (+   101us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:29.008725 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:29.009028 (+   303us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:29.009292 (+   264us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:29.009344 (+    52us) write_op.cc:312] APPLY: finished
0709 13:18:29.009519 (+   175us) log.cc:844] Serialized 22 byte log entry
0709 13:18:29.735793 (+726274us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54002ec7d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175732a 00007f6c316dcf14 00007f6c316dcec3 00007f6c316dce38 00007f6c316dcdf3 00007f6c316dc0dc 00007f6c31705e16 00007f6c316edcbb 00007f6c316d839d 00007f6c316dbd75
0709 13:18:30.102337 (+366544us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:30.131893 (+ 29556us) write_op.cc:454] Released schema lock
0709 13:18:30.136835 (+  4942us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:30.147871 (+ 11036us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:30.147905 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":28148480,"child_traces":[["op",{"apply.queue_time_us":225324,"apply.run_cpu_time_us":42659,"apply.run_wall_time_us":1139536,"num_ops":1,"prepare.queue_time_us":181746,"prepare.run_cpu_time_us":17502,"prepare.run_wall_time_us":121811,"raft.queue_time_us":1164472,"raft.run_cpu_time_us":34290,"raft.run_wall_time_us":1481891,"replication_time_us":1489819,"spinlock_wait_cycles":321601152,"thread_start_us":1603457,"threads_started":5,"wal-append.queue_time_us":874880,"wal-append.run_cpu_time_us":24518,"wal-append.run_wall_time_us":1351418}]]}
I20260709 13:18:30.751569 19587 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.673466 21957 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:30.766068 19587 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.766855 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:30.768831 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:30.772763 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 83435.7us
I20260709 13:18:30.773661 19582 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:18:30.773772 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 76015.5us
I20260709 13:18:30.741534 21947 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:30.776072 19625 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:30.752842 21991 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:30.743065 21944 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:30.738013 21703 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.757036 21652 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:18:30.754060 21855 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:30.756850 21948 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.794189 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.752796 21943 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.794667 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.781879 19587 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:30.790409 19582 raft_consensus.cc:1275] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:18:30.796947 20665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59430 (request call id 70) took 2886 ms (client timeout 1792 ms). Trace:
W20260709 13:18:30.801702 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 129999us
I20260709 13:18:30.802454 19476 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:30.804356 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:30.805665 19580 raft_consensus.cc:2410] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:30.779130 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:18:30.800279 20665 rpcz_store.cc:269] 0709 13:18:27.906660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.946447 (+ 39787us) service_pool.cc:224] Handling call
0709 13:18:30.791583 (+2845136us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400599cd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:30.791791 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3453923200}
W20260709 13:18:30.808741 19395 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d05498e224814b9b8f31e3f965ab2583 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d56df3728fc04e37b2d29a3bcd91d167 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:30.810377 19653 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:30.809445 19581 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:18:30.811437 19581 pending_rounds.cc:85] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 1
I20260709 13:18:30.811699 19581 pending_rounds.cc:107] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:18:30.811935 19581 raft_consensus.cc:2889] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:30.789256 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:30.818291 19578 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:30.763150 21782 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:18:30.815619 19582 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:30.787403 21973 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:30.778988 21633 raft_consensus.cc:2764] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:18:30.787786 21993 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:30.779778 21979 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:30.820636 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:30.822114 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:30.825851 19478 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:30.724695 21982 consensus_queue.cc:260] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:30.827677 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.849136 19508 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 5.
I20260709 13:18:30.800064 21789 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.824101 21973 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:30.829078 22004 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.833580 20659 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:18:30.834113 19580 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:30.837083 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:30.838227 19503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1882) took 1847 ms (client timeout 1596 ms). Trace:
W20260709 13:18:30.859957 19503 rpcz_store.cc:269] 0709 13:18:28.990632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.704276 (+713644us) service_pool.cc:224] Handling call
0709 13:18:30.838053 (+1133777us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b5400260554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:30.838159 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1995823872}
I20260709 13:18:30.860378 19504 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:30.808322 21703 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:30.685345 19406 catalog_manager.cc:5697] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 5 to 7, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 7 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.842020 19661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1537) took 1470 ms. Trace:
I20260709 13:18:30.786152 21974 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:18:30.752827 21971 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.843712 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:30.871119 19505 raft_consensus.cc:2393] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 6: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:30.865917 21979 raft_consensus.cc:697] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:30.871905 19510 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:18:30.872227 21979 consensus_queue.cc:237] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.873749 21633 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.874151 19657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1528) took 3759 ms. Trace:
I20260709 13:18:30.874276 21633 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.874727 19657 rpcz_store.cc:276] 0709 13:18:27.114531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.118288 (+  3757us) service_pool.cc:224] Handling call
0709 13:18:27.123640 (+  5352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.042865 (+2919225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.873799 (+830934us) spinlock_profiling.cc:243] Waited 2.62 s on lock 0x7b54002c88d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:30.874041 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6021008768}
I20260709 13:18:30.874817 19406 catalog_manager.cc:5697] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.845014 21904 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:30.779390 21990 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:18:30.830399 21993 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.846428 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:30.818921 21855 consensus_queue.cc:1059] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:18:30.847951 19587 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 5. Ops: []
I20260709 13:18:30.831092 19659 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:30.815953 21943 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.861920 19478 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:30.863008 19661 rpcz_store.cc:276] 0709 13:18:29.371270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.720825 (+349555us) service_pool.cc:224] Handling call
0709 13:18:29.733496 (+ 12671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.041438 (+307942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.841785 (+800347us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b54003f3254. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:30.841957 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10524928}
I20260709 13:18:30.862653 21789 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:30.869156 21703 raft_consensus.cc:697] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:30.821832 21989 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:18:30.827991 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:30.830019 21960 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:18:30.799703 21948 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.855374 21985 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:30.876713 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:30.964598 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:31.042704 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:31.105969 19553 connection.cc:256] RPC call timeout handler was delayed by -1.704483952000146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
I20260709 13:18:30.854496 21973 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:30.973973 20619 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
W20260709 13:18:31.010368 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 148551us
W20260709 13:18:30.898499 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.123421 19553 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:31.130167 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 156333us
I20260709 13:18:31.128122 19659 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:18:30.966965 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 189035us
I20260709 13:18:31.132858 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.133517 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.133845 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.134369 19582 raft_consensus.cc:2393] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:31.134454 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.133514 19585 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:31.135107 19583 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:31.135193 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.136447 19504 raft_consensus.cc:2410] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:31.136548 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.137238 19578 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:30.966240 21993 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.137388 21904 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:30.876652 19406 catalog_manager.cc:5697] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:18:31.046659 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:30.860466 21782 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:31.144629 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.144946 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.145974 19476 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:31.147377 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.147519 21652 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:31.152772 19585 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:31.147428 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.148365 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.170116 19586 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:30.905802 21982 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.149456 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.150203 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.172500 19580 raft_consensus.cc:1275] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:18:31.112460 21984 consensus_meta.cc:287] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.596s	user 0.006s	sys 0.003s
I20260709 13:18:30.876582 21633 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:31.147557 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.184967 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.184967 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:31.185778 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 374013us
I20260709 13:18:31.186480 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.187168 19504 raft_consensus.cc:2410] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:18:31.188868 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.184347 19584 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:31.191604 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.167258 22003 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:31.046056 21977 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:31.107023 21948 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:31.170421 19583 raft_consensus.cc:2410] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:31.092535 20661 raft_consensus.cc:2368] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7.
I20260709 13:18:31.172518 19582 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:31.032645 21959 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.966542 21985 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.179963 20662 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:31.238296 19505 raft_consensus.cc:2376] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 6. Re-sending same reply.
I20260709 13:18:31.174952 21699 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:18:31.108597 21943 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:31.182555 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.182860 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.154469 19503 raft_consensus.cc:2410] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:18:31.183501 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 407487us
I20260709 13:18:31.170372 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.280009 19511 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:31.280236 19585 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
W20260709 13:18:31.196746 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.171778 21904 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:30.888096 21956 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:31.200402 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:30.862833 22004 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:31.207640 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.046311 21961 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:30.905448 21930 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:31.151131 22010 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:31.217247 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.218597 19584 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:18:31.208462 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 76817.4us
I20260709 13:18:31.219743 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.105757 21971 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:31.145098 21789 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:31.188652 21838 raft_consensus.cc:3055] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:31.241209 19657 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:31.237803 21985 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:31.249439 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:31.258679 22018 log.cc:927] Time spent T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:18:31.200516 22003 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.185043 21984 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:31.457403 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 85426.2us
I20260709 13:18:31.500253 19625 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:31.500504 19512 raft_consensus.cc:2410] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:31.501411 19586 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:31.303565 19652 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 8: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:31.502458 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.285148 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.503345 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:31.222424 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.515618 19507 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:31.201262 21703 consensus_queue.cc:237] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:31.516549 20662 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:31.517936 21961 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:31.302132 21963 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:31.508818 21054 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:31.518716 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1440) took 1100 ms. Trace:
W20260709 13:18:31.509236 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.519045 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:31.519511 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.519737 19657 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:31.517879 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:31.518944 21054 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.323062 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.526415 21054 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:31.519114 19510 rpcz_store.cc:276] 0709 13:18:30.418022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.456908 (+ 38886us) service_pool.cc:224] Handling call
0709 13:18:30.476008 (+ 19100us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.872326 (+396318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.518493 (+646167us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b5400184cd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:31.518664 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":909900544}
I20260709 13:18:31.371423 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:31.528296 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.525563 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.529300 19587 raft_consensus.cc:2410] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:18:31.531942 19551 connection.cc:256] RPC call timeout handler was delayed by -1.6952710569998999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
W20260709 13:18:31.532337 19551 connection.cc:256] RPC call timeout handler was delayed by -1.6844710569998824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
W20260709 13:18:31.532617 19551 connection.cc:256] RPC call timeout handler was delayed by -1.6493710569998257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
W20260709 13:18:31.532900 19551 connection.cc:256] RPC call timeout handler was delayed by -1.3883710569998584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
W20260709 13:18:31.534451 19551 connection.cc:256] RPC call timeout handler was delayed by -1.3865710569998555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
W20260709 13:18:31.534762 19551 connection.cc:256] RPC call timeout handler was delayed by -1.0841710569998213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2522s for a response
W20260709 13:18:31.535033 19551 connection.cc:256] RPC call timeout handler was delayed by -1.0562710569997762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2553s for a response
I20260709 13:18:31.535554 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:31.539844 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:31.543673 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.545197 19657 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:31.546561 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.547623 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.561408 19504 raft_consensus.cc:2393] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 4: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:31.548955 19580 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:31.511544 22003 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.566550 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.577967 19625 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:31.578868 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:31.550165 19478 leader_election.cc:336] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.599s (SENT)
I20260709 13:18:31.559738 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.567992 21054 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:31.548048 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.580281 19478 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:31.580835 19505 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:31.549057 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.564030 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:31.577896 19661 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:31.568733 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.549659 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.584906 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.508080 21838 raft_consensus.cc:740] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:31.582537 19658 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:31.574190 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.587584 19657 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:31.585078 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.549162 21904 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.351549 21964 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.213s
I20260709 13:18:31.590014 19625 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:31.596199 19625 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:31.590011 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:31.596577 21054 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:31.592253 19478 leader_election.cc:336] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.656s (SENT)
I20260709 13:18:31.597705 19478 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:31.597952 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:31.598902 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:31.599324 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:31.588169 19653 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:31.594484 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.601293 19658 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:31.590934 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.602192 19661 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:31.538374 22010 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.603785 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.533268 21961 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.604768 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:31.607534 19478 leader_election.cc:336] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.706s (SENT)
I20260709 13:18:31.610451 19509 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 8: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:31.591609 19476 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:31.559005 21943 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:31.559376 21855 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.559194 21960 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.610692 19478 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:31.561714 22012 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:31.613562 19478 leader_election.cc:336] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.711s (SENT)
I20260709 13:18:31.613917 21054 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:31.614114 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:31.614414 21054 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.614919 21054 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.554373 20661 raft_consensus.cc:2376] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7. Re-sending same reply.
I20260709 13:18:31.620332 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.628437 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.632711 19584 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:31.628820 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.633970 19585 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:31.594022 21904 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:31.616768 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.637529 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.634829 19586 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:31.636139 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:31.594295 21963 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:31.638705 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.638914 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.640233 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.606377 21990 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:31.606235 22019 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:31.654465 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.677096 19478 leader_election.cc:400] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615) with higher term. Message: Invalid argument: T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7.
I20260709 13:18:31.647670 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:31.685004 19478 leader_election.cc:403] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:31.676859 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.685954 19505 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:31.676407 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.646884 19654 raft_consensus.cc:2393] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:31.680456 19586 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:31.687208 19582 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:31.679492 19661 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:31.681021 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.688357 19585 raft_consensus.cc:2410] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:31.590183 21947 consensus_queue.cc:1059] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:18:31.682890 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.608546 21782 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:31.606469 21966 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:18:31.606575 22020 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:31.690738 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.677237 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:31.730877 19579 raft_consensus.cc:2376] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7. Re-sending same reply.
I20260709 13:18:31.594580 21948 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:18:31.632056 21971 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:31.608546 21974 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:31.710675 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.748876 19585 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:31.635951 22005 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:31.704630 19578 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:31.711639 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.706049 21054 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:31.645510 21652 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:31.727038 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:31.728109 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 128863us
I20260709 13:18:31.756646 19503 raft_consensus.cc:3055] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:31.691200 22018 log.cc:927] Time spent T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:18:31.729337 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.632637 21960 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:31.737104 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 89528.6us
I20260709 13:18:31.766486 19476 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:31.738816 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 142721us
I20260709 13:18:31.605129 21633 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:18:31.681667 21699 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.740299 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.773643 19654 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:31.729524 21963 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:31.684444 21990 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.684177 21943 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:31.747798 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.747889 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.787083 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.787585 19580 raft_consensus.cc:2410] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:18:31.748267 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.688880 21987 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:31.689209 22019 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.755373 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.757139 19503 raft_consensus.cc:740] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:31.789247 19508 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
W20260709 13:18:31.757607 19659 consensus_meta.cc:287] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.611s	user 0.009s	sys 0.001s
I20260709 13:18:31.759007 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:31.791258 19659 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:31.791412 19582 raft_consensus.cc:2410] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:18:31.791682 19579 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:31.757361 22012 raft_consensus.cc:3055] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:31.761930 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:31.763077 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.616233 21961 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:31.807124 21054 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:31.774586 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:31.807446 19476 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:31.741873 19509 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:31.808594 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:31.809218 19654 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:31.612352 22010 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:31.808204 19584 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:31.767719 19625 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:31.730376 22020 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.786339 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.632509 21855 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:31.759419 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:31.636615 21838 consensus_queue.cc:260] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:31.818187 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 58851.5us
I20260709 13:18:31.754750 21703 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615) with higher term. Message: Invalid argument: T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7.
W20260709 13:18:31.736075 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 59121.2us
I20260709 13:18:31.825397 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:31.791939 22019 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:31.826172 19478 leader_election.cc:336] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.734s (SENT)
I20260709 13:18:31.791962 21990 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:31.747583 21959 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:31.790211 19503 consensus_queue.cc:260] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:31.539362 19406 catalog_manager.cc:5697] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 3 to 4, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 4 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:31.805742 19586 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
W20260709 13:18:31.770224 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.812556 19476 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:31.813356 19578 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:18:31.819876 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 52292.7us
I20260709 13:18:31.826381 19657 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:31.792600 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.791726 21652 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:31.792863 21699 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:31.818814 22020 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:31.817764 21782 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:31.824911 21943 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:31.827140 19478 leader_election.cc:336] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.735s (SENT)
I20260709 13:18:31.828598 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:31.811172 21987 raft_consensus.cc:697] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:31.834921 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.859154 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.872251 19661 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:31.806628 22012 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:31.861156 19625 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:31.796247 21963 raft_consensus.cc:697] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:31.864501 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.846318 19503 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:31.867151 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:31.881721 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 54609.3us
I20260709 13:18:31.826732 21981 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:31.844336 21956 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:31.811596 22035 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:31.866683 21782 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.891191 19625 leader_election.cc:400] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10.
W20260709 13:18:31.836690 21973 consensus_meta.cc:287] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.664s	user 0.007s	sys 0.002s
I20260709 13:18:31.879407 19657 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:31.881860 21054 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:31.896358 21054 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.896729 21054 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:31.898120 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.898784 19653 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:31.899842 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:31.882351 19478 leader_election.cc:336] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.778s (SENT)
I20260709 13:18:31.900470 19478 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:31.844992 19584 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:31.840185 21838 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:31.866031 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 53559.9us
I20260709 13:18:31.837776 21961 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:31.839676 21855 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:31.858349 21789 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:31.875363 22014 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260709 13:18:31.887984 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.916957 19661 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:31.870635 21977 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:31.866662 21984 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:31.877275 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:18:31.870826 21943 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:31.875625 21947 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:31.947896 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.927763 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.891645 19625 leader_election.cc:403] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:31.900384 19653 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
W20260709 13:18:31.986974 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 109764us
I20260709 13:18:31.910043 19476 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:31.883719 21703 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:31.884209 21981 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:31.916234 19478 leader_election.cc:336] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.792s (SENT)
W20260709 13:18:32.012988 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 121942us
W20260709 13:18:32.013170 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 96944.7us
I20260709 13:18:31.889106 22035 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.919690 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:31.919880 21054 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:31.921604 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:32.017477 19657 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:31.887095 21974 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:18:31.997879 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.021734 19582 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:32.003580 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:32.022605 19585 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:32.006281 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 198811us
I20260709 13:18:31.883993 22004 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:32.030234 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.014703 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:32.032752 21963 consensus_queue.cc:237] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:32.033982 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:32.034925 21054 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:32.035068 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.043625 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:31.902868 21782 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:32.018471 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:32.019335 19503 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:31.922240 21977 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.027243 19625 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:32.014555 19478 leader_election.cc:336] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.874s (SENT)
I20260709 13:18:31.986464 21943 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:31.986719 21979 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:32.020349 22024 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:18:31.905795 21973 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:31.988462 21947 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.894405 21652 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:32.013734 21789 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:32.020028 21981 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:31.948498 22037 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:31.988899 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:32.035532 19653 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:32.116539 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.025321 22015 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10.
I20260709 13:18:32.027743 21984 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:32.021150 22035 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:32.138023 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.118716 19586 raft_consensus.cc:2410] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:32.124655 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:32.140970 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 113756us
I20260709 13:18:32.141185 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:32.142644 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.123844 19478 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:32.145116 19653 raft_consensus.cc:2410] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:18:32.068506 22025 log.cc:927] Time spent T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.304s	user 0.011s	sys 0.000s
I20260709 13:18:32.145581 19581 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
W20260709 13:18:32.146884 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 242442us
W20260709 13:18:32.123353 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 280225us
I20260709 13:18:32.034103 21987 consensus_queue.cc:237] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:32.066650 19661 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:32.148077 19476 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:32.148324 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:32.119307 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 130467us
I20260709 13:18:32.123306 19582 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:32.149330 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:32.149493 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:32.149968 19503 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:32.151330 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:32.153496 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:32.152386 19503 raft_consensus.cc:2410] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:18:32.117414 21947 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.118486 21977 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:32.156347 19627 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:32.161139 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:32.156541 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:32.157393 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:32.161780 19657 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:32.113085 22004 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.116786 21789 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:32.124146 22038 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:32.123008 21984 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.161427 19627 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:32.168102 19586 raft_consensus.cc:2410] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:32.168440 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:32.170372 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:32.160472 19476 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:32.162317 19504 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:32.174559 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:32.173708 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 159087us
I20260709 13:18:32.177996 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:32.175609 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1505) took 1041 ms. Trace:
W20260709 13:18:32.182866 19478 leader_election.cc:336] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.882s (SENT)
I20260709 13:18:32.152809 21855 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:32.033598 22003 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:32.183658 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:32.184850 19478 leader_election.cc:336] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.901s (SENT)
I20260709 13:18:32.123059 21979 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:32.188037 19478 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:32.160105 21963 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:32.190371 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.191952 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.181921 19653 rpcz_store.cc:276] 0709 13:18:31.134670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.159742 (+1025072us) service_pool.cc:224] Handling call
0709 13:18:32.175548 (+ 15806us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:32.171459 21959 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:32.002049 22012 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:32.186612 19625 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:32.171582 21971 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:32.186834 19627 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:32.192575 19582 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:32.192260 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.214749 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:32.215477 19586 raft_consensus.cc:2410] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:32.216437 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.216706 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:32.217037 19586 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:32.217509 19512 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:32.217903 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:32.173998 21789 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.193817 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:32.175962 22038 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.179677 21984 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:32.175544 21960 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:32.204723 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:32.208550 19654 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:32.231160 19510 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:32.210333 21982 consensus_meta.cc:287] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 1.027s	user 0.007s	sys 0.005s
I20260709 13:18:32.221320 19627 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:32.224264 19504 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:32.190748 21957 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:32.194069 22037 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:32.236418 22029 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:18:32.173980 22004 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:32.224429 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 74994.9us
I20260709 13:18:32.215588 19653 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
W20260709 13:18:32.238361 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 53550.7us
W20260709 13:18:32.239040 19478 leader_election.cc:336] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.921s (SENT)
I20260709 13:18:32.206550 21959 raft_consensus.cc:697] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:32.190860 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:32.231825 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:32.246706 19654 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:32.247255 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1547) took 1412 ms. Trace:
I20260709 13:18:32.247543 19654 rpcz_store.cc:276] 0709 13:18:30.834476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.246277 (+1411801us) service_pool.cc:224] Handling call
0709 13:18:32.246561 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.247033 (+   472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.247204 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:32.185570 21855 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:18:32.219455 22028 log.cc:927] Time spent T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 13:18:32.234239 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.235062 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59942 (request call id 93) took 1496 ms. Trace:
W20260709 13:18:32.235538 22043 log.cc:927] Time spent T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:32.281908 19582 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:18:32.235711 22031 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:18:32.225973 19586 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:18:32.241573 19478 leader_election.cc:336] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.931s (SENT)
W20260709 13:18:32.230706 21993 consensus_meta.cc:287] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 1.092s	user 0.009s	sys 0.003s
I20260709 13:18:32.243696 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:32.245245 19660 raft_consensus.cc:2410] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:32.213845 22044 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:32.226814 21964 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:32.252430 19656 rpcz_store.cc:276] 0709 13:18:30.738865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.744980 (+  6115us) service_pool.cc:224] Handling call
0709 13:18:30.770184 (+ 25204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.058880 (+288696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.058928 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.182463 (+123535us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.534124 (+351661us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:31.534159 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.534226 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.042605 (+508379us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:18:32.232962 (+190357us) raft_consensus.cc:1685] finished
0709 13:18:32.232985 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.234965 (+  1980us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5382,"raft.queue_time_us":23956,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":18349,"spinlock_wait_cycles":71866240,"thread_start_us":595709,"threads_started":2,"wal-append.queue_time_us":437767}
I20260709 13:18:32.226715 20661 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:32.283007 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:32.349093 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.350337 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.226682 21930 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:32.307228 20619 leader_election.cc:336] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Timed out: RequestConsensusVote RPC to 127.17.251.131:33295 timed out after 1.545s (SENT)
I20260709 13:18:32.352219 19654 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 3. Current term is 5. Ops: []
I20260709 13:18:32.352355 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:32.353267 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1552) took 1517 ms. Trace:
I20260709 13:18:32.353770 19654 rpcz_store.cc:276] 0709 13:18:30.835784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.252954 (+1417170us) service_pool.cc:224] Handling call
0709 13:18:32.351987 (+ 99033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.352947 (+   960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.353194 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:32.357019 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 113380us
I20260709 13:18:32.358654 19627 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:32.339062 21054 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.360047 21054 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:32.229507 21971 raft_consensus.cc:697] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:32.366837 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 59684.4us
W20260709 13:18:32.367192 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 118231us
I20260709 13:18:32.368539 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:32.372331 19627 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:32.373875 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.375841 19582 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:32.376677 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:32.252264 21855 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.378194 19512 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:32.379664 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:32.388686 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.390458 19586 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
W20260709 13:18:32.390906 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.391863 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:32.380944 19478 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:32.228159 22038 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:32.402657 21963 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:32.338127 20662 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:32.406248 19406 catalog_manager.cc:5697] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:32.354544 21964 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.435369 19510 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:32.366864 21957 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:32.408560 19406 catalog_manager.cc:5697] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 2 to 3, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 3 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:32.381798 21969 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:32.366387 21930 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.366345 22037 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:32.375315 21982 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:32.414332 22026 log.cc:927] Time spent T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.294s	user 0.001s	sys 0.001s
I20260709 13:18:32.355633 22048 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:32.440549 19504 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:32.440953 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:32.461297 19586 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:32.461545 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:32.462386 19504 raft_consensus.cc:2410] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:32.448766 21957 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:32.463757 21957 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:32.454833 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:32.431636 22039 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
W20260709 13:18:32.457748 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.462138 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:32.448148 19585 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:32.351162 21993 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:32.438614 21973 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:32.469991 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.456046 21699 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:32.464316 21977 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:32.468959 19586 raft_consensus.cc:2376] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6. Re-sending same reply.
I20260709 13:18:32.442574 21964 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.441267 21956 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:32.471009 19476 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:32.466764 22048 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.495930 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:32.497200 19510 raft_consensus.cc:2410] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:32.463212 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:32.499114 19504 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:32.499974 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:32.479040 19585 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:32.501929 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.503000 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.503579 19585 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:32.504382 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:32.504918 19585 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.458187 21930 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:32.463304 22019 consensus_meta.cc:287] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.591s	user 0.006s	sys 0.008s
I20260709 13:18:32.468336 22054 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:32.491312 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.492030 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:32.438910 22050 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:32.493533 19652 raft_consensus.cc:2393] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 4: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:32.512773 19585 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:32.439030 22032 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 13:18:32.507346 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 286849us
W20260709 13:18:32.510330 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 268758us
W20260709 13:18:32.489899 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 121425us
I20260709 13:18:32.510943 19586 raft_consensus.cc:2376] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9. Re-sending same reply.
I20260709 13:18:32.378190 22044 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:32.496915 21973 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:32.517181 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.522996 19586 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:32.515463 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:32.514694 19478 leader_election.cc:336] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.936s (SENT)
I20260709 13:18:32.524168 19478 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:32.513535 22047 log.cc:927] Time spent T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 13:18:32.525660 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.527544 19586 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:32.503842 22048 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:32.528942 19625 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:32.530243 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:32.531473 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.533785 19586 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:32.532510 19625 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:32.539505 19625 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:32.538379 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.471699 21959 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:32.508517 22019 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:32.548314 22054 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:32.513844 22052 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:18:32.597707 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:32.561376 21973 raft_consensus.cc:697] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:18:32.603523 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 88857.3us
I20260709 13:18:32.506995 21971 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:32.607147 19478 leader_election.cc:336] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.942s (SENT)
I20260709 13:18:32.489378 19406 catalog_manager.cc:5697] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:32.612673 21741 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.614202 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1554) took 1777 ms. Trace:
I20260709 13:18:32.614852 19661 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 8: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:32.595407 21982 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:32.614617 19656 rpcz_store.cc:276] 0709 13:18:30.836320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.411894 (+1575574us) service_pool.cc:224] Handling call
0709 13:18:32.456548 (+ 44654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:32.456945 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:32.456984 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:32.457518 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:18:32.526505 (+ 68987us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:32.526562 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.526652 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.613967 (+ 87315us) raft_consensus.cc:1685] finished
0709 13:18:32.613988 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.614139 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12859,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":4464,"thread_start_us":30432,"threads_started":1,"wal-append.queue_time_us":133907}
I20260709 13:18:32.613306 21741 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:32.611377 22054 raft_consensus.cc:697] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:32.642056 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:32.643333 19504 raft_consensus.cc:2368] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8.
I20260709 13:18:32.611557 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1555) took 1774 ms. Trace:
I20260709 13:18:32.646207 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:32.547695 22037 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:32.614243 22052 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.623019 22062 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:32.610790 22004 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:32.644994 19658 rpcz_store.cc:276] 0709 13:18:30.836606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.451679 (+1615073us) service_pool.cc:224] Handling call
0709 13:18:32.452085 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:32.454085 (+  2000us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:32.480428 (+ 26343us) log.cc:844] Serialized 14 byte log entry
0709 13:18:32.607786 (+127358us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:32.608516 (+   730us) log.cc:844] Serialized 26 byte log entry
0709 13:18:32.608714 (+   198us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:32.608767 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.608865 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.610368 (+  1503us) raft_consensus.cc:1685] finished
0709 13:18:32.610395 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.610581 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1529,"prepare.queue_time_us":26427,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":6919,"raft.queue_time_us":8745,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":6896,"thread_start_us":84858,"threads_started":1,"wal-append.queue_time_us":99135}
I20260709 13:18:32.703040 19504 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:32.708720 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:32.711484 19658 raft_consensus.cc:2368] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10.
W20260709 13:18:32.712780 19503 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.004s	sys 0.007s
W20260709 13:18:32.715687 19503 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.004s	sys 0.007s
I20260709 13:18:32.644440 21982 raft_consensus.cc:697] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:32.630245 21947 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:32.721516 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:32.739498 19507 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.009s	sys 0.012s
W20260709 13:18:32.740864 19507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.010s	sys 0.012s
I20260709 13:18:32.746352 22057 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:32.746897 22051 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:18:32.747272 22061 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:32.717764 22052 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:32.748613 22053 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:32.711787 22062 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:32.749687 22054 consensus_queue.cc:237] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:32.754405 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1786) took 1149 ms. Trace:
I20260709 13:18:32.647110 21987 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:18:32.740132 22034 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.228s
I20260709 13:18:32.758445 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:32.759625 21984 consensus_meta.cc:287] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.003s
I20260709 13:18:32.760582 22044 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:32.762776 22019 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:32.631981 22005 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
W20260709 13:18:32.767297 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.792913 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:32.809131 19508 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:32.761010 21973 consensus_queue.cc:237] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:32.814297 19585 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:32.711968 22056 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:32.816385 19587 rpcz_store.cc:276] 0709 13:18:31.605124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.605427 (+   303us) service_pool.cc:224] Handling call
0709 13:18:31.605843 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.730792 (+124949us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:31.759248 (+ 28456us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.847019 (+ 87771us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:31.847091 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:31.847157 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.754095 (+906938us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400227ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:32.754149 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.754309 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31333,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":11274,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":9373,"spinlock_wait_cycles":286837120,"thread_start_us":87292,"threads_started":1,"wal-append.queue_time_us":238452}
W20260709 13:18:32.822113 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.713287 22004 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.104s
I20260709 13:18:32.822954 19579 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:18:32.819707 21943 consensus_meta.cc:287] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.652s	user 0.002s	sys 0.007s
I20260709 13:18:32.810333 21993 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:32.832283 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:32.811136 21977 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:32.836369 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:32.817219 21652 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.846158 19587 raft_consensus.cc:2410] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:32.819054 21974 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:32.810405 22057 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:32.819082 22061 raft_consensus.cc:697] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:18:32.846645 19511 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.004s	sys 0.024s
W20260709 13:18:32.894132 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 255166us
I20260709 13:18:32.950145 19657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1545) took 2125 ms. Trace:
W20260709 13:18:32.983952 19511 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.004s	sys 0.028s
I20260709 13:18:32.984385 19657 rpcz_store.cc:276] 0709 13:18:30.824620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.172182 (+1347562us) service_pool.cc:224] Handling call
0709 13:18:32.172477 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:32.172820 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:32.172847 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:32.181077 (+  8230us) log.cc:844] Serialized 26 byte log entry
0709 13:18:32.473455 (+292378us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:32.473496 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.474334 (+   838us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.949933 (+475599us) raft_consensus.cc:1685] finished
0709 13:18:32.949951 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.950084 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":215,"raft.queue_time_us":2469,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":3892,"thread_start_us":249499,"threads_started":1,"wal-append.queue_time_us":311585}
I20260709 13:18:32.987560 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:32.956025 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:32.955608 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 583355us
I20260709 13:18:32.958519 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:32.886319 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1804) took 1149 ms. Trace:
I20260709 13:18:32.990664 19578 rpcz_store.cc:276] 0709 13:18:31.737560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.752034 (+ 14474us) service_pool.cc:224] Handling call
0709 13:18:31.777983 (+ 25949us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.861667 (+ 83684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.885973 (+1024306us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b54003d13d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:32.886241 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61979904}
I20260709 13:18:32.853771 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:32.989813 19627 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:32.993222 19579 raft_consensus.cc:2376] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10. Re-sending same reply.
W20260709 13:18:33.010955 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.012156 19478 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:33.014823 19478 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:33.014917 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:33.015682 19503 raft_consensus.cc:2393] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 4: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:33.016711 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:33.026615 22062 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.028613 22062 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:32.838626 22056 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:32.868610 22060 log.cc:927] Time spent T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.273s	user 0.000s	sys 0.000s
I20260709 13:18:33.036427 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:32.879297 21838 consensus_meta.cc:287] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.966s	user 0.011s	sys 0.000s
W20260709 13:18:32.954648 21981 consensus_meta.cc:287] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.829s	user 0.006s	sys 0.005s
W20260709 13:18:32.882126 21789 consensus_meta.cc:287] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.649s	user 0.003s	sys 0.006s
W20260709 13:18:32.992488 21985 consensus_meta.cc:287] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 1.465s	user 0.011s	sys 0.002s
W20260709 13:18:33.155210 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 140444us
I20260709 13:18:32.830545 21984 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:33.036973 19652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1519) took 1733 ms (client timeout 1510 ms). Trace:
W20260709 13:18:33.115128 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 122064us
W20260709 13:18:32.856909 22020 consensus_meta.cc:287] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.978s	user 0.008s	sys 0.001s
W20260709 13:18:33.035171 19660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59942 (request call id 92) took 2296 ms (client timeout 1545 ms). Trace:
W20260709 13:18:33.171327 19660 rpcz_store.cc:269] 0709 13:18:30.738583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.741717 (+  3134us) service_pool.cc:224] Handling call
0709 13:18:33.034819 (+2293102us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54000ae454. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:33.035022 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3445293824}
W20260709 13:18:32.862843 21904 consensus_meta.cc:287] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 1.175s	user 0.008s	sys 0.004s
W20260709 13:18:33.139814 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 103476us
I20260709 13:18:33.152005 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:32.873456 21947 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:32.895323 21979 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:33.049551 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 55239.8us
I20260709 13:18:33.159174 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:18:33.057421 21633 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:32.853507 22058 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.528s
I20260709 13:18:33.194778 22092 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:33.195436 22058 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:33.196353 22092 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:33.197014 22058 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:33.200402 19478 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:33.159857 22061 consensus_queue.cc:237] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:32.855086 21982 consensus_queue.cc:237] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:32.873826 19406 catalog_manager.cc:5697] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 3 to 4, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 4 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.163977 21789 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:33.205730 19406 catalog_manager.cc:5697] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 2 to 3, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 3 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.206851 21984 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.207542 21984 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:33.207968 21984 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:33.161459 22082 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:33.208372 21984 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:33.164455 19652 rpcz_store.cc:269] 0709 13:18:31.303205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.559465 (+256260us) service_pool.cc:224] Handling call
0709 13:18:33.036679 (+1477214us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b5400122fd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:33.036852 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2099552640}
W20260709 13:18:33.208748 22035 consensus_meta.cc:287] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 1.055s	user 0.000s	sys 0.014s
I20260709 13:18:33.169100 19503 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:33.209717 22052 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:33.160207 21782 consensus_meta.cc:287] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 1.007s	user 0.006s	sys 0.011s
I20260709 13:18:33.210384 21782 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.029306 22062 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:33.030323 22042 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:33.139402 22056 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:33.213768 21741 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.214519 22062 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:33.181385 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:33.216267 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.179097 22020 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.166846 21985 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.217911 19659 raft_consensus.cc:2393] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:33.218428 21633 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.218923 22020 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:33.219482 21985 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:33.163756 21981 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.220738 19657 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:18:33.221796 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 225201us
W20260709 13:18:33.218967 19659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1526) took 1508 ms (client timeout 1891 ms). Trace:
I20260709 13:18:32.847559 21943 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:32.992990 21974 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:33.200814 22048 consensus_meta.cc:287] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.663s	user 0.007s	sys 0.000s
I20260709 13:18:33.207326 19406 catalog_manager.cc:5697] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 3 to 6, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 6 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.212507 21782 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:32.874467 21957 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.181110 19578 raft_consensus.cc:2376] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8. Re-sending same reply.
I20260709 13:18:33.244144 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1505) took 1033 ms. Trace:
I20260709 13:18:33.244833 19578 rpcz_store.cc:276] 0709 13:18:32.210282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.106449 (+896167us) service_pool.cc:224] Handling call
0709 13:18:33.244059 (+137610us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.223467 19478 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:33.224049 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.187899 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:33.219784 19655 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:18:33.222816 19659 rpcz_store.cc:269] 0709 13:18:31.711343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.858907 (+147564us) service_pool.cc:224] Handling call
0709 13:18:33.218777 (+1359870us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54002170d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:33.218910 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3094181632}
I20260709 13:18:33.229004 19509 raft_consensus.cc:2368] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7.
I20260709 13:18:32.993680 21652 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:33.220965 21633 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.201426 22057 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:18:33.262611 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 44975.2us
I20260709 13:18:33.266198 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:33.257709 19406 catalog_manager.cc:5697] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 3 to 4, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 4 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:18:33.186834 21904 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.269137 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.209178 22035 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.197572 22058 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:33.239012 22062 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:33.273260 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:33.273742 19512 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:33.230301 22052 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:33.307389 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:33.271450 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1546) took 2437 ms. Trace:
W20260709 13:18:33.278388 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 54989.9us
I20260709 13:18:33.269524 19584 raft_consensus.cc:2393] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:33.304541 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.310865 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:33.311955 19551 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:33.270257 21990 consensus_meta.cc:287] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 1.386s	user 0.008s	sys 0.010s
I20260709 13:18:33.313241 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:18:33.274362 21855 consensus_meta.cc:287] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.859s	user 0.004s	sys 0.006s
I20260709 13:18:33.316017 19406 catalog_manager.cc:5697] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 1 to 4, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 4 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:18:33.268967 22082 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:33.315235 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1506) took 1104 ms. Trace:
I20260709 13:18:33.270504 21633 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:33.320374 19578 rpcz_store.cc:276] 0709 13:18:32.210545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.272913 (+1062368us) service_pool.cc:224] Handling call
0709 13:18:33.315171 (+ 42258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.264891 22088 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:33.322073 19506 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 8: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:18:33.322976 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 333074us
I20260709 13:18:33.309852 19653 rpcz_store.cc:276] 0709 13:18:30.834160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.238107 (+1403947us) service_pool.cc:224] Handling call
0709 13:18:32.238430 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:32.238741 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:32.238776 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:32.244860 (+  6084us) log.cc:844] Serialized 26 byte log entry
0709 13:18:32.509420 (+264560us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:32.509881 (+   461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.510147 (+   266us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:33.271198 (+761051us) raft_consensus.cc:1685] finished
0709 13:18:33.271222 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.271376 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10819,"raft.queue_time_us":3915,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":44597,"thread_start_us":96862,"threads_started":1,"wal-append.queue_time_us":154186}
I20260709 13:18:33.305310 22058 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.301327 22057 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:33.271075 21985 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:18:33.260412 22048 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.323133 22082 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.319018 21947 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:33.325999 21981 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:33.333395 19653 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:33.303615 22062 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.314153 21979 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:33.338992 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:33.329309 19627 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.334450 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:33.322604 21855 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.320938 21990 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:33.520324 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.429247 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:33.484766 19553 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:60808 dropped due to backpressure: service queue is full with 50 items
I20260709 13:18:33.521831 19578 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:33.483464 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:33.634716 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1564) took 2074 ms. Trace:
I20260709 13:18:33.427578 19661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1532) took 1586 ms. Trace:
I20260709 13:18:33.635110 19653 rpcz_store.cc:276] 0709 13:18:31.560680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.332667 (+1771987us) service_pool.cc:224] Handling call
0709 13:18:33.333074 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.528256 (+195182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.634661 (+106405us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.635246 19661 rpcz_store.cc:276] 0709 13:18:31.841475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.148073 (+306598us) service_pool.cc:224] Handling call
0709 13:18:33.427373 (+1279300us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b5400102054. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:33.427519 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1071112448}
I20260709 13:18:33.636909 19661 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:33.375073 19586 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:33.621343 22050 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.329713 21959 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:33.318845 22083 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:18:33.455749 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 143846us
I20260709 13:18:33.638212 22050 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.638703 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:33.639693 21948 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:33.639846 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.640681 21948 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:33.641177 21948 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.421588 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1801) took 1709 ms. Trace:
I20260709 13:18:33.641587 21948 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:33.641793 19583 rpcz_store.cc:276] 0709 13:18:31.711811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.741714 (+ 29903us) service_pool.cc:224] Handling call
0709 13:18:31.765899 (+ 24185us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.766215 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.766242 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.766677 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:18:32.763610 (+996933us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b1800385840. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa0d1 00007f6c31715a0f
0709 13:18:33.047190 (+283580us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:33.047242 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.047331 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:33.421273 (+373942us) raft_consensus.cc:1685] finished
0709 13:18:33.421292 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.421524 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":821,"raft.queue_time_us":29530,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":9663,"spinlock_wait_cycles":12547840,"thread_start_us":283366,"threads_started":1,"wal-append.queue_time_us":1516043}
I20260709 13:18:33.402932 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1556) took 2566 ms. Trace:
I20260709 13:18:33.643682 19658 rpcz_store.cc:276] 0709 13:18:30.836861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.952272 (+2115411us) service_pool.cc:224] Handling call
0709 13:18:32.956661 (+  4389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:32.957016 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:32.957047 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:32.992729 (+ 35682us) log.cc:844] Serialized 26 byte log entry
0709 13:18:33.322426 (+329697us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:33.322667 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.322899 (+   232us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:33.402664 (+ 79765us) raft_consensus.cc:1685] finished
0709 13:18:33.402690 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.402849 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25179,"raft.queue_time_us":31396,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":37540,"thread_start_us":154339,"threads_started":1,"wal-append.queue_time_us":277281}
I20260709 13:18:33.645676 19658 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:18:33.646241 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1531) took 1805 ms. Trace:
I20260709 13:18:33.646533 19658 rpcz_store.cc:276] 0709 13:18:31.841207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.645082 (+1803875us) service_pool.cc:224] Handling call
0709 13:18:33.645419 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:33.646005 (+   586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.646192 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.647799 19658 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:33.648259 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1567) took 1468 ms. Trace:
I20260709 13:18:33.648526 19658 rpcz_store.cc:276] 0709 13:18:32.179590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.647223 (+1467633us) service_pool.cc:224] Handling call
0709 13:18:33.647482 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.648066 (+   584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.648216 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.648604 19410 catalog_manager.cc:5697] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.347705 21947 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:33.418464 22094 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:18:33.344831 19406 catalog_manager.cc:5697] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 3 to 6, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 6 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.421358 22012 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:33.416489 21930 consensus_meta.cc:287] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.902s	user 0.010s	sys 0.002s
I20260709 13:18:33.639874 21990 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.524542 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1913) took 1358 ms. Trace:
I20260709 13:18:33.668030 19410 catalog_manager.cc:5697] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 5 to 7, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 7 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.670082 19511 rpcz_store.cc:276] 0709 13:18:32.166355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.166511 (+   156us) service_pool.cc:224] Handling call
0709 13:18:32.166758 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.167602 (+   844us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:32.991785 (+824183us) log.cc:844] Serialized 14 byte log entry
0709 13:18:33.524171 (+532386us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:33.524225 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:33.524274 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.524343 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.524475 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50177,"prepare.queue_time_us":419165,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":8533,"raft.queue_time_us":57480,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":22806,"thread_start_us":1073460,"threads_started":2,"wal-append.queue_time_us":405281}
I20260709 13:18:33.672258 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:33.672799 19511 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.659310 21974 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.667075 22004 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:33.674429 22004 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.676604 22004 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.667457 21947 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.676465 19406 catalog_manager.cc:5697] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 6 to 7, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 7 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:18:33.678396 22004 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:33.678136 19406 catalog_manager.cc:5697] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 2 to 4, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 4 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.678900 22004 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.679895 19406 catalog_manager.cc:5697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 3 to 4, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 4 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:33.311786 19510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.008s	sys 0.010s
W20260709 13:18:33.681813 19510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.008s	sys 0.010s
I20260709 13:18:33.682536 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1921) took 1476 ms. Trace:
I20260709 13:18:33.520985 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1563) took 1960 ms. Trace:
I20260709 13:18:33.684036 19660 rpcz_store.cc:276] 0709 13:18:31.560457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.263360 (+1702903us) service_pool.cc:224] Handling call
0709 13:18:33.272308 (+  8948us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.300026 (+ 27718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.300057 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:33.305631 (+  5574us) log.cc:844] Serialized 26 byte log entry
0709 13:18:33.520497 (+214866us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:33.520546 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.520628 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:33.520687 (+    59us) raft_consensus.cc:1685] finished
0709 13:18:33.520705 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.520907 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27342,"raft.queue_time_us":28915,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":11297,"thread_start_us":190282,"threads_started":1,"wal-append.queue_time_us":113335}
W20260709 13:18:33.544693 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.428655 21904 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.391507 21957 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:33.687381 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59942 (request call id 94) took 1319 ms. Trace:
I20260709 13:18:33.488276 21652 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:33.669661 21963 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:33.425216 22048 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.526046 22062 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.693269 21963 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.696053 21963 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.696663 22050 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.689522 21930 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.343102 21789 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:33.620698 20662 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:33.390051 20659 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:18:33.392462 22089 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:18:33.371073 21964 consensus_meta.cc:287] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.863s	user 0.010s	sys 0.000s
W20260709 13:18:33.423897 22038 consensus_meta.cc:287] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.983s	user 0.010s	sys 0.000s
W20260709 13:18:33.702121 19584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1474) took 1876 ms (client timeout 1599 ms). Trace:
I20260709 13:18:33.702346 22038 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:33.702630 19584 rpcz_store.cc:269] 0709 13:18:31.826156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.901556 (+ 75400us) service_pool.cc:224] Handling call
0709 13:18:33.701895 (+1800339us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400107a54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:33.702040 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2980456192}
I20260709 13:18:33.703830 19656 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:33.704682 22038 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.336247 22057 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.705430 22057 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:33.706384 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1559) took 2675 ms. Trace:
I20260709 13:18:33.706807 19656 rpcz_store.cc:276] 0709 13:18:31.031250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.985786 (+1954536us) service_pool.cc:224] Handling call
0709 13:18:33.113990 (+128204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.704296 (+590306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.706061 (+  1765us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b54000e74d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:33.706293 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1356036864}
I20260709 13:18:33.702105 21964 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.712459 21964 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:33.630613 22090 log.cc:927] Time spent T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.413s	user 0.007s	sys 0.000s
I20260709 13:18:33.631839 21054 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:18:33.621541 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 292605us
I20260709 13:18:33.715047 19627 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.716293 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.523171 19504 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 7: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:33.444368 22035 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.634091 19580 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:33.446332 19478 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:33.335016 22052 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:33.747092 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 300841us
I20260709 13:18:33.747378 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:33.748520 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.634843 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1529) took 1202 ms. Trace:
I20260709 13:18:33.750799 19578 rpcz_store.cc:276] 0709 13:18:32.432797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.325742 (+892945us) service_pool.cc:224] Handling call
0709 13:18:33.634784 (+309042us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.326727 22080 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:33.634325 21981 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.351478 22082 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:33.637437 19661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1530) took 1796 ms. Trace:
I20260709 13:18:33.779452 19661 rpcz_store.cc:276] 0709 13:18:31.840828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.636331 (+1795503us) service_pool.cc:224] Handling call
0709 13:18:33.636595 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.637221 (+   626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.637380 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.651435 19658 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:33.641479 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.428378 22010 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:33.663594 19581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1785) took 2085 ms (client timeout 1542 ms). Trace:
W20260709 13:18:33.787708 19581 rpcz_store.cc:269] 0709 13:18:31.578467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.578591 (+   124us) service_pool.cc:224] Handling call
0709 13:18:33.663367 (+2084776us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b540011d5d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:33.663503 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1301457664}
I20260709 13:18:33.789192 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:33.790060 19581 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:33.790521 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1510) took 1579 ms. Trace:
I20260709 13:18:33.790428 19627 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.633334 22056 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.417758 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:33.794338 19503 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.682991 19510 rpcz_store.cc:276] 0709 13:18:32.206168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.504392 (+298224us) service_pool.cc:224] Handling call
0709 13:18:32.515659 (+ 11267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.515869 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:32.609512 (+ 93643us) log.cc:844] Serialized 14 byte log entry
0709 13:18:33.682170 (+1072658us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:33.682233 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:33.682281 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.682348 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.682475 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":93906,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":110907,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":12088,"thread_start_us":1153962,"threads_started":3,"wal-append.queue_time_us":211124}
I20260709 13:18:33.689198 19660 rpcz_store.cc:276] 0709 13:18:32.368110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.686228 (+1318118us) service_pool.cc:224] Handling call
0709 13:18:33.686677 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.686925 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.686962 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:33.687023 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:33.687069 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.687141 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.687302 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.402616 21943 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.700279 21930 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:33.710634 19582 raft_consensus.cc:2368] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7.
I20260709 13:18:33.632241 21820 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:33.680918 22004 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.637439 21984 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:33.729054 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:33.676637 21948 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.814474 19504 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:33.782642 21054 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:33.781304 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1570) took 1600 ms. Trace:
I20260709 13:18:33.783818 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:33.523075 19553 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:60808 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1507)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1508)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35102 (request call id 124)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1813)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1538)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1542)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1528)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1472)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1473)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1480)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 121)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1519)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1532)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1535)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1540)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1541)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1543)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1545)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1547)
W20260709 13:18:33.786206 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 144787us
I20260709 13:18:33.815671 19661 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.816460 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.817925 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.335973 21956 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.222s
I20260709 13:18:33.791054 19581 rpcz_store.cc:276] 0709 13:18:32.211473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.788887 (+1577414us) service_pool.cc:224] Handling call
0709 13:18:33.790465 (+  1578us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.791975 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.781725 22050 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:33.821664 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:33.822357 19581 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 7.
W20260709 13:18:33.790331 22061 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.012s	sys 0.018s
I20260709 13:18:33.805272 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:33.792520 22038 raft_consensus.cc:2764] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:18:33.750532 19478 leader_election.cc:336] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.168s (SENT)
I20260709 13:18:33.797209 22019 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:33.791024 21961 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.819185 19505 raft_consensus.cc:2393] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 8: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:33.815460 19658 rpcz_store.cc:276] 0709 13:18:32.180466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.649264 (+1468798us) service_pool.cc:224] Handling call
0709 13:18:33.649523 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.780933 (+131410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.781232 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.840778 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:33.841528 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1512) took 1629 ms. Trace:
I20260709 13:18:33.842043 19581 rpcz_store.cc:276] 0709 13:18:32.211927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.823242 (+1611315us) service_pool.cc:224] Handling call
0709 13:18:33.841475 (+ 18233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.795728 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:33.796461 22054 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:33.827889 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:33.828670 19660 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.804456 21820 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:33.829937 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 79446.1us
W20260709 13:18:33.848553 19478 leader_election.cc:336] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.183s (SENT)
W20260709 13:18:33.799990 21982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.018s	sys 0.023s
I20260709 13:18:33.833285 19627 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.848913 19478 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:33.827118 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:33.786316 21981 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.836216 19503 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:33.850929 19627 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.851984 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:33.835306 19504 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:33.841486 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:33.825034 19511 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
W20260709 13:18:33.828281 22061 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.012s	sys 0.018s
I20260709 13:18:33.846159 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59942 (request call id 96) took 1331 ms. Trace:
I20260709 13:18:33.822080 21943 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:33.844969 21930 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:33.782900 22062 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.853078 19658 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 3.
I20260709 13:18:33.875212 22056 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.837561 22019 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:33.875970 22019 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:33.836674 22010 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:33.877815 22010 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.847687 21961 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:33.878237 22010 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:33.855167 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:33.860399 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:33.843844 22052 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:33.861694 21930 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:33.863363 22033 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:33.865935 22079 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.672s	user 0.004s	sys 0.000s
I20260709 13:18:33.859831 19656 rpcz_store.cc:276] 0709 13:18:32.514999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.707745 (+1192746us) service_pool.cc:224] Handling call
0709 13:18:33.708081 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.708279 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:33.830514 (+122235us) log.cc:844] Serialized 14 byte log entry
0709 13:18:33.845781 (+ 15267us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:33.845839 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:33.845890 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.845968 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.846093 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":150437,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":104,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":3412,"thread_start_us":136722,"threads_started":2}
I20260709 13:18:33.866664 21948 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.849370 21820 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:33.891667 22034 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.901443 22034 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.903995 22034 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:33.868489 21981 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:33.860854 21943 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.868817 21984 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:33.853958 21985 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:33.849053 21982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.023s	sys 0.023s
I20260709 13:18:33.871991 21947 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.859144 21789 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:33.875407 19658 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7. Ops: [4.2-6.3]
I20260709 13:18:33.910264 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1536) took 1394 ms. Trace:
I20260709 13:18:33.910347 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1535) took 1394 ms. Trace:
I20260709 13:18:33.910575 19656 rpcz_store.cc:276] 0709 13:18:32.515875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.895010 (+1379135us) service_pool.cc:224] Handling call
0709 13:18:33.909812 (+ 14802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.909946 (+   134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.910033 (+    87us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:33.910074 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:33.910109 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.910143 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.910221 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.910980 19658 rpcz_store.cc:276] 0709 13:18:32.515466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.874763 (+1359297us) service_pool.cc:224] Handling call
0709 13:18:33.875138 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:33.909963 (+ 34825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.910280 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.852048 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.862318 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:33.883088 19660 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:33.913156 19660 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:33.913736 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1538) took 1392 ms. Trace:
I20260709 13:18:33.914023 19660 rpcz_store.cc:276] 0709 13:18:32.521491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.912724 (+1391233us) service_pool.cc:224] Handling call
0709 13:18:33.912982 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.913476 (+   494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.913692 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.859493 22038 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:33.846938 22054 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:33.884869 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.847752 22015 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:33.859086 22058 consensus_meta.cc:287] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.007s
I20260709 13:18:33.890228 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:33.919790 19510 raft_consensus.cc:2368] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7.
I20260709 13:18:33.854074 21855 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:33.859969 21980 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:33.897012 19661 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:33.885604 21990 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:33.875204 22062 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.881568 21961 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:33.889845 21930 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:33.914978 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 62990.1us
I20260709 13:18:33.919266 22054 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.915915 19581 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:33.920512 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:33.940945 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1513) took 1728 ms. Trace:
I20260709 13:18:33.941378 19581 rpcz_store.cc:276] 0709 13:18:32.212146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.850100 (+1637954us) service_pool.cc:224] Handling call
0709 13:18:33.940868 (+ 90768us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.907155 21943 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:33.946552 20661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59444 (request call id 81) took 2131 ms. Trace:
I20260709 13:18:33.946982 20661 rpcz_store.cc:276] 0709 13:18:31.814873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.817785 (+  2912us) service_pool.cc:224] Handling call
0709 13:18:31.886489 (+ 68704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.374448 (+487959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.946249 (+1571801us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b5400599cd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:33.946465 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":727510784}
I20260709 13:18:33.947494 21980 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.948074 21980 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.950173 21980 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:33.904592 22057 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:33.921384 19625 leader_election.cc:336] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Timed out: RequestConsensusVote RPC to 127.17.251.129:38645 timed out after 1.664s (SENT)
I20260709 13:18:33.922183 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:33.925035 19661 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:33.917193 21956 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:33.922780 21948 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:33.953050 19625 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.928831 22003 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.930963 21959 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:33.931651 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1565) took 2370 ms. Trace:
W20260709 13:18:33.931702 19655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1543) took 3120 ms (client timeout 1925 ms). Trace:
I20260709 13:18:33.889122 22052 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.888139 22033 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:33.970302 22033 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.971489 22033 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.972101 22057 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.975612 22019 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:33.986032 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.979279 21943 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.941926 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:33.987362 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 45778.4us
I20260709 13:18:33.987921 22019 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:33.953188 19510 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:33.961665 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:33.961287 19654 rpcz_store.cc:276] 0709 13:18:31.560922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.576717 (+2015795us) service_pool.cc:224] Handling call
0709 13:18:33.632875 (+ 56158us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.633298 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.633331 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:33.633885 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:18:33.784458 (+150573us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:33.784502 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.784572 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:33.931426 (+146854us) raft_consensus.cc:1685] finished
0709 13:18:33.931449 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.931594 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5193,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":143651,"threads_started":1,"wal-append.queue_time_us":207831}
I20260709 13:18:33.964234 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:33.952440 21990 consensus_queue.cc:1059] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:18:33.961127 21948 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:33.962001 19655 rpcz_store.cc:269] 0709 13:18:30.811175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.817515 (+  6340us) service_pool.cc:224] Handling call
0709 13:18:33.929515 (+3112000us) spinlock_profiling.cc:243] Waited 2.36 s on lock 0x7b540032b9d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:33.931633 (+  2118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5427178240}
I20260709 13:18:33.966938 22052 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.924001 22058 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.968696 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.018626 19584 raft_consensus.cc:2410] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:18:33.977037 22101 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.935735 19627 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:33.978070 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:33.979486 22104 log.cc:927] Time spent T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.349s	user 0.001s	sys 0.000s
I20260709 13:18:33.953209 22062 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:33.981707 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:33.986572 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.988129 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:34.033284 19579 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:34.034054 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 46020.5us
I20260709 13:18:34.035104 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.035646 19551 leader_election.cc:400] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10.
I20260709 13:18:34.036031 19551 leader_election.cc:403] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:33.943615 21947 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:33.988401 22054 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:33.989295 21959 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:33.989902 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.045120 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1811) took 1152 ms. Trace:
I20260709 13:18:34.045430 19585 rpcz_store.cc:276] 0709 13:18:32.892460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.989551 (+1097091us) service_pool.cc:224] Handling call
0709 13:18:34.045048 (+ 55497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.046295 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.046888 19585 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:34.047333 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1813) took 1154 ms. Trace:
I20260709 13:18:33.929272 21820 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.050228 21957 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:34.050685 21957 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:34.051076 21957 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:34.051602 21820 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:33.991410 19657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1573) took 1019 ms. Trace:
I20260709 13:18:34.052304 19657 rpcz_store.cc:276] 0709 13:18:32.972389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.987294 (+ 14905us) service_pool.cc:224] Handling call
0709 13:18:33.991128 (+1003834us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b540032b4d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:33.991335 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534465408}
I20260709 13:18:34.053293 19653 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:33.992138 19652 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:34.042421 22067 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:33.992316 22080 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:33.993487 22012 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:34.054870 22012 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.055253 22012 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:34.056197 22054 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:34.018095 22010 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.019560 22110 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:34.059809 22010 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:34.000792 19578 raft_consensus.cc:2368] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7.
I20260709 13:18:34.043202 22101 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:34.060591 19505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1476) took 1536 ms (client timeout 1970 ms). Trace:
I20260709 13:18:33.995352 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.061668 21943 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:34.003188 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:34.061111 19505 rpcz_store.cc:269] 0709 13:18:32.523960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.578525 (+ 54565us) service_pool.cc:224] Handling call
0709 13:18:34.060397 (+1481872us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001ef0d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:34.060533 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2803935488}
I20260709 13:18:34.064041 22101 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:34.000816 19661 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.064679 19511 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:34.064919 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1473) took 1543 ms. Trace:
I20260709 13:18:34.020340 19581 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.065323 19508 rpcz_store.cc:276] 0709 13:18:32.521167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.830082 (+308915us) service_pool.cc:224] Handling call
0709 13:18:32.830398 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.325400 (+495002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.325433 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:33.334706 (+  9273us) log.cc:844] Serialized 26 byte log entry
0709 13:18:33.487651 (+152945us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:33.487705 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.978866 (+491161us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:18:34.045527 (+ 66661us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54001e0d54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:34.045576 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:34.064734 (+ 19158us) raft_consensus.cc:1685] finished
0709 13:18:34.064752 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.064863 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16130,"raft.queue_time_us":16280,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":8763,"spinlock_wait_cycles":1091684352,"thread_start_us":96330,"threads_started":1,"wal-append.queue_time_us":162626}
W20260709 13:18:34.024997 19584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1508) took 1814 ms (client timeout 2183 ms). Trace:
W20260709 13:18:34.067153 19584 rpcz_store.cc:269] 0709 13:18:32.211015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.952044 (+1741029us) service_pool.cc:224] Handling call
0709 13:18:34.024924 (+ 72880us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.068154 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.027727 22052 raft_consensus.cc:3055] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:34.070112 22052 raft_consensus.cc:740] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:34.070957 22052 consensus_queue.cc:260] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:34.072350 22052 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.072645 19652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1504) took 2939 ms. Trace:
I20260709 13:18:34.073032 19652 rpcz_store.cc:276] 0709 13:18:31.133121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.209217 (+2076096us) service_pool.cc:224] Handling call
0709 13:18:33.991877 (+782660us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.054113 (+ 62236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.072449 (+ 18336us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b540032b4d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:34.072585 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1799281024}
W20260709 13:18:34.075142 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 226595us
W20260709 13:18:34.075773 19478 leader_election.cc:336] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.211s (SENT)
W20260709 13:18:34.076664 19478 leader_election.cc:336] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.239s (SENT)
I20260709 13:18:34.077005 19478 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:34.077817 22035 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.078900 22080 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:34.078504 22035 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:34.080566 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1566) took 2504 ms. Trace:
I20260709 13:18:34.081009 19653 rpcz_store.cc:276] 0709 13:18:31.575841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.636131 (+2060290us) service_pool.cc:224] Handling call
0709 13:18:33.636412 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.053734 (+417322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.080306 (+ 26572us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54000ada54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:34.080501 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958314368}
I20260709 13:18:33.997211 21930 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:34.006083 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 84717.2us
W20260709 13:18:34.040823 19512 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1926) took 1700 ms (client timeout 1558 ms). Trace:
W20260709 13:18:34.042821 19580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1806) took 2256 ms (client timeout 1905 ms). Trace:
W20260709 13:18:34.043529 19582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1493) took 2076 ms (client timeout 1931 ms). Trace:
I20260709 13:18:34.004271 21948 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.047674 19585 rpcz_store.cc:276] 0709 13:18:32.893055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.046095 (+1153040us) service_pool.cc:224] Handling call
0709 13:18:34.047285 (+  1190us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:34.049075 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 113441us
I20260709 13:18:34.049232 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.044693 21990 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:18:34.060717 19578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1509) took 1849 ms (client timeout 2211 ms). Trace:
I20260709 13:18:34.037227 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:34.038336 19509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 1903) took 1888 ms (client timeout 1664 ms). Trace:
I20260709 13:18:34.064249 19505 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:34.084019 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:34.090984 19478 leader_election.cc:336] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.319s (SENT)
I20260709 13:18:34.084419 19625 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:34.084729 19580 rpcz_store.cc:269] 0709 13:18:31.786363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.810228 (+ 23865us) service_pool.cc:224] Handling call
0709 13:18:34.042570 (+2232342us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b5400107554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:34.042747 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3987274624}
I20260709 13:18:34.092365 19625 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:34.084920 19582 rpcz_store.cc:269] 0709 13:18:31.967064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.376430 (+409366us) service_pool.cc:224] Handling call
0709 13:18:34.029945 (+1653515us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400226fd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:34.043428 (+ 13483us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3066312576}
I20260709 13:18:34.087075 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1467) took 2346 ms. Trace:
I20260709 13:18:34.088390 19587 raft_consensus.cc:2410] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:34.093518 19625 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:34.091466 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:34.107343 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1523) took 1867 ms. Trace:
I20260709 13:18:34.087445 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.087940 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:34.085707 19511 raft_consensus.cc:1275] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:34.109401 19585 raft_consensus.cc:2410] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:18:34.086683 19586 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1520) took 1867 ms (client timeout 1997 ms). Trace:
I20260709 13:18:34.106880 19506 rpcz_store.cc:276] 0709 13:18:31.741143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.741278 (+   135us) service_pool.cc:224] Handling call
0709 13:18:34.086853 (+2345575us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400402754. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:34.086992 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3483865984}
W20260709 13:18:34.090250 19578 rpcz_store.cc:269] 0709 13:18:32.211236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.951368 (+1740132us) service_pool.cc:224] Handling call
0709 13:18:34.060659 (+109291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.108099 19587 rpcz_store.cc:276] 0709 13:18:32.241825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.028050 (+1786225us) service_pool.cc:224] Handling call
0709 13:18:34.107274 (+ 79224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.109543 19661 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 6.
W20260709 13:18:34.084586 19512 rpcz_store.cc:269] 0709 13:18:32.340044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.379330 (+ 39286us) service_pool.cc:224] Handling call
0709 13:18:34.040630 (+1661300us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b54002085d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:34.040759 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2053894912}
W20260709 13:18:34.090366 19509 rpcz_store.cc:269] 0709 13:18:32.150271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.150880 (+   609us) service_pool.cc:224] Handling call
0709 13:18:34.038140 (+1887260us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002aa3d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:34.038271 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2457644416}
I20260709 13:18:34.114524 19579 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:34.115490 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1808) took 1223 ms. Trace:
W20260709 13:18:34.110301 19586 rpcz_store.cc:269] 0709 13:18:32.219164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.536198 (+317034us) service_pool.cc:224] Handling call
0709 13:18:34.086475 (+1550277us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b54002fce54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:34.086607 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1882182016}
W20260709 13:18:34.091377 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 54251.8us
W20260709 13:18:34.117758 19583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1507) took 1907 ms (client timeout 2168 ms). Trace:
W20260709 13:18:34.118300 19478 leader_election.cc:336] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.395s (SENT)
W20260709 13:18:34.118219 19583 rpcz_store.cc:269] 0709 13:18:32.210780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.029436 (+1818656us) service_pool.cc:224] Handling call
0709 13:18:34.117695 (+ 88259us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:34.119297 19478 leader_election.cc:336] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.841s (SENT)
I20260709 13:18:34.107636 19581 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
W20260709 13:18:34.106432 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 59132.2us
I20260709 13:18:34.115918 19579 rpcz_store.cc:276] 0709 13:18:32.891605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.981366 (+1089761us) service_pool.cc:224] Handling call
0709 13:18:34.115409 (+134043us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.118219 19625 leader_election.cc:400] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7.
I20260709 13:18:34.120951 19625 leader_election.cc:403] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:18:34.130532 19478 leader_election.cc:336] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.672s (SENT)
I20260709 13:18:34.120065 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1809) took 1228 ms. Trace:
I20260709 13:18:34.134747 19581 rpcz_store.cc:276] 0709 13:18:32.891895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.955538 (+1063643us) service_pool.cc:224] Handling call
0709 13:18:34.119980 (+164442us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.143695 19652 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:34.143929 19653 raft_consensus.cc:1275] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:34.124987 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1514) took 1912 ms. Trace:
I20260709 13:18:34.144840 19585 rpcz_store.cc:276] 0709 13:18:32.212376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.087192 (+1874816us) service_pool.cc:224] Handling call
0709 13:18:34.124921 (+ 37729us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.148679 19508 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:34.152777 19627 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:34.157217 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:34.161787 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:34.158634 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:34.164149 19652 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:34.075723 22050 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:34.164927 19625 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:34.078939 22058 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:34.173308 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:34.174742 19655 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 8: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:34.173319 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.165822 19553 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:60800 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1538)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1542)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1561)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1528)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35102 (request call id 126)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1562)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1472)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1473)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1480)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 121)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1519)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1532)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1535)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1540)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1541)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1543)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1545)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1553)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1814)
I20260709 13:18:34.081597 22035 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:34.180604 22037 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:18:34.180943 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:34.181391 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:34.193825 19507 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:34.161849 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:34.181737 21977 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:34.181995 19505 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:18:34.163319 21982 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7.
I20260709 13:18:34.182101 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:34.183849 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:34.128716 21961 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:34.214670 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:34.215399 20662 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:34.185715 21956 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:34.184072 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.216192 21956 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.216675 21956 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.217343 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.218163 19505 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:34.218919 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.220211 19505 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:34.186364 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.124009 22110 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:34.222012 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:34.222159 22110 raft_consensus.cc:697] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:34.222703 19506 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:34.126226 21984 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:34.223068 22110 consensus_queue.cc:237] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.190053 19653 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:34.125890 22020 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:34.232463 22020 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.232980 22020 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:34.173264 22019 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:34.139233 22062 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:34.234764 22019 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.235342 22019 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.164306 22010 consensus_queue.cc:1059] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:18:34.195295 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:34.238633 22010 consensus_queue.cc:1243] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:34.198500 19658 raft_consensus.cc:2393] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:18:34.239320 22010 raft_consensus.cc:3055] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:34.239773 22010 raft_consensus.cc:740] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:34.021297 22082 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.167124 21943 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:18:34.204638 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:34.205056 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:34.205685 21980 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:34.208354 20659 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:34.208854 21855 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:34.088090 22015 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 13:18:34.209925 21985 consensus_queue.cc:1048] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:34.210012 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:34.151891 21652 consensus_queue.cc:1059] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:18:34.214881 21961 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:34.215447 19509 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:34.124390 21960 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:34.216692 19580 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 8: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:34.306639 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:34.174326 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:34.231164 22035 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:34.231702 21930 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:34.238874 19657 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:34.310779 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:34.247041 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:34.312011 19660 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:34.313122 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:34.248679 19627 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:34.249099 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:34.315701 19658 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:34.249481 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.316370 19512 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:34.317494 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.178043 19553 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60800 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1538)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1542)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1561)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1528)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35102 (request call id 126)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1562)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1472)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1473)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1480)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 121)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1519)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1532)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1535)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1540)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1541)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1543)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1545)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1553)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1814)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1818)
I20260709 13:18:34.254598 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:34.268350 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:34.297685 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:34.320119 19506 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:34.240800 22010 consensus_queue.cc:260] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.302511 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:34.325523 19655 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:34.302523 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.303431 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:34.162694 21703 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:18:34.327069 19503 raft_consensus.cc:2410] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:34.307885 19551 leader_election.cc:400] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8.
I20260709 13:18:34.248654 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.330516 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:34.322048 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 73466.8us
I20260709 13:18:34.332484 19580 raft_consensus.cc:2393] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:34.300613 22057 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:34.323550 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:34.201318 21977 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.332484 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.334261 19551 leader_election.cc:403] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:18:34.334551 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:34.333273 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.337072 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:34.316109 22032 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.099s	user 0.005s	sys 0.015s
I20260709 13:18:34.310664 22035 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:34.306210 21943 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:34.343058 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:34.326848 21652 consensus_queue.cc:1243] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:34.352367 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:34.343678 19478 leader_election.cc:336] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 3.200s (SENT)
I20260709 13:18:34.310668 22067 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:34.355232 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:34.363004 19657 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:34.330161 22061 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:34.374852 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.253261 21959 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.355233 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.379999 19506 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 7: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:34.329020 22095 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:34.383487 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:34.383994 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 52637.1us
I20260709 13:18:34.339046 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:34.367349 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.389412 22082 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:34.391052 21948 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.356454 21789 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:34.399665 19504 raft_consensus.cc:2393] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:18:34.344110 22032 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.005s	sys 0.015s
I20260709 13:18:34.316212 22012 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.344009 21947 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8.
I20260709 13:18:34.395291 22010 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:34.398708 19658 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:34.356954 19478 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:34.344545 22057 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.366729 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1473) took 2540 ms. Trace:
I20260709 13:18:34.378890 22061 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.423571 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.423797 22061 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.424356 19587 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:34.425187 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.426193 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.427706 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.428481 19505 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 5: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:34.339488 21993 consensus_queue.cc:1059] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 13:18:34.400861 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 248953us
I20260709 13:18:34.402009 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.360956 21943 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:34.394176 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.418671 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:34.401103 21789 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.420818 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:34.423352 19553 rpcz_store.cc:276] 0709 13:18:31.825907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.366631 (+2540724us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:18:34.348228 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:34.438792 19657 raft_consensus.cc:2410] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:18:34.439285 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 91263.5us
I20260709 13:18:34.439621 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:34.429477 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 85843.7us
I20260709 13:18:34.429632 22128 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:34.432070 19658 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:34.445361 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:34.400305 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.450309 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:34.451086 19658 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 7: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:34.433336 19476 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:34.435302 21977 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:34.413349 21960 raft_consensus.cc:697] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:34.455448 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.454493 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:34.456737 19658 raft_consensus.cc:2393] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:34.439566 20662 raft_consensus.cc:2393] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:18:34.438681 19553 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60808 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1561)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1528)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35102 (request call id 126)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1562)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1472)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1480)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 121)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1519)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1532)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1535)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1540)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1541)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1543)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1545)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1553)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1814)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1818)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1820)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1821)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1824)
I20260709 13:18:34.457587 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:34.452934 19476 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:34.454054 19580 raft_consensus.cc:2410] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 7 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:34.379145 22067 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.456105 19582 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:34.429692 21993 raft_consensus.cc:3055] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:34.466773 21993 raft_consensus.cc:740] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:34.467257 22067 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:34.467876 22067 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:34.467670 21993 consensus_queue.cc:260] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.468889 21993 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.470364 19587 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:34.472132 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1539) took 1021 ms. Trace:
I20260709 13:18:34.472465 19587 rpcz_store.cc:276] 0709 13:18:33.450392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.425962 (+975570us) service_pool.cc:224] Handling call
0709 13:18:34.471944 (+ 45982us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b5400227ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:34.472070 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100256512}
I20260709 13:18:34.442934 21789 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.474776 19627 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:34.459002 21703 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:34.440691 19478 leader_election.cc:336] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 3.317s (SENT)
I20260709 13:18:34.442133 21904 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
W20260709 13:18:34.478394 22118 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.089s	user 0.000s	sys 0.003s
I20260709 13:18:34.478222 21703 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:34.478948 21703 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:34.480803 22119 log.cc:927] Time spent T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:18:34.481710 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1562) took 2921 ms. Trace:
I20260709 13:18:34.481824 21990 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10.
I20260709 13:18:34.482146 19659 rpcz_store.cc:276] 0709 13:18:31.560203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.253976 (+1693773us) service_pool.cc:224] Handling call
0709 13:18:33.254460 (+   484us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:33.255049 (+   589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.255094 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:33.997094 (+742000us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b2c0002b1b8. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:18:33.997755 (+   661us) log.cc:844] Serialized 52 byte log entry
0709 13:18:34.327867 (+330112us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:34.327928 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.328031 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:34.477763 (+149732us) spinlock_profiling.cc:243] Waited 6.04 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:18:34.481444 (+  3681us) raft_consensus.cc:1685] finished
0709 13:18:34.481473 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.481651 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8615,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6833,"spinlock_wait_cycles":22119936,"thread_start_us":329623,"threads_started":1,"wal-append.queue_time_us":390796}
I20260709 13:18:34.484259 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:34.461499 21960 consensus_queue.cc:237] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.462001 21948 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:34.486730 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:34.464184 22121 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:18:34.496348 19476 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:34.498200 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:34.460839 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:34.489068 19584 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:34.478471 19478 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:34.500859 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 60208.9us
I20260709 13:18:34.463654 19553 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60800 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1561)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1528)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1832)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35102 (request call id 126)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1562)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1472)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1480)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 121)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1519)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1532)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1535)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1540)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1541)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1543)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1545)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1553)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1814)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1818)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1820)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1821)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1824)
I20260709 13:18:34.449172 21947 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:34.503157 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.386572 21961 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.503401 19658 raft_consensus.cc:2393] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:34.487876 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:34.510424 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.514969 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.515456 19587 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.469156 21956 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.504225 22095 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:34.508756 21977 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:34.521661 22117 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:18:34.522442 22129 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:18:34.524309 22019 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:34.537412 21943 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:34.538641 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.539070 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:34.513610 21904 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:34.543037 19395 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d05498e224814b9b8f31e3f965ab2583 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d56df3728fc04e37b2d29a3bcd91d167 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:34.514111 21984 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:18:34.587373 19395 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 44404.3us
I20260709 13:18:34.587527 21977 consensus_queue.cc:1059] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:34.517452 22059 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:18:34.546262 19625 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:34.547365 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.588919 19578 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:34.589435 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1538) took 1139 ms. Trace:
I20260709 13:18:34.589694 20662 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:34.589846 19578 rpcz_store.cc:276] 0709 13:18:33.450076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.547032 (+1096956us) service_pool.cc:224] Handling call
0709 13:18:34.589375 (+ 42343us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.590405 21959 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:34.590919 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.591002 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.591444 19578 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.549618 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.551651 22057 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:34.552037 19587 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:34.554682 22053 raft_consensus.cc:3055] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:18:34.555217 21957 consensus_meta.cc:287] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.003s
I20260709 13:18:34.506348 22128 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:34.556603 21981 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:34.598971 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.558561 22061 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:34.563301 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.602440 19476 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:34.566917 19657 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:34.567227 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.573853 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1516) took 2361 ms. Trace:
I20260709 13:18:34.575100 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.585398 19579 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:34.585719 19652 raft_consensus.cc:2368] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6.
I20260709 13:18:34.592459 19581 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:34.595098 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 48932.3us
W20260709 13:18:34.596208 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 156174us
I20260709 13:18:34.610355 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:34.604987 19580 rpcz_store.cc:276] 0709 13:18:32.212984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.333037 (+2120053us) service_pool.cc:224] Handling call
0709 13:18:34.568030 (+234993us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54002fc954. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:34.573778 (+  5748us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256042880}
I20260709 13:18:34.611302 21054 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:34.605979 19586 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:34.613903 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1533) took 1165 ms. Trace:
I20260709 13:18:34.614262 19586 rpcz_store.cc:276] 0709 13:18:33.448137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.569242 (+1121105us) service_pool.cc:224] Handling call
0709 13:18:34.613816 (+ 44574us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.615293 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:34.599987 19587 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:34.576540 22123 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.564850 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.622408 19585 raft_consensus.cc:2410] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:34.623692 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.620532 19581 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:34.596029 21904 raft_consensus.cc:697] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:34.597956 22053 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:34.624876 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.630685 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.599515 22004 consensus_queue.cc:1059] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:18:34.658915 21904 consensus_queue.cc:237] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:34.659850 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 57520.8us
I20260709 13:18:34.661417 19476 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:34.661929 22058 consensus_queue.cc:1059] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:34.662304 19476 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:34.663573 22037 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:34.663990 22037 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.664327 22037 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.658915 22128 raft_consensus.cc:697] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:34.667022 22128 consensus_queue.cc:237] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.657289 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.674319 19586 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:34.675863 19578 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:34.676838 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.626634 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1549) took 1172 ms. Trace:
I20260709 13:18:34.677600 19581 rpcz_store.cc:276] 0709 13:18:33.453831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.549361 (+1095530us) service_pool.cc:224] Handling call
0709 13:18:34.626559 (+ 77198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.678579 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.679280 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.679625 19581 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:34.657819 19579 raft_consensus.cc:2393] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:34.659948 22056 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:34.628059 19584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1550) took 1174 ms (client timeout 1532 ms). Trace:
I20260709 13:18:34.680001 19506 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:34.631039 19585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1515) took 2418 ms (client timeout 3200 ms). Trace:
I20260709 13:18:34.688526 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.610598 21959 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:34.684404 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:34.693950 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 78708.9us
I20260709 13:18:34.693387 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.652313 19587 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:34.621582 22101 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:34.689607 19584 rpcz_store.cc:269] 0709 13:18:33.454149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.067884 (+613735us) service_pool.cc:224] Handling call
0709 13:18:34.627925 (+560041us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b5400303c54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:34.628009 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":951966464}
I20260709 13:18:34.621817 22110 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:34.695863 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.710458 19587 raft_consensus.cc:2368] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7.
I20260709 13:18:34.711578 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.712145 19587 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:34.688663 19585 rpcz_store.cc:269] 0709 13:18:32.212608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.564605 (+2351997us) service_pool.cc:224] Handling call
0709 13:18:34.630991 (+ 66386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.714468 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.715067 19585 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:34.705478 21977 raft_consensus.cc:3055] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:34.716267 21977 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:34.716336 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:34.717018 20661 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.681790 22019 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:34.684096 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.696439 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:34.689641 19581 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:34.612669 22054 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:34.718204 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.734210 19579 raft_consensus.cc:2393] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 5: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:34.704486 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.623009 22057 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:34.625015 21984 raft_consensus.cc:3055] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:34.706991 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.707630 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.818347 19504 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.818225 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:34.599910 21957 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.719611 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.722522 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.826838 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.726883 19652 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:18:34.827288 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 165047us
I20260709 13:18:34.729557 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:34.828290 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:34.828758 19661 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:34.730480 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:34.680373 22050 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:34.605885 21820 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:18:34.840323 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.837468 19506 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:34.816648 19584 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:34.819526 19503 raft_consensus.cc:2393] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:34.833312 19587 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:34.683435 22005 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:34.827123 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:34.826828 19581 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:34.843066 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.843787 19587 raft_consensus.cc:2393] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:34.844576 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.845243 19587 raft_consensus.cc:2410] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:18:34.829401 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:34.832381 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.848393 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:34.720402 22012 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:34.717243 21977 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.705907 21943 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:34.813107 22057 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:34.835132 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 104772us
I20260709 13:18:34.627118 22123 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.838413 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.709662 22110 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:34.849026 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.839049 21948 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:34.720877 22135 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.851075 19585 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
W20260709 13:18:34.836231 22136 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:18:34.851672 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:34.862239 22062 consensus_meta.cc:287] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.620s	user 0.010s	sys 0.002s
W20260709 13:18:34.720227 22134 log.cc:927] Time spent T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:18:34.847225 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1812) took 1954 ms. Trace:
I20260709 13:18:34.894491 19587 rpcz_store.cc:276] 0709 13:18:32.892759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.844375 (+1951616us) service_pool.cc:224] Handling call
0709 13:18:34.847175 (+  2800us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.895605 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.896178 19587 raft_consensus.cc:2376] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6. Re-sending same reply.
I20260709 13:18:34.860633 21943 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.897059 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.864257 22057 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:34.840911 22121 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:18:34.834348 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:34.857743 19581 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:18:34.706327 22101 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:34.817553 21984 raft_consensus.cc:740] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:34.706058 21959 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.862056 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:34.918111 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 56134.4us
I20260709 13:18:34.918927 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:34.920087 19551 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:34.920696 19656 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.836165 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:34.921530 21959 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:34.921815 22012 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:34.923875 19551 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:34.909646 22135 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.925035 22082 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:34.864763 19584 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:34.834151 22050 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:34.849495 19476 leader_election.cc:400] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6.
I20260709 13:18:34.875751 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:34.929857 19476 leader_election.cc:403] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:34.930274 19585 raft_consensus.cc:2393] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:18:34.930580 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 87197.5us
I20260709 13:18:34.880532 19504 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:34.852222 19579 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:34.882344 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.934993 19580 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:18:34.936410 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 121) took 2959 ms. Trace:
I20260709 13:18:34.936758 19580 rpcz_store.cc:276] 0709 13:18:31.977530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.935657 (+2958127us) service_pool.cc:224] Handling call
0709 13:18:34.935951 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.936116 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.936139 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:34.936179 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:34.936208 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.936258 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.936355 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.736809 22010 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.125s
I20260709 13:18:34.897704 19587 raft_consensus.cc:2376] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8. Re-sending same reply.
I20260709 13:18:34.731904 22067 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:34.907622 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:34.939692 19587 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:34.940505 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 122) took 2950 ms. Trace:
I20260709 13:18:34.940917 19587 rpcz_store.cc:276] 0709 13:18:31.990398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.939127 (+2948729us) service_pool.cc:224] Handling call
0709 13:18:34.939462 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.940207 (+   745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.940436 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.941582 21789 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.941388 19580 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:34.943552 21984 consensus_queue.cc:260] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.945045 21984 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:34.881421 22005 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:34.895931 21977 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.946208 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1519) took 2732 ms. Trace:
W20260709 13:18:34.950284 22138 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:18:34.948024 19580 rpcz_store.cc:276] 0709 13:18:32.218808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.939591 (+2720783us) service_pool.cc:224] Handling call
0709 13:18:34.940728 (+  1137us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:34.944869 (+  4141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.946007 (+  1138us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:34.916803 22052 consensus_meta.cc:287] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.844s	user 0.010s	sys 0.005s
I20260709 13:18:34.950958 21789 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:34.926308 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:34.953573 22142 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6.
I20260709 13:18:34.929652 19656 raft_consensus.cc:2410] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:34.952833 19586 raft_consensus.cc:2410] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:18:34.926573 19584 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:34.955433 22012 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:34.961544 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1472) took 3136 ms. Trace:
I20260709 13:18:34.981935 19584 rpcz_store.cc:276] 0709 13:18:31.825577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.926136 (+3100559us) service_pool.cc:224] Handling call
0709 13:18:34.926393 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.961184 (+ 34791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.961470 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.983480 19584 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:34.984035 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1524) took 2731 ms. Trace:
I20260709 13:18:34.984330 19584 rpcz_store.cc:276] 0709 13:18:32.252772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.982976 (+2730204us) service_pool.cc:224] Handling call
0709 13:18:34.983306 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.983840 (+   534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.983987 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.985494 19584 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:34.986011 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1807) took 2094 ms. Trace:
I20260709 13:18:34.986297 19584 rpcz_store.cc:276] 0709 13:18:32.891253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.985045 (+2093792us) service_pool.cc:224] Handling call
0709 13:18:34.985330 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.985820 (+   490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.985965 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.942716 21957 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:34.955623 19580 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:34.954098 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:34.988374 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1521) took 2769 ms. Trace:
W20260709 13:18:34.988866 22020 consensus_meta.cc:287] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.755s	user 0.012s	sys 0.000s
I20260709 13:18:34.988785 19580 rpcz_store.cc:276] 0709 13:18:32.219438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.952807 (+2733369us) service_pool.cc:224] Handling call
0709 13:18:34.954676 (+  1869us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:34.988112 (+ 33436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.988322 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.895671 22062 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:34.899106 21943 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.990521 19578 raft_consensus.cc:2410] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:34.988592 22033 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:34.991922 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:34.992216 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1528) took 2593 ms. Trace:
I20260709 13:18:34.992753 22033 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:34.965574 21963 raft_consensus.cc:3055] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:34.993716 21963 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:34.993994 22035 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.994757 21963 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.995318 22035 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:34.954802 22110 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.995885 21963 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.954429 19582 raft_consensus.cc:2393] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:34.960911 19579 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:18:34.996639 22110 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:34.997160 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:34.997556 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1534) took 1549 ms. Trace:
I20260709 13:18:34.997900 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 125) took 1776 ms. Trace:
I20260709 13:18:34.997988 19582 rpcz_store.cc:276] 0709 13:18:33.448464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.566961 (+1118497us) service_pool.cc:224] Handling call
0709 13:18:34.997383 (+430422us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b54002fd354. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:34.997504 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":803473792}
I20260709 13:18:34.998317 19579 rpcz_store.cc:276] 0709 13:18:33.221442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.997084 (+1775642us) service_pool.cc:224] Handling call
0709 13:18:34.997386 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.997558 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.997583 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:34.997661 (+    78us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:34.997694 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.997751 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.997849 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.999462 19585 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:34.990283 19580 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:35.000561 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 123) took 2102 ms. Trace:
I20260709 13:18:35.000948 19580 rpcz_store.cc:276] 0709 13:18:32.897767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.989796 (+2092029us) service_pool.cc:224] Handling call
0709 13:18:34.990089 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.000333 (+ 10244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.000507 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.992568 19578 rpcz_store.cc:276] 0709 13:18:32.398610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.676602 (+2277992us) service_pool.cc:224] Handling call
0709 13:18:34.992042 (+315440us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54002288d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:34.992166 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719284992}
I20260709 13:18:35.003007 19578 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:35.003733 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1535) took 1555 ms. Trace:
I20260709 13:18:35.004046 19578 rpcz_store.cc:276] 0709 13:18:33.448806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.002424 (+1553618us) service_pool.cc:224] Handling call
0709 13:18:35.002717 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.003489 (+   772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.003679 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.927269 21948 raft_consensus.cc:2764] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:18:35.005357 19578 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:35.005908 19508 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:34.929893 22050 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:35.006258 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1537) took 1556 ms. Trace:
I20260709 13:18:35.006608 19578 rpcz_store.cc:276] 0709 13:18:33.449731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.004797 (+1555066us) service_pool.cc:224] Handling call
0709 13:18:35.005067 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.006034 (+   967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.006213 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:35.007050 22050 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.007827 19578 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:35.007951 22003 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:35.008416 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1540) took 1557 ms. Trace:
I20260709 13:18:35.008803 19578 rpcz_store.cc:276] 0709 13:18:33.450674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.007296 (+1556622us) service_pool.cc:224] Handling call
0709 13:18:35.007606 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.008196 (+   590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.008372 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:34.964258 22123 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:35.002936 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:34.831169 22053 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:34.946440 22005 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:35.010918 22053 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:35.011053 20661 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:34.970359 22101 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:35.012228 22101 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.973078 22054 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.013605 22054 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.016462 19578 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:34.999519 19582 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:18:35.017091 19582 pending_rounds.cc:85] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 4
I20260709 13:18:35.017128 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1541) took 1566 ms. Trace:
I20260709 13:18:35.017454 19582 pending_rounds.cc:107] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:18:35.017930 19582 raft_consensus.cc:2889] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:35.017580 19578 rpcz_store.cc:276] 0709 13:18:33.450943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.009877 (+1558934us) service_pool.cc:224] Handling call
0709 13:18:35.010159 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.016863 (+  6704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.017072 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:35.018739 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1532) took 1571 ms. Trace:
I20260709 13:18:35.019187 19578 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:35.019145 19582 rpcz_store.cc:276] 0709 13:18:33.447674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.998931 (+1551257us) service_pool.cc:224] Handling call
0709 13:18:34.999209 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.018517 (+ 19308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.018695 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:35.019860 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1543) took 1568 ms. Trace:
I20260709 13:18:35.020663 19582 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:34.989375 22020 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:35.022322 22033 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:35.012102 22139 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.118s	user 0.000s	sys 0.002s
I20260709 13:18:35.023214 22020 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:35.020183 19578 rpcz_store.cc:276] 0709 13:18:33.451501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.018604 (+1567103us) service_pool.cc:224] Handling call
0709 13:18:35.018962 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.019611 (+   649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.019807 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:35.024382 19587 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:18:34.912592 19661 raft_consensus.cc:2410] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:35.024973 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1545) took 1573 ms. Trace:
I20260709 13:18:35.025301 19587 rpcz_store.cc:276] 0709 13:18:33.452052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.023853 (+1571801us) service_pool.cc:224] Handling call
0709 13:18:35.024174 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.024744 (+   570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.024925 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:35.026175 19578 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:35.026556 19587 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:35.026765 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1546) took 1574 ms. Trace:
I20260709 13:18:35.033890 22135 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:35.027151 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1547) took 1574 ms. Trace:
I20260709 13:18:35.034910 19587 rpcz_store.cc:276] 0709 13:18:33.453188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.026013 (+1572825us) service_pool.cc:224] Handling call
0709 13:18:35.026330 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.026933 (+   603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.027105 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:35.036366 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.036791 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1553) took 1200 ms. Trace:
I20260709 13:18:34.954659 21789 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:35.038964 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35102 (request call id 126) took 1104 ms. Trace:
I20260709 13:18:35.037168 19587 rpcz_store.cc:276] 0709 13:18:33.836771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.035766 (+1198995us) service_pool.cc:224] Handling call
0709 13:18:35.036111 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.036464 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:35.036498 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:35.036547 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:35.036582 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.036642 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.036741 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1463,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":87}
W20260709 13:18:35.039664 19478 leader_election.cc:336] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.728s (SENT)
I20260709 13:18:35.044049 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:35.044889 22123 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:35.016896 21947 consensus_meta.cc:287] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.503s	user 0.006s	sys 0.002s
I20260709 13:18:35.045425 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:35.046733 21947 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:35.047178 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:35.047418 19583 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:35.048089 19580 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:18:35.049068 19583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1531) took 1601 ms (client timeout 1845 ms). Trace:
I20260709 13:18:35.049254 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:35.049978 19587 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:35.049105 19580 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:35.051707 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.039383 19586 rpcz_store.cc:276] 0709 13:18:33.934442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.733832 (+799390us) service_pool.cc:224] Handling call
0709 13:18:35.038751 (+304919us) spinlock_profiling.cc:243] Waited 87.2 ms on lock 0x7b5400101154. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:35.038907 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200547584}
I20260709 13:18:35.050271 19652 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:35.055217 19658 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:35.057025 19658 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:35.049515 19583 rpcz_store.cc:269] 0709 13:18:33.447346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.569242 (+1121896us) service_pool.cc:224] Handling call
0709 13:18:35.048928 (+479686us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b5400246b54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:35.049019 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1048176896}
I20260709 13:18:35.058655 19652 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:35.060442 19652 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:18:35.061671 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.062812 19478 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:35.064088 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:35.068244 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.070075 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1544) took 1618 ms. Trace:
I20260709 13:18:35.078490 19583 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:18:35.078943 19625 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:35.045279 22057 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:35.167412 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:35.208763 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1480) took 3337 ms. Trace:
I20260709 13:18:35.394590 19585 rpcz_store.cc:276] 0709 13:18:31.871713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.930907 (+3059194us) service_pool.cc:224] Handling call
0709 13:18:34.999303 (+ 68396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.999998 (+   695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.208462 (+208464us) spinlock_profiling.cc:243] Waited 68.1 ms on lock 0x7b54001013d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:35.208670 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156619520}
I20260709 13:18:35.396179 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:35.081211 21947 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:35.161126 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:35.309221 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 306956us
I20260709 13:18:35.071808 19582 rpcz_store.cc:276] 0709 13:18:33.451783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.020088 (+1568305us) service_pool.cc:224] Handling call
0709 13:18:35.020465 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.067515 (+ 47050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.070005 (+  2490us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:35.400087 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:35.400224 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:35.088449 22056 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:35.338291 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 259427us
W20260709 13:18:35.336654 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 273911us
I20260709 13:18:35.361263 19654 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:35.027135 19578 rpcz_store.cc:276] 0709 13:18:33.452329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.025732 (+1573403us) service_pool.cc:224] Handling call
0709 13:18:35.026008 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.026548 (+   540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.026716 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:35.401849 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.220436 19659 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:35.402590 19478 leader_election.cc:336] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.845s (SENT)
I20260709 13:18:35.128177 19658 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:18:35.131147 19657 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:35.363710 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.139233 19580 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:35.403872 19478 leader_election.cc:336] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.925s (SENT)
I20260709 13:18:35.361467 19656 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 13:18:35.078874 21703 consensus_meta.cc:287] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.599s	user 0.006s	sys 0.006s
I20260709 13:18:35.385869 19661 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:18:35.304108 21943 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:35.367380 22135 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.387437 22054 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:35.042913 21956 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:35.079036 22035 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:35.393687 19584 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:35.281889 22061 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:18:35.293819 22132 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.047s	sys 0.035s
W20260709 13:18:35.040771 22137 log.cc:927] Time spent T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
I20260709 13:18:35.439621 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:35.413981 21789 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:35.383256 21981 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:35.390321 21948 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:35.437109 19655 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:35.408989 19660 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:35.442160 19658 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:35.444502 21943 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:35.445214 19661 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:35.083616 22037 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:35.457144 22033 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.415620 21703 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:35.424433 22135 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:35.505721 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 437324us
I20260709 13:18:35.481966 21948 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:35.505995 22033 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:35.499228 21981 raft_consensus.cc:697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:35.511300 22003 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:18:35.534458 21984 consensus_meta.cc:287] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.589s	user 0.014s	sys 0.000s
I20260709 13:18:35.536391 22037 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:35.539850 22101 consensus_meta.cc:287] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.000s
I20260709 13:18:35.529863 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:35.534439 22003 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:18:35.573474 22135 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:35.568194 21981 consensus_queue.cc:237] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:35.575840 22054 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:35.566991 22035 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:35.594595 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 357217us
I20260709 13:18:35.610118 21703 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:35.632225 22150 log.cc:927] Time spent T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.126s	user 0.000s	sys 0.002s
I20260709 13:18:35.617199 21948 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:35.586766 22003 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:35.648417 22153 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:18:35.688724 22151 log.cc:927] Time spent T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.112s	user 0.001s	sys 0.001s
W20260709 13:18:35.701174 21963 consensus_meta.cc:287] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.705s	user 0.012s	sys 0.000s
I20260709 13:18:35.713145 22057 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:35.717540 22003 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.720106 22033 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:35.730852 22033 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:35.368454 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.901423 21977 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:35.901707 21703 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:35.404349 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:35.779978 19506 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:18:35.781087 19511 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.010s	sys 0.021s
W20260709 13:18:35.781075 19512 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.007s	sys 0.026s
I20260709 13:18:35.797453 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:35.799750 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:35.405819 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:35.802850 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.402091 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:35.413000 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:35.400780 19582 raft_consensus.cc:2376] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10. Re-sending same reply.
I20260709 13:18:35.960420 22056 consensus_queue.cc:1059] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:18:35.977931 22050 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:35.804256 19581 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
W20260709 13:18:35.979919 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 574006us
I20260709 13:18:35.982008 19580 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:35.982231 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1562) took 1853 ms. Trace:
I20260709 13:18:35.982885 19581 rpcz_store.cc:276] 0709 13:18:34.128376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.907416 (+779040us) service_pool.cc:224] Handling call
0709 13:18:35.981978 (+1074562us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b540021cfd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:35.982152 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1950963968}
I20260709 13:18:35.983585 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:35.984169 19406 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48852 (request call id 172) took 20435 ms (client timeout 15000 ms). Trace:
I20260709 13:18:35.396947 19585 raft_consensus.cc:2376] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8. Re-sending same reply.
I20260709 13:18:35.260605 19587 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:35.820654 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1810) took 2928 ms. Trace:
I20260709 13:18:35.986073 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:35.821954 19579 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.004s	sys 0.019s
I20260709 13:18:35.986778 19578 raft_consensus.cc:2410] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:18:35.987116 19579 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.004s	sys 0.020s
I20260709 13:18:35.987351 19585 raft_consensus.cc:2410] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:18:35.842226 19410 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 46) took 3342 ms. Trace:
I20260709 13:18:35.988138 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:35.989303 19578 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:18:35.856143 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.882934 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:35.984706 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:35.960489 22035 consensus_queue.cc:1059] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:18:35.887126 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:35.957921 21963 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:18:35.994692 19661 raft_consensus.cc:2393] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:35.993580 19581 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:35.891798 20631 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:35.995747 21963 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:35.986390 19584 rpcz_store.cc:276] 0709 13:18:32.892173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.987021 (+2094848us) service_pool.cc:224] Handling call
0709 13:18:34.987288 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.426064 (+438776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.819983 (+393919us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b5400106654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:35.820399 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934005632}
W20260709 13:18:35.997761 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 106400us
I20260709 13:18:35.989946 19585 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:35.897188 20662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59430 (request call id 83) took 1303 ms. Trace:
I20260709 13:18:35.999308 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1844) took 1144 ms. Trace:
I20260709 13:18:35.999390 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1845) took 1132 ms. Trace:
I20260709 13:18:35.898203 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1821) took 1575 ms. Trace:
I20260709 13:18:35.899531 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:35.899461 21904 consensus_queue.cc:1059] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:36.028007 21904 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.988529 19410 rpcz_store.cc:276] 0709 13:18:32.499487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.499635 (+   148us) service_pool.cc:224] Handling call
0709 13:18:35.841768 (+3342133us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:33.864015 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:33.864614 (+   599us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:33.864652 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:18:33.864671 (+    19us) tablet.cc:662] Decoding operations
0709 13:18:33.865118 (+   447us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:33.865177 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:33.865210 (+    33us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:33.865596 (+   386us) tablet.cc:701] Row locks acquired
0709 13:18:33.865609 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:18:33.880622 (+ 15013us) write_op.cc:270] Start()
0709 13:18:33.880735 (+   113us) write_op.cc:276] Timestamp: P: 1783603113880573 usec, L: 0
0709 13:18:33.880760 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:18:33.916324 (+ 35564us) log.cc:844] Serialized 920 byte log entry
0709 13:18:34.672321 (+755997us) op_driver.cc:464] REPLICATION: finished
0709 13:18:35.506252 (+833931us) write_op.cc:301] APPLY: starting
0709 13:18:35.510030 (+  3778us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:35.524670 (+ 14640us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:35.534473 (+  9803us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:35.571102 (+ 36629us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:35.586579 (+ 15477us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:18:35.589531 (+  2952us) write_op.cc:312] APPLY: finished
0709 13:18:35.598989 (+  9458us) log.cc:844] Serialized 28 byte log entry
0709 13:18:35.738604 (+139615us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:35.738722 (+   118us) write_op.cc:454] Released schema lock
0709 13:18:35.738781 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:35.739262 (+   481us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:35.739300 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12597,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":804998,"apply.run_cpu_time_us":11379,"apply.run_wall_time_us":241245,"num_ops":2,"prepare.queue_time_us":176780,"prepare.run_cpu_time_us":36249,"prepare.run_wall_time_us":318978,"raft.queue_time_us":1148399,"raft.run_cpu_time_us":90551,"raft.run_wall_time_us":1008306,"replication_time_us":723702,"thread_start_us":1264440,"threads_started":5,"wal-append.queue_time_us":521483,"wal-append.run_cpu_time_us":18785,"wal-append.run_wall_time_us":1218668}]]}
W20260709 13:18:35.742358 22058 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.005s	sys 0.008s
W20260709 13:18:36.057751 19627 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.010s	sys 0.025s
W20260709 13:18:36.058313 22058 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.006s	sys 0.008s
I20260709 13:18:36.058667 21977 raft_consensus.cc:3055] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:18:35.403891 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.917107 19653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.007s
W20260709 13:18:35.924500 19511 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.011s	sys 0.021s
W20260709 13:18:35.928210 19512 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.007s	sys 0.027s
I20260709 13:18:35.935497 22057 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:35.935571 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 150199us
I20260709 13:18:35.936322 21984 consensus_queue.cc:1059] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:35.937453 22153 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:35.948191 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1504) took 1218 ms. Trace:
W20260709 13:18:35.957100 19583 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.013s	sys 0.008s
I20260709 13:18:35.984614 19580 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.982033 22033 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:36.000043 19584 rpcz_store.cc:276] 0709 13:18:34.867038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.998023 (+1130985us) service_pool.cc:224] Handling call
0709 13:18:35.998574 (+   551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.998904 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.998949 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:35.999014 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:35.999069 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.999137 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.999295 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:35.980863 22050 consensus_queue.cc:1059] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:35.999794 19585 rpcz_store.cc:276] 0709 13:18:34.854840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.988957 (+1134117us) service_pool.cc:224] Handling call
0709 13:18:35.989546 (+   589us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.998927 (+  9381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.999191 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:35.977252 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:36.006044 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:36.003204 19586 rpcz_store.cc:276] 0709 13:18:34.322306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.053516 (+731210us) service_pool.cc:224] Handling call
0709 13:18:35.126587 (+ 73071us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.397394 (+270807us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:18:35.397435 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.416225 (+ 18790us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.871175 (+454950us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:35.871278 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.871436 (+   158us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:35.897751 (+ 26315us) raft_consensus.cc:1685] finished
0709 13:18:35.897773 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.897998 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":147715,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":25988,"thread_start_us":41948,"threads_started":1,"wal-append.queue_time_us":67481}
I20260709 13:18:36.017082 22168 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:36.022380 21703 raft_consensus.cc:3055] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:18:36.023590 22174 log.cc:927] Time spent T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.093s	user 0.000s	sys 0.002s
I20260709 13:18:35.939615 22005 consensus_queue.cc:1059] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:18:36.023798 19408 catalog_manager.cc:5697] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 7 to 9, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 9 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.103180 19408 catalog_manager.cc:5697] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.989953 22142 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:18:36.105275 22057 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:35.960021 22037 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
W20260709 13:18:35.734017 22053 consensus_meta.cc:287] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.723s	user 0.007s	sys 0.007s
I20260709 13:18:36.028715 21904 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.108498 22057 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:36.109153 19583 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.015s	sys 0.008s
I20260709 13:18:36.110579 21904 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:35.991305 19655 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:36.034082 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1846) took 1158 ms. Trace:
I20260709 13:18:36.113636 19582 raft_consensus.cc:2410] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:36.113799 19578 rpcz_store.cc:276] 0709 13:18:34.875570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.032662 (+1157092us) service_pool.cc:224] Handling call
0709 13:18:36.033260 (+   598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.033702 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.033728 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:36.033798 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:36.033837 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.033897 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.034018 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:35.999650 20662 rpcz_store.cc:276] 0709 13:18:34.593708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.595961 (+  2253us) service_pool.cc:224] Handling call
0709 13:18:34.624888 (+ 28927us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:34.686663 (+ 61775us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:34.693696 (+  7033us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:34.850320 (+156624us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.415909 (+565589us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:35.417358 (+  1449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.434397 (+ 17039us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:35.575556 (+141159us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:18:35.896371 (+320815us) raft_consensus.cc:1685] finished
0709 13:18:35.896428 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.896908 (+   480us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16332,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":12460,"spinlock_wait_cycles":8030592,"thread_start_us":424805,"threads_started":1,"wal-append.queue_time_us":627734}
I20260709 13:18:35.996094 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:36.117044 19587 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:36.052582 19581 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:18:36.059170 21977 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:36.118043 19476 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:36.119189 21977 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:36.058307 19627 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.011s	sys 0.025s
I20260709 13:18:36.085898 19506 rpcz_store.cc:276] 0709 13:18:34.729398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.841868 (+112470us) service_pool.cc:224] Handling call
0709 13:18:34.842146 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.934525 (+1092379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.940067 (+  5542us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b54000ecc54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:35.948089 (+  8022us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2154406144}
W20260709 13:18:36.089942 19653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.007s	sys 0.007s
I20260709 13:18:36.094120 22153 raft_consensus.cc:3055] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:36.096473 22035 raft_consensus.cc:3055] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:36.126092 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.126915 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.135572 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 154238us
I20260709 13:18:36.135811 21948 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:36.122721 22153 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:18:36.090821 21703 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:36.121435 19408 catalog_manager.cc:5697] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 4 to 5, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 5 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:18:36.137528 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 770375us
W20260709 13:18:36.138109 19625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.013s	sys 0.017s
I20260709 13:18:36.125556 22035 raft_consensus.cc:740] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:36.137600 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:36.158087 19625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.014s	sys 0.017s
I20260709 13:18:36.162158 19584 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:36.162550 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 1982) took 1483 ms. Trace:
I20260709 13:18:36.163091 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1849) took 1251 ms. Trace:
I20260709 13:18:36.163650 19584 rpcz_store.cc:276] 0709 13:18:34.912238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.125454 (+1213216us) service_pool.cc:224] Handling call
0709 13:18:36.153820 (+ 28366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.162737 (+  8917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.162992 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:35.984685 19406 rpcz_store.cc:269] 0709 13:18:15.548174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.568669 (+ 20495us) service_pool.cc:224] Handling call
0709 13:18:15.725485 (+156816us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b54002ec7d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c4090 00007f6c31762f3a 00007f6c375191cc 00007f6c3761737e 00007f6c35ad82a4 00007f6c35ad8232 00007f6c35ad8161 00007f6c35ad80dc 00007f6c35ad7392 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:35.983870 (+20258385us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:34.253958 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:34.254601 (+   643us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:34.254637 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:18:34.254650 (+    13us) tablet.cc:662] Decoding operations
0709 13:18:34.256242 (+  1592us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:34.256292 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:34.256335 (+    43us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:18:34.402277 (+145942us) tablet.cc:701] Row locks acquired
0709 13:18:34.402296 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:18:34.434318 (+ 32022us) write_op.cc:270] Start()
0709 13:18:34.449591 (+ 15273us) write_op.cc:276] Timestamp: P: 1783603114421968 usec, L: 0
0709 13:18:34.449660 (+    69us) op_driver.cc:348] REPLICATION: starting
0709 13:18:34.526064 (+ 76404us) log.cc:844] Serialized 6796 byte log entry
0709 13:18:35.451511 (+925447us) op_driver.cc:464] REPLICATION: finished
0709 13:18:35.651018 (+199507us) write_op.cc:301] APPLY: starting
0709 13:18:35.677825 (+ 26807us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:35.684554 (+  6729us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:35.684744 (+   190us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:35.691196 (+  6452us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:35.691616 (+   420us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:18:35.691699 (+    83us) write_op.cc:312] APPLY: finished
0709 13:18:35.692215 (+   516us) log.cc:844] Serialized 118 byte log entry
0709 13:18:35.692417 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:35.692635 (+   218us) write_op.cc:454] Released schema lock
0709 13:18:35.692717 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:35.693235 (+   518us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:35.693274 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1104262,"reported_tablets":38,"spinlock_wait_cycles":8337152,"child_traces":[["op",{"apply.queue_time_us":189957,"apply.run_cpu_time_us":5606,"apply.run_wall_time_us":49698,"num_ops":17,"prepare.queue_time_us":355776,"prepare.run_cpu_time_us":15298,"prepare.run_wall_time_us":282264,"replication_time_us":997765,"thread_start_us":146243,"threads_started":1}]]}
I20260709 13:18:36.125026 20661 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:36.160203 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1820) took 1833 ms. Trace:
I20260709 13:18:36.176090 22168 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:36.177863 19408 catalog_manager.cc:5697] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.181227 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1851) took 1164 ms. Trace:
I20260709 13:18:36.186617 19581 rpcz_store.cc:276] 0709 13:18:35.016588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.180025 (+1163437us) service_pool.cc:224] Handling call
0709 13:18:36.180484 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.180856 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.180888 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:36.180936 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:36.180972 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.181039 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.181164 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:36.185979 19584 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:18:36.183759 19408 catalog_manager.cc:5697] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 6 to 9, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 9 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.188520 19584 pending_rounds.cc:85] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 4
I20260709 13:18:36.201961 19580 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:36.205101 22050 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:36.206012 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60692 (request call id 96) took 1218 ms. Trace:
I20260709 13:18:36.206458 19408 catalog_manager.cc:5697] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 3 to 8, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 8 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.208091 21984 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:36.208642 19408 catalog_manager.cc:5697] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:18:36.210649 19506 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:36.205217 21977 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:36.210588 19408 catalog_manager.cc:5697] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 6 to 7, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 7 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.212664 19408 catalog_manager.cc:5697] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.213546 19553 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:18:36.187698 21703 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.215457 21703 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:36.215006 19408 catalog_manager.cc:5697] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:18:36.138684 22153 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:36.217558 22153 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:36.217376 19408 catalog_manager.cc:5697] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 5 to 10, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 10 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.218812 22168 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:36.219609 21963 raft_consensus.cc:3055] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:36.220093 21963 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:36.219375 19408 catalog_manager.cc:5697] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 4 to 9, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 9 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:36.222179 19627 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60800 dropped due to backpressure: service queue is full with 50 items [suppressed 55 similar messages]
I20260709 13:18:36.221422 19408 catalog_manager.cc:5697] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 5 to 7, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 7 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.221226 21963 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.223784 19627 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:36.223981 21963 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:36.224102 19408 catalog_manager.cc:5697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 4 to 6, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 6 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.206459 19511 rpcz_store.cc:276] 0709 13:18:35.003509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.003668 (+   159us) service_pool.cc:224] Handling call
0709 13:18:35.003986 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.004181 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:35.004441 (+   260us) log.cc:844] Serialized 14 byte log entry
0709 13:18:36.148295 (+1143854us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:36.165401 (+ 17106us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:36.189789 (+ 24388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.203395 (+ 13606us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.205947 (+  2552us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69945,"prepare.queue_time_us":558,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":49947,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":274,"thread_start_us":1081330,"threads_started":1,"wal-append.queue_time_us":560795}
W20260709 13:18:36.228966 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 92192.8us
I20260709 13:18:36.231848 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:36.232635 22033 raft_consensus.cc:2764] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:36.234503 22057 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:36.235671 22057 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:36.221553 22168 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:36.163170 19512 rpcz_store.cc:276] 0709 13:18:34.678981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.681529 (+  2548us) service_pool.cc:224] Handling call
0709 13:18:34.716254 (+ 34725us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:34.914360 (+198106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.914407 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:34.959853 (+ 45446us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.094455 (+1134602us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:36.094573 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.162008 (+ 67435us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b5400081954. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:36.162066 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.162121 (+    55us) raft_consensus.cc:1685] finished
0709 13:18:36.162140 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.162474 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18844,"raft.queue_time_us":24074,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"spinlock_wait_cycles":411035392,"thread_start_us":1098379,"threads_started":1,"wal-append.queue_time_us":574974}
I20260709 13:18:36.198027 19584 pending_rounds.cc:107] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:18:36.240293 19584 raft_consensus.cc:2889] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.172559 19579 rpcz_store.cc:276] 0709 13:18:34.321964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.048724 (+726760us) service_pool.cc:224] Handling call
0709 13:18:35.048985 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.049175 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:36.034379 (+985204us) log.cc:844] Serialized 14 byte log entry
0709 13:18:36.135917 (+101538us) log.cc:844] Serialized 14 byte log entry
0709 13:18:36.136416 (+   499us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:36.136571 (+   155us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:36.136784 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.140214 (+  3430us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.155530 (+ 15316us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":544412,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":788,"raft.queue_time_us":13947,"raft.run_cpu_time_us":488,"raft.run_wall_time_us":5438,"thread_start_us":1026595,"threads_started":2}
I20260709 13:18:36.242776 19655 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 4.
I20260709 13:18:36.243917 19587 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:36.241475 22050 raft_consensus.cc:697] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:36.254340 22050 consensus_queue.cc:237] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.254791 22179 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:36.255600 22056 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.255715 22179 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.256588 22056 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.258771 22058 raft_consensus.cc:3055] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:36.259203 22058 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:36.259996 22056 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:36.254660 21984 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:36.260300 22058 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.263924 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:36.265002 19657 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:36.265319 19654 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:36.267084 22163 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:36.267374 19627 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:36.267699 22172 raft_consensus.cc:3055] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:36.268132 22172 raft_consensus.cc:740] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:36.238500 22033 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.275048 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:36.276167 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.267132 22178 log.cc:927] Time spent T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.089s	user 0.001s	sys 0.003s
I20260709 13:18:36.277719 21948 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.278347 19408 catalog_manager.cc:5697] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.278174 22033 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.281667 21948 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.282394 22179 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:36.270437 22053 raft_consensus.cc:3055] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:36.274519 22058 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:36.280608 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1850) took 1315 ms. Trace:
I20260709 13:18:36.285511 19584 rpcz_store.cc:276] 0709 13:18:34.961493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.164601 (+1203108us) service_pool.cc:224] Handling call
0709 13:18:36.165050 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.276951 (+111901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.277146 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:36.277976 21982 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:36.283696 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:36.286875 19581 raft_consensus.cc:1275] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:36.287575 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1853) took 1248 ms. Trace:
I20260709 13:18:36.287919 19581 rpcz_store.cc:276] 0709 13:18:35.039520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.198255 (+1158735us) service_pool.cc:224] Handling call
0709 13:18:36.269439 (+ 71184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.287288 (+ 17849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.287507 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:36.286816 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 73585.1us
I20260709 13:18:36.290441 19627 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:36.283185 22053 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:36.296150 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 770433us
I20260709 13:18:36.306406 19661 raft_consensus.cc:2393] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:36.297312 22057 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:36.308224 22180 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.301292 22179 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:36.328951 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1842) took 1491 ms. Trace:
I20260709 13:18:36.285122 21984 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.307878 22033 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:36.343386 22142 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:36.349572 22179 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.353544 22172 consensus_queue.cc:260] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.349790 21957 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:36.350541 19408 catalog_manager.cc:5697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 1 to 4, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 4 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:18:36.351308 22142 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.357312 19408 catalog_manager.cc:5697] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:18:36.357807 22180 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:36.354099 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 63821.5us
I20260709 13:18:36.359349 19408 catalog_manager.cc:5697] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:18:36.361234 19627 leader_election.cc:400] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7.
I20260709 13:18:36.360930 19408 catalog_manager.cc:5697] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 4 to 5, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 5 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.354919 22172 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:36.376184 21904 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:36.376901 21904 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:36.385347 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.385536 21957 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.391116 19408 catalog_manager.cc:5697] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 6 to 7, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 7 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.393188 19476 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:36.393671 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:36.393932 22005 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:36.329283 22176 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.394690 19657 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:36.395426 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:36.395087 22053 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.334649 19583 rpcz_store.cc:276] 0709 13:18:34.837932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.079990 (+242058us) service_pool.cc:224] Handling call
0709 13:18:35.080522 (+   532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.080791 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:36.109889 (+1029098us) log.cc:844] Serialized 14 byte log entry
0709 13:18:36.278429 (+168540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:36.284606 (+  6177us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:36.285330 (+   724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.308155 (+ 22825us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.328857 (+ 20702us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13879,"prepare.queue_time_us":525712,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":58116,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":883066,"threads_started":3,"wal-append.queue_time_us":159903}
I20260709 13:18:36.414392 21957 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.417762 19408 catalog_manager.cc:5697] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 3 to 7, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 7 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.340044 22035 consensus_queue.cc:260] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:36.421167 22035 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:36.421936 22056 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:36.421273 19408 catalog_manager.cc:5697] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 1 to 4, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 4 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.422461 22056 raft_consensus.cc:697] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:36.423228 19408 catalog_manager.cc:5697] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 1 to 5, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 5 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:18:36.423538 22056 consensus_queue.cc:237] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.424677 19408 catalog_manager.cc:5697] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 3 to 6, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 6 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
W20260709 13:18:36.425594 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.426632 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 65695.2us
I20260709 13:18:36.429710 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:36.430778 21820 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:36.432411 19627 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:36.426172 19658 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:36.434964 22176 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.437068 21820 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:36.437317 22176 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:36.433207 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.426329 19408 catalog_manager.cc:5697] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
W20260709 13:18:36.434829 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.421363 21957 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:36.443728 19408 catalog_manager.cc:5697] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 4 to 7, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 7 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:18:36.444933 19627 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:36.445953 21957 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:36.447520 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:36.448451 21957 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:18:36.450803 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 207386us
I20260709 13:18:36.452545 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:36.454046 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:36.455648 19508 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:36.458456 22057 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:36.472628 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 117085us
I20260709 13:18:36.475068 19511 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:18:36.475579 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.469058 19408 catalog_manager.cc:5697] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 1 to 2, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.483001 22050 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:36.484262 22053 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:36.486840 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:36.508818 22177 log.cc:927] Time spent T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.303s	user 0.003s	sys 0.000s
I20260709 13:18:36.509802 21957 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:36.511421 21984 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:36.515249 21948 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:36.517591 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 63710.6us
W20260709 13:18:36.517990 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.519596 22186 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:36.520215 22050 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:36.523126 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.527191 19505 raft_consensus.cc:2393] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:36.530412 22180 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:36.530815 22057 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:36.534304 19505 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:36.537674 22179 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:36.538909 22142 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:36.540407 19657 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:36.549666 22057 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.551020 22057 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.551743 22050 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:36.552834 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:36.542806 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:36.543504 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:36.543293 21981 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:36.555123 22050 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.555697 22050 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.558204 21981 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:36.558665 22033 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:36.558825 22050 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:36.496604 19408 catalog_manager.cc:5697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:18:36.558694 21981 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:36.560571 21981 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.547122 19627 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:36.549759 22186 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:36.561736 21981 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:36.562006 22186 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.564378 22186 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:36.549197 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:36.553539 22057 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:36.554392 21948 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.565353 19507 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:36.565450 21948 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.559295 22033 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.567714 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:36.567821 21948 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:36.568116 22033 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:36.568187 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.569190 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.569114 21820 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:36.569964 21820 raft_consensus.cc:697] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:36.568460 19507 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:36.571892 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 178853us
I20260709 13:18:36.571393 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:36.578615 19476 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:36.580065 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:36.600924 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:36.604348 19476 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:36.605638 22058 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:36.606112 22058 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.606462 22058 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:36.612449 19657 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:36.614852 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.615511 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.571064 21820 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.617944 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:36.607332 22050 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:36.623013 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:36.624104 19478 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:36.625294 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:36.624635 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:36.625844 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:36.628187 21948 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.630116 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:36.631157 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:36.631532 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:36.631844 22186 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:36.633219 22057 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.633167 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:36.633832 22033 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.632774 19659 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:36.634052 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:36.634249 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:36.634424 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:36.635249 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:36.635380 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:36.636313 22185 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.631875 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:36.634069 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:36.610787 21982 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:36.645731 19505 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 7.
I20260709 13:18:36.650092 19506 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:36.673565 19655 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
W20260709 13:18:36.673656 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 102405us
W20260709 13:18:36.674290 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.671833 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:36.652048 22050 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.693042 19508 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:36.693193 19652 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:36.700171 19510 raft_consensus.cc:2410] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:36.692628 21963 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.694204 22050 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:36.672791 22172 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:36.712322 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:36.709280 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:36.709793 19657 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
W20260709 13:18:36.713217 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 77947.4us
I20260709 13:18:36.651743 21948 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:36.709982 19627 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:36.715031 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 104649us
I20260709 13:18:36.715924 21982 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:36.719657 22058 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.720424 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:36.721055 19505 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:36.721922 22058 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:36.726892 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:36.709201 22005 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.728448 22005 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:36.732744 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 108759us
I20260709 13:18:36.732949 19509 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:36.692631 22033 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.698204 22057 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.737480 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:36.695842 22186 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:36.755522 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.736361 19625 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:36.709688 22185 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.743633 21904 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.744227 19478 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:36.744755 22037 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.745465 19627 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:36.747130 22033 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:36.737085 22153 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:36.771708 19507 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:36.760634 21982 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:36.802772 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:36.805438 19653 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:36.806401 22203 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:36.807039 22203 raft_consensus.cc:697] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:36.808032 22203 consensus_queue.cc:237] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.773412 22153 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:36.740759 21963 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.758235 22172 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:36.782929 22033 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:18:36.820892 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 57502.9us
I20260709 13:18:36.802011 21904 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:36.821254 22153 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:36.832839 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:36.835680 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:36.813711 22176 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:36.814714 22187 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:36.809891 21957 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:18:36.834692 19661 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:36.819451 21982 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:36.850235 21982 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:36.853765 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 129993us
I20260709 13:18:36.855333 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:36.858186 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 118938us
I20260709 13:18:36.813539 22037 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.843741 22176 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:36.873193 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:18:36.874912 19478 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:36.875799 22179 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:36.875799 21977 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:36.876401 22179 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:36.877455 22179 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:36.883417 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:36.884685 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.885715 21703 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:36.886097 19478 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:36.887266 21977 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:36.890257 21977 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:36.894173 21977 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:18:36.899015 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.902675 22176 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:36.902596 22187 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:36.902159 22033 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.905705 22054 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:36.928311 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 73074us
W20260709 13:18:36.925652 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 180298us
I20260709 13:18:36.903448 22050 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.954370 21703 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:36.909495 22005 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:36.959474 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.961405 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:36.962352 19658 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:18:36.965209 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:36.966230 19661 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:36.967017 19655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:18:36.967478 22210 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.968107 22210 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:36.971375 22202 log.cc:927] Time spent T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 13:18:36.972482 22206 log.cc:927] Time spent T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:18:36.974242 22205 log.cc:927] Time spent T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:18:36.975512 22201 log.cc:927] Time spent T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:18:36.977102 22199 log.cc:927] Time spent T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:18:36.978667 22037 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:36.981177 22050 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:36.959995 22033 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:36.986837 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:36.988533 19627 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:36.928063 22054 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.993001 19506 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:36.958547 22187 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.962952 21948 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:37.001268 22186 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.006712 22054 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:37.010466 21957 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:37.058467 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 93336.1us
I20260709 13:18:37.085898 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:37.094267 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:37.089927 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 101576us
I20260709 13:18:37.053864 21948 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:37.053745 22186 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:37.057603 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:18:37.114429 22218 log.cc:927] Time spent T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:18:37.068360 22172 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:37.068872 21963 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.126978 19478 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:37.155134 21948 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:37.156180 20661 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:37.173753 22186 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.176680 22186 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:37.179728 21981 consensus_meta.cc:287] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.618s	user 0.011s	sys 0.000s
I20260709 13:18:37.180356 19655 raft_consensus.cc:606] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:18:37.180814 19655 raft_consensus.cc:614] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:37.047844 22187 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:37.193500 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.204483 19652 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:37.209522 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.186898 22211 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:37.212834 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:37.215655 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 129941us
W20260709 13:18:37.204730 22188 log.cc:927] Time spent T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:37.204660 22053 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:37.224499 19661 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:37.193409 22196 raft_consensus.cc:2764] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:18:37.226181 22189 log.cc:927] Time spent T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:18:37.226769 22186 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.226964 22212 log.cc:927] Time spent T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 13:18:37.226119 22216 log.cc:927] Time spent T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:18:37.237826 22186 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.228546 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:37.232342 19627 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:37.238934 19661 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:37.241097 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 114246us
I20260709 13:18:37.244334 19627 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:37.247005 22231 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:37.247548 22231 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:37.248437 22231 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.250840 22187 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.252925 19661 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:37.253659 22225 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.254209 22225 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.256420 22225 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:37.237826 22207 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:18:37.264190 21820 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:37.275767 22211 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:37.276584 22211 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:37.241902 22053 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:37.279331 22185 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.278950 22053 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:37.283835 22200 log.cc:927] Time spent T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.472s	user 0.002s	sys 0.000s
I20260709 13:18:37.287885 22057 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.242156 21982 consensus_queue.cc:1059] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:18:37.288709 22169 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.289330 21982 raft_consensus.cc:3055] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:37.289893 21982 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:18:37.290910 22224 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.084s	user 0.003s	sys 0.001s
I20260709 13:18:37.289332 22169 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:37.292768 22204 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.384s	user 0.000s	sys 0.004s
I20260709 13:18:37.293579 22186 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.289986 22210 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.292068 19478 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:37.295271 22033 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.295688 19478 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:37.296712 21963 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:37.297132 21963 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:37.297529 21963 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:37.297788 22179 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:37.298188 22179 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:37.298556 22179 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:37.291040 21982 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.301319 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.315769 19476 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:37.341250 19661 raft_consensus.cc:1275] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:37.343597 22168 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.344208 22168 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:37.346180 22172 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.346905 22172 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:37.349887 22033 consensus_queue.cc:1059] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:37.351157 22033 consensus_queue.cc:1243] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:37.351807 22210 raft_consensus.cc:3055] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:37.352257 22210 raft_consensus.cc:740] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:37.353425 22210 consensus_queue.cc:260] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.355079 22210 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:37.357457 22214 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:37.358033 22214 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:37.358484 22214 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:37.362218 19476 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:37.363521 19476 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:37.364336 22058 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:37.364800 22058 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.365231 22058 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:37.370013 21703 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:37.370326 22050 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:37.371263 22050 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.370620 21703 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.374634 21703 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:37.377875 19655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:18:37.378933 19655 raft_consensus.cc:606] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:37.379417 19655 raft_consensus.cc:614] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:37.382441 22169 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.383670 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.385408 21982 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:37.385638 19655 raft_consensus.cc:2410] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 13:18:37.389500 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 52698.7us
I20260709 13:18:37.394135 22168 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:37.402060 19655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9807bdebbbd742009e4a329706a92790"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:18:37.402853 19655 raft_consensus.cc:606] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:37.403224 19655 raft_consensus.cc:614] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:37.403399 22176 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:37.382444 21904 consensus_meta.cc:287] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.000s
I20260709 13:18:37.401981 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:37.417279 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.415988 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:37.416558 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 170977us
I20260709 13:18:37.421118 19476 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:37.422405 19476 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:37.425381 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:37.341715 22153 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:37.414898 22196 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:37.432212 19505 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:37.425485 22005 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:37.423882 22186 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:37.438213 19505 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:37.410773 22210 consensus_queue.cc:1059] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:18:37.442260 19658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:18:37.434809 22186 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.416677 22142 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:18:37.432636 21984 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:37.420589 22176 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.451501 19658 raft_consensus.cc:606] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:18:37.438352 22005 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:37.453635 19627 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:37.451776 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:37.458343 19658 raft_consensus.cc:614] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:37.435088 22050 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.435113 22035 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:18:37.453266 22186 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:37.473238 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:37.437796 22054 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.458211 22033 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:37.495973 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.496656 19660 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:37.497825 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.498901 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.499539 19660 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:37.492404 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.493213 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.500303 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.493866 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.494480 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:37.501760 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:37.502151 19512 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:37.489797 22005 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.495846 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.496610 22033 raft_consensus.cc:697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:37.501127 19660 raft_consensus.cc:2410] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:37.495142 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:37.505523 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.510141 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:37.513758 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.514806 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:37.515445 19507 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:37.516273 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:37.463074 21984 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:37.521648 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:37.511580 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 99838.5us
I20260709 13:18:37.519423 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:37.521632 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.510319 19656 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:37.524344 19657 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
I20260709 13:18:37.525193 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:37.527267 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.521632 19652 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:18:37.523756 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:37.530745 22230 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:37.534619 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.538339 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.539367 19478 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:37.540176 19504 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:37.543635 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:37.544377 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:37.546244 19511 raft_consensus.cc:2410] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:37.471346 21963 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.549816 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:37.522195 22210 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:37.554101 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.558020 19657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:18:37.547302 19506 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:18:37.560648 19506 pending_rounds.cc:85] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 3
I20260709 13:18:37.560721 19657 raft_consensus.cc:606] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:18:37.560937 19506 pending_rounds.cc:107] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:18:37.561152 19657 raft_consensus.cc:614] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:37.561213 19506 raft_consensus.cc:2889] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:37.560377 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 131092us
I20260709 13:18:37.493228 22214 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.562543 19583 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 7.
W20260709 13:18:37.565254 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 67750.3us
I20260709 13:18:37.562125 19580 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 9.
I20260709 13:18:37.568699 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:37.569610 19504 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 4.
W20260709 13:18:37.571273 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 47613us
I20260709 13:18:37.572075 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:37.572881 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:37.573663 19661 raft_consensus.cc:2393] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:37.545210 22168 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:37.546157 22037 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:37.550915 22185 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:37.547252 22153 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:37.578718 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45651.1us
I20260709 13:18:37.586521 20631 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:18:37.559639 22230 raft_consensus.cc:697] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:37.537945 22232 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:18:37.574069 22215 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:37.575140 22172 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:37.580242 22210 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:37.615154 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:37.616987 19504 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:37.617661 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 45666us
I20260709 13:18:37.620177 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:37.601470 21984 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.622843 22237 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:37.629915 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:37.634168 19512 raft_consensus.cc:2410] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:37.618088 22153 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:37.627437 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:37.621196 22225 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:37.647598 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:37.589241 22168 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:37.662847 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:37.668419 21948 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:37.628052 22214 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.627341 22054 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:37.648041 22035 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.592038 22033 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.649125 22153 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.629987 22185 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.680985 19627 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:37.680003 22179 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:37.696509 22168 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.670365 22005 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.697469 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:37.708120 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.697597 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:37.626442 22226 consensus_queue.cc:1059] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
W20260709 13:18:37.701121 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 74980.5us
I20260709 13:18:37.708287 19580 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 7.
I20260709 13:18:37.667495 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:37.700485 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:37.626816 22215 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:18:37.713928 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:37.716245 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.716993 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:37.717860 19583 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:37.703958 22153 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:37.629179 22210 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.698024 22227 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:37.720966 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:37.721661 19505 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:37.719790 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:37.719043 22163 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:37.725235 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:37.726051 19584 raft_consensus.cc:2410] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:37.731000 22057 raft_consensus.cc:3055] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:37.628587 22230 consensus_queue.cc:237] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:37.731185 19586 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:18:37.746879 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 76638.9us
I20260709 13:18:37.714599 22187 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:37.722947 21948 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:37.702852 22225 consensus_queue.cc:1059] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:18:37.702280 22035 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.763684 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:37.766007 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:37.768559 22172 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.769026 22053 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.791368 22225 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.770150 21703 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.754945 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:37.791714 22053 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.733031 22057 raft_consensus.cc:740] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:37.780216 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:37.784230 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:37.763355 22242 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:37.784911 22231 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:37.839112 22231 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:37.840320 22053 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.840065 22231 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.791373 22172 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.723487 22185 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.791407 20662 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:37.714205 22005 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.834676 19581 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:37.841594 22231 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:37.779309 19395 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d05498e224814b9b8f31e3f965ab2583 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d56df3728fc04e37b2d29a3bcd91d167 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:18:37.854007 19395 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 74904.6us
I20260709 13:18:37.857383 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:37.858286 19507 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:37.843318 22211 consensus_meta.cc:287] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.566s	user 0.012s	sys 0.000s
I20260709 13:18:37.862141 22211 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.850566 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:37.796052 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:37.867961 19579 raft_consensus.cc:2410] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:37.869256 19581 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:37.874509 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.796684 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:37.875519 19657 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:37.875972 19587 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:37.792164 22225 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.753247 21957 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:18:37.797541 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:37.922199 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 52468.9us
I20260709 13:18:37.900593 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:37.834707 19586 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:37.796351 21981 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:37.797122 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:37.932623 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.912441 19507 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:18:37.794422 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:37.935813 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:37.936376 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:37.797955 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:37.933979 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:37.936859 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:37.793941 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:37.939129 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:37.939741 19583 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:37.939872 19581 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:37.939798 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.937584 19578 raft_consensus.cc:2376] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7. Re-sending same reply.
I20260709 13:18:37.784952 21963 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.943704 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:37.943888 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:37.944445 20662 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:37.944394 19506 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 7.
I20260709 13:18:37.788625 22227 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:37.931527 19585 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:37.937991 19582 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:37.946342 19586 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:37.946476 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:37.947468 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:37.946975 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:37.948310 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:37.948753 19507 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 8.
I20260709 13:18:37.844964 22172 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.853283 22208 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.849414 22179 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:37.792685 21982 consensus_queue.cc:1059] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.149s
I20260709 13:18:37.949182 19579 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:37.966342 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:37.951155 19584 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:37.967032 19580 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:37.849475 22035 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.847013 22185 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.971481 19585 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:37.971668 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:37.848038 22005 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:37.799242 22249 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.152s
I20260709 13:18:37.973739 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:37.965983 19587 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:37.845397 22186 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:37.968784 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 251880us
I20260709 13:18:37.803225 22058 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:37.798094 22215 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.152s
I20260709 13:18:37.974404 19583 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:37.974749 19582 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:37.979061 19586 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:18:37.802719 22163 consensus_queue.cc:1048] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.166s
I20260709 13:18:37.986032 21981 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:37.991402 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:37.997236 19579 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:37.993641 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:38.001303 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:38.002137 19585 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:37.847836 22057 consensus_queue.cc:260] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.006534 19627 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:38.005059 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:38.011564 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 63634.7us
I20260709 13:18:37.956336 22231 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:18:38.000648 19584 pending_rounds.cc:85] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 2
I20260709 13:18:38.013741 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:38.015296 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:38.016110 19584 pending_rounds.cc:107] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:18:38.016418 19584 raft_consensus.cc:2889] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:38.017264 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:38.020543 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:38.022222 19551 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:38.023633 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:38.024875 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:38.026087 19625 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:37.966001 22208 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.019853 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:38.042876 19512 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 8: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:38.047878 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:38.007548 22237 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.053248 19582 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:38.053495 19583 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:38.055899 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.057809 19509 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:38.059626 19506 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:38.068367 22257 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:38.070534 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:38.068215 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:38.075176 19587 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:37.998031 22232 consensus_queue.cc:1059] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:18:38.025666 22244 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:38.046300 21948 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:38.046113 22187 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:38.041002 22053 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:38.045413 22210 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:38.071570 22223 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:18:38.098275 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:38.101598 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:38.102180 19583 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.111016 19507 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 7.
I20260709 13:18:38.112366 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.070415 21984 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.078842 22226 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:38.120808 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:38.128193 19586 raft_consensus.cc:2410] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:38.092445 22244 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.012868 22035 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.120998 19580 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:38.097016 21948 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.095819 22233 raft_consensus.cc:3055] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:18:38.134294 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 152111us
I20260709 13:18:38.100587 22187 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.100741 22210 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.147379 19582 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:38.100107 22053 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:38.150789 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:38.080878 22237 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.122696 22185 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.156057 19586 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:38.167734 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:38.158898 19581 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
W20260709 13:18:38.186234 22196 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.000s	sys 0.014s
W20260709 13:18:38.186744 22196 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.000s	sys 0.014s
I20260709 13:18:38.130374 22244 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.168392 19582 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:38.190905 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:38.191712 19586 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:38.148941 21948 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:38.200883 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 65708.9us
I20260709 13:18:38.143419 22226 raft_consensus.cc:697] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:38.201524 20659 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:38.160435 22187 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:38.159804 22210 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.167083 22053 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.149781 22233 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:38.188844 21703 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:38.131294 21984 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.114980 21981 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.193040 22211 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:38.219218 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:38.219470 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:38.148308 22035 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.224531 19660 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:38.223678 19654 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:38.207161 22033 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.209389 22225 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:38.235491 19661 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:38.247957 22186 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:38.237562 22254 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:18:38.228797 22208 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:38.209652 22185 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:38.262579 19582 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:38.282497 19581 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:38.288604 21984 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:38.290307 22255 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:18:38.258621 22235 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:38.303426 19587 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:38.257364 22252 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:38.307983 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:38.310396 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:38.311287 19581 raft_consensus.cc:2410] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:38.314054 19580 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:38.315162 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:38.302021 22169 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.321677 22215 raft_consensus.cc:3055] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:38.322223 22215 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:38.322082 22169 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:38.324712 22169 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:38.292817 22226 consensus_queue.cc:237] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.326259 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:38.327029 20659 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:38.257381 22033 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.329912 22033 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:38.323267 22215 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.310066 22252 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.331934 22252 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:38.339082 22035 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:38.342234 19553 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:18:38.261981 22256 raft_consensus.cc:3055] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:38.342975 19585 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:38.346269 19580 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:38.350510 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:38.352932 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:38.254866 22233 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.354508 22233 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.354666 22237 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:38.349287 22033 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:38.358294 22033 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.358709 22033 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.358783 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.366592 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.348951 22256 raft_consensus.cc:740] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:38.364898 22163 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:18:38.331331 22215 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.372161 19580 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:18:38.377970 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.375514 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:38.364210 20662 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:38.377668 19627 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:38.368014 22225 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.384389 22261 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:38.366516 22153 consensus_meta.cc:287] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.629s	user 0.008s	sys 0.003s
I20260709 13:18:38.376924 21957 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:18:38.376103 22186 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:38.372499 22262 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:38.367698 19583 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:38.415357 22235 raft_consensus.cc:697] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 7 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:18:38.395781 19578 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:38.413136 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:38.423966 19580 raft_consensus.cc:2376] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10. Re-sending same reply.
I20260709 13:18:38.423604 22235 consensus_queue.cc:237] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:38.412717 22168 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:38.416103 22271 log.cc:927] Time spent T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:18:38.429665 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 51779.8us
I20260709 13:18:38.401381 21820 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:38.430095 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 64276us
I20260709 13:18:38.436896 19627 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:38.364953 22208 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:18:38.432915 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.440752 19586 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:18:38.445089 22243 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:38.445701 22243 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:38.446180 22243 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.447216 22033 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:38.445715 20662 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:38.432940 22262 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.450927 19585 raft_consensus.cc:2393] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:38.452219 22033 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:38.453996 22261 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:38.455529 19586 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:38.456063 22261 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:38.456825 22261 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.457341 19586 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:38.422533 22186 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:38.375001 22252 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.393499 22187 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:38.460675 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 402214us
I20260709 13:18:38.465420 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:38.470166 19658 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.006s	sys 0.022s
I20260709 13:18:38.457785 22033 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.418406 22153 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:38.452272 22262 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:38.486056 19510 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:38.470597 22186 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.488657 19508 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:38.430941 22225 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.493997 22211 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:38.495889 22272 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:18:38.496497 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:38.497560 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:38.497711 22276 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:38.487784 22033 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.501890 22186 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.538699 19586 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:38.504699 21948 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:38.548491 22058 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:38.548329 22243 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.549976 19587 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:18:38.550019 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 84711.7us
I20260709 13:18:38.530263 22262 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:38.555450 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.528667 22283 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:38.557559 19587 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 13:18:38.556406 20661 raft_consensus.cc:2368] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10.
I20260709 13:18:38.561797 22284 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.562700 22225 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:38.562438 22284 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.566286 22053 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.577405 22261 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:38.578451 22153 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:38.579274 22252 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:38.579525 22243 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:38.581928 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.535712 22211 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.584508 19587 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:38.591413 21948 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:38.593909 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.595641 22286 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:38.588642 22252 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:38.596503 22285 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:38.596791 22186 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:38.596550 22244 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:38.600044 22187 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:38.595804 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.475503 22256 consensus_queue.cc:260] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:38.537864 22276 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.601541 22033 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:38.617484 22185 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:38.602577 22244 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:38.614799 22210 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.608390 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:38.623842 19625 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:38.653256 19587 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:38.613346 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:38.654609 19579 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.610772 22256 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.589345 22053 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:38.610944 22267 consensus_queue.cc:1175] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "068c03c9dcc848e6bf909131b1f83065" responder_term: 8 status { last_received { term: 7 index: 7 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:38.623294 22226 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:18:38.597478 22058 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.612032 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.625847 22243 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:18:38.613894 22276 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:38.660904 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:38.662001 19508 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:38.662833 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:38.712541 22058 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.713351 20662 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.713902 22057 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.714862 22058 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:38.664132 22035 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:38.664870 22228 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:38.670750 19587 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 10.
I20260709 13:18:38.718861 22210 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:38.719622 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:38.720177 19587 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.603278 22211 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:38.685745 19478 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.722747 20631 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:18:38.723423 19582 raft_consensus.cc:2410] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:38.723666 19478 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.724105 22244 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:38.724637 22244 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 10 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:18:38.724695 19478 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.725402 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:38.725793 22053 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:38.726058 19582 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:38.725962 22268 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:38.726408 22243 consensus_queue.cc:1243] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:38.726994 22243 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:38.727133 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:38.727371 22243 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:38.727958 19582 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:38.725549 22244 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:38.728909 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:38.729043 22035 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:38.698799 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 86856.2us
I20260709 13:18:38.729776 19582 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:38.730103 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.730615 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:38.731300 22210 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:38.732627 22276 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:38.732944 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:38.699582 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:38.733726 19512 raft_consensus.cc:2410] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:38.733804 19507 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:38.734213 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:38.697417 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:38.734679 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:38.735013 19657 raft_consensus.cc:2410] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:38.712357 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:38.712306 22185 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:38.735222 19658 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.727427 22268 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:38.742918 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:38.689718 22179 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:18:38.738198 19504 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:38.755677 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:38.736415 19625 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:38.740453 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:38.742825 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:38.748212 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:38.757346 19587 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:38.757831 19503 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.748739 19579 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 8.
I20260709 13:18:38.736934 19478 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.731300 19582 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:38.755692 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:38.762979 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:38.764403 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:38.764863 19509 pending_rounds.cc:85] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 5
I20260709 13:18:38.764997 19659 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.765168 19509 pending_rounds.cc:107] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:18:38.765457 19509 raft_consensus.cc:2889] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:38.743343 22268 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:38.769917 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:38.770185 22268 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.772594 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:38.773451 19505 raft_consensus.cc:2410] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:18:38.774825 19652 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:38.774896 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:38.778666 19582 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:38.740734 20659 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:38.782459 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45595.6us
I20260709 13:18:38.782720 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:38.783206 19478 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.787002 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:38.790498 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:38.791581 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:38.792160 19656 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.793028 22233 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:38.793459 22233 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.793505 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:38.793952 22233 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:38.794229 19657 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:38.794371 22269 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:38.794945 22269 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:38.795296 22269 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.798316 20662 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:38.799605 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:38.800691 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:38.801184 19509 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:38.804219 19503 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:38.804353 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:38.804960 19655 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:38.804382 19553 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:18:38.741070 22054 raft_consensus.cc:3055] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:38.809243 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:38.811331 19659 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:38.812810 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:38.756217 22267 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.801770 22228 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:38.817597 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:38.823051 19504 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.817926 19657 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:38.826673 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:38.827359 19507 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.819193 19587 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:38.820518 19508 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:18:38.830658 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:38.831265 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.837338 19655 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:18:38.828881 19478 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.844460 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.809700 22054 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:38.849718 19478 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.814216 22053 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:38.853950 19478 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:38.856606 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.822026 22267 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.861253 19587 raft_consensus.cc:1275] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:38.850433 21963 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:38.854076 22035 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:38.854610 22237 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:38.854836 22053 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:38.840595 22228 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.850232 22058 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:18:38.898088 19661 raft_consensus.cc:2410] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:18:38.908591 22268 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.896514 21984 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:18:38.884518 22276 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:18:38.913951 22290 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:38.916159 22179 consensus_queue.cc:1059] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:18:38.920822 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 116504us
I20260709 13:18:38.921903 22185 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:38.922459 22185 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:38.923278 22185 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:38.925755 21948 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:38.926385 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:38.926347 21948 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.927073 19584 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.928510 21948 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:38.869767 22196 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:38.873934 21963 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:38.936277 19507 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:38.942370 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.943941 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:38.945513 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:38.883653 22035 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:38.884812 22237 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:38.895395 22053 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.955602 19586 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:38.958284 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:38.981467 19658 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:38.976935 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:38.934319 22196 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:38.986020 22196 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.986258 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:38.986438 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:38.989284 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.946836 22282 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:38.963122 22288 log.cc:927] Time spent T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:18:38.947897 21963 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.992614 19658 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:38.971669 22237 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:39.001279 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 143560us
I20260709 13:18:38.957099 22035 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.869700 22054 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:38.998059 19509 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:39.005429 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:39.005787 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 115445us
I20260709 13:18:39.006029 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:39.006780 19478 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.989846 22187 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:38.987443 22033 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:39.012880 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.956449 22057 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:18:39.017037 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:39.022814 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:38.998353 22227 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:38.985311 20659 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:39.036202 19584 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:39.015888 21984 consensus_queue.cc:1243] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:39.042953 22225 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:39.044770 22267 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:39.046553 22233 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.047850 22268 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:39.038447 22269 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.049952 22295 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:18:39.052210 22203 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:39.053354 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:39.054752 20661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59430 (request call id 84) took 1308 ms. Trace:
I20260709 13:18:39.061857 19655 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:39.063789 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:39.065310 19659 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:39.015105 22285 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:39.087422 22262 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:39.026103 22286 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:39.020183 22231 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 13:18:39.027827 22252 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:38.998736 22210 consensus_queue.cc:1059] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:18:39.021307 22058 raft_consensus.cc:3055] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:18:39.117827 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 111178us
I20260709 13:18:39.192327 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:39.118556 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:38.998615 22282 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.026994 22187 raft_consensus.cc:697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:39.137496 19553 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:39.035177 22033 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:39.140589 19656 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:39.013124 21948 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.102s
W20260709 13:18:39.181913 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 128654us
W20260709 13:18:39.242292 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 50123.8us
I20260709 13:18:39.143806 22290 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.249033 22290 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.249372 19478 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:39.185643 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 162902us
I20260709 13:18:39.250667 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:39.221407 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:39.251209 22290 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:39.251564 21984 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:39.252079 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:39.253063 21984 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:39.253981 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:39.160353 22297 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:39.254586 19656 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:39.254988 22297 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.255438 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:39.255549 22297 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.256105 19656 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:39.256922 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:39.225878 19506 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:39.220610 21820 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:39.259471 19661 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:39.257570 19656 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:39.261581 19656 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:39.262406 19581 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:39.175024 22284 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:39.162612 20661 rpcz_store.cc:276] 0709 13:18:37.745989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.754634 (+  8645us) service_pool.cc:224] Handling call
0709 13:18:39.054537 (+1299903us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b5400018454. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:39.054670 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1662049152}
I20260709 13:18:39.234447 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:39.237954 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:39.265791 19476 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:39.238561 22302 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.246462 22215 consensus_queue.cc:1059] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:39.247098 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:39.247674 22268 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:39.188256 22267 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.266429 19510 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
W20260709 13:18:39.271643 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 134283us
I20260709 13:18:39.191475 22058 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:39.273097 19504 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:39.273808 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:39.270968 19476 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:39.275336 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:39.282291 19661 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:39.286017 19478 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:39.284328 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:39.297919 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 50891.1us
I20260709 13:18:39.301214 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:39.274147 22299 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:39.275116 22210 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:39.277796 22225 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:39.275346 21963 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.310717 22282 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:39.311091 21963 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:39.311477 22286 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:39.311717 21963 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:39.270380 22244 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:18:39.312088 21963 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.312458 21963 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:39.312338 22243 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.322012 22187 consensus_queue.cc:237] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.326956 22058 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.328718 22058 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:39.329795 22294 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:39.285015 21984 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:18:39.296489 22284 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:39.337311 22233 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:39.305941 22268 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:39.338923 22268 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.339425 22268 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:39.305487 21948 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:39.342445 21948 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:39.343741 21948 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.346684 22269 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:39.347570 22269 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:39.348136 22269 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:39.349910 22243 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:39.351305 22035 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.352784 19511 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:39.354039 22033 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.282827 22267 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.358769 19654 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:39.360206 22267 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:39.300626 22290 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:18:39.275507 22302 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.372576 22302 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:39.318569 22210 raft_consensus.cc:697] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:39.375521 22295 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.375454 22210 consensus_queue.cc:237] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:39.376389 22295 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.377556 22225 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:39.378858 22225 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.381999 22306 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.382848 22306 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:39.384675 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 67662.1us
I20260709 13:18:39.385813 19627 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:39.390618 19580 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:39.398063 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:39.398746 19587 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:39.401036 19579 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:39.403219 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.403224 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:39.404142 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:39.404791 19580 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:39.409581 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:39.410723 19587 raft_consensus.cc:2393] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 7: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:39.413064 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:39.308117 22299 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.419866 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:39.420684 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:39.424052 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:39.413373 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:39.418251 19654 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:39.424999 19580 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:39.428997 19503 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:39.436479 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:39.441206 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 175766us
W20260709 13:18:39.445392 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 164825us
I20260709 13:18:39.403558 22294 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:39.384375 22295 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:39.449182 19580 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:39.349155 22269 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.431720 22299 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.452294 19627 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:39.448864 22257 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.452659 22035 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:39.482686 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 196773us
I20260709 13:18:39.483747 19478 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:39.475014 20661 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:39.489259 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:39.456272 22285 consensus_queue.cc:1059] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:18:39.472105 22295 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:39.502974 19512 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:18:39.503597 19512 pending_rounds.cc:85] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 4
I20260709 13:18:39.503921 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:39.504416 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 47134.7us
I20260709 13:18:39.504575 19510 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:39.503954 19512 pending_rounds.cc:107] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:18:39.505184 19512 raft_consensus.cc:2889] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:39.494305 22275 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:39.515825 19503 raft_consensus.cc:1217] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 6.3->[8.4-10.5]   Dedup: 8.4->[10.5-10.5]
I20260709 13:18:39.526041 19503 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: [8.4-10.5]
I20260709 13:18:39.531988 22316 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.532646 22316 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.534371 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:39.535744 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:39.536527 19512 raft_consensus.cc:2393] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 7: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:39.537511 19512 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:39.481294 22257 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.525859 22275 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:39.627233 22053 consensus_meta.cc:287] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.649s	user 0.012s	sys 0.000s
I20260709 13:18:39.626878 22304 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:39.651149 22053 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.628024 21820 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.633347 21963 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:39.638418 22196 consensus_meta.cc:287] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.652s	user 0.012s	sys 0.000s
I20260709 13:18:39.648003 19580 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:18:39.506989 22267 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:18:39.651377 22304 raft_consensus.cc:697] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:39.627385 22276 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:39.503453 22295 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.511088 22310 consensus_queue.cc:1059] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.150s
W20260709 13:18:39.686108 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 147788us
W20260709 13:18:39.649910 22237 consensus_meta.cc:287] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.625s	user 0.016s	sys 0.000s
W20260709 13:18:39.704176 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 218814us
I20260709 13:18:39.702644 22237 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.705025 19478 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:39.705818 19509 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:39.706341 19478 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:39.706780 22318 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:39.700994 22294 raft_consensus.cc:697] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:18:39.708554 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 193690us
I20260709 13:18:39.709892 22328 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:39.711061 22237 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:39.652920 22275 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:39.716259 21963 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:39.717707 22307 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.193s
I20260709 13:18:39.639417 22306 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:39.719547 22310 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:39.720100 22324 raft_consensus.cc:3055] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:39.720630 22324 raft_consensus.cc:740] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:39.680038 22267 consensus_queue.cc:1243] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:39.728206 22306 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.721692 22324 consensus_queue.cc:260] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:39.728206 19478 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:39.731019 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:39.732823 19478 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:39.735868 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:39.736644 19478 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:39.737561 19478 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:39.720094 22310 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.740697 22310 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:39.742194 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:39.743050 22324 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.744362 22297 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:39.745666 19505 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:39.746615 22304 consensus_queue.cc:237] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.708894 22294 consensus_queue.cc:237] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.752957 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:39.721529 22053 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:39.679570 22196 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.680676 21820 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.735188 22035 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:39.809725 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:39.763473 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:39.817096 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.816684 22035 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.825383 22035 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:39.826229 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 67705us
I20260709 13:18:39.834329 19581 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:39.736014 22306 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.838491 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:39.842057 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:39.851089 19508 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:18:39.830570 21963 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:39.843115 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:39.843303 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:39.842144 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:39.852742 19660 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 5.
I20260709 13:18:39.862428 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:39.827234 22268 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:39.991391 19510 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:39.863317 19583 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:39.981993 20619 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:39.918812 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:39.919472 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:39.991078 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 72902.8us
I20260709 13:18:39.827369 22319 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:39.852422 21963 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:40.005033 22287 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.013s	sys 0.041s
I20260709 13:18:40.011382 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:40.013516 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:40.006736 22235 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:40.036830 22169 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:40.018146 22309 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:40.021962 22257 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:40.022253 22268 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.027397 22196 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.056022 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:40.057087 19656 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:39.988570 22316 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:40.067031 19661 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:39.830293 22237 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.178s
W20260709 13:18:40.009112 22299 consensus_meta.cc:287] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
I20260709 13:18:40.038079 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:40.069509 19508 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 10.
I20260709 13:18:40.009871 22319 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.031112 19511 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:40.073253 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:40.029971 21963 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.074673 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:40.033419 22287 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.013s	sys 0.041s
I20260709 13:18:40.078949 19507 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:40.084439 22297 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:40.085362 22268 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.078471 20661 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:18:40.056596 22295 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:40.029608 22275 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.126397 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:40.074460 22237 consensus_queue.cc:1243] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:40.127570 19656 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:40.131539 19583 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:40.086190 22196 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:40.130584 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.135553 19511 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:40.130427 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 119128us
I20260709 13:18:40.075268 22319 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:40.133867 19478 leader_election.cc:400] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615) with higher term. Message: Invalid argument: T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10.
W20260709 13:18:40.128141 22058 consensus_meta.cc:287] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.799s	user 0.009s	sys 0.005s
I20260709 13:18:40.137889 19478 leader_election.cc:403] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:40.142233 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:40.142848 19583 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:40.076597 22299 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.090261 22268 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.157322 22335 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.158219 22335 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.161165 22335 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:40.173105 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:40.176679 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:40.177721 19656 raft_consensus.cc:2410] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 13:18:40.182794 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.196314 22344 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615) with higher term. Message: Invalid argument: T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10.
I20260709 13:18:40.138422 22196 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:40.151613 22306 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.203428 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:40.205870 19583 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
W20260709 13:18:40.215080 22338 log.cc:927] Time spent T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:18:40.216295 22344 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:40.216866 22344 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:40.221201 22243 consensus_meta.cc:287] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.870s	user 0.012s	sys 0.000s
I20260709 13:18:40.210216 22235 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:40.227113 22305 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.995s	user 0.003s	sys 0.000s
I20260709 13:18:40.230001 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:40.230870 22340 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:18:40.232614 21963 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.235014 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:40.248848 19656 raft_consensus.cc:2410] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:18:40.236995 22327 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.532s	user 0.002s	sys 0.000s
I20260709 13:18:40.250524 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:40.238623 22179 raft_consensus.cc:3055] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:40.243988 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:40.251279 19656 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:40.251828 19583 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:40.249292 22235 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:40.255074 22348 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:40.256229 19625 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:40.256299 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:40.256361 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:40.257272 19658 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:40.256568 22035 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.261535 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:40.262365 19658 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:40.255971 22179 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:40.263516 22179 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.264472 22179 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:40.269203 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:40.252467 22309 raft_consensus.cc:697] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:40.273167 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:40.257997 22243 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.286289 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:40.320827 19506 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:40.321950 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:40.323628 19506 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:18:40.326598 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:40.330231 22309 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.299023 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:40.270386 22035 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.319322 19583 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 8: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:18:40.334807 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:40.337915 22252 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:40.310161 22319 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.338356 22252 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:40.339231 22252 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.340175 22319 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.340802 22319 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:40.342224 19511 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:18:40.345345 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:40.349050 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:40.349732 22228 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:40.350930 19507 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:40.352267 19507 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:40.352547 21963 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.357935 22235 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.358845 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:40.359458 19658 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.363235 19506 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:40.343770 22319 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.366344 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:40.368088 19660 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 8.
I20260709 13:18:40.361331 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:40.371162 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:40.372400 19508 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:18:40.376557 22323 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.672s	user 0.000s	sys 0.004s
I20260709 13:18:40.380681 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:40.381548 19587 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.387558 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:40.391701 19478 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:40.392990 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:40.393661 19583 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:40.396138 21963 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:40.396605 21963 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.396939 21963 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.399900 22302 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
W20260709 13:18:40.402455 22301 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 1.086s	user 0.002s	sys 0.000s
I20260709 13:18:40.406510 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1880) took 1879 ms. Trace:
I20260709 13:18:40.419123 22313 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:40.419741 22313 raft_consensus.cc:697] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:40.419870 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1895) took 1017 ms. Trace:
I20260709 13:18:40.420627 22313 consensus_queue.cc:237] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.422220 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1892) took 1023 ms. Trace:
I20260709 13:18:40.420327 19579 rpcz_store.cc:276] 0709 13:18:39.402682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.407063 (+  4381us) service_pool.cc:224] Handling call
0709 13:18:39.407559 (+   496us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:39.422233 (+ 14674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.422281 (+    48us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:39.445148 (+ 22867us) log.cc:844] Serialized 78 byte log entry
0709 13:18:39.489265 (+ 44117us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:39.502620 (+ 13355us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.419175 (+916555us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b1800313600. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e5e7c0a 00007f6c37d27219 00007f6c2e66fa40 00007f6c2e66a4e4 00007f6c2e66a455 00007f6c31752060 00007f6c31764716 00007f6c31775287 00007f6c31775208
0709 13:18:40.419380 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.419464 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:40.419504 (+    40us) raft_consensus.cc:1685] finished
0709 13:18:40.419598 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.419807 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5529,"prepare.queue_time_us":14724,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":14540,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":12427,"spinlock_wait_cycles":3298560,"thread_start_us":18430,"threads_started":1,"wal-append.queue_time_us":74007}
I20260709 13:18:40.426347 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:40.426992 19579 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:40.427886 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:40.428606 19587 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:40.429381 19579 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.429982 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:40.428676 19478 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:40.430650 19587 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:40.422636 19585 rpcz_store.cc:276] 0709 13:18:39.398652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.398794 (+   142us) service_pool.cc:224] Handling call
0709 13:18:39.399108 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:39.399593 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.399620 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:39.402963 (+  3343us) log.cc:844] Serialized 26 byte log entry
0709 13:18:39.499271 (+ 96308us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:39.519860 (+ 20589us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.421911 (+902051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.421989 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:40.422033 (+    44us) raft_consensus.cc:1685] finished
0709 13:18:40.422048 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.422163 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":908890,"prepare.queue_time_us":20364,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":243,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":18148,"thread_start_us":49955,"threads_started":1,"wal-append.queue_time_us":96280}
I20260709 13:18:40.441129 19478 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:40.448539 22328 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.020s	sys 0.021s
W20260709 13:18:40.449141 22328 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.020s	sys 0.021s
I20260709 13:18:40.449505 22328 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:40.456740 19587 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:40.457894 19658 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:40.460767 19478 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:40.461719 22035 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:18:40.462419 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.462460 22035 raft_consensus.cc:697] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:40.463994 22035 consensus_queue.cc:237] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.406906 19582 rpcz_store.cc:276] 0709 13:18:38.526922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.779483 (+252561us) service_pool.cc:224] Handling call
0709 13:18:38.779770 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.930554 (+150784us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:38.930844 (+   290us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.069404 (+138560us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b18003b4940. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d522 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:18:39.114864 (+ 45460us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:39.119928 (+  5064us) log.cc:844] Serialized 26 byte log entry
0709 13:18:39.120121 (+   193us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:39.120479 (+   358us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.141741 (+ 21262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.141854 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:40.401869 (+1260015us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:18:40.406290 (+  4421us) raft_consensus.cc:1685] finished
0709 13:18:40.406309 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.406449 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":179977,"prepare.queue_time_us":4089,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":2608,"raft.queue_time_us":172501,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":21150,"spinlock_wait_cycles":42342400,"thread_start_us":183177,"threads_started":1,"wal-append.queue_time_us":272758}
I20260709 13:18:40.467948 19585 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:40.451210 22053 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:40.472425 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:40.466274 22302 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:40.474231 19579 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
W20260709 13:18:40.450920 22185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.001s	sys 0.013s
I20260709 13:18:40.470649 22319 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.467078 19587 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:18:40.475514 19582 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:18:40.472515 22053 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.471643 21948 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.472924 22284 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:40.486797 19582 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:18:40.481755 22185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.001s	sys 0.013s
W20260709 13:18:40.498167 19654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1664) took 1437 ms (client timeout 1862 ms). Trace:
I20260709 13:18:40.484776 19583 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:40.509806 22225 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:40.510499 22225 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.513180 22225 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.513797 22227 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.514384 22227 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.516711 22227 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.518111 22283 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.518777 22283 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.521065 22283 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:40.507614 19654 rpcz_store.cc:269] 0709 13:18:39.060543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.118357 (+ 57814us) service_pool.cc:224] Handling call
0709 13:18:40.497935 (+1379578us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54001ec654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:40.498054 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375258880}
I20260709 13:18:40.523990 22309 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:40.525223 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:40.526347 19583 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 8.
I20260709 13:18:40.487711 22053 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:40.486021 22290 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.508690 19579 pending_rounds.cc:85] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 1
I20260709 13:18:40.481587 22302 raft_consensus.cc:697] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:40.525013 22284 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.544780 22309 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.546994 19579 pending_rounds.cc:107] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:18:40.547300 19580 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:40.503361 21948 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.506130 22282 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.571964 19510 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:40.573941 22282 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.575091 22268 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.551381 19579 raft_consensus.cc:2889] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:40.554123 21963 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.554194 22302 consensus_queue.cc:237] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.585824 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:40.586498 19661 raft_consensus.cc:2376] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7. Re-sending same reply.
I20260709 13:18:40.556622 22284 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.585911 21957 raft_consensus.cc:3055] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:40.589800 21957 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:40.590921 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:40.590725 21957 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.591571 19654 raft_consensus.cc:2376] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6. Re-sending same reply.
I20260709 13:18:40.591918 21957 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.592170 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:40.592818 19658 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:40.569545 22035 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.594131 22035 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.595860 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:40.560449 22054 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.561017 20659 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 8: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:18:40.621387 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:40.563175 21948 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.564472 22344 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.550458 22290 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.618520 22284 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:40.619252 22268 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.619742 22282 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.632889 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:40.634246 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:40.642268 21963 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.631008 22033 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:40.474884 22328 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.648197 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:40.650761 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:40.645423 22187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.008s	sys 0.007s
I20260709 13:18:40.666184 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:40.637755 22268 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.667907 19506 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:40.669204 19506 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:40.671420 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:40.672501 22309 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.672996 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:40.673820 19508 raft_consensus.cc:2410] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:40.674660 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:40.675361 19508 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 6: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:40.676059 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:40.672540 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:40.682765 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.657998 22362 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:40.669965 19506 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.689299 19506 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:40.689360 19510 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:40.692051 22268 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.668912 22035 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:40.694937 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2066) took 1471 ms. Trace:
I20260709 13:18:40.695329 19509 rpcz_store.cc:276] 0709 13:18:39.223008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.231825 (+  8817us) service_pool.cc:224] Handling call
0709 13:18:39.232099 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.706327 (+474228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.694673 (+988346us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b540012f554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:40.694872 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1088863616}
I20260709 13:18:40.696817 19584 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:40.703317 22317 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.983s	user 0.002s	sys 0.000s
W20260709 13:18:40.704506 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.706918 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:40.707633 19661 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:40.709038 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2072) took 1466 ms. Trace:
I20260709 13:18:40.709605 19505 rpcz_store.cc:276] 0709 13:18:39.243137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.243355 (+   218us) service_pool.cc:224] Handling call
0709 13:18:39.243680 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.746053 (+502373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.708817 (+962764us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54001b0b54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:40.708982 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154009856}
I20260709 13:18:40.711330 22252 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:40.715274 22196 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:40.719322 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:40.720023 19582 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:40.720356 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:40.721045 19587 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:40.734443 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:40.735220 19582 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:40.735267 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:18:40.738389 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.739306 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.740762 21981 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:40.741333 21981 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.735435 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:40.745642 19583 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:40.747656 22299 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:40.750982 22187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.009s	sys 0.008s
I20260709 13:18:40.758610 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:40.786537 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:40.787809 19658 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:40.802227 19504 raft_consensus.cc:1240] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:40.804337 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:40.804337 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:40.816144 19661 raft_consensus.cc:2410] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:40.815878 22035 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:40.753755 22203 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.819631 22035 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.820117 22203 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.819783 22268 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:40.822381 19654 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:40.822559 22268 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.823195 22302 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:40.823659 22302 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:40.824739 22302 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:40.826581 22302 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.823202 22268 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.829494 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:40.830551 22282 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:40.831051 22282 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.838867 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:40.801396 22299 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:40.841125 22329 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:40.839382 22211 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:40.853471 22211 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:40.847880 22299 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:40.856180 22275 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:40.838084 22282 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.841132 22320 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.939311 22286 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:40.942866 22286 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:40.925876 22187 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:41.020399 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:40.837394 19478 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:41.025903 19583 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:41.022392 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:41.029254 19585 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:41.030627 19625 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:41.036041 19585 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
W20260709 13:18:41.023844 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 185097us
W20260709 13:18:41.069487 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 232202us
I20260709 13:18:41.070173 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:41.070861 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.070824 19584 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:41.072306 19478 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:41.080600 19506 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:18:41.081427 19506 pending_rounds.cc:85] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 6
I20260709 13:18:41.081777 19506 pending_rounds.cc:107] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:18:41.082073 19506 raft_consensus.cc:2889] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:40.916713 22320 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.077265 19583 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:18:41.091429 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:41.092288 19661 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:41.092402 19587 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:41.019465 22262 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:41.086337 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:41.098024 19656 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.086647 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:41.093647 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:41.098474 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:41.099081 19584 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:41.103116 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:41.103626 19659 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:41.104044 19583 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
W20260709 13:18:41.084811 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 46366.3us
I20260709 13:18:41.094595 19657 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:41.046798 22187 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.107726 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:41.107149 19652 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:41.110754 19658 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:41.046458 22275 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:41.081128 22297 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:41.085557 22309 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:41.115984 19655 raft_consensus.cc:3055] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:41.046156 22324 consensus_queue.cc:1059] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:18:41.121070 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:41.104843 21820 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:41.122037 19655 raft_consensus.cc:740] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:18:41.123960 21957 consensus_meta.cc:287] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.531s	user 0.022s	sys 0.014s
I20260709 13:18:41.124801 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:41.113513 22054 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:18:41.111313 22208 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.125450 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:41.045908 22329 consensus_queue.cc:1059] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:18:41.132813 19656 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:41.090565 22344 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:18:41.126628 21963 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:41.108146 22185 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:18:41.185022 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:41.135151 22235 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:41.195808 22235 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.196316 22235 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:41.155330 22208 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:41.196724 22053 consensus_meta.cc:287] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.644s	user 0.020s	sys 0.016s
I20260709 13:18:41.197191 22053 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.199354 22053 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:41.200193 22320 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:41.125406 22340 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:18:41.201797 21963 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:41.202826 21963 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.180037 22210 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.205991 22210 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.207324 22248 raft_consensus.cc:3055] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:41.207470 22187 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:41.135535 22268 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:41.208019 22210 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:41.114168 22262 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.135615 22285 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.207777 22248 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:41.209501 19582 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:41.135246 22275 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:41.210844 22248 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.211139 22275 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.212038 22248 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.212766 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:41.213363 19587 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:41.144531 22309 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.214336 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:41.214455 22341 consensus_queue.cc:1059] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:41.214711 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:41.215332 22309 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:41.215924 22309 raft_consensus.cc:3055] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:41.215989 22035 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:41.216373 22309 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:41.215504 19582 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:41.179526 19655 consensus_queue.cc:260] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.220961 19655 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:41.121745 19625 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:41.153471 22286 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:41.221644 19587 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:41.223152 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:41.189102 19584 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
W20260709 13:18:41.225541 19652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1684) took 1487 ms (client timeout 1834 ms). Trace:
I20260709 13:18:41.237066 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:41.227133 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:41.237787 19652 rpcz_store.cc:269] 0709 13:18:39.738344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.741895 (+  3551us) service_pool.cc:224] Handling call
0709 13:18:41.225329 (+1483434us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400023ad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:41.225470 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3137515392}
I20260709 13:18:41.243887 19582 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:41.186463 22299 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:41.182060 22290 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:41.258502 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:41.259359 19587 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:41.261667 19578 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.009s	sys 0.009s
W20260709 13:18:41.261976 19578 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.009s	sys 0.009s
I20260709 13:18:41.200156 22208 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:41.223981 22310 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.276418 19655 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:18:41.277860 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 194353us
I20260709 13:18:41.210103 22262 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:41.282020 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.282969 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.260717 22286 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:41.232671 21981 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:41.286573 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1619) took 1454 ms. Trace:
I20260709 13:18:41.285847 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:41.210054 22285 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:41.261483 22304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.025s	sys 0.029s
W20260709 13:18:41.302328 22304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.025s	sys 0.030s
I20260709 13:18:41.305928 22211 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:41.285691 22310 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.310082 22310 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:41.284340 22302 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.315111 22282 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.317183 22282 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:41.318378 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 196742us
I20260709 13:18:41.287555 19578 rpcz_store.cc:276] 0709 13:18:39.832328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.833762 (+  1434us) service_pool.cc:224] Handling call
0709 13:18:39.842502 (+  8740us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.544577 (+702075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.544610 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:40.553268 (+  8658us) log.cc:844] Serialized 26 byte log entry
0709 13:18:40.654232 (+100964us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:41.262335 (+608103us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.285697 (+ 23362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.285765 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.285806 (+    41us) raft_consensus.cc:1685] finished
0709 13:18:41.285817 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.286508 (+   691us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":656802,"raft.queue_time_us":639341,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"thread_start_us":674829,"threads_started":3,"wal-append.queue_time_us":130324}
I20260709 13:18:41.327724 19587 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:41.311468 22302 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.285079 22299 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:41.290518 22303 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:41.346913 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.348606 19578 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:41.349398 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 63671.8us
I20260709 13:18:41.350297 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:41.352891 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:41.353099 19625 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:41.350935 22283 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:41.257294 22309 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:41.360416 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.351163 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1621) took 1518 ms. Trace:
I20260709 13:18:41.326476 21820 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:41.369688 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:41.301689 22286 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.375566 19578 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:41.345517 22358 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:41.387368 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:41.352226 22360 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:41.351823 22282 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:41.395365 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 285496us
I20260709 13:18:41.362202 19581 rpcz_store.cc:276] 0709 13:18:39.832952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.860817 (+ 27865us) service_pool.cc:224] Handling call
0709 13:18:39.861153 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.578749 (+717596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.578800 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:40.623951 (+ 45151us) log.cc:844] Serialized 26 byte log entry
0709 13:18:40.780517 (+156566us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:41.341827 (+561310us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.350800 (+  8973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.350890 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.350938 (+    48us) raft_consensus.cc:1685] finished
0709 13:18:41.350955 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.351099 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":625824,"prepare.queue_time_us":529477,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":621596,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":1964,"thread_start_us":556664,"threads_started":3,"wal-append.queue_time_us":289632}
I20260709 13:18:41.400234 19656 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:41.385682 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:41.401034 19504 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:41.364454 22290 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:41.403631 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:41.366586 21820 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.366544 22163 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:41.412643 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:41.413710 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:41.408339 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:41.408667 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:41.416402 19506 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:41.410274 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:41.410543 19581 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:41.412514 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:41.418105 19656 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.413223 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:41.421027 19512 raft_consensus.cc:2393] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 7: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:41.423558 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:41.426052 19655 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:41.377272 22262 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:41.414788 19661 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
W20260709 13:18:41.395097 22318 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.687s	user 0.004s	sys 0.019s
I20260709 13:18:41.429951 19511 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:41.377218 22210 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:41.347282 22299 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.360963 22329 consensus_queue.cc:1059] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:18:41.431345 19476 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:41.431789 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:41.364213 22233 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:18:41.367882 22208 consensus_queue.cc:1059] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:18:41.367197 22054 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:18:41.369096 22320 consensus_queue.cc:1059] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:18:41.373636 22276 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:18:41.444499 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:41.454229 19510 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
W20260709 13:18:41.436350 22318 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.729s	user 0.005s	sys 0.019s
I20260709 13:18:41.359817 22303 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.451512 19476 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:41.366428 22283 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.424743 21820 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:41.410368 22290 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:41.455276 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:41.386819 22187 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 13:18:41.453945 22350 log.cc:927] Time spent T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:18:41.430397 22360 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:41.423013 22163 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:41.456761 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:41.447117 19658 raft_consensus.cc:2410] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:41.408353 22282 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.463264 19510 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:41.404306 22359 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:18:41.403038 22362 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:18:38.767956 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:41.477793 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:41.450033 22329 consensus_queue.cc:1243] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:41.404610 22358 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.451200 21963 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:41.473598 19476 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:41.456615 22324 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:41.473477 19406 catalog_manager.cc:5697] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 4 to 6, leader changed from 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 6 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:18:41.488822 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 414350us
I20260709 13:18:41.457343 22318 raft_consensus.cc:697] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:41.463351 22235 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:41.462342 22320 consensus_queue.cc:1243] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:41.473541 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1642) took 1221 ms. Trace:
I20260709 13:18:41.515955 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:41.525333 19585 raft_consensus.cc:2393] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:41.517175 19508 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.517830 19578 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:41.463446 22290 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.524855 19579 rpcz_store.cc:276] 0709 13:18:40.251875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.507830 (+255955us) service_pool.cc:224] Handling call
0709 13:18:40.508374 (+   544us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:40.637791 (+129417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.637836 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:40.638687 (+   851us) log.cc:844] Serialized 52 byte log entry
0709 13:18:41.106156 (+467469us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:41.434912 (+328756us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.473030 (+ 38118us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.473213 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.473305 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.473341 (+    36us) raft_consensus.cc:1685] finished
0709 13:18:41.473352 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.473487 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76516,"prepare.queue_time_us":193517,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":144605,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":3076,"spinlock_wait_cycles":71424,"thread_start_us":736796,"threads_started":2,"wal-append.queue_time_us":541238}
I20260709 13:18:41.461192 22211 raft_consensus.cc:3055] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:41.501266 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:41.485212 19656 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:41.477298 22057 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:41.520702 22318 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:41.443055 22377 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:18:41.460553 22210 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:18:41.482779 22163 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:41.515691 22305 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:41.531486 19510 raft_consensus.cc:2410] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:41.478421 22382 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:41.521557 22299 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:41.542033 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 68518.7us
I20260709 13:18:41.539705 19579 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:41.571471 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:41.540910 19478 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:41.521974 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.521972 22324 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:41.579329 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:41.580327 19510 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:41.530522 22211 raft_consensus.cc:740] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:41.581957 19510 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:41.584904 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:41.543905 22179 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:41.590251 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1620) took 1757 ms. Trace:
I20260709 13:18:41.626111 19508 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:41.618359 19586 rpcz_store.cc:276] 0709 13:18:39.832647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.832780 (+   133us) service_pool.cc:224] Handling call
0709 13:18:39.833129 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.471754 (+638625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.471786 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:40.475523 (+  3737us) log.cc:844] Serialized 26 byte log entry
0709 13:18:40.633024 (+157501us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:41.127123 (+494099us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.588929 (+461806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.589874 (+   945us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.589943 (+    69us) raft_consensus.cc:1685] finished
0709 13:18:41.589963 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.590154 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":650115,"prepare.queue_time_us":676585,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":704887,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":8107,"thread_start_us":1056284,"threads_started":3,"wal-append.queue_time_us":254032}
I20260709 13:18:41.631112 19510 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:18:41.632548 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 50275.8us
I20260709 13:18:41.634059 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:41.639705 19478 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:41.643366 22196 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:41.643999 22196 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:41.644196 22299 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:41.644550 22196 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:41.647842 22252 consensus_meta.cc:287] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.936s	user 0.013s	sys 0.005s
I20260709 13:18:41.644639 22299 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.587173 22380 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:41.614826 22227 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:41.613662 22302 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:41.583107 22285 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:41.643249 22382 consensus_queue.cc:1059] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:41.611469 22304 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:41.629083 22372 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
W20260709 13:18:41.664536 22370 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:18:41.664062 22299 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:41.664629 22380 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.662298 19478 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:41.691080 19478 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:41.672331 21963 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:41.635667 20662 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:41.673805 19508 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:18:41.656826 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 273710us
I20260709 13:18:41.693785 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:41.668722 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 55456.7us
W20260709 13:18:41.705233 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.716086 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:41.716380 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.716665 19579 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:41.716861 19476 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:41.722659 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:41.722970 19508 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:41.723254 19510 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:18:41.684684 22304 raft_consensus.cc:697] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:41.703202 22179 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:41.693079 22380 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.714299 21963 raft_consensus.cc:697] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:41.670608 22324 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.711992 22382 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:41.735016 19579 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 9.
I20260709 13:18:41.748623 19510 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:41.733739 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 276787us
I20260709 13:18:41.725554 22303 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:41.733554 22340 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.768013 22340 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:41.735132 22179 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:41.768462 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:41.675771 22211 consensus_queue.cc:260] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.747010 22282 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:41.769243 22179 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.749372 22377 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:18:41.756232 22385 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 13:18:41.749017 22381 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 13:18:41.740676 22035 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:41.825708 22382 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:41.830133 21957 raft_consensus.cc:3055] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:41.818691 22392 log.cc:927] Time spent T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:18:41.818887 22395 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:18:41.830338 22386 log.cc:927] Time spent T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
W20260709 13:18:41.835084 22387 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:18:41.857934 22374 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.336s	user 0.000s	sys 0.001s
I20260709 13:18:41.884986 22275 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.830772 22341 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:41.820719 22233 raft_consensus.cc:3055] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:41.836534 22324 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.835757 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:41.835209 22283 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:41.840968 22235 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:41.835366 22358 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:41.907073 22341 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.869395 21957 raft_consensus.cc:740] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:18:41.910250 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.908723 22233 raft_consensus.cc:740] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:41.894627 22211 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:41.940403 22290 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.970208 22309 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:41.971796 22290 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:41.911612 22275 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.915620 21820 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.831207 21963 consensus_queue.cc:237] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.763383 22196 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:41.961831 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 242011us
I20260709 13:18:41.984761 19625 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:41.958595 22341 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:41.816509 22304 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:41.966799 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60692 (request call id 109) took 1611 ms. Trace:
W20260709 13:18:41.973068 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 250515us
W20260709 13:18:41.974969 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 207503us
W20260709 13:18:41.975040 22248 consensus_meta.cc:287] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.763s	user 0.011s	sys 0.002s
I20260709 13:18:41.996903 19507 rpcz_store.cc:276] 0709 13:18:40.355167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.356401 (+  1234us) service_pool.cc:224] Handling call
0709 13:18:40.356744 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.357280 (+   536us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:40.357313 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:41.217774 (+860461us) spinlock_profiling.cc:243] Waited 7.43 ms on lock 0x7b2c00000c88. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:18:41.225894 (+  8120us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.529879 (+303985us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:41.529917 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.529979 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.955012 (+425033us) raft_consensus.cc:1685] finished
0709 13:18:41.955058 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.966727 (+ 11669us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":587,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":81,"spinlock_wait_cycles":17087232,"thread_start_us":248528,"threads_started":1,"wal-append.queue_time_us":426022}
I20260709 13:18:41.999008 19478 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:41.890286 19627 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:41.986266 19625 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:42.003240 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:42.006465 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:41.967020 22299 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:42.014783 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 297960us
W20260709 13:18:42.017058 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 126903us
I20260709 13:18:42.018208 19627 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:42.016013 19476 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:42.019326 22415 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.957379 22382 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.005051 22411 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:42.010131 22233 consensus_queue.cc:260] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.011217 21957 consensus_queue.cc:260] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.021487 22054 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:42.065188 22267 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:42.096648 22267 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:42.034682 22196 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:42.075552 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.037194 22380 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.031389 22413 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:42.080132 22286 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:42.105356 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:42.105537 22413 raft_consensus.cc:697] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:42.058696 22057 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.106141 19580 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:42.064684 22302 raft_consensus.cc:3055] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:42.046901 21820 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:42.109220 22302 raft_consensus.cc:740] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:42.042910 22179 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:42.051633 22405 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:18:42.026937 22415 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.110208 22302 consensus_queue.cc:260] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.022691 22403 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:42.111160 22403 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.111433 22302 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.111527 22403 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.112185 22179 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:42.081103 19406 catalog_manager.cc:5697] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:18:42.078569 22396 log.cc:927] Time spent T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.166s	user 0.003s	sys 0.000s
I20260709 13:18:42.087994 22235 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.052783 22203 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:42.043087 22411 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.084858 22359 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:42.114161 22235 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:42.114872 22359 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.115727 22380 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:42.114344 22411 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.116621 22235 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:42.020790 22414 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:42.148680 22414 raft_consensus.cc:697] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:42.149873 22414 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.116879 22359 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:42.042237 22299 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:42.065536 22402 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:42.159799 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1912) took 1069 ms. Trace:
I20260709 13:18:42.095916 22054 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:42.118009 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 102106us
I20260709 13:18:42.160216 19583 rpcz_store.cc:276] 0709 13:18:41.090307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.380752 (+290445us) service_pool.cc:224] Handling call
0709 13:18:41.381088 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:41.408545 (+ 27457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.408576 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:41.444098 (+ 35522us) log.cc:844] Serialized 52 byte log entry
0709 13:18:41.490176 (+ 46078us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b180037f7e0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa0d1 00007f6c31715a0f
0709 13:18:41.715430 (+225254us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:41.732754 (+ 17324us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.055926 (+323172us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.056101 (+   175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.056165 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:42.159538 (+103373us) raft_consensus.cc:1685] finished
0709 13:18:42.159563 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.159731 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":359749,"prepare.queue_time_us":17830,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":87,"raft.queue_time_us":371429,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":8372,"spinlock_wait_cycles":6721408,"thread_start_us":224995,"threads_started":1,"wal-append.queue_time_us":517341}
I20260709 13:18:42.032984 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:42.162709 19661 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.093144 19578 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:18:42.061157 22407 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.119009 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:42.083041 22227 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:42.068517 22307 raft_consensus.cc:3055] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:18:42.059893 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 291509us
I20260709 13:18:42.169836 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:42.171000 19503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60692 (request call id 110) took 1815 ms (client timeout 1528 ms). Trace:
I20260709 13:18:42.171361 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:42.171437 19503 rpcz_store.cc:269] 0709 13:18:40.355482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.361042 (+  5560us) service_pool.cc:224] Handling call
0709 13:18:42.170764 (+1809722us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54002080d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:42.170896 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4132810496}
I20260709 13:18:42.050637 20661 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:42.083484 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:42.160440 22054 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:42.121109 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:42.174103 19582 raft_consensus.cc:2393] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 7: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:18:42.122082 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 103998us
I20260709 13:18:42.175666 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:42.176903 19627 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:42.122606 22203 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:42.171277 22286 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:42.177704 22227 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.178661 22211 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:42.179064 22211 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.179407 22211 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.180049 22227 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:42.041025 22340 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:42.097489 22267 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.016672 22035 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:42.044677 22275 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:42.124778 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 107603us
I20260709 13:18:42.124863 22248 consensus_queue.cc:1059] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:18:42.037297 22163 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.106490 22057 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.085917 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:42.223773 19587 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:18:42.131047 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:42.132727 19553 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:42.133659 21820 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:42.168960 22307 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:42.106546 22413 consensus_queue.cc:237] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:42.064095 22262 consensus_meta.cc:287] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.000s
I20260709 13:18:42.101347 22233 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.137831 22380 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:42.022337 22377 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:42.133317 22415 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:42.156551 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 133570us
I20260709 13:18:42.167030 19583 raft_consensus.cc:1240] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:42.075441 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:42.178130 22203 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:42.123458 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:42.182495 19476 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:18:42.279748 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:42.190706 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:42.201965 19661 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 9.
W20260709 13:18:42.216063 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.221467 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.217422 22267 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:42.224998 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:42.227355 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.133973 22179 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:42.232446 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 99786.7us
I20260709 13:18:42.290293 19504 raft_consensus.cc:2410] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 10 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:42.215302 22376 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:42.284839 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:42.292665 19652 raft_consensus.cc:2410] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:42.178170 22286 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:42.266980 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.297881 19507 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:42.288268 22415 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:42.300755 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.302120 19504 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 7: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:42.303387 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:42.304536 19504 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:42.268301 19508 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:18:42.288033 22252 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:18:42.230716 22210 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:18:42.274945 19578 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:42.222412 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:42.286026 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 95411.4us
I20260709 13:18:42.218958 22359 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:42.289517 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:42.305568 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.241464 22208 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:42.273561 22378 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.295821 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:42.213973 22187 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:18:42.273806 19511 pending_rounds.cc:85] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 7
I20260709 13:18:42.322729 19511 pending_rounds.cc:107] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:18:42.323020 19511 raft_consensus.cc:2889] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:42.271387 19506 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:42.318311 19408 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48826 (request call id 178) took 7766 ms. Trace:
I20260709 13:18:42.241124 22329 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.314270 19627 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:42.233757 22275 consensus_queue.cc:1059] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:18:42.314579 19504 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:42.314726 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:42.327595 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.328510 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:42.329104 19656 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.328711 22329 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.291359 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:42.296525 22290 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:42.273070 21982 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.306806 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.343837 19508 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
W20260709 13:18:42.307571 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 125214us
I20260709 13:18:42.266724 22377 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:42.348394 22377 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.348946 22329 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:42.349311 22418 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:42.300778 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:42.353938 19512 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.329859 22324 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:18:42.290215 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.331629 22359 raft_consensus.cc:697] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:42.317261 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.359192 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:42.358844 22359 consensus_queue.cc:237] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.359874 19658 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:42.309876 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:42.276036 22283 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:42.360842 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:42.275499 22262 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:42.305789 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:42.362017 19653 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.363605 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:42.365834 19585 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:42.361462 19658 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:42.367441 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1917) took 1237 ms. Trace:
I20260709 13:18:42.368014 19585 rpcz_store.cc:276] 0709 13:18:41.130103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.540759 (+410656us) service_pool.cc:224] Handling call
0709 13:18:41.541079 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.366332 (+825253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.367219 (+   887us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b5400107554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:42.367380 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1896352000}
I20260709 13:18:42.215592 22403 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.279263 22033 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.223094 22227 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 13:18:42.333073 19652 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:42.272013 21820 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.273705 22358 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:42.334348 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:42.409596 19582 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:42.298688 22303 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:42.335132 19509 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:42.313103 22286 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.307844 21963 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:42.342695 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.425719 19506 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:18:42.373984 19505 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:42.378350 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:42.383664 19585 raft_consensus.cc:1275] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:42.384142 19656 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:42.387504 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:42.234663 22341 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.324005 19408 rpcz_store.cc:276] 0709 13:18:34.545540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.545714 (+   174us) service_pool.cc:224] Handling call
0709 13:18:36.729556 (+2183842us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b54002ec628. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c36683aa1 00007f6c366aa9b4 00007f6c3518e3dc 00007f6c3514fe0b 00007f6c3514fbe4 00007f6c376502d1 00007f6c37650b2f 00007f6c3750fd4b 00007f6c37617c3e 00007f6c35ad82a4 00007f6c35ad8232
0709 13:18:42.312134 (+5582578us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:36.955062 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:36.955792 (+   730us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:36.955841 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:18:36.955860 (+    19us) tablet.cc:662] Decoding operations
0709 13:18:36.985394 (+ 29534us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:36.985509 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:36.985537 (+    28us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:18:37.234420 (+248883us) tablet.cc:701] Row locks acquired
0709 13:18:37.237883 (+  3463us) write_op.cc:260] PREPARE: finished
0709 13:18:37.238072 (+   189us) write_op.cc:270] Start()
0709 13:18:37.238222 (+   150us) write_op.cc:276] Timestamp: P: 1783603117237995 usec, L: 0
0709 13:18:37.238254 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:18:37.290663 (+ 52409us) log.cc:844] Serialized 11160 byte log entry
0709 13:18:37.792623 (+501960us) op_driver.cc:464] REPLICATION: finished
0709 13:18:37.856937 (+ 64314us) spinlock_profiling.cc:243] Waited 42.2 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c2e6500ac 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c35190ef0
0709 13:18:38.167274 (+310337us) write_op.cc:301] APPLY: starting
0709 13:18:38.199636 (+ 32362us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:38.247769 (+ 48133us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:38.247814 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:38.288870 (+ 41056us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:38.289339 (+   469us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 13:18:38.289382 (+    43us) write_op.cc:312] APPLY: finished
0709 13:18:38.318515 (+ 29133us) log.cc:844] Serialized 187 byte log entry
0709 13:18:38.318793 (+   278us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.319153 (+   360us) write_op.cc:454] Released schema lock
0709 13:18:38.319269 (+   116us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:38.319789 (+   520us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.319821 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":41518,"reported_tablets":52,"spinlock_wait_cycles":35995904,"child_traces":[["op",{"apply.queue_time_us":326864,"apply.run_cpu_time_us":7155,"apply.run_wall_time_us":185645,"num_ops":28,"prepare.queue_time_us":171434,"prepare.run_cpu_time_us":32077,"prepare.run_wall_time_us":485023,"raft.queue_time_us":291274,"raft.run_cpu_time_us":18836,"raft.run_wall_time_us":200657,"replication_time_us":554192,"spinlock_wait_cycles":97067776,"thread_start_us":687194,"threads_started":4,"wal-append.queue_time_us":191237,"wal-append.run_cpu_time_us":25495,"wal-append.run_wall_time_us":1843988}]]}
I20260709 13:18:42.393633 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:42.323223 22208 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.401487 19508 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:42.404135 19504 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:18:42.406562 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:42.407601 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:42.407212 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.410028 19580 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
W20260709 13:18:42.421766 22425 log.cc:927] Time spent T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:18:42.440368 19583 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:42.440827 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:42.415923 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:42.441747 19585 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.414407 19653 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:42.418632 19509 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:42.420033 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 93505us
I20260709 13:18:42.420691 19625 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:42.343246 22282 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:18:42.289373 20619 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.129:38645 timed out after 1.528s (SENT) [suppressed 10 similar messages]
I20260709 13:18:42.418536 19512 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:42.423601 19655 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: [8.4-8.4]
W20260709 13:18:42.424237 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 108612us
I20260709 13:18:42.447065 19507 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:42.315337 22411 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.398351 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:42.431869 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:42.376151 22415 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:42.315136 22035 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:42.438647 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 90595.4us
I20260709 13:18:42.437034 19581 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
W20260709 13:18:42.448498 19395 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d05498e224814b9b8f31e3f965ab2583 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d56df3728fc04e37b2d29a3bcd91d167 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:18:42.451205 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 72957.1us
I20260709 13:18:42.458559 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:42.308427 22307 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.425486 21963 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:42.463199 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:42.470207 19585 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:42.472815 19627 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:42.454244 22382 raft_consensus.cc:2764] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:18:42.390959 21982 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:42.480000 19476 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
W20260709 13:18:42.481036 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 60440.3us
I20260709 13:18:42.481060 19657 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: [2.2-5.3]
I20260709 13:18:42.403688 22033 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.482787 19625 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:42.330489 22378 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:42.428557 22329 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:18:42.426144 22303 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.500375 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:42.433032 22358 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.478477 22208 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:42.510643 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:42.463922 22210 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:42.512683 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:42.479395 21963 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:42.548192 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 49041.5us
I20260709 13:18:42.517115 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:42.471987 22404 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:42.520951 19585 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:42.529134 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.555277 19509 raft_consensus.cc:2410] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:42.531154 22262 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:42.540254 22033 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:42.531774 22380 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:18:42.541371 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:42.542802 22341 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:42.543241 22196 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.492846 22163 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:42.490278 22256 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:42.493055 22320 consensus_queue.cc:1175] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2cfd02601ea44976833027665abc93bf" responder_term: 8 status { last_received { term: 8 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 8 index: 5 } }
I20260709 13:18:42.578142 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:42.505520 22185 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:42.500854 22179 raft_consensus.cc:2764] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:42.457906 22282 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.462813 22415 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.511889 22275 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:42.559645 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 76975.7us
I20260709 13:18:42.590322 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:42.599366 19653 raft_consensus.cc:1275] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:42.575718 22033 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:42.607806 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:42.602878 22033 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:42.609325 21982 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:42.610109 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.612010 22377 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:42.612553 22412 consensus_queue.cc:1175] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d56df3728fc04e37b2d29a3bcd91d167" responder_term: 9 status { last_received { term: 7 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: [6.4-8.5]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:42.613180 19510 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:42.614651 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.615116 22303 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:42.615272 19505 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:42.574523 22304 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.532366 21957 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:42.532622 22407 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:42.501461 22276 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:18:42.577122 19585 raft_consensus.cc:1275] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:42.533721 22057 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:42.507054 22302 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:18:42.493178 22307 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.560189 22404 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.550527 22210 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:42.583856 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:42.563834 22262 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:42.564440 22248 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:42.618853 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:42.567402 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 50420.2us
W20260709 13:18:42.620208 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 330849us
I20260709 13:18:42.577889 22256 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:42.627686 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:42.609365 22033 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.628888 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:42.685288 19652 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:42.686645 19652 raft_consensus.cc:1275] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:18:42.641348 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 92464us
I20260709 13:18:42.642885 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:42.687914 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.688843 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:42.689034 19627 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:42.604686 22275 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:42.580236 22196 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.647094 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:42.668079 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:42.668576 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:42.675542 22433 log.cc:927] Time spent T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Append to log took a long time: real 0.098s	user 0.002s	sys 0.000s
I20260709 13:18:42.628671 21981 consensus_queue.cc:1059] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:18:42.680013 19654 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:42.645440 22431 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:42.680968 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:42.668154 22262 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.683682 22256 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.689450 22203 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:42.690434 19627 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:42.694141 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:42.694453 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:42.642122 22403 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:42.708951 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:42.707978 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:42.699643 19654 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:42.640120 21982 consensus_queue.cc:1059] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:18:42.657105 21820 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:42.662932 22404 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.683146 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:42.718113 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.667531 22248 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.706281 22057 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:42.695761 22324 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:42.722208 22054 consensus_meta.cc:287] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.549s	user 0.005s	sys 0.005s
I20260709 13:18:42.723698 22378 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:42.697886 22380 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:18:42.724143 22358 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:42.724500 22411 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:42.689916 22275 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.626694 22304 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:42.729667 19585 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:42.757023 22303 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:42.741372 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 46993.1us
I20260709 13:18:42.740061 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:42.829068 19579 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:42.755424 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:42.796129 22248 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:42.761346 19504 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:42.761936 19654 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:42.728897 22432 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:18:42.669267 22210 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.727120 22397 raft_consensus.cc:3055] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:42.809686 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:42.843741 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 136326us
I20260709 13:18:42.725594 22196 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:42.729312 22203 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.756688 22267 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:42.757350 22185 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:42.737361 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:42.830034 19586 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
W20260709 13:18:42.762825 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 79754.2us
I20260709 13:18:42.796785 22422 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:42.828040 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:42.868983 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:42.728163 22211 consensus_meta.cc:287] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.548s	user 0.003s	sys 0.006s
I20260709 13:18:42.762048 22290 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:42.838140 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:42.803087 22359 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:42.716729 22431 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:42.754529 22307 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:18:42.810597 22415 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:42.844760 19512 raft_consensus.cc:2410] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:18:42.846637 19478 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:42.848601 19585 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:18:42.865677 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:42.926994 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.849679 22397 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:42.807246 22054 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.880980 20619 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:42.933243 19652 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:18:42.933496 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 86967.4us
I20260709 13:18:42.903625 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:42.943729 20661 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:42.924423 22187 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:42.946241 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.947465 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.948043 22431 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:42.948498 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.948640 22431 consensus_queue.cc:1059] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:42.949103 19505 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:18:42.951138 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:42.951985 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:42.952517 22262 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.904124 22057 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:42.866552 22267 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.911533 22304 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:42.842984 22376 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:42.867210 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:42.855010 22418 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:18:42.930816 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:42.934269 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 53431.2us
I20260709 13:18:42.864522 22203 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.835966 22303 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.929955 22282 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:42.978415 22442 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:18:42.978848 22303 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:42.926344 22196 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:42.979700 22196 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.980773 22431 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:42.981233 22431 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.981595 22431 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.981953 22196 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:42.942050 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:42.942625 22437 log.cc:927] Time spent T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:18:42.942888 22318 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:42.943029 22054 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:42.954144 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.955971 22235 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:42.925661 22211 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.975824 19579 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:42.926781 22378 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:42.961817 19586 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:42.928026 22422 raft_consensus.cc:697] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 9 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:18:42.986006 19583 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:42.988040 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:42.995150 19509 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:42.959357 22267 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:42.953424 22227 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:42.986116 22304 raft_consensus.cc:3055] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:42.868094 22185 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:42.956429 22187 raft_consensus.cc:697] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:43.006619 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:43.007634 19585 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:42.975289 22376 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.982553 22196 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:42.925851 22290 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:42.990280 22318 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:42.955084 21963 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:42.926662 22359 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.014380 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:43.019217 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 66150.2us
I20260709 13:18:43.005841 22185 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:43.002768 22304 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:43.028861 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:43.032703 19506 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:43.017160 22318 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.001173 22227 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.017475 22196 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:43.029032 22282 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:43.001276 22378 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.001709 22447 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:18:43.056690 22196 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.058082 22455 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:18:43.055176 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:43.005327 22397 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.050217 22282 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:43.055096 22210 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:43.060783 22262 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:43.065448 22057 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:43.055099 22422 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:43.081080 22282 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:43.106817 22057 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.107842 22404 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.110008 22290 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:43.110349 19580 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:43.110703 22290 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:43.111186 22290 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.111652 22404 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:43.112231 22404 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.112629 22404 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.113229 22290 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:43.088145 22397 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:43.061471 22187 consensus_queue.cc:237] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:43.114133 22453 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:18:43.160629 22462 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:43.189502 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:43.068483 22304 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.109944 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:43.113493 22185 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.190759 22404 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:43.195497 22211 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:43.257058 22462 raft_consensus.cc:697] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:43.246238 20661 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
W20260709 13:18:43.261179 22446 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:18:43.259563 22304 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:43.297844 21963 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:18:43.320665 21957 consensus_meta.cc:287] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.695s	user 0.002s	sys 0.006s
I20260709 13:18:43.321372 19659 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:43.323282 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1646) took 1026 ms. Trace:
I20260709 13:18:43.323652 19659 rpcz_store.cc:276] 0709 13:18:42.297095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.297236 (+   141us) service_pool.cc:224] Handling call
0709 13:18:42.363453 (+ 66217us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b58000e1c98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:18:43.323057 (+959604us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b54001ecb54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:43.323187 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2206389760}
I20260709 13:18:43.317466 22248 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.303783 22378 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:43.327052 22248 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:43.334388 22163 raft_consensus.cc:3055] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:43.334875 22163 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:43.335907 22163 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.340101 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:43.340940 19586 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:43.342582 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:43.343245 19578 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:43.344344 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:43.344955 19578 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:43.348551 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:43.356022 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:43.329420 22227 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:43.358523 22256 consensus_meta.cc:287] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.627s	user 0.006s	sys 0.006s
W20260709 13:18:43.369261 22033 consensus_meta.cc:287] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.685s	user 0.010s	sys 0.001s
W20260709 13:18:43.353799 22324 consensus_meta.cc:287] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.000s
I20260709 13:18:43.376070 19478 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:43.359472 22163 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:43.373075 22286 consensus_meta.cc:287] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.940s	user 0.009s	sys 0.003s
I20260709 13:18:43.383728 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:43.383342 19478 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:43.387928 19581 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:43.387252 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:43.390195 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:43.390738 19504 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:43.379803 22033 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.393290 22033 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:43.377645 22468 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:18:43.375283 22256 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.379153 22324 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:43.425400 19586 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:43.386451 22413 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:43.426895 19578 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:43.401903 19504 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:43.429795 19586 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:43.415021 22275 consensus_meta.cc:287] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.000s
I20260709 13:18:43.431945 19586 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:43.443487 22282 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.449659 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:43.432027 22471 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:43.455421 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1640) took 1166 ms. Trace:
I20260709 13:18:43.455574 22471 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.456077 22471 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:43.455914 19655 rpcz_store.cc:276] 0709 13:18:42.283236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.285194 (+  1958us) service_pool.cc:224] Handling call
0709 13:18:42.364686 (+ 79492us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b58000e1c98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:18:42.364878 (+   192us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.447019 (+ 82141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.448814 (+1001795us) spinlock_profiling.cc:243] Waited 58.3 ms on lock 0x7b5400103954. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:43.449091 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150904064}
I20260709 13:18:43.396744 22286 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.427690 22413 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:43.417321 22267 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.380798 22462 consensus_queue.cc:237] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.426151 22203 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.474275 19587 raft_consensus.cc:2393] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:43.461874 22413 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:43.459856 22185 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:43.439412 22275 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.482575 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:43.483510 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:43.490379 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:43.490907 22275 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:43.491428 19504 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:43.491650 22376 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.492641 19505 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:43.492424 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:43.493808 22376 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:43.494613 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:43.495941 19504 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 8: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:43.496851 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:43.497118 22359 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:43.499555 22452 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.553s	user 0.002s	sys 0.007s
I20260709 13:18:43.499739 19504 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:43.500862 19656 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
W20260709 13:18:43.513154 22469 log.cc:927] Time spent T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:18:43.514107 22282 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:43.461593 22431 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.548069 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1668) took 1140 ms. Trace:
I20260709 13:18:43.551255 22431 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:43.548704 19582 rpcz_store.cc:276] 0709 13:18:42.407573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.411013 (+  3440us) service_pool.cc:224] Handling call
0709 13:18:42.411391 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.622053 (+210662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.622089 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:42.622154 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:42.622188 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.547696 (+925508us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b5400302d54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:43.547772 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.547975 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484013824}
W20260709 13:18:43.555922 22451 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.020s	sys 0.021s
I20260709 13:18:43.700986 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1664) took 1304 ms. Trace:
W20260709 13:18:43.575793 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 177754us
I20260709 13:18:43.693501 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:43.675290 19652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1730) took 1149 ms. Trace:
I20260709 13:18:43.701432 19584 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:43.739336 19652 rpcz_store.cc:276] 0709 13:18:42.525662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.687277 (+161615us) service_pool.cc:224] Handling call
0709 13:18:42.687585 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.933865 (+246280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.674922 (+741057us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54000e7ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:43.675202 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":564254592}
I20260709 13:18:43.578784 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1591) took 1056 ms. Trace:
I20260709 13:18:43.740756 19508 rpcz_store.cc:276] 0709 13:18:42.522493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.523022 (+   529us) service_pool.cc:224] Handling call
0709 13:18:42.523441 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.535068 (+ 11627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.535110 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:42.535723 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 13:18:43.502493 (+966770us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b180033aa80. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa0d1 00007f6c31715a0f
0709 13:18:43.523219 (+ 20726us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:43.523282 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.523387 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:43.578438 (+ 55051us) raft_consensus.cc:1685] finished
0709 13:18:43.578463 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.578713 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9497,"raft.queue_time_us":281,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":16214,"spinlock_wait_cycles":2955648,"thread_start_us":20460,"threads_started":1,"wal-append.queue_time_us":998163}
I20260709 13:18:43.707401 19583 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:43.742640 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:43.732728 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.739005 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:43.737596 19587 rpcz_store.cc:276] 0709 13:18:42.396796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.397413 (+   617us) service_pool.cc:224] Handling call
0709 13:18:43.700711 (+1303298us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400247a54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:43.700905 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2372920192}
W20260709 13:18:43.735253 22429 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 1.116s	user 0.000s	sys 0.020s
I20260709 13:18:43.754240 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:43.760826 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 67446.7us
I20260709 13:18:43.762981 19627 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:43.672149 22276 raft_consensus.cc:3055] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:43.766119 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:43.766258 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:43.667903 22248 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:43.738389 22451 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.035s	sys 0.036s
I20260709 13:18:43.692976 22324 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.768146 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:43.699532 21957 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.769452 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:43.706264 22397 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.649523 22275 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:43.566672 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:43.575206 22256 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:43.776340 19587 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:43.757283 22448 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.820312 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2115) took 1591 ms. Trace:
I20260709 13:18:43.757171 22035 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:43.778357 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:43.688771 22413 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.769285 22267 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:43.832540 19510 rpcz_store.cc:276] 0709 13:18:42.228634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.228774 (+   140us) service_pool.cc:224] Handling call
0709 13:18:42.270420 (+ 41646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.613565 (+343145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.820078 (+1206513us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b540003d4d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:43.820255 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787849600}
I20260709 13:18:43.767647 22276 raft_consensus.cc:740] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:43.835274 19476 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:43.838932 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1580) took 1617 ms. Trace:
I20260709 13:18:43.840140 19503 rpcz_store.cc:276] 0709 13:18:42.221405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.221554 (+   149us) service_pool.cc:224] Handling call
0709 13:18:42.221938 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.222308 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.222336 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:42.230807 (+  8471us) log.cc:844] Serialized 26 byte log entry
0709 13:18:42.488499 (+257692us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:42.488544 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.488635 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:43.687848 (+1199213us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:18:43.833144 (+145296us) raft_consensus.cc:1685] finished
0709 13:18:43.833162 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.838864 (+  5702us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9721,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":47080,"spinlock_wait_cycles":11402112,"thread_start_us":257348,"threads_started":1,"wal-append.queue_time_us":344158}
I20260709 13:18:43.841425 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:43.773347 22286 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:43.843945 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:43.773218 22203 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:43.846235 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:43.848677 19506 raft_consensus.cc:2368] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9.
I20260709 13:18:43.849512 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:43.850032 19506 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:43.854101 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.854132 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 91306.8us
I20260709 13:18:43.855083 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:43.855566 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:43.838671 22442 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:43.855690 19587 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:43.857195 19507 raft_consensus.cc:2393] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 8: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:43.833961 22320 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:43.774948 22248 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.838873 22211 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:43.859236 19506 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:18:43.857416 19627 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:43.864766 19583 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:43.822186 22324 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.866252 22489 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.839638 20659 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:43.829255 21957 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.828111 22397 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.873555 19583 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:18:43.832176 22275 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.858253 22267 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.838698 22035 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.880697 19587 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:18:43.865175 22163 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:43.839188 22448 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.838021 22276 consensus_queue.cc:260] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:43.890101 22485 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:18:43.890813 22318 consensus_meta.cc:287] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.846s	user 0.013s	sys 0.000s
I20260709 13:18:43.891410 22491 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:43.891969 22491 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.892330 22491 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:43.897898 20665 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 9 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:43.891335 22318 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.901511 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:43.902351 21957 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:43.902918 21957 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.903366 21957 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.904810 19655 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:43.905292 21957 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:43.885605 22320 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.909572 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:43.914491 19655 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:18:43.912765 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:43.915428 19657 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
W20260709 13:18:43.923473 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 66124.8us
I20260709 13:18:43.925441 19627 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:43.925580 19661 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:43.929582 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:43.888563 22267 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.884232 22489 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.921845 21957 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:43.940840 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.940241 21957 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.899242 22163 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.942431 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:43.946349 19661 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 8: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:43.950250 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:43.923858 22320 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.951972 22310 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:43.952461 22310 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:43.952885 22310 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:43.953300 22163 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:43.959982 22448 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:43.959441 22324 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:43.964068 19659 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:43.964745 22035 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:43.966187 21957 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:43.963327 22318 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:43.922930 22471 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:43.972229 19655 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:18:43.948580 22493 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.973130 22493 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:43.973866 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1939) took 1235 ms. Trace:
I20260709 13:18:43.942888 22492 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.967893 19660 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:18:43.967986 22267 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:43.953459 22320 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:43.969894 22397 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:43.966820 22413 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:43.975693 19660 pending_rounds.cc:85] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 4
I20260709 13:18:43.976627 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:43.954222 22163 consensus_queue.cc:1059] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:18:43.998750 19660 pending_rounds.cc:107] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:18:43.999109 19660 raft_consensus.cc:2889] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:43.978616 22248 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:43.948136 22489 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:43.979127 22493 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:43.981827 22378 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:43.982770 22185 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.983816 22227 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:43.984766 22283 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:43.986228 22377 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:43.990880 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:43.991626 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 46568us
I20260709 13:18:44.004005 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:44.014866 19553 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:43.974367 19585 rpcz_store.cc:276] 0709 13:18:42.738026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.040112 (+302086us) service_pool.cc:224] Handling call
0709 13:18:43.052096 (+ 11984us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:43.052314 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:43.083661 (+ 31347us) log.cc:844] Serialized 14 byte log entry
0709 13:18:43.246594 (+162933us) log.cc:844] Serialized 14 byte log entry
0709 13:18:43.313379 (+ 66785us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b1800385960. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e63b2a6 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1
0709 13:18:43.474387 (+161008us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b1800385960. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:18:43.972243 (+497856us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b1800385960. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e5e7c0a 00007f6c37d27219 00007f6c2e66fa40 00007f6c2e66a4e4 00007f6c2e66a455 00007f6c31752060 00007f6c31764716 00007f6c31775287 00007f6c31775208
0709 13:18:43.973218 (+   975us) log.cc:844] Serialized 14 byte log entry
0709 13:18:43.973399 (+   181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:43.973451 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:43.973516 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.973600 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.973787 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3515,"prepare.queue_time_us":11865,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":107,"raft.queue_time_us":118,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":2354,"spinlock_wait_cycles":15546880,"thread_start_us":188113,"threads_started":2,"wal-append.queue_time_us":219845}
I20260709 13:18:44.073824 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:44.075034 19655 raft_consensus.cc:2368] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12.
I20260709 13:18:44.075742 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:44.076180 19655 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:44.077903 22467 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.083488 22467 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.084312 22380 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:44.084911 22380 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:44.083376 22283 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.086959 22380 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:44.078655 22227 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:44.087513 22380 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:44.095531 19627 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:44.082249 19655 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:44.092413 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:44.092998 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 79497us
I20260709 13:18:44.105135 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:44.106115 19655 raft_consensus.cc:2368] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12.
I20260709 13:18:44.106850 19627 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:44.112779 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:44.114799 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:44.115651 22466 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:44.116078 19551 leader_election.cc:400] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12.
I20260709 13:18:44.116055 22466 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:44.118036 22466 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.118424 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:44.119887 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:44.120705 22303 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:44.121337 22303 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:44.121452 22187 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:44.121845 22303 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:44.116716 22458 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:44.122826 22458 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:44.123241 22458 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:44.122752 22303 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.124058 22458 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.125659 22458 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:44.127249 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:44.128372 22358 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:44.129263 22358 raft_consensus.cc:697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:44.083719 22471 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:44.106869 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:44.132586 19585 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:44.132979 19655 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:18:44.093164 22210 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:44.071851 22378 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:44.136317 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:44.133912 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:44.134577 19627 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:44.089160 22227 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:44.143002 22500 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:44.144215 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:43.997828 22492 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:44.158054 22441 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 1.212s	user 0.000s	sys 0.004s
I20260709 13:18:44.161139 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:44.089781 22283 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:44.156390 22210 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.108853 22489 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:18:44.129864 22412 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:44.092025 22359 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.088287 22033 consensus_queue.cc:1059] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:18:44.096946 22467 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:44.095973 22185 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.088045 22380 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.169883 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1729) took 1645 ms. Trace:
I20260709 13:18:44.172528 19580 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:44.226577 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:44.210042 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:44.228801 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1931) took 1493 ms. Trace:
W20260709 13:18:44.210474 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 75870.8us
I20260709 13:18:44.229206 19584 rpcz_store.cc:276] 0709 13:18:42.735780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.754829 (+ 19049us) service_pool.cc:224] Handling call
0709 13:18:43.701196 (+946367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:43.752116 (+ 50920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.228604 (+476488us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b5400247a50. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:44.228745 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2175812352}
I20260709 13:18:44.093084 22491 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:44.226562 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:44.230463 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:44.230510 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:44.234303 19661 raft_consensus.cc:2410] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:18:44.213011 22262 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.227161 19656 rpcz_store.cc:276] 0709 13:18:42.524821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.670086 (+145265us) service_pool.cc:224] Handling call
0709 13:18:44.169709 (+1499623us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b5400023fd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:44.169822 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1744983808}
I20260709 13:18:44.238901 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:44.239181 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:44.212163 22500 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:44.218258 22493 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.194370 22499 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:44.193267 22378 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:44.172807 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:44.235256 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:44.251143 19587 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:44.240005 19656 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:44.217496 22210 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:44.238358 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1598) took 1353 ms. Trace:
I20260709 13:18:44.211951 22465 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:44.246721 19551 leader_election.cc:400] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12.
I20260709 13:18:44.224255 22412 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:44.251078 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:44.240770 22434 log.cc:927] Time spent T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 1.651s	user 0.026s	sys 0.040s
I20260709 13:18:44.255007 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:44.257412 19509 rpcz_store.cc:276] 0709 13:18:42.884631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.999587 (+114956us) service_pool.cc:224] Handling call
0709 13:18:43.552336 (+552749us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.552755 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:43.552783 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:43.553275 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:18:43.753026 (+199751us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:43.753064 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.753127 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:43.927512 (+174385us) raft_consensus.cc:1685] finished
0709 13:18:43.927542 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.231898 (+304356us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54001e0d50. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:44.238288 (+  6390us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":247,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":1270330112,"thread_start_us":199372,"threads_started":1,"wal-append.queue_time_us":305394}
I20260709 13:18:44.275619 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:44.235741 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:44.276271 22489 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:44.248311 22262 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.278407 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:44.473793 19655 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.281853 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1689) took 1137 ms. Trace:
I20260709 13:18:44.270934 22378 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:44.282454 19551 leader_election.cc:403] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:18:44.282920 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1690) took 1122 ms. Trace:
I20260709 13:18:44.480500 19582 rpcz_store.cc:276] 0709 13:18:43.160918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.556784 (+395866us) service_pool.cc:224] Handling call
0709 13:18:43.557069 (+   285us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:43.983550 (+426481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.983580 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:43.984226 (+   646us) log.cc:844] Serialized 52 byte log entry
0709 13:18:44.109334 (+125108us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:44.226083 (+116749us) log.cc:844] Serialized 14 byte log entry
0709 13:18:44.282674 (+ 56591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.282746 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.282777 (+    31us) raft_consensus.cc:1685] finished
0709 13:18:44.282784 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.282880 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":424962,"prepare.queue_time_us":167672,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":454512,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":25361,"thread_start_us":256213,"threads_started":3,"wal-append.queue_time_us":177568}
I20260709 13:18:44.482028 22262 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:44.482564 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:44.483184 19582 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:44.484081 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:44.485080 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:44.282998 19580 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:44.485795 22211 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:44.394330 20619 leader_election.cc:336] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Timed out: RequestConsensusVote RPC to 127.17.251.129:38645 timed out after 1.528s (SENT)
I20260709 13:18:44.486526 22211 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.227946 22359 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.488862 22359 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:44.219901 22283 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:18:44.482565 22489 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.489125 22211 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:44.486915 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 92644.4us
I20260709 13:18:44.474478 19579 rpcz_store.cc:276] 0709 13:18:43.144217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.554439 (+410222us) service_pool.cc:224] Handling call
0709 13:18:43.576022 (+ 21583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.985251 (+409229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.985282 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:43.990210 (+  4928us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.136001 (+145791us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:44.136040 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.136104 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.281544 (+145440us) raft_consensus.cc:1685] finished
0709 13:18:44.281573 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.281790 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":408778,"raft.queue_time_us":409376,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":58,"thread_start_us":144568,"threads_started":1,"wal-append.queue_time_us":241797}
I20260709 13:18:44.490986 22489 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:44.491114 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:44.491946 19579 raft_consensus.cc:2368] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11.
I20260709 13:18:44.492842 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:44.493441 19579 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:44.486272 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:44.495915 19580 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:18:44.496805 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:44.473709 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:44.191941 22358 consensus_queue.cc:237] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:44.291713 22502 log.cc:927] Time spent T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
W20260709 13:18:44.473076 22501 log.cc:927] Time spent T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 13:18:44.505195 19655 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:44.531067 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:44.285526 22412 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.517140 19580 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:18:44.529124 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:44.534271 19579 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:44.284767 22499 raft_consensus.cc:697] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:44.539990 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:44.535030 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 288519us
I20260709 13:18:44.543530 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:44.545589 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:44.546737 19655 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:44.546830 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:44.547760 19582 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:44.548380 19655 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:44.537602 19578 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:44.276160 22310 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.551705 19655 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:44.253995 22493 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.560139 19655 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:44.561933 19655 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:18:44.522238 22506 log.cc:927] Time spent T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:18:44.564622 22310 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:44.565352 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:44.574002 19579 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:44.566066 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:44.568523 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:44.575654 19578 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:44.570304 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:44.570508 22499 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.577890 22467 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:44.571385 22378 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:44.580641 22378 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:44.580716 22185 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:44.581264 22378 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:44.571931 22511 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:44.577332 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:44.584111 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1581) took 2329 ms. Trace:
I20260709 13:18:44.590792 19511 rpcz_store.cc:276] 0709 13:18:42.223894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.224655 (+   761us) service_pool.cc:224] Handling call
0709 13:18:42.273578 (+ 48923us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.323528 (+ 49950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.323558 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:42.354356 (+ 30798us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b2c00000c88. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:18:42.354746 (+   390us) log.cc:844] Serialized 26 byte log entry
0709 13:18:42.433504 (+ 78758us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:42.433542 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.433610 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.094544 (+1660934us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:18:44.552667 (+458123us) raft_consensus.cc:1685] finished
0709 13:18:44.552703 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.552884 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31861888,"thread_start_us":78463,"threads_started":1,"wal-append.queue_time_us":192593}
I20260709 13:18:44.603062 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:44.604717 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:44.606189 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:44.606519 19580 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:18:44.610796 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 90798.1us
I20260709 13:18:44.614723 19627 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:44.616564 19627 leader_election.cc:400] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11.
I20260709 13:18:44.607053 19660 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:44.551687 22262 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12.
I20260709 13:18:44.495949 22466 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.649276 19654 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:44.624605 19627 leader_election.cc:403] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:44.629222 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:44.632503 22310 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:44.622803 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:44.638338 22493 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:44.541908 22500 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.624111 22185 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:44.640359 22491 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:44.617527 22467 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:44.590063 22511 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:44.645885 22492 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:44.634109 22458 consensus_meta.cc:287] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.000s
I20260709 13:18:44.656344 19627 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:44.661060 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:44.633474 22404 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:44.623664 22208 consensus_queue.cc:1059] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:18:44.660609 22211 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11.
I20260709 13:18:44.719491 19652 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
W20260709 13:18:44.720147 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 65190.5us
I20260709 13:18:44.749137 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:44.756543 19507 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1604) took 1737 ms (client timeout 2195 ms). Trace:
W20260709 13:18:44.757050 19507 rpcz_store.cc:269] 0709 13:18:43.018863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.490123 (+471260us) service_pool.cc:224] Handling call
0709 13:18:44.756280 (+1266157us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54002a99d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:44.756458 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":838717824}
I20260709 13:18:44.763085 22380 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:44.763931 19505 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:44.725636 22404 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:44.728293 22491 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:44.772694 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 167446us
I20260709 13:18:44.775662 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:44.765107 22412 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.780512 19627 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:44.775998 22404 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.774760 22211 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:44.772948 22466 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:44.774677 22491 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:44.804458 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 969212us
I20260709 13:18:44.805948 19476 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:44.809538 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:44.810329 19507 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 8: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:44.811877 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:44.813148 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:44.813985 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:44.814532 19512 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:44.806989 19476 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:44.800752 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:44.816787 19507 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:44.782490 22328 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:44.793144 22057 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.783601 22208 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:44.822075 19509 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:44.772331 22210 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:44.861334 19512 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:18:44.842094 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:44.843693 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:44.844014 22035 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:44.781196 22511 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.816358 22499 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:18:44.844551 22412 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:44.816160 22491 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:44.797333 22211 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.803682 22489 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:44.887513 22489 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.887975 22489 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.869441 22057 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.890137 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2138) took 1122 ms. Trace:
I20260709 13:18:44.890564 19505 rpcz_store.cc:276] 0709 13:18:43.768078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.769069 (+   991us) service_pool.cc:224] Handling call
0709 13:18:44.763725 (+994656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.764349 (+   624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.889918 (+125569us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b54002a99d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:44.890071 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2286859008}
I20260709 13:18:44.891109 22057 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:44.892032 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:44.892517 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 91870.5us
I20260709 13:18:44.893193 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:44.853776 22462 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.896895 22450 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:44.897322 22462 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.899024 22211 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:44.899334 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 92397.4us
I20260709 13:18:44.900287 19476 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:44.901047 22462 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:44.901666 22462 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:44.857807 22476 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:44.858281 22447 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:44.858691 22445 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.904065 22445 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.839483 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:44.907461 19506 raft_consensus.cc:2368] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12.
W20260709 13:18:44.853792 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.872014 22517 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:18:44.881795 19578 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:44.840711 22448 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:44.883854 22513 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:18:44.885597 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:44.859614 22208 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.893894 22511 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.895298 22471 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:44.895370 22418 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:44.895790 22455 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:44.896556 22328 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:44.901816 22302 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:44.902741 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:44.855201 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:44.942238 19503 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 7: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:44.851963 22248 raft_consensus.cc:3055] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:44.944211 22248 raft_consensus.cc:740] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:44.944469 19511 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:18:44.944919 19511 pending_rounds.cc:85] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 3
I20260709 13:18:44.945120 19511 pending_rounds.cc:107] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:18:44.945441 19511 raft_consensus.cc:2889] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:44.928949 22476 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.913405 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:44.887993 22378 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.914485 19476 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:44.951004 19625 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:44.928829 22448 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.951920 22378 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:44.952729 19625 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:44.934015 22445 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:44.917685 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 142474us
W20260709 13:18:44.924353 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.926713 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:44.929175 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:44.957103 22471 raft_consensus.cc:697] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:44.958168 22471 consensus_queue.cc:237] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.906729 22421 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:44.959183 22476 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:44.959443 22421 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:44.961346 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 59780.6us
I20260709 13:18:44.933722 22432 consensus_queue.cc:1059] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:18:44.962551 19509 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 3.
I20260709 13:18:44.945163 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1742) took 1034 ms. Trace:
W20260709 13:18:44.976052 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 49448.3us
I20260709 13:18:44.976413 19659 rpcz_store.cc:276] 0709 13:18:43.910954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.911329 (+   375us) service_pool.cc:224] Handling call
0709 13:18:43.911772 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:43.964496 (+ 52724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.944922 (+980426us) spinlock_profiling.cc:243] Waited 51.9 ms on lock 0x7b54001ebc54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:44.945108 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119317888}
I20260709 13:18:44.962774 19625 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:44.978300 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:44.979359 19659 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:44.934847 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:44.932641 22208 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:44.985711 19587 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:44.983505 19625 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:44.990779 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:44.992054 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:44.993983 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:44.995103 22413 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:44.995399 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:44.999933 22211 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:45.001219 19654 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:44.974619 22318 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:45.002187 22211 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:45.002408 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:45.003294 19585 raft_consensus.cc:2410] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:18:45.003590 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1688) took 1859 ms. Trace:
I20260709 13:18:45.006978 19582 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:45.004092 19586 rpcz_store.cc:276] 0709 13:18:43.143945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.433192 (+289247us) service_pool.cc:224] Handling call
0709 13:18:43.433652 (+   460us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:43.985181 (+551529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.985218 (+    37us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:43.985979 (+   761us) log.cc:844] Serialized 78 byte log entry
0709 13:18:44.291655 (+305676us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:44.291695 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.291767 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.003282 (+711515us) raft_consensus.cc:1685] finished
0709 13:18:45.003309 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.003508 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":550994,"raft.queue_time_us":551647,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":58,"spinlock_wait_cycles":9984,"thread_start_us":305257,"threads_started":1,"wal-append.queue_time_us":728697}
I20260709 13:18:45.009891 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:45.011202 19659 raft_consensus.cc:2410] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:18:45.012990 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 50130.2us
I20260709 13:18:44.942150 22210 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:44.953474 22448 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:45.042906 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 248861us
I20260709 13:18:45.018085 19579 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:45.015674 22309 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.015508 22302 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:18:44.987686 22418 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:45.030326 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:44.987403 22412 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:44.987869 22203 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:18:45.031682 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 224336us
I20260709 13:18:45.005981 22163 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:45.033272 22413 raft_consensus.cc:3055] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:44.945209 22248 consensus_queue.cc:260] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:45.039377 19476 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:45.043825 19627 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:45.014851 22476 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:45.050175 19587 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:45.075145 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:45.075915 19512 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:45.056712 22210 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.057220 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:45.060272 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:45.081545 19503 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:45.060972 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:45.082788 19661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1666) took 1143 ms. Trace:
I20260709 13:18:45.043542 22211 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:45.051049 22309 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:45.147764 22397 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:45.072697 22445 consensus_queue.cc:1059] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:18:45.151217 22421 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:45.152376 22275 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:45.154909 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1697) took 1054 ms. Trace:
I20260709 13:18:45.168298 19581 rpcz_store.cc:276] 0709 13:18:44.100226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.110520 (+ 10294us) service_pool.cc:224] Handling call
0709 13:18:44.110923 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.246444 (+135521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.246488 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:44.260199 (+ 13711us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.649191 (+388992us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:44.649258 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.078167 (+428909us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400227ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:45.078211 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.078255 (+    44us) raft_consensus.cc:1685] finished
0709 13:18:45.078268 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.154564 (+ 76296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311129856,"thread_start_us":156747,"threads_started":1,"wal-append.queue_time_us":276052}
W20260709 13:18:45.155426 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 98324.2us
I20260709 13:18:45.033123 22179 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:18:45.170367 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:45.171222 19551 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:45.073149 22413 raft_consensus.cc:740] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:45.158376 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 119083us
W20260709 13:18:45.158946 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 115538us
I20260709 13:18:45.163177 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:45.083148 19661 rpcz_store.cc:276] 0709 13:18:43.939624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.976235 (+ 36611us) service_pool.cc:224] Handling call
0709 13:18:45.082609 (+1106374us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54002c83d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:45.082735 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540643200}
I20260709 13:18:45.165526 19655 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 5. Current term is 6. Ops: [2.2-5.3]
I20260709 13:18:45.166309 19585 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:45.172252 19551 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:45.157209 19587 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:45.177647 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:45.222095 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 46274.8us
I20260709 13:18:45.222775 19503 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:45.223011 19476 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:45.221825 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 49635.5us
I20260709 13:18:45.162698 22511 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:45.227830 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:45.178078 22445 consensus_queue.cc:1243] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer 068c03c9dcc848e6bf909131b1f83065 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:45.228616 22455 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:18:45.230252 22057 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:45.232142 22283 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:45.163859 22397 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:45.235283 19661 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:45.164129 22163 raft_consensus.cc:697] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:45.238574 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:45.228787 22450 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:45.241799 22432 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:45.255667 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:45.254619 22163 consensus_queue.cc:237] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:45.256420 19581 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:45.246145 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:45.166036 22418 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:45.257649 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:45.258159 22418 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:45.262452 19661 raft_consensus.cc:2410] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:45.263147 22456 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:45.265967 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:45.268709 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:45.272738 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59942 (request call id 130) took 1368 ms. Trace:
I20260709 13:18:45.173174 22035 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:45.178215 22303 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:45.178510 22465 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:45.226765 22412 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:45.164383 22210 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:45.251775 22057 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:45.254591 22283 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:45.253871 19652 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:45.287801 19652 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:45.280545 19581 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:45.275740 19478 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:45.281390 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 326242us
I20260709 13:18:45.237287 22358 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:18:45.302758 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:45.237176 22483 consensus_queue.cc:1059] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:18:45.243046 22466 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:18:45.286145 22057 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.271519 22447 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 13:18:45.439947 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 137303us
W20260709 13:18:45.455183 22529 log.cc:927] Time spent T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.282s	user 0.000s	sys 0.000s
I20260709 13:18:45.284778 22302 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:18:45.465013 22309 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:45.466921 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2136) took 1711 ms. Trace:
I20260709 13:18:45.440480 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:45.271302 22450 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:45.303458 22404 consensus_meta.cc:287] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.500s	user 0.010s	sys 0.000s
W20260709 13:18:45.292735 22530 log.cc:927] Time spent T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.321s	user 0.001s	sys 0.001s
W20260709 13:18:45.292909 22534 log.cc:927] Time spent T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:18:45.285687 22303 raft_consensus.cc:697] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:45.285998 22283 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:45.281608 22511 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
W20260709 13:18:45.579720 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 44010.6us
I20260709 13:18:45.480132 19658 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:18:45.581736 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:45.486795 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 503362us
I20260709 13:18:45.584957 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:45.467336 19508 rpcz_store.cc:276] 0709 13:18:43.755873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.757886 (+  2013us) service_pool.cc:224] Handling call
0709 13:18:43.758316 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.764951 (+  6635us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:44.643698 (+878747us) spinlock_profiling.cc:243] Waited 918 us on lock 0x7b180032c0e0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66a455 00007f6c351523c7 00007f6c317649a7 00007f6c317740bf 00007f6c31774038
0709 13:18:44.777957 (+134259us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.146316 (+368359us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.172788 (+ 26472us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.172944 (+   156us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:45.172981 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.173066 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.460999 (+287933us) raft_consensus.cc:1685] finished
0709 13:18:45.461120 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.466850 (+  5730us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1125145,"prepare.queue_time_us":73425,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":108871,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":5150,"spinlock_wait_cycles":2110336,"thread_start_us":384766,"threads_started":2,"wal-append.queue_time_us":666759}
I20260709 13:18:45.357410 22448 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:45.493971 19503 raft_consensus.cc:3055] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:45.586355 19503 raft_consensus.cc:740] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:45.587376 19503 consensus_queue.cc:260] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:45.589066 19503 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:45.466612 22407 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.283999 22412 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.446906 22057 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:45.438930 22380 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:45.286331 22419 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.207s
I20260709 13:18:45.539716 19655 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:18:45.641459 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 56638.2us
I20260709 13:18:45.642925 19625 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:45.305418 22208 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:45.568954 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:45.451376 22455 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:45.717844 19625 leader_election.cc:400] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9.
W20260709 13:18:45.486122 22471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.011s	sys 0.015s
I20260709 13:18:45.439507 22445 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.168s
W20260709 13:18:45.629770 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 140611us
W20260709 13:18:45.567528 22526 log.cc:927] Time spent T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.248s	user 0.000s	sys 0.009s
I20260709 13:18:45.302904 22413 consensus_queue.cc:260] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:45.778537 22413 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:45.781872 19582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.007s	sys 0.019s
W20260709 13:18:45.782249 19582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.007s	sys 0.019s
I20260709 13:18:45.635067 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:45.542459 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:45.303105 22397 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:45.755275 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 111166us
I20260709 13:18:45.768489 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:45.787534 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2132) took 2035 ms. Trace:
W20260709 13:18:45.791429 19585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.060s	sys 0.070s
I20260709 13:18:45.792562 19625 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:45.792073 19655 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:45.794296 19585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.060s	sys 0.070s
I20260709 13:18:45.799115 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:45.803247 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:45.805663 19656 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:45.807610 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:45.954634 19656 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:45.959342 19503 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:18:45.792078 19504 rpcz_store.cc:276] 0709 13:18:43.752345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.752597 (+   252us) service_pool.cc:224] Handling call
0709 13:18:43.771371 (+ 18774us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.793379 (+1022008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.793410 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:44.794052 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.906006 (+111954us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:44.906046 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.906114 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.787223 (+881109us) raft_consensus.cc:1685] finished
0709 13:18:45.787251 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.787447 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1081719,"raft.queue_time_us":1032224,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":17676,"thread_start_us":111585,"threads_started":1,"wal-append.queue_time_us":259739}
W20260709 13:18:45.767136 22471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.011s	sys 0.020s
I20260709 13:18:45.565780 22286 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:45.753719 22455 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.765528 22203 consensus_queue.cc:1059] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.188s
W20260709 13:18:45.784350 22538 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 13:18:45.754566 22256 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:45.756088 22275 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:18:45.908387 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:46.009831 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.809163 19505 raft_consensus.cc:2410] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:18:45.967844 19503 pending_rounds.cc:85] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 7
I20260709 13:18:46.010490 19503 pending_rounds.cc:107] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:18:46.010849 19503 raft_consensus.cc:2889] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:45.634625 22540 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.278s
W20260709 13:18:45.974053 19661 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.047s	sys 0.103s
I20260709 13:18:45.977687 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:46.023295 19661 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.047s	sys 0.103s
I20260709 13:18:45.979743 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1624) took 1141 ms. Trace:
I20260709 13:18:45.974431 22397 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:45.687150 22380 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:45.984102 19506 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:18:46.031816 19579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.081s	sys 0.090s
I20260709 13:18:46.031914 19506 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:45.837975 22187 raft_consensus.cc:3055] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:45.530649 22404 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:45.861812 22447 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.139s
I20260709 13:18:45.639457 22412 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:45.628525 22532 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.348s
W20260709 13:18:46.021742 19627 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.011s	sys 0.022s
I20260709 13:18:46.023694 19509 rpcz_store.cc:276] 0709 13:18:44.838386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.841851 (+  3465us) service_pool.cc:224] Handling call
0709 13:18:45.979507 (+1137656us) spinlock_profiling.cc:243] Waited 97.2 ms on lock 0x7b540037c3d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:45.979653 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223461632}
W20260709 13:18:46.055646 19627 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.012s	sys 0.022s
W20260709 13:18:46.056180 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 1.01237e+06us
W20260709 13:18:45.977679 19507 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.012s	sys 0.038s
W20260709 13:18:46.058036 19507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.012s	sys 0.038s
W20260709 13:18:46.026335 22418 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.015s	sys 0.020s
W20260709 13:18:45.995092 22491 consensus_meta.cc:287] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 1.101s	user 0.007s	sys 0.003s
W20260709 13:18:46.032462 19579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.081s	sys 0.090s
I20260709 13:18:46.029315 22203 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:46.064092 19583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.004s	sys 0.019s
W20260709 13:18:46.064477 19583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.004s	sys 0.020s
I20260709 13:18:45.640673 22407 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:45.989805 22499 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:46.021332 19586 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.012s	sys 0.022s
I20260709 13:18:45.994480 22455 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.033583 22187 raft_consensus.cc:740] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:46.025606 19655 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:46.043800 22210 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:46.034348 22480 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.032s	user 0.017s	sys 0.017s
I20260709 13:18:45.943365 22535 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:45.855785 22283 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:46.067075 19586 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.013s	sys 0.022s
W20260709 13:18:46.042132 22328 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.007s	sys 0.023s
W20260709 13:18:46.049810 22377 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.018s	sys 0.014s
W20260709 13:18:46.067986 19552 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.007s	sys 0.015s
I20260709 13:18:46.039157 19506 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:46.001977 22286 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:46.080345 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:46.061975 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1620) took 1251 ms. Trace:
W20260709 13:18:46.062680 22418 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.015s	sys 0.020s
I20260709 13:18:45.980341 22303 consensus_queue.cc:237] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:46.107903 20619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.009s	sys 0.017s
W20260709 13:18:46.144176 19584 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.013s	sys 0.032s
W20260709 13:18:46.738852 19584 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.459s	user 0.013s	sys 0.037s
W20260709 13:18:46.743136 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.743424 22578 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:46.730417 19580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.465s	user 0.019s	sys 0.035s
I20260709 13:18:45.273268 19653 rpcz_store.cc:276] 0709 13:18:43.903968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.904115 (+   147us) service_pool.cc:224] Handling call
0709 13:18:43.904496 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:43.904814 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:43.934940 (+ 30126us) log.cc:844] Serialized 14 byte log entry
0709 13:18:44.583164 (+648224us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b180026aee0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa23a 00007f6c31764a2a
0709 13:18:45.270813 (+687649us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.272275 (+  1462us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:45.272331 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:45.272423 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.272521 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.272664 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1917,"prepare.queue_time_us":83879,"prepare.run_cpu_time_us":173,"prepare.run_wall_time_us":1817,"raft.queue_time_us":2471,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":87,"spinlock_wait_cycles":9244416,"thread_start_us":714672,"threads_started":3,"wal-append.queue_time_us":950882}
W20260709 13:18:46.159521 20618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.009s	sys 0.014s
W20260709 13:18:46.745819 20629 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.010s	sys 0.007s
W20260709 13:18:46.746045 20619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.019s	sys 0.019s
W20260709 13:18:46.159301 20631 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.010s	sys 0.015s
W20260709 13:18:46.159121 19551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.014s	sys 0.010s
I20260709 13:18:46.216177 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:46.727276 19478 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.007s	sys 0.006s
W20260709 13:18:46.730443 19511 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.009s	sys 0.004s
W20260709 13:18:46.726796 19475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.096s	user 0.000s	sys 0.010s
I20260709 13:18:46.748317 19655 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:46.736302 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:46.733456 19581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.255s	user 0.018s	sys 0.010s
W20260709 13:18:46.745472 19661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.006s	sys 0.006s
W20260709 13:18:46.729948 19476 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.162s	user 0.005s	sys 0.022s
W20260709 13:18:46.730854 19582 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.000s	sys 0.022s
I20260709 13:18:46.073263 22203 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:46.212949 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1714) took 1001 ms. Trace:
W20260709 13:18:46.793962 19552 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.347s	user 0.007s	sys 0.026s
I20260709 13:18:46.310487 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1712) took 1265 ms. Trace:
I20260709 13:18:46.793637 19506 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:46.861244 19580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.596s	user 0.022s	sys 0.043s
W20260709 13:18:46.929430 19478 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.010s	sys 0.014s
W20260709 13:18:46.943140 19476 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.376s	user 0.006s	sys 0.031s
W20260709 13:18:46.964407 19581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.486s	user 0.018s	sys 0.023s
W20260709 13:18:46.930801 19661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.017s	sys 0.008s
W20260709 13:18:46.942602 19475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.312s	user 0.003s	sys 0.018s
I20260709 13:18:46.902235 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:46.966073 19582 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.004s	sys 0.029s
W20260709 13:18:46.350056 22493 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.005s	sys 0.023s
W20260709 13:18:46.966128 19511 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.014s	sys 0.010s
W20260709 13:18:46.215372 22541 log.cc:927] Time spent T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.350s	user 0.001s	sys 0.000s
I20260709 13:18:46.748986 19507 rpcz_store.cc:276] 0709 13:18:44.810814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.832377 (+ 21563us) service_pool.cc:224] Handling call
0709 13:18:44.832690 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.832884 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:45.051437 (+218553us) log.cc:844] Serialized 14 byte log entry
0709 13:18:46.061322 (+1009885us) log.cc:844] Serialized 14 byte log entry
0709 13:18:46.061556 (+   234us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:46.061609 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:46.061701 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.061775 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.061907 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1678,"prepare.queue_time_us":48243,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":84,"raft.queue_time_us":5193,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":7568,"spinlock_wait_cycles":27356288,"thread_start_us":1188037,"threads_started":2,"wal-append.queue_time_us":1237675}
I20260709 13:18:46.975047 22500 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.976168 22500 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:46.073177 22499 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:46.977908 19585 rpcz_store.cc:276] 0709 13:18:45.211270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.211452 (+   182us) service_pool.cc:224] Handling call
0709 13:18:45.221550 (+ 10098us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.221997 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.222025 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.228750 (+  6725us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.794842 (+566092us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:45.794899 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.794993 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.212730 (+417737us) raft_consensus.cc:1685] finished
0709 13:18:46.212748 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.212885 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16327,"raft.queue_time_us":2614,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":7521,"thread_start_us":563677,"threads_started":1,"wal-append.queue_time_us":980011}
W20260709 13:18:46.103773 22480 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.018s	sys 0.018s
W20260709 13:18:46.900163 22377 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.858s	user 0.022s	sys 0.035s
W20260709 13:18:46.902351 22328 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.753s	user 0.022s	sys 0.043s
W20260709 13:18:46.961947 20629 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.010s	sys 0.017s
W20260709 13:18:46.213639 22542 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
W20260709 13:18:46.418134 22419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.004s	sys 0.019s
I20260709 13:18:46.182682 22210 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:18:46.989060 19551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.621s	user 0.018s	sys 0.022s
I20260709 13:18:46.221007 22511 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.989401 22404 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:46.989974 20618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.407s	user 0.009s	sys 0.037s
I20260709 13:18:46.222175 22466 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:46.627404 22397 consensus_meta.cc:287] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.587s	user 0.008s	sys 0.003s
W20260709 13:18:46.338425 22489 consensus_meta.cc:287] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 1.450s	user 0.012s	sys 0.001s
I20260709 13:18:46.902024 22450 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:46.071095 22491 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:47.210476 19477 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.346s	user 0.022s	sys 0.018s
I20260709 13:18:47.225732 19659 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:47.213292 22499 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:47.226099 19477 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.591s	user 0.022s	sys 0.021s
I20260709 13:18:46.222309 22492 raft_consensus.cc:3055] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:47.217892 22286 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:46.182682 22211 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:47.146754 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.149978 20631 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.649s	user 0.012s	sys 0.035s
W20260709 13:18:47.228878 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.795245 22256 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:47.140808 19578 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:46.305155 22535 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.060959 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:46.306604 22407 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:46.794875 22558 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:18:47.235183 22493 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.564s	user 0.014s	sys 0.049s
W20260709 13:18:47.162269 19583 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.015s	sys 0.024s
I20260709 13:18:47.187815 19661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1691) took 2263 ms. Trace:
I20260709 13:18:47.258548 22579 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:46.213761 22543 consensus_queue.cc:1059] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 1.405s
I20260709 13:18:47.262084 22511 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:47.128675 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 1.56172e+06us
I20260709 13:18:46.794227 22185 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:18:47.010203 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 1.42962e+06us
I20260709 13:18:47.267743 19655 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
W20260709 13:18:47.139772 19656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1769) took 1392 ms (client timeout 1728 ms). Trace:
I20260709 13:18:47.175796 22203 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:46.861111 22283 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:47.272480 19656 rpcz_store.cc:269] 0709 13:18:45.733259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.901208 (+1167949us) service_pool.cc:224] Handling call
0709 13:18:47.125345 (+224137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.263615 22500 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:47.278899 22407 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:47.278560 22466 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:47.279451 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.281035 22310 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.281164 22492 raft_consensus.cc:740] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:18:47.281641 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.281878 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1727) took 1052 ms. Trace:
W20260709 13:18:47.277182 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 1.98328e+06us
I20260709 13:18:47.322916 19585 rpcz_store.cc:276] 0709 13:18:46.219820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.980688 (+760868us) service_pool.cc:224] Handling call
0709 13:18:47.272409 (+291721us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:46.308544 22187 consensus_queue.cc:260] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.282510 22549 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.282034 22256 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:47.283250 22404 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:47.284970 20619 connection.cc:256] RPC call timeout handler was delayed by -1.7276486950001981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
I20260709 13:18:47.288858 22380 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.290951 22489 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:46.544464 22455 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:46.478376 22412 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.294072 22211 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:47.263068 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 1.95391e+06us
W20260709 13:18:47.295122 22421 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:18:47.295706 22558 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.264823 19661 rpcz_store.cc:276] 0709 13:18:44.917290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.263279 (+345989us) service_pool.cc:224] Handling call
0709 13:18:45.263588 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.263836 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:45.264183 (+   347us) log.cc:844] Serialized 14 byte log entry
0709 13:18:46.025362 (+761179us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.060806 (+1035444us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.123337 (+ 62531us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:47.147107 (+ 23770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.179804 (+ 32697us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.180169 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1337,"prepare.queue_time_us":4721,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":77,"raft.queue_time_us":27525,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":34349,"spinlock_wait_cycles":14617344,"thread_start_us":1701318,"threads_started":2,"wal-append.queue_time_us":847931,"wal-append.run_cpu_time_us":2076,"wal-append.run_wall_time_us":1020183}
I20260709 13:18:47.297755 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1721) took 2013 ms. Trace:
I20260709 13:18:47.281036 22210 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.301708 22499 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:18:47.301800 19655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1754) took 1746 ms (client timeout 1858 ms). Trace:
I20260709 13:18:47.306565 22378 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:47.309185 22467 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:47.369452 22467 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:47.353698 19655 rpcz_store.cc:269] 0709 13:18:45.555393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.080052 (+524659us) service_pool.cc:224] Handling call
0709 13:18:47.276668 (+1196616us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.305358 22458 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:18:47.311054 22057 consensus_meta.cc:287] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 1.557s	user 0.007s	sys 0.019s
I20260709 13:18:47.301457 22511 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:47.274616 19583 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.016s	sys 0.029s
I20260709 13:18:47.318274 22543 raft_consensus.cc:3055] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:18:47.376762 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.296612 22579 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:47.328824 22310 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:47.336688 22404 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.355966 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:47.358649 22489 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:47.359036 19476 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.131:33295 timed out after 2.087s (SENT) [suppressed 5 similar messages]
I20260709 13:18:47.359707 19660 raft_consensus.cc:2393] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:47.358726 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:47.361651 22380 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.364001 22210 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.152777 19579 rpcz_store.cc:276] 0709 13:18:45.044723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.045010 (+   287us) service_pool.cc:224] Handling call
0709 13:18:45.062320 (+ 17310us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:45.155094 (+ 92774us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:45.173214 (+ 18120us) log.cc:844] Serialized 14 byte log entry
0709 13:18:46.063890 (+890676us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:46.070550 (+  6660us) log.cc:844] Serialized 52 byte log entry
0709 13:18:46.070761 (+   211us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:46.177135 (+106374us) log.cc:844] Serialized 14 byte log entry
0709 13:18:46.183328 (+  6193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.183434 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.310167 (+126733us) raft_consensus.cc:1685] finished
0709 13:18:46.310196 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.310387 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":113208,"prepare.queue_time_us":19143,"raft.queue_time_us":98831,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":13278,"spinlock_wait_cycles":9157888,"thread_start_us":783999,"threads_started":1,"wal-append.queue_time_us":1069192}
I20260709 13:18:47.365058 19506 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:47.364694 22499 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:47.365670 22419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.557s	user 0.013s	sys 0.029s
I20260709 13:18:47.367393 22491 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:47.368585 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:47.337731 19580 rpcz_store.cc:276] 0709 13:18:45.262457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.263811 (+  1354us) service_pool.cc:224] Handling call
0709 13:18:45.264124 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.264451 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.264480 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.264916 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.169820 (+1904904us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:47.216365 (+ 46545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.248791 (+ 32426us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.248860 (+    69us) raft_consensus.cc:1685] finished
0709 13:18:47.248881 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.276225 (+ 27344us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":168,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"thread_start_us":1676352,"threads_started":1,"wal-append.queue_time_us":1881793}
I20260709 13:18:47.316139 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1975) took 1053 ms. Trace:
I20260709 13:18:47.369239 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:47.382488 22407 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:47.382746 22378 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:47.393428 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.379424 22543 raft_consensus.cc:740] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:47.405645 19578 rpcz_store.cc:276] 0709 13:18:46.219131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.219275 (+   144us) service_pool.cc:224] Handling call
0709 13:18:47.268028 (+1048753us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.406800 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 1976) took 1177 ms. Trace:
I20260709 13:18:47.415612 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:47.415871 19585 rpcz_store.cc:276] 0709 13:18:46.219488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.355499 (+1136011us) service_pool.cc:224] Handling call
0709 13:18:47.397011 (+ 41512us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.006879 22578 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.292299 22535 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.433045 19655 raft_consensus.cc:2410] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:18:47.382550 22511 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:47.437106 19655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1749) took 1890 ms (client timeout 2201 ms). Trace:
W20260709 13:18:47.437557 19655 rpcz_store.cc:269] 0709 13:18:45.543656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.383635 (+1839979us) service_pool.cc:224] Handling call
0709 13:18:47.433493 (+ 49858us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:47.440366 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 81379.4us
W20260709 13:18:47.439612 19653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1764) took 1862 ms (client timeout 1946 ms). Trace:
W20260709 13:18:47.444370 19653 rpcz_store.cc:269] 0709 13:18:45.731634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.368090 (+1636456us) service_pool.cc:224] Handling call
0709 13:18:47.435709 (+ 67619us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.447979 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1630) took 2579 ms. Trace:
I20260709 13:18:47.374331 22549 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.450937 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1726) took 2173 ms. Trace:
I20260709 13:18:47.448606 19506 rpcz_store.cc:276] 0709 13:18:44.852394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.957269 (+104875us) service_pool.cc:224] Handling call
0709 13:18:44.957686 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.983964 (+1026278us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b5400063220. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316d1dc0 00007f6c3175c1c0 00007f6c3175d231 00007f6c31759d8f 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c
0709 13:18:47.401602 (+1417638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.431828 (+ 30226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14023040}
I20260709 13:18:47.459661 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:47.460631 19579 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.387979 22057 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.460819 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:47.465857 20662 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:47.466089 22567 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:47.434278 22458 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.466507 22380 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.467895 19658 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
W20260709 13:18:47.468298 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 109962us
I20260709 13:18:47.468726 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:47.494380 19655 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
W20260709 13:18:47.494990 19655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1768) took 1762 ms (client timeout 2182 ms). Trace:
W20260709 13:18:47.495363 19655 rpcz_store.cc:269] 0709 13:18:45.732986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.443086 (+1710100us) service_pool.cc:224] Handling call
0709 13:18:47.494927 (+ 51841us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.469045 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:47.469321 22569 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
W20260709 13:18:47.469949 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.454507 19581 rpcz_store.cc:276] 0709 13:18:45.272958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.289561 (+ 16603us) service_pool.cc:224] Handling call
0709 13:18:45.289887 (+   326us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:45.292959 (+  3072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.292992 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:45.302951 (+  9959us) log.cc:844] Serialized 52 byte log entry
0709 13:18:47.060197 (+1757246us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:47.215900 (+155703us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.399075 (+183175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.413857 (+ 14782us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.413931 (+    74us) raft_consensus.cc:1685] finished
0709 13:18:47.413956 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.445790 (+ 31834us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11176,"prepare.queue_time_us":66167,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":67,"raft.queue_time_us":64089,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":50715,"thread_start_us":1663170,"threads_started":2,"wal-append.queue_time_us":1864915}
I20260709 13:18:47.475127 22499 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:47.475333 22455 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.475584 22558 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.477921 22412 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:47.479547 22378 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.482262 22543 consensus_queue.cc:260] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.397199 22185 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.490665 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:47.473901 22187 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:47.483040 22211 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:47.483213 22328 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.483053 22421 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:47.466548 22560 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:18:47.513391 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.515352 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.483076 22568 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:47.523237 19578 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:47.525111 19653 raft_consensus.cc:2410] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:18:47.517289 19656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1761) took 1959 ms (client timeout 2200 ms). Trace:
W20260709 13:18:47.527848 19656 rpcz_store.cc:269] 0709 13:18:45.557400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.414689 (+1857289us) service_pool.cc:224] Handling call
0709 13:18:47.517209 (+102520us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:47.528896 19653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1759) took 1972 ms (client timeout 2414 ms). Trace:
W20260709 13:18:47.529403 19653 rpcz_store.cc:269] 0709 13:18:45.556845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.460048 (+1903203us) service_pool.cc:224] Handling call
0709 13:18:47.528834 (+ 68786us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.501289 22210 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:47.500550 22377 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:47.533102 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:47.533897 21963 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.534051 19653 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:47.533785 22560 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:47.534497 22448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.691s	user 0.000s	sys 0.021s
I20260709 13:18:47.534803 22590 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:47.535305 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.535583 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:47.535782 22397 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.536245 22569 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:47.537357 22492 consensus_queue.cc:260] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.507738 22511 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.540580 22450 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.524369 22467 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:47.530697 19627 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.020s	sys 0.036s
I20260709 13:18:47.557962 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1751) took 2005 ms. Trace:
I20260709 13:18:47.558578 22585 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.559772 22455 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:47.554543 22448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.799s	user 0.000s	sys 0.022s
I20260709 13:18:47.562103 21963 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.562486 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1718) took 2243 ms. Trace:
I20260709 13:18:47.561870 22566 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 13:18:47.566434 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 49946.7us
I20260709 13:18:47.566957 22590 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.567782 22057 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:47.568159 19655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1756) took 2012 ms (client timeout 2619 ms). Trace:
W20260709 13:18:47.618026 19655 rpcz_store.cc:269] 0709 13:18:45.556011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.502923 (+1946912us) service_pool.cc:224] Handling call
0709 13:18:47.568091 (+ 65168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.567852 22421 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.568632 22543 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:47.569141 22572 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.286s	user 0.002s	sys 0.000s
I20260709 13:18:47.569936 22594 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:47.571367 22578 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:47.573477 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:47.573997 22532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.419s	user 0.003s	sys 0.026s
I20260709 13:18:47.573891 20619 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:47.575644 22595 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:47.559820 22302 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:47.575698 22592 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.552233 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1722) took 2286 ms. Trace:
I20260709 13:18:47.561815 19587 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:47.529953 22378 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.563889 22418 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:47.597859 19627 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.021s	sys 0.037s
I20260709 13:18:47.598408 19653 rpcz_store.cc:276] 0709 13:18:45.544239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.533252 (+1989013us) service_pool.cc:224] Handling call
0709 13:18:47.533728 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.549231 (+ 15503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.549429 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.541649 22535 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:47.646471 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:47.647464 19653 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:18:47.533171 22328 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:47.612147 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 75805.2us
I20260709 13:18:47.651968 22328 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.542111 22211 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:47.618532 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1724) took 2348 ms. Trace:
I20260709 13:18:47.653326 22211 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.653136 19584 rpcz_store.cc:276] 0709 13:18:45.269784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.278826 (+  9042us) service_pool.cc:224] Handling call
0709 13:18:45.279121 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.279314 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:46.739869 (+1460555us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.470102 (+730233us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.548536 (+ 78434us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.554573 (+  6037us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:47.595988 (+ 41415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.612412 (+ 16424us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.618477 (+  6065us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18892,"prepare.queue_time_us":1124987,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":111,"raft.queue_time_us":216048,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":148,"spinlock_wait_cycles":18689408,"thread_start_us":2131231,"threads_started":4,"wal-append.queue_time_us":693453}
I20260709 13:18:47.652731 22328 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.641390 19579 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:47.657317 22211 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:47.658947 19653 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:47.659861 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1755) took 2104 ms. Trace:
I20260709 13:18:47.660260 19653 rpcz_store.cc:276] 0709 13:18:45.555735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.648504 (+2092769us) service_pool.cc:224] Handling call
0709 13:18:47.649573 (+  1069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.659546 (+  9973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.659795 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.656883 22328 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.662375 19653 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:47.663265 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1757) took 2107 ms. Trace:
I20260709 13:18:47.604295 22448 raft_consensus.cc:697] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:47.613942 19586 rpcz_store.cc:276] 0709 13:18:45.258967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.262582 (+  3615us) service_pool.cc:224] Handling call
0709 13:18:45.262923 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.263155 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:46.900763 (+1637608us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.429588 (+528825us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.439475 (+  9887us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:47.458237 (+ 18762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.486032 (+ 27795us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.501812 (+ 15780us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1063395,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":4059,"raft.queue_time_us":292366,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":2157,"thread_start_us":2082515,"threads_started":3,"wal-append.queue_time_us":371287}
W20260709 13:18:47.636076 22532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.564s	user 0.003s	sys 0.027s
W20260709 13:18:47.669399 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.663724 19653 rpcz_store.cc:276] 0709 13:18:45.556283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.661463 (+2105180us) service_pool.cc:224] Handling call
0709 13:18:47.662001 (+   538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.662951 (+   950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.663174 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:47.671636 19661 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1767) took 1938 ms (client timeout 2123 ms). Trace:
I20260709 13:18:47.620975 22412 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:47.666698 19654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1684) took 2689 ms (client timeout 1976 ms). Trace:
I20260709 13:18:47.541699 22567 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:47.615629 22210 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.663636 22328 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.638288 22404 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.637782 22455 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.644323 22450 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:47.700196 19661 rpcz_store.cc:269] 0709 13:18:45.732714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.573141 (+1840427us) service_pool.cc:224] Handling call
0709 13:18:47.671555 (+ 98414us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.642835 19583 rpcz_store.cc:276] 0709 13:18:45.265563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.266823 (+  1260us) service_pool.cc:224] Handling call
0709 13:18:45.267130 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:45.267492 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.267518 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:45.268007 (+   489us) log.cc:844] Serialized 52 byte log entry
0709 13:18:46.064868 (+796861us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:47.411562 (+1346694us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.502862 (+ 91300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.506630 (+  3768us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.516486 (+  9856us) raft_consensus.cc:1685] finished
0709 13:18:47.516512 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.552158 (+ 35646us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":833229,"prepare.run_cpu_time_us":225,"prepare.run_wall_time_us":65857,"raft.queue_time_us":67198,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":36235,"thread_start_us":1913508,"threads_started":2,"wal-append.queue_time_us":1184325}
I20260709 13:18:47.694490 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:47.689973 22302 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.699790 22595 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.701776 22592 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.710482 22421 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.711117 22302 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.711306 22595 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.711730 22302 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:47.711905 22592 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.664234 22377 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.701968 22211 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.713132 22211 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.698068 22577 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:47.715051 22569 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:47.687333 22256 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:18:47.701951 19654 rpcz_store.cc:269] 0709 13:18:44.912883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.913067 (+   184us) service_pool.cc:224] Handling call
0709 13:18:47.559586 (+2646519us) spinlock_profiling.cc:243] Waited 50.4 ms on lock 0x7b5400102554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:47.602049 (+ 42463us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115982080}
I20260709 13:18:47.637281 22585 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:47.721998 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.704860 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1720) took 2445 ms. Trace:
I20260709 13:18:47.667066 22397 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.711826 22588 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:47.693434 22418 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:47.704561 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 145134us
I20260709 13:18:47.693511 22535 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.728440 22248 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.734069 22535 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.735684 22450 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.736454 22535 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:47.737779 21963 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.738698 22377 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.637428 22568 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.728196 22492 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:47.728415 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:47.728958 22448 consensus_queue.cc:237] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.739794 22397 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:47.715274 22577 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.729386 22596 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:47.703608 22583 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:47.729910 19655 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:47.731026 22560 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:47.712364 22302 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.740186 22458 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.758327 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1753) took 2207 ms. Trace:
I20260709 13:18:47.755019 19661 raft_consensus.cc:2376] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11. Re-sending same reply.
I20260709 13:18:47.758941 19655 rpcz_store.cc:276] 0709 13:18:45.544815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.626069 (+2081254us) service_pool.cc:224] Handling call
0709 13:18:47.699471 (+ 73402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.752232 (+ 52761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.752439 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.758303 19578 raft_consensus.cc:2410] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:18:47.764019 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:47.724565 22407 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:47.773012 22588 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:47.785285 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.703725 22412 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.687956 22594 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.723222 19582 rpcz_store.cc:276] 0709 13:18:45.259577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.259810 (+   233us) service_pool.cc:224] Handling call
0709 13:18:45.260191 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:45.260608 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.260638 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:45.261237 (+   599us) log.cc:844] Serialized 52 byte log entry
0709 13:18:45.782616 (+521379us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:47.570987 (+1788371us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b180026c440. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c313024bc 00007f6c2e65048b 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66a455 00007f6c351523c7 00007f6c317649a7 00007f6c317740bf
0709 13:18:47.571175 (+   188us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.677015 (+105840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.688966 (+ 11951us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.692191 (+  3225us) raft_consensus.cc:1685] finished
0709 13:18:47.699994 (+  7803us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.704797 (+  4803us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57958,"prepare.queue_time_us":671332,"prepare.run_cpu_time_us":9717,"prepare.run_wall_time_us":322040,"raft.queue_time_us":31507,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":40029,"spinlock_wait_cycles":14005120,"thread_start_us":1556476,"threads_started":3,"wal-append.queue_time_us":960336,"wal-append.run_cpu_time_us":2530,"wal-append.run_wall_time_us":1016684}
W20260709 13:18:47.792241 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 218494us
I20260709 13:18:47.789573 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1629) took 2937 ms. Trace:
I20260709 13:18:47.794796 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:47.784571 22567 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:47.794384 19511 rpcz_store.cc:276] 0709 13:18:44.852147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.946662 (+ 94515us) service_pool.cc:224] Handling call
0709 13:18:44.947055 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:45.003377 (+ 56322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.003408 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:45.015383 (+ 11975us) log.cc:844] Serialized 52 byte log entry
0709 13:18:45.988255 (+972872us) spinlock_profiling.cc:243] Waited 8.24 ms on lock 0x7b18001776a0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa0d1 00007f6c31715a0f
0709 13:18:47.177209 (+1188954us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:47.177336 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.177531 (+   195us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.568285 (+390754us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:18:47.763694 (+195409us) raft_consensus.cc:1685] finished
0709 13:18:47.763715 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.789522 (+ 25807us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97822,"raft.queue_time_us":64930,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":6324,"spinlock_wait_cycles":85682944,"thread_start_us":984922,"threads_started":1,"wal-append.queue_time_us":2241058}
I20260709 13:18:47.799150 22302 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:47.800834 20619 leader_election.cc:336] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Timed out: RequestConsensusVote RPC to 127.17.251.129:38645 timed out after 1.838s (SENT)
I20260709 13:18:47.786410 22404 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:18:47.802117 22412 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:47.802877 22511 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.802927 22549 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:47.797586 19653 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:47.752794 22535 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:47.787698 22211 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:47.809254 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1758) took 2249 ms. Trace:
I20260709 13:18:47.812034 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:47.813596 19653 rpcz_store.cc:276] 0709 13:18:45.556558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.704997 (+2148439us) service_pool.cc:224] Handling call
0709 13:18:47.793248 (+ 88251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.805938 (+ 12690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.806147 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.815608 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:47.794503 22310 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.832851 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:47.834578 22210 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.819550 22185 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.808741 22560 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:18:47.840869 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:47.842656 22587 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.850075 22588 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:18:47.855616 19659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1773) took 2121 ms (client timeout 1683 ms). Trace:
W20260709 13:18:47.856124 19659 rpcz_store.cc:269] 0709 13:18:45.734367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.215821 (+481454us) service_pool.cc:224] Handling call
0709 13:18:47.855361 (+1639540us) spinlock_profiling.cc:243] Waited 91.9 ms on lock 0x7b54003f3c54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:47.855523 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211475712}
I20260709 13:18:47.872905 22568 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.796540 22583 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.874251 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:47.874588 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 62004us
I20260709 13:18:47.875454 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:47.876322 22310 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:47.877096 22378 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:47.879863 19506 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:47.881882 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:47.882519 19503 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:47.883697 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:47.880019 19505 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:47.835798 22590 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.885775 19581 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:47.894868 19627 connection.cc:256] RPC call timeout handler was delayed by -1.3250663720000375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
I20260709 13:18:47.836308 22535 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:47.898584 22275 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.902279 22275 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:47.904096 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45524.6us
I20260709 13:18:47.906751 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:47.907514 19505 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 7.
I20260709 13:18:47.908988 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:47.886338 22286 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.880570 22450 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:47.918359 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.919063 19509 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:47.919719 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.920257 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.923424 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:47.895994 22310 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.925252 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:47.925307 22310 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.894614 20662 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:47.937317 22577 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.937650 22310 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:47.938288 22616 log.cc:927] Time spent T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:18:47.924185 22286 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:47.946074 22585 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:47.907606 22275 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:47.926638 22535 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:47.959558 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:47.870826 22587 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:47.986259 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.994093 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:47.948894 22211 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.993248 22466 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:47.928440 22450 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:48.027587 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.058180 19652 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
W20260709 13:18:48.014463 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.026801 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 58651.6us
W20260709 13:18:48.072499 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 137564us
I20260709 13:18:48.079592 19627 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:48.079736 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 131066us
I20260709 13:18:48.084790 22594 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:48.072443 22380 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:48.025758 22583 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:48.007845 22418 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:48.098277 22618 log.cc:927] Time spent T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:18:48.082363 22577 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:18:48.114323 22577 consensus_queue.cc:1243] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:48.114975 22577 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:48.115358 22577 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:48.116438 22577 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:48.117921 22587 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:48.118098 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1770) took 2384 ms. Trace:
I20260709 13:18:48.118470 19655 rpcz_store.cc:276] 0709 13:18:45.733541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.759988 (+2026447us) service_pool.cc:224] Handling call
0709 13:18:47.821536 (+ 61548us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.822163 (+   627us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:47.822557 (+   394us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.935029 (+112472us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.955527 (+ 20498us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.956172 (+   645us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:47.956470 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.065596 (+109126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.065694 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.117806 (+ 52112us) raft_consensus.cc:1685] finished
0709 13:18:48.117845 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.117986 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":154699,"prepare.queue_time_us":1746,"raft.queue_time_us":107257,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":16723,"spinlock_wait_cycles":20793344,"thread_start_us":105816,"threads_started":1,"wal-append.queue_time_us":108788}
I20260709 13:18:48.099481 22275 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:48.061411 22276 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:48.085644 22462 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:18:48.109804 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.111222 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.057941 22211 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:48.126704 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.212754 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:48.213886 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:48.214041 22456 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:48.215175 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:48.173271 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.216620 19505 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:48.216301 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:48.218887 19505 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:48.221303 19654 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:48.221359 19578 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:48.220827 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:48.213646 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.222600 20661 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:48.222987 19578 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:48.223173 19509 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
W20260709 13:18:48.223898 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 93833.9us
I20260709 13:18:48.220211 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1685) took 3306 ms. Trace:
W20260709 13:18:48.221017 19587 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1715) took 2982 ms (client timeout 1569 ms). Trace:
W20260709 13:18:48.248082 19587 rpcz_store.cc:269] 0709 13:18:45.238193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.238323 (+   130us) service_pool.cc:224] Handling call
0709 13:18:48.220774 (+2982451us) spinlock_profiling.cc:243] Waited 2.25 s on lock 0x7b5400107554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:48.220915 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5175551744}
I20260709 13:18:48.222697 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1763) took 2649 ms. Trace:
I20260709 13:18:48.238423 19627 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:48.249358 19654 rpcz_store.cc:276] 0709 13:18:45.573340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.774827 (+2201487us) service_pool.cc:224] Handling call
0709 13:18:48.221093 (+446266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.221741 (+   648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.222504 (+   763us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54002175d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:48.222641 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":933595520}
I20260709 13:18:48.251116 19654 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:48.252463 22309 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:48.252715 19627 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:48.252923 22309 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:48.219772 22299 consensus_queue.cc:1059] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:18:48.254575 22299 raft_consensus.cc:3055] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:48.254753 19656 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:48.255038 22299 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:48.255610 19658 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1760) took 2698 ms (client timeout 1552 ms). Trace:
W20260709 13:18:48.256069 19658 rpcz_store.cc:269] 0709 13:18:45.557129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.581367 (+ 24238us) service_pool.cc:224] Handling call
0709 13:18:48.226008 (+2644641us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b5400020dd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:48.255542 (+ 29534us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3926450560}
I20260709 13:18:48.256127 22299 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:48.226002 19660 rpcz_store.cc:276] 0709 13:18:44.914340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.915430 (+  1090us) service_pool.cc:224] Handling call
0709 13:18:48.219976 (+3304546us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b54002175d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:48.220153 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5471297920}
I20260709 13:18:48.179634 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:48.241830 22619 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.002s
I20260709 13:18:48.244107 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1771) took 2510 ms. Trace:
W20260709 13:18:48.245026 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 76496us
I20260709 13:18:48.179031 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.255122 19656 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:48.238831 22455 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:48.219197 19512 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:48.254042 19661 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:48.247404 22450 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:48.182520 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:48.158661 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 345471us
I20260709 13:18:48.158083 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1728) took 1938 ms. Trace:
I20260709 13:18:48.182034 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:48.180269 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:48.266485 19659 rpcz_store.cc:276] 0709 13:18:45.733829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.856972 (+2123143us) service_pool.cc:224] Handling call
0709 13:18:47.857412 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.895466 (+ 38054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.895510 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.911268 (+ 15758us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.997960 (+ 86692us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:47.998018 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.998117 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.243869 (+245752us) raft_consensus.cc:1685] finished
0709 13:18:48.243890 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.244042 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9376,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":7049,"thread_start_us":86238,"threads_started":1,"wal-append.queue_time_us":194889}
I20260709 13:18:48.406800 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:18:48.159121 19652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1748) took 2615 ms (client timeout 1519 ms). Trace:
I20260709 13:18:48.354172 19654 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:48.406877 19504 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:48.362741 19511 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:48.433990 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:48.426080 19652 rpcz_store.cc:269] 0709 13:18:45.543294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.543426 (+   132us) service_pool.cc:224] Handling call
0709 13:18:48.158894 (+2615468us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b540032b9d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:48.159031 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4559420288}
I20260709 13:18:48.257187 22577 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:48.322144 19585 rpcz_store.cc:276] 0709 13:18:46.220112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.437973 (+1217861us) service_pool.cc:224] Handling call
0709 13:18:47.517051 (+ 79078us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:47.643273 (+126222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.643303 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:47.689324 (+ 46021us) log.cc:844] Serialized 52 byte log entry
0709 13:18:47.788632 (+ 99308us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:47.807191 (+ 18559us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.157705 (+350514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.157806 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.157853 (+    47us) raft_consensus.cc:1685] finished
0709 13:18:48.157871 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.158020 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":355802,"prepare.queue_time_us":19705,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":57,"raft.queue_time_us":392779,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":22870,"thread_start_us":158496,"threads_started":2,"wal-append.queue_time_us":131434}
I20260709 13:18:48.408584 19661 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:48.125967 22275 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.441462 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.357088 22299 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:48.449090 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 47408.2us
I20260709 13:18:48.356498 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:48.353390 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:48.253953 22309 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:48.454308 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 578962us
I20260709 13:18:48.174188 22614 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.270s
I20260709 13:18:48.319564 22397 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:48.408613 22211 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:48.456736 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.454105 19476 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:48.455264 19656 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:48.446516 22275 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:48.365581 22579 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:18:48.462643 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.173851 22179 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.287s
I20260709 13:18:48.350884 22543 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:48.469451 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:48.469761 22585 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.479112 19510 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:48.476301 19504 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
W20260709 13:18:48.477326 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 258004us
I20260709 13:18:48.485426 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:48.474967 22309 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:48.465688 22283 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:48.513986 22397 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.514820 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.514801 22397 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:48.515689 19504 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:48.517233 22397 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:48.485893 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:48.530694 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.494974 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:48.532522 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:48.533969 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.496227 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.535176 19511 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:48.536104 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.536737 19511 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:48.494467 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.477478 22450 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:48.498323 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.537523 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.537961 22450 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.502265 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.538374 22450 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:48.538547 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.503239 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.539947 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:48.540166 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.540740 19512 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:48.541100 19505 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:48.516598 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:48.518406 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.525808 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.526535 22585 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:48.546216 22585 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:18:48.546407 19406 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 47) took 12013 ms (client timeout 15000 ms). Trace:
I20260709 13:18:48.527297 22543 raft_consensus.cc:697] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:48.538702 19509 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
W20260709 13:18:48.550562 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 81255us
I20260709 13:18:48.551951 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:48.552594 22208 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:48.552110 22543 consensus_queue.cc:237] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:48.509956 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.554762 22574 raft_consensus.cc:3055] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:48.554924 22283 raft_consensus.cc:697] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:48.555234 19506 raft_consensus.cc:2410] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:18:48.555234 22574 raft_consensus.cc:740] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:18:48.556095 22283 consensus_queue.cc:237] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:48.553838 22510 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:48.553903 22378 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:48.478690 22560 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:18:48.487560 19656 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:48.561121 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:48.589738 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.596947 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 1982) took 1335 ms. Trace:
I20260709 13:18:48.596362 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:48.599064 19580 rpcz_store.cc:276] 0709 13:18:47.261448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.708938 (+447490us) service_pool.cc:224] Handling call
0709 13:18:47.709295 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:47.716353 (+  7058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.716384 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:47.754029 (+ 37645us) log.cc:844] Serialized 52 byte log entry
0709 13:18:47.929215 (+175186us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:47.933855 (+  4640us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.458365 (+524510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.458444 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.596684 (+138240us) raft_consensus.cc:1685] finished
0709 13:18:48.596707 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.596886 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":620493,"prepare.queue_time_us":4466,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":544294,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":32610,"thread_start_us":124886,"threads_started":1,"wal-append.queue_time_us":389476}
I20260709 13:18:48.606258 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.618499 19551 leader_election.cc:400] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12.
I20260709 13:18:48.619405 19625 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:48.627355 19512 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:48.628466 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.629172 19512 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:48.630170 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.631320 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:48.642944 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 151608us
W20260709 13:18:48.647904 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.642336 22203 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:48.656363 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:48.624655 22450 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:48.546939 19406 rpcz_store.cc:269] 0709 13:18:36.532404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.532634 (+   230us) service_pool.cc:224] Handling call
0709 13:18:48.546098 (+12013464us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:42.340969 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:42.341517 (+   548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:42.341551 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:18:42.341569 (+    18us) tablet.cc:662] Decoding operations
0709 13:18:42.350022 (+  8453us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:42.350102 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:42.350138 (+    36us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:42.350392 (+   254us) tablet.cc:701] Row locks acquired
0709 13:18:42.350410 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:18:42.350558 (+   148us) write_op.cc:270] Start()
0709 13:18:42.350685 (+   127us) write_op.cc:276] Timestamp: P: 1783603122350512 usec, L: 0
0709 13:18:42.350722 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:18:42.353553 (+  2831us) log.cc:844] Serialized 988 byte log entry
0709 13:18:42.949830 (+596277us) op_driver.cc:464] REPLICATION: finished
0709 13:18:43.310741 (+360911us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b54002ec7d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c31755e28 00007f6c35190581 00007f6c3518fd58 00007f6c351949f1 00007f6c351949a9 00007f6c35194939 00007f6c35194901 00007f6c35193b2d 000000000038f354 000000000038f199
0709 13:18:43.492131 (+181390us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c2e6500ac 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c35190ef0
0709 13:18:44.750688 (+1258557us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b18002a2f20. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e63b2a6 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1
0709 13:18:44.905254 (+154566us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b18002a2f20. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:18:44.905425 (+   171us) write_op.cc:301] APPLY: starting
0709 13:18:44.905530 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:44.905718 (+   188us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:44.905749 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:44.939634 (+ 33885us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:45.002276 (+ 62642us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:18:45.002337 (+    61us) write_op.cc:312] APPLY: finished
0709 13:18:45.002564 (+   227us) log.cc:844] Serialized 28 byte log entry
0709 13:18:47.063629 (+2061065us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:47.074642 (+ 11013us) write_op.cc:454] Released schema lock
0709 13:18:47.074911 (+   269us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:47.075777 (+   866us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:47.075814 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3153549,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":825591,"apply.run_cpu_time_us":78449,"apply.run_wall_time_us":2170200,"num_ops":2,"prepare.queue_time_us":180316,"prepare.run_cpu_time_us":69953,"prepare.run_wall_time_us":969986,"raft.queue_time_us":194353,"raft.run_cpu_time_us":72279,"raft.run_wall_time_us":851065,"replication_time_us":598952,"spinlock_wait_cycles":94689280,"thread_start_us":3127694,"threads_started":5,"wal-append.queue_time_us":1484417,"wal-append.run_cpu_time_us":30994,"wal-append.run_wall_time_us":2321504}]]}
W20260709 13:18:48.666309 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 67631.2us
I20260709 13:18:48.666323 22500 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.669301 22445 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:48.669842 22445 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:48.670301 22445 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:48.672459 22483 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:18:48.669682 22500 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:48.676895 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 123257us
I20260709 13:18:48.674383 19476 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:48.678669 19511 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 7: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:48.651309 22377 consensus_queue.cc:1059] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:18:48.680805 22595 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:18:48.706089 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 348648us
W20260709 13:18:48.708200 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.709599 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.725884 19657 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:48.730263 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.731254 19505 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:48.708585 22483 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:18:48.741657 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 87754us
I20260709 13:18:48.749912 19654 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:48.753069 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.756691 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.758186 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.709563 22595 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:48.759043 19476 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:18:48.758982 19508 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:48.768654 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:48.769718 22628 log.cc:927] Time spent T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:18:48.770313 22445 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:48.772496 22445 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:48.772681 19512 raft_consensus.cc:2410] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:18:48.775743 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:48.776932 22276 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.778803 22276 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:48.780867 22276 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:48.782138 22483 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:48.782836 22483 raft_consensus.cc:697] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:48.783907 22483 consensus_queue.cc:237] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:48.786641 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:48.789681 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.790694 19580 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:48.791074 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:48.744321 22588 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:18:48.793998 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:48.794029 22303 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.794857 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:48.795529 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:48.797089 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:48.777499 22378 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:48.799759 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:48.799759 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:48.800891 19585 raft_consensus.cc:2410] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:48.788025 22450 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:48.802445 19508 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:48.803534 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:48.811846 19586 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
W20260709 13:18:48.812811 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 60809us
I20260709 13:18:48.813160 19579 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
W20260709 13:18:48.813488 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 101093us
I20260709 13:18:48.817811 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:48.819448 19476 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:48.820901 19476 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:48.821602 22577 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:48.822113 22577 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:48.802281 22210 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:48.828894 19584 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:48.827971 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:48.822314 22560 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:48.837937 19580 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:48.839994 22299 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:48.844866 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:48.845781 19585 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:48.848223 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:48.850557 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 74907.6us
I20260709 13:18:48.830420 22614 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:48.854575 19625 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:48.815717 22276 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:18:48.855818 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.832598 22210 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:48.864686 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:48.867628 19625 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:48.878639 22625 log.cc:927] Time spent T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.249s	user 0.003s	sys 0.000s
I20260709 13:18:48.829377 22303 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:48.883483 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:48.887089 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:48.888382 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:48.884052 19580 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:48.899510 19585 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:18:48.885998 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:48.900529 19578 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
W20260709 13:18:48.884763 19657 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1670) took 4884 ms (client timeout 1743 ms). Trace:
W20260709 13:18:48.901209 19657 rpcz_store.cc:269] 0709 13:18:44.000420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.073553 (+ 73133us) service_pool.cc:224] Handling call
0709 13:18:48.884524 (+4810971us) spinlock_profiling.cc:243] Waited 4.62 s on lock 0x7b540032afd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:48.884677 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10617747840}
I20260709 13:18:48.893780 22203 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:18:48.863075 22577 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:48.904641 22203 consensus_queue.cc:1243] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:18:48.904970 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 84230us
I20260709 13:18:48.905314 22203 raft_consensus.cc:3055] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:48.906724 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:48.875195 22210 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.880115 22397 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:48.907442 22635 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:18:48.906877 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.880650 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1732) took 1302 ms. Trace:
I20260709 13:18:48.908665 19512 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:48.910276 19581 rpcz_store.cc:276] 0709 13:18:47.578103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.118958 (+540855us) service_pool.cc:224] Handling call
0709 13:18:48.119303 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:48.446423 (+327120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.446456 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:48.453239 (+  6783us) log.cc:844] Serialized 52 byte log entry
0709 13:18:48.677874 (+224635us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:48.680407 (+  2533us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.680622 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.680730 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.880388 (+199658us) raft_consensus.cc:1685] finished
0709 13:18:48.880409 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.880574 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":313683,"prepare.queue_time_us":1808,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":1459,"raft.queue_time_us":337939,"spinlock_wait_cycles":11558528,"thread_start_us":209096,"threads_started":1,"wal-append.queue_time_us":282877}
W20260709 13:18:48.914326 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 151467us
I20260709 13:18:48.882828 22208 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:48.914040 19625 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:48.913486 22614 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:48.917006 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.920369 19508 raft_consensus.cc:2410] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:18:48.911509 22203 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:48.921356 22543 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:48.921804 22543 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.924522 19625 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:48.926976 19625 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:48.928802 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:48.929453 20661 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:48.920791 22614 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.930153 22614 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:48.932016 22179 raft_consensus.cc:3055] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:48.932410 22179 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:48.933192 22179 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:48.934690 22179 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:48.922115 22543 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:48.936002 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.887941 22378 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:18:48.938495 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.940119 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.941217 19509 raft_consensus.cc:2410] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:18:48.942323 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.943007 19508 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:48.922076 22203 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:48.946074 22203 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:48.947355 22500 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:48.948390 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.949036 19503 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:48.949712 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.911500 22397 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.920897 22208 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.960197 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.961853 19476 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:48.885390 22275 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:48.954008 22397 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:48.967123 22299 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:48.967713 19476 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:48.968045 22303 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:48.968746 19656 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:18:48.994828 19656 pending_rounds.cc:85] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 5
I20260709 13:18:48.995200 19656 pending_rounds.cc:107] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:18:48.995572 19656 raft_consensus.cc:2889] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:48.996505 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1779) took 1301 ms. Trace:
I20260709 13:18:48.996904 19656 rpcz_store.cc:276] 0709 13:18:47.695203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.254233 (+559030us) service_pool.cc:224] Handling call
0709 13:18:48.254531 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.996168 (+741637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.996406 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:48.972054 22624 log.cc:927] Time spent T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 13:18:48.977053 22492 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.968057 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:48.964911 22535 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:48.952906 22276 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:49.011175 22276 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.011631 22276 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:48.982108 22574 consensus_queue.cc:260] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:49.014529 22574 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:48.984530 19658 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:48.985167 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.000038 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1772) took 3266 ms. Trace:
I20260709 13:18:49.003311 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.003574 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.002064 19507 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:18:49.047996 19582 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:18:49.006356 22595 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:49.007050 22318 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:48.983230 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1735) took 1338 ms. Trace:
W20260709 13:18:49.020360 22641 log.cc:927] Time spent T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:18:49.021965 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.023345 22275 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:49.023806 22643 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.134s	user 0.002s	sys 0.000s
W20260709 13:18:49.059787 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.986007 22208 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:49.024565 22492 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:49.025653 22286 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:49.028033 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.071156 19578 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:18:49.031095 22627 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.402s	user 0.002s	sys 0.000s
W20260709 13:18:49.032286 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.049656 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 122715us
I20260709 13:18:49.073081 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:49.046234 19653 rpcz_store.cc:276] 0709 13:18:45.734088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.859232 (+2125144us) service_pool.cc:224] Handling call
0709 13:18:47.927072 (+ 67840us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.069723 (+142651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.069763 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.089962 (+ 20199us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.284043 (+194081us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:48.366360 (+ 82317us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.366647 (+   287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.366740 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.971409 (+604669us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:18:48.999696 (+ 28287us) raft_consensus.cc:1685] finished
0709 13:18:48.999804 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.999951 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4958,"prepare.queue_time_us":82960,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":51526,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":4578,"spinlock_wait_cycles":6750592,"thread_start_us":189658,"threads_started":1,"wal-append.queue_time_us":508162}
I20260709 13:18:49.052752 19583 rpcz_store.cc:276] 0709 13:18:47.644661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.156943 (+512282us) service_pool.cc:224] Handling call
0709 13:18:48.157276 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:48.440204 (+282928us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:48.460594 (+ 20390us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.721943 (+261349us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:48.732995 (+ 11052us) log.cc:844] Serialized 52 byte log entry
0709 13:18:48.733208 (+   213us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:48.733459 (+   251us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.734023 (+   564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.734112 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.983002 (+248890us) raft_consensus.cc:1685] finished
0709 13:18:48.983027 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.983176 (+   149us) inbound_call.cc:177] Queueing success response
0709 13:18:49.032959 (+ 49783us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b180026c1a0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
Metrics: {"mutex_wait_us":240109,"prepare.queue_time_us":16013,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":77,"raft.queue_time_us":184975,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":7593,"spinlock_wait_cycles":3606272,"thread_start_us":230130,"threads_started":1,"wal-append.queue_time_us":288993}
I20260709 13:18:49.060601 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:49.066767 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 99181.9us
I20260709 13:18:49.068122 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:49.081694 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.081889 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.088163 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:49.091007 19580 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:18:49.092270 19551 connection.cc:256] RPC call timeout handler was delayed by -3.3134905770000387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260709 13:18:49.092916 19551 connection.cc:256] RPC call timeout handler was delayed by -2.4628817830000571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1976s for a response
W20260709 13:18:49.093554 19551 connection.cc:256] RPC call timeout handler was delayed by -2.4485594070001753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
I20260709 13:18:49.093807 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:49.094087 19551 connection.cc:256] RPC call timeout handler was delayed by -2.1746861970002556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
I20260709 13:18:49.094579 19506 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
W20260709 13:18:49.094900 19551 connection.cc:256] RPC call timeout handler was delayed by -1.3655861970000842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27130000000000004s for a response
I20260709 13:18:49.097925 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:49.099040 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:49.100720 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.072273 22299 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.104571 22276 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:49.105719 22275 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:49.126402 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.106513 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.127357 19656 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:49.107991 19625 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:49.128151 19511 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:49.128734 19625 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:49.099927 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.129218 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.129634 19510 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:49.130640 22203 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:49.116689 22614 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:49.125283 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.134188 19504 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:18:49.126636 19583 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:49.131387 19625 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:49.123318 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:49.126338 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.136159 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.136780 19578 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:49.138582 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:49.139523 19506 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 8: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:49.141680 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.143242 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:49.144620 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.146268 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.149609 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.150220 19578 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:49.151582 22286 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:49.152271 22286 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:49.153669 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1774) took 1550 ms. Trace:
I20260709 13:18:49.154048 19655 rpcz_store.cc:276] 0709 13:18:47.618377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.127090 (+508713us) service_pool.cc:224] Handling call
0709 13:18:48.127477 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.127961 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:48.128288 (+   327us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.479698 (+351410us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.492975 (+ 13277us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.493130 (+   155us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:48.528708 (+ 35578us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.529341 (+   633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.529442 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.030339 (+500897us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:18:49.153438 (+123099us) raft_consensus.cc:1685] finished
0709 13:18:49.153459 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.153588 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14544,"prepare.queue_time_us":35315,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":82,"raft.queue_time_us":19003,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":15902,"spinlock_wait_cycles":36291328,"thread_start_us":305701,"threads_started":1,"wal-append.queue_time_us":460734}
I20260709 13:18:49.133428 22276 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:49.132301 20661 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:49.135983 22275 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:49.158489 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.159246 19656 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:49.162642 19625 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:49.166196 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.166345 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.166666 22286 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:49.167495 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.167790 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.169864 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.170758 19625 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:49.172890 19582 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:18:49.174229 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.156497 22203 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:49.180017 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.180910 19657 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:49.168484 22543 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:49.181984 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.182215 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.182667 19653 raft_consensus.cc:2393] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 5: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:49.183208 19657 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:49.183545 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.183809 22543 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:49.184407 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.184660 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.185729 22614 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:49.186040 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.186761 19655 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:49.186859 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:49.187552 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.187175 22210 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:49.188578 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.190002 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.190690 19654 raft_consensus.cc:2393] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:49.191390 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.192348 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:49.193049 19654 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:49.194470 19652 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:49.195092 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.195453 19659 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:18:49.198113 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.198743 22467 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:49.200796 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:49.201761 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 111650us
I20260709 13:18:49.201944 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:49.206277 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:49.219820 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.220968 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.222430 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.223246 19654 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:49.225095 19585 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:49.229529 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.230556 19578 raft_consensus.cc:2410] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:18:49.161365 22275 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.233042 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.233436 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.233736 19657 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:49.235275 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.169108 22500 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:49.240675 19476 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:49.144680 22299 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:49.235996 19509 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:49.249327 19583 raft_consensus.cc:2410] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:18:49.146927 22208 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:49.201790 22614 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:49.254328 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.254437 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.256239 19584 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:49.256268 19654 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:49.258036 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.235939 22275 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:49.266978 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 96296.1us
I20260709 13:18:49.267879 19625 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:49.273420 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 86364.9us
I20260709 13:18:49.242664 22500 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.280490 19625 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:49.283034 19656 raft_consensus.cc:2368] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9.
I20260709 13:18:49.250702 22535 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:49.289688 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.299793 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.278529 22179 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:49.282244 22543 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:49.307642 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:49.254995 22577 consensus_queue.cc:1059] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:18:49.305783 19409 catalog_manager.cc:5697] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:18:49.284228 22210 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:49.311268 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.308553 19583 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:49.278913 22614 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:49.309930 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.285396 22585 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:49.285769 22500 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:49.314783 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.315397 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.319082 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.326013 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:49.326331 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.329442 19656 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:18:49.330017 19584 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:49.330302 19583 raft_consensus.cc:2410] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:18:49.311908 22543 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.312814 22492 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:49.331519 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.309005 22179 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:49.337267 19654 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:18:49.396134 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.406307 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.445446 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:49.423293 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.502472 19586 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:49.501125 19582 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:49.406049 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.405676 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.404662 19476 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:49.501015 19505 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:18:49.353500 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:49.506862 19512 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 7: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:49.352779 19511 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:18:49.499639 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 102743us
I20260709 13:18:49.337383 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:49.406355 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.501128 19583 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:49.513048 19579 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:49.471058 19409 catalog_manager.cc:5697] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 6 to 8, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 8 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:49.515560 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:49.456928 22632 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:18:49.456602 22648 log.cc:927] Time spent T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:18:49.325881 22467 raft_consensus.cc:2764] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:18:49.519887 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:49.521472 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 185847us
I20260709 13:18:49.338011 22543 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:49.526073 20619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.526985 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.500865 22179 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:49.531378 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:49.533037 19657 raft_consensus.cc:2393] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:49.532411 19653 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:18:49.533680 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
W20260709 13:18:49.529320 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 221725us
I20260709 13:18:49.535596 20665 raft_consensus.cc:2376] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9. Re-sending same reply.
W20260709 13:18:49.537756 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.406406 22286 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 13:18:49.540215 22587 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:49.541015 19409 catalog_manager.cc:5697] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 2 to 6, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 6 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:49.541909 20659 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:49.542150 22653 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:18:49.544363 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:49.545583 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:49.547197 19587 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:49.518227 22577 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:49.550946 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.551716 19503 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:18:49.555594 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:49.557813 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:49.574679 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:49.575407 19581 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:49.580282 19503 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:49.583037 19579 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:49.584654 19579 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:49.588227 19583 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:49.589735 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.596576 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:49.597812 19583 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:49.502072 22614 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:49.557178 22595 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:49.613571 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.572142 22318 consensus_queue.cc:1059] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:18:49.609050 19409 catalog_manager.cc:5697] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 3 to 7, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 7 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:18:49.620968 19476 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:49.615208 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.606446 22483 raft_consensus.cc:3055] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:18:49.630970 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 75470.7us
I20260709 13:18:49.633868 22299 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:49.536813 19656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:18:49.641268 19625 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:49.642570 19656 raft_consensus.cc:606] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:18:49.643103 19656 raft_consensus.cc:614] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:49.639817 19584 raft_consensus.cc:2410] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:49.609969 22286 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:49.646543 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.651233 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:49.657222 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.658155 19503 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:18:49.639251 22483 raft_consensus.cc:740] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:49.650310 22397 consensus_meta.cc:287] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.640s	user 0.006s	sys 0.006s
I20260709 13:18:49.653496 22535 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:49.655906 22210 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:49.703006 19409 catalog_manager.cc:5697] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 3 to 6, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 6 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:49.668421 22397 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:49.708842 22397 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:49.710071 19585 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:49.677577 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.711215 19503 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:18:49.712425 19661 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: [8.4-8.4]
W20260709 13:18:49.714780 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 56366.2us
I20260709 13:18:49.682017 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:49.690112 22574 consensus_meta.cc:287] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.007s
I20260709 13:18:49.691090 22543 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:49.695952 22657 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:18:49.698289 22654 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:49.698123 22483 consensus_queue.cc:260] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:49.717322 19625 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:49.718721 19553 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:49.705152 19409 catalog_manager.cc:5697] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 3 to 6, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 6 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:18:49.729257 19586 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:49.732311 19579 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:49.739871 19581 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:49.740834 19587 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:18:49.741899 19506 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:49.776875 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 58231.5us
W20260709 13:18:49.778529 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 96632.3us
W20260709 13:18:49.782399 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 161507us
I20260709 13:18:49.789306 22283 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:49.790540 22283 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:49.790935 22283 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:49.791965 22283 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:49.793293 22283 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:49.795168 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 77948.9us
I20260709 13:18:49.803103 19625 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:18:49.806027 22535 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:49.806355 22208 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:49.806629 22535 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:49.807243 22535 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:49.799245 22543 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:49.800175 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:49.829038 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 49405us
I20260709 13:18:49.830188 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:49.743470 22210 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:49.831337 22210 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:49.831920 22210 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:49.743219 20662 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:49.801960 19503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:18:49.837946 19503 raft_consensus.cc:606] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:18:49.838358 19503 raft_consensus.cc:614] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:49.808401 22179 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:49.841851 19510 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:49.745205 22397 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:49.842828 22179 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:49.781188 22286 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:49.796360 22483 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:49.812704 19625 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:49.847641 19625 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:49.850129 22397 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:49.850701 22397 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.850796 19503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:18:49.851207 22397 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:49.851533 19503 raft_consensus.cc:606] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:18:49.851954 19503 raft_consensus.cc:614] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:49.828994 22283 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:49.853545 22208 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:49.859493 22208 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:49.860046 22208 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:49.824352 22275 consensus_meta.cc:287] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.004s
W20260709 13:18:49.874292 20662 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59442 (request call id 108) took 1314 ms (client timeout 1521 ms). Trace:
W20260709 13:18:49.875031 20662 rpcz_store.cc:269] 0709 13:18:48.559609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.563440 (+  3831us) service_pool.cc:224] Handling call
0709 13:18:49.874023 (+1310583us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54006cc5d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:49.874200 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2570453888}
I20260709 13:18:49.862581 22275 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:49.889515 22275 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:49.891008 19625 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:49.857882 19503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f949ff511e844749624dedf436dff50"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
W20260709 13:18:49.896576 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 381660us
W20260709 13:18:49.908200 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 222632us
W20260709 13:18:49.915279 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 304305us
I20260709 13:18:49.894783 22286 raft_consensus.cc:697] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:18:49.919275 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 89192.7us
I20260709 13:18:49.922510 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:49.894517 22467 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:49.923228 19627 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:49.909456 22318 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.909266 22587 raft_consensus.cc:697] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:49.911252 22275 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:49.926347 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:49.926903 22595 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:49.930153 22595 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.930441 22492 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:49.930635 22595 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:49.930200 22587 consensus_queue.cc:237] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:49.932178 22666 consensus_queue.cc:1059] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:49.934389 19625 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:49.935010 19551 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:49.936101 19551 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:49.938295 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.938949 19504 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:49.939970 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:49.940158 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.944669 19504 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:49.933439 22299 raft_consensus.cc:3055] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:49.954272 19508 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:49.965941 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.950955 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:49.949870 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:49.955823 19503 raft_consensus.cc:606] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:18:49.968092 19510 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:49.950623 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:49.974275 19625 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:49.974301 19509 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:49.954561 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:49.982566 19511 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:49.985199 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 55439.2us
I20260709 13:18:49.988739 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:49.967418 19504 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:18:50.032522 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:50.033133 19504 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:50.014900 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.956084 22283 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:49.946208 22510 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:49.946105 22275 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:50.024675 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
W20260709 13:18:50.038661 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 49994.7us
I20260709 13:18:50.039407 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:50.039455 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:50.039638 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:50.040073 19505 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:49.953804 22664 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:50.041767 19478 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:50.042295 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 138924us
W20260709 13:18:50.043121 20619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.965989 22299 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:50.046248 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:50.056115 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.990965 22492 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:50.066572 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 247861us
I20260709 13:18:49.934633 22318 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.065366 19478 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:50.075409 22208 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.039302 22543 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:50.044807 22667 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:50.077159 22500 consensus_meta.cc:287] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.739s	user 0.012s	sys 0.000s
I20260709 13:18:49.961607 22286 consensus_queue.cc:237] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:50.077944 22299 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.078863 19505 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:50.038473 22275 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.037138 22510 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:50.084954 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:50.064870 22577 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:50.066310 22492 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.114822 22299 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:50.130511 22318 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:50.107097 22492 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.106266 22275 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:50.106009 22510 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.133780 22671 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:50.085505 22585 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.137787 22585 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.143630 22543 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:50.144114 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.147526 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 107990us
I20260709 13:18:50.148944 19627 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:50.150653 19627 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:50.106379 22668 raft_consensus.cc:2764] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:18:50.152072 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 67193.3us
I20260709 13:18:50.152515 22673 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:50.153199 22673 raft_consensus.cc:697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:50.154561 22673 consensus_queue.cc:237] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.155054 22614 raft_consensus.cc:3055] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:50.155601 22614 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:50.106137 22577 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.158113 22577 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.153164 19478 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:50.097298 19504 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:18:50.151998 22535 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:50.182019 19511 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
W20260709 13:18:50.086793 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 150744us
I20260709 13:18:50.170992 19625 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:50.156669 22614 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.186780 19627 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:50.172171 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:50.184129 19509 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:50.148530 22483 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:50.193702 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:50.172513 22543 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:50.195953 19478 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:50.104923 22500 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:50.201484 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:50.202702 22467 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:50.202919 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 54063.1us
I20260709 13:18:50.203263 22467 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:50.203295 19509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:18:50.204063 22467 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.209725 22283 consensus_queue.cc:1059] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:50.210637 22668 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:50.211186 22668 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:50.211632 22668 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:50.211684 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:50.197285 22672 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:50.216378 22672 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:50.216888 22672 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.220958 22467 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.230334 22467 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:50.163868 22210 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.190444 22483 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:50.167110 22595 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.191871 22276 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:50.195448 22667 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:50.285900 22587 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:50.289750 22587 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:50.296087 22587 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:50.292939 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 97067.3us
I20260709 13:18:50.298631 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:50.244319 22614 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:50.292315 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 98702.8us
W20260709 13:18:50.291404 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 79884.3us
I20260709 13:18:50.278038 22483 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.200528 22666 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 13:18:50.300958 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:50.306119 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:50.278375 22679 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:50.309010 19551 leader_election.cc:400] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9.
W20260709 13:18:50.308317 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 104575us
I20260709 13:18:50.309577 19551 leader_election.cc:403] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:18:50.246192 22676 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:18:50.311429 19627 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:50.300972 22678 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:50.323385 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 133924us
I20260709 13:18:50.295521 22667 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:50.325062 19478 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:50.326380 19627 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:50.322999 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:50.305320 22671 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:50.307525 22179 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:50.293071 22318 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:18:50.307348 22276 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:50.292086 22397 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.313448 22543 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:50.312059 22664 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:50.325078 19625 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:50.311470 22679 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.340276 22208 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:50.338816 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:50.342082 22208 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:50.342715 22208 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:50.342773 22286 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:50.343096 22208 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.343310 22286 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.343559 22208 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:50.343791 22286 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:50.346488 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:50.346403 22672 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.336509 22671 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:50.354745 19625 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:50.338418 22283 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:50.340755 22664 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:50.348203 22678 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.347782 22679 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.363417 22671 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.378355 22276 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:50.363921 22283 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:50.388389 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 50299.2us
I20260709 13:18:50.379261 22664 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:50.393584 19656 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:50.396822 22210 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:50.399362 22585 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:50.369328 22492 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.394305 22276 raft_consensus.cc:697] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:50.402418 22492 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:50.402869 22276 consensus_queue.cc:237] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.384392 22676 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:50.406132 22676 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:50.406625 22676 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:50.407811 22275 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.395744 22678 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:50.412853 22678 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:50.386735 22500 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:50.392288 22283 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:50.401086 22577 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.423992 22682 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:50.424006 22685 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:50.427762 22685 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:50.424165 22687 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9.
I20260709 13:18:50.428259 22685 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:50.424150 22683 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 13:18:50.424188 22562 consensus_queue.cc:1059] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:18:50.432214 22397 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:50.432291 22562 raft_consensus.cc:3055] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:50.432737 22562 raft_consensus.cc:740] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:18:50.434744 19509 raft_consensus.cc:606] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:18:50.435353 19509 raft_consensus.cc:614] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:50.424150 22680 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:18:50.440074 22467 raft_consensus.cc:3055] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:50.440508 22467 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:50.437515 22535 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:50.436909 22208 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.448758 22684 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:50.449230 22684 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:50.450392 22208 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:50.450022 22684 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.454363 22684 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:50.395220 22667 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.457679 22595 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:50.457818 22179 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:50.458364 22179 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.467020 22676 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.468331 19509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:18:50.468947 19509 raft_consensus.cc:606] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:18:50.469277 19509 raft_consensus.cc:614] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:50.470861 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:50.472844 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:50.441257 22467 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:50.499441 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 153014us
W20260709 13:18:50.491063 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 94514.8us
I20260709 13:18:50.441088 22510 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.473086 22668 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.433681 22562 consensus_queue.cc:260] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:50.510414 20619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.501194 22467 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.469483 22676 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:50.502017 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 140743us
W20260709 13:18:50.518445 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 192090us
I20260709 13:18:50.523438 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.526499 19509 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:18:50.479878 22587 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.536604 19625 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:50.537331 19656 raft_consensus.cc:2410] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:50.538475 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:50.543948 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.538723 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:50.541605 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:50.549376 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:50.550901 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.551682 19654 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:50.517524 22672 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:50.552597 19653 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:50.553506 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:50.550359 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.555717 19625 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:50.556063 19661 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:50.557492 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.558372 19655 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:50.560757 19509 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:50.564785 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:50.564426 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:50.568790 19652 raft_consensus.cc:2368] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9.
I20260709 13:18:50.557531 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:50.574662 19625 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:50.578327 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:50.579574 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:50.579355 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:50.580266 19504 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:50.581233 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:50.583336 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.589207 19510 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:50.542969 22275 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:50.595275 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:50.565794 20618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.594440 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:50.599237 19659 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.600236 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:50.600808 19660 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:50.601070 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.595043 22500 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:50.605268 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:50.605542 22500 raft_consensus.cc:697] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:50.610709 19654 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:50.611629 22500 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.611892 22179 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.609930 22688 raft_consensus.cc:2764] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:18:50.607172 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:50.595135 22397 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:50.614832 19506 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:50.615136 22397 raft_consensus.cc:697] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:50.616039 22397 consensus_queue.cc:237] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.606510 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:50.605902 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:50.618216 19510 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:50.608258 22483 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.620878 22483 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:50.606845 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:50.620904 19654 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:18:50.622947 22688 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:50.628677 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.632292 22693 log.cc:927] Time spent T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:18:50.624215 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:50.624825 22686 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:50.595534 22694 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.618314 19505 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:50.634461 22694 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.636798 22694 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:50.638001 22676 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:50.557994 22208 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:18:50.641120 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 74163.9us
I20260709 13:18:50.570046 22562 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:50.641161 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:50.644915 19505 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
W20260709 13:18:50.647078 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 61681.5us
I20260709 13:18:50.647454 19506 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:18:50.650799 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.527267 22673 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 13:18:50.654091 19625 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:50.654343 19510 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:18:50.651661 19656 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:50.659292 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:50.659473 19625 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:50.659956 19654 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:50.638595 22676 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:50.524873 22595 consensus_queue.cc:1059] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:18:50.675683 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:50.679371 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:50.679826 19505 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:50.564365 22286 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.682314 19503 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:50.570770 22692 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.136s
I20260709 13:18:50.679438 22535 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:50.700965 22179 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:50.649138 22688 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:50.712818 19660 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
W20260709 13:18:50.684900 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 43855.9us
I20260709 13:18:50.716326 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.708830 22283 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.684804 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.651969 22208 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:50.718415 19654 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:50.719626 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:50.724679 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:50.725064 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.679385 22276 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:50.726317 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.730530 19654 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 8: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:50.716138 22694 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:50.714061 22668 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:50.680238 22676 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:50.697222 22595 raft_consensus.cc:3055] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:18:50.756381 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 430054us
I20260709 13:18:50.708447 22685 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.749881 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.768906 19654 raft_consensus.cc:2368] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10.
I20260709 13:18:50.706619 22671 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.767694 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:50.725939 22467 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:50.722615 22535 raft_consensus.cc:697] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:50.730413 22577 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:50.747666 20618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.773766 19627 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:50.808452 19627 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:50.786326 19506 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:50.760914 22666 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:50.755184 22276 raft_consensus.cc:697] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:50.792531 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:50.759905 22688 raft_consensus.cc:2764] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:18:50.807035 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.819387 19654 raft_consensus.cc:2368] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10.
I20260709 13:18:50.811760 19627 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:50.769587 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 118915us
I20260709 13:18:50.763435 22595 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:50.785410 22682 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:50.769727 22510 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:50.809461 22700 log.cc:927] Time spent T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:18:50.839737 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:50.816634 19511 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:50.822456 19627 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:50.832608 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:50.843714 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.844295 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:50.844703 19654 raft_consensus.cc:2393] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:50.849043 19507 raft_consensus.cc:2368] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9.
I20260709 13:18:50.852681 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:50.855209 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:50.864560 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:50.856351 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:50.817592 22691 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:50.866079 19508 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:50.867611 19508 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:50.869498 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.827762 22587 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:50.914358 19507 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:18:50.908516 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:50.837812 22467 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:50.836144 22678 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:50.837580 22699 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:50.915539 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:50.915604 19505 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:50.918977 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.810810 22694 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:18:50.846192 22686 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:50.926240 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.869001 22698 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:50.868590 22688 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:50.854389 22510 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:18:50.963866 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 98859.8us
I20260709 13:18:50.822203 22208 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:50.965068 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 113361us
I20260709 13:18:50.967310 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.967871 19661 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:18:50.968822 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.819191 22666 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:50.964915 22664 consensus_meta.cc:287] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.000s
I20260709 13:18:50.962783 22587 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:50.922681 19652 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
W20260709 13:18:50.991806 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 76964.9us
I20260709 13:18:50.978706 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:50.975451 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 110972us
I20260709 13:18:50.981804 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.981873 22699 consensus_queue.cc:1059] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:18:50.995268 22702 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:18:50.996599 20619 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:50.997187 22671 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:50.998805 22670 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:51.004235 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.005709 19659 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:50.991806 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:50.978430 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.907857 22276 consensus_queue.cc:237] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:50.984324 22701 log.cc:927] Time spent T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:18:50.985244 22705 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:18:51.000125 22672 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:51.001888 22283 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:51.001699 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:51.003132 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:50.986773 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:51.016984 19658 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:50.925515 22595 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:50.989471 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:51.017043 19627 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:51.011967 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:50.966912 22703 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:18:50.972786 22286 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:51.015257 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:50.968606 22500 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:51.018564 19659 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:51.015686 19505 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:18:51.020903 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:50.919865 22535 consensus_queue.cc:237] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.022245 22543 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:51.022882 22585 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:51.022979 20662 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:51.024077 22595 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.025797 19654 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:51.006246 22664 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:51.026510 22679 consensus_meta.cc:287] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.637s	user 0.011s	sys 0.000s
I20260709 13:18:50.991237 22587 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.035075 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:51.042768 19658 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:51.043421 19653 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:18:51.047447 19661 raft_consensus.cc:2410] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:18:51.061678 19653 pending_rounds.cc:85] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 4
I20260709 13:18:51.062011 19653 pending_rounds.cc:107] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:18:51.062232 19653 raft_consensus.cc:2889] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:51.063815 19652 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:51.053774 19655 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
W20260709 13:18:51.053783 19627 connection.cc:256] RPC call timeout handler was delayed by -1.1192908660000285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
I20260709 13:18:51.059733 19659 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:18:51.048471 22283 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:51.069115 22286 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:51.070192 22688 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:51.073778 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:51.074726 19658 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:18:51.076252 19657 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:18:51.080417 19654 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:51.071858 22711 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:51.086083 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:51.085192 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:51.086920 20661 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:51.088523 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:51.064891 22587 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:51.078871 22286 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:51.090315 22286 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:51.064757 22679 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.097909 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:51.098551 22688 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:51.098834 20659 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.098986 22688 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:51.099844 22679 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:51.100078 22688 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.052981 22685 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:51.101890 22510 raft_consensus.cc:2764] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:18:51.102089 22664 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:51.102696 22664 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:51.081897 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:51.110141 19658 raft_consensus.cc:2368] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10.
I20260709 13:18:51.111943 19627 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:51.114269 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:51.116323 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:51.117040 19654 raft_consensus.cc:2393] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:51.060609 22585 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:51.119306 19653 raft_consensus.cc:2393] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:51.119354 19551 leader_election.cc:400] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9.
I20260709 13:18:51.125764 22678 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:51.128002 22691 raft_consensus.cc:3055] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:51.128847 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:51.135218 19655 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:51.129676 20659 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:51.133917 19551 leader_election.cc:403] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:18:51.101318 22688 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:51.115466 22500 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:51.139657 22500 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.141786 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:51.134552 22678 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.147900 22678 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.150108 19627 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:51.152099 22208 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:51.151937 22286 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.152688 22208 raft_consensus.cc:697] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:51.153541 22208 consensus_queue.cc:237] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:51.155057 22694 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:51.155622 22694 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:51.157680 19655 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:51.159323 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:51.134739 22691 raft_consensus.cc:740] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:51.142061 22711 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.178231 19652 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:51.181367 19652 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:51.162290 19655 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:51.162918 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:51.146019 22283 consensus_queue.cc:1059] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:18:51.163956 22585 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:51.165377 22562 consensus_meta.cc:287] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.000s
I20260709 13:18:51.166432 22510 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:51.169667 22286 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:51.170917 22666 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:51.192148 19654 raft_consensus.cc:2368] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10.
I20260709 13:18:51.189497 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:51.193573 19510 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:51.199394 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:51.195730 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:51.200479 19505 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:51.203506 19652 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:51.212809 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:51.213490 19505 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.197044 22510 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:51.214764 22510 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.216056 22510 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.215231 19654 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:51.230399 19505 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:51.234218 19510 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:51.240618 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:51.247466 19507 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:18:51.275918 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:51.280436 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:51.283092 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:51.284714 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:51.284883 19551 leader_election.cc:400] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9.
I20260709 13:18:51.285926 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:51.286070 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:51.286978 22210 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:51.275151 22286 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:51.191921 22694 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.300987 19476 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:51.280936 22676 consensus_meta.cc:287] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
I20260709 13:18:51.292330 19478 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:51.302721 19476 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:51.278467 22686 consensus_queue.cc:1059] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:18:51.309536 19476 leader_election.cc:400] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10.
I20260709 13:18:51.312885 19476 leader_election.cc:400] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10.
I20260709 13:18:51.314313 19476 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:51.309283 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:51.322782 19657 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.290635 22467 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:51.331195 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:51.332248 19476 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:51.335570 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:51.337365 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:51.338346 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:51.298357 22210 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:51.338967 19476 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:51.342180 19476 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:51.336043 22673 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:51.353678 20659 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:51.353967 22725 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:51.333945 22719 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:51.312352 22286 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.334021 22666 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:51.355659 22666 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.356060 22666 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.357116 22286 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:51.346477 22210 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.321827 22667 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:51.357342 20661 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:51.338275 22275 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.373553 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:51.340677 22672 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:51.338423 22397 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:51.339115 22276 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:51.376353 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.346737 22671 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:51.375867 19654 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:51.378985 22689 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:51.379989 19509 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:51.380540 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:51.311578 22676 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.438812 19506 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.426715 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:51.441051 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:51.371528 22500 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:51.425849 19406 catalog_manager.cc:5697] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:51.406526 19657 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:51.382017 22687 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:51.382140 22672 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:51.474622 22711 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9.
I20260709 13:18:51.474826 22676 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:51.371951 22719 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:18:51.475885 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:51.480753 22691 consensus_queue.cc:260] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.482596 22691 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.484495 19503 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:51.486048 22689 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:51.412680 22664 raft_consensus.cc:3055] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:51.487460 22664 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:51.488302 22664 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.489744 22687 raft_consensus.cc:697] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:51.490725 22283 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.491225 22283 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:51.492141 22698 consensus_meta.cc:287] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.000s
I20260709 13:18:51.492652 22698 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:51.406309 22671 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.493486 22671 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.494658 22696 raft_consensus.cc:3055] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:51.490767 22687 consensus_queue.cc:237] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.498543 22696 raft_consensus.cc:740] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:51.499387 22696 consensus_queue.cc:260] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:51.493340 22283 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:51.504683 22678 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:51.512068 22688 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:51.512251 19659 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:51.514127 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.515014 19579 raft_consensus.cc:2410] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:18:51.489372 22664 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:51.518169 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:51.518455 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:51.519248 19586 raft_consensus.cc:2410] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:18:51.519824 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.520488 19578 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.506389 22667 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:51.470233 22672 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:51.530001 19578 raft_consensus.cc:2410] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:18:51.461236 22299 consensus_queue.cc:1059] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:18:51.533020 22299 raft_consensus.cc:3055] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:51.533527 22299 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:51.405149 22708 consensus_queue.cc:1059] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 13:18:51.534925 22708 raft_consensus.cc:3055] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:51.535351 22708 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:51.536314 22708 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.469365 22286 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.540011 22286 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:51.492239 22666 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:51.542685 22286 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:51.461097 22684 consensus_queue.cc:1059] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:18:51.544507 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 99644us
I20260709 13:18:51.546211 19476 leader_election.cc:400] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10.
I20260709 13:18:51.549104 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.382465 22275 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.550910 19476 leader_election.cc:403] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:18:51.515602 19406 catalog_manager.cc:5697] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 7 to 9, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 9 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:51.554512 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:51.555085 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.555166 19586 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:51.556253 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.556615 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:51.556468 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.558538 19578 raft_consensus.cc:2410] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:18:51.559409 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:51.560149 19583 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:51.560796 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.561247 19585 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:51.560518 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:51.558643 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 223183us
I20260709 13:18:51.561933 19578 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.422681 22668 consensus_queue.cc:1059] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:18:51.416983 22685 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:18:51.563413 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.569422 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:51.567438 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.570320 19585 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.570261 19579 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:51.408255 22614 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.142s
I20260709 13:18:51.437754 22276 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.571481 19579 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:51.558622 22708 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:51.413813 19395 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d05498e224814b9b8f31e3f965ab2583 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d56df3728fc04e37b2d29a3bcd91d167 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:51.553085 22719 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10.
I20260709 13:18:51.406996 22397 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.576079 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.584990 19506 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
W20260709 13:18:51.586321 19395 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 217346us
I20260709 13:18:51.577176 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:51.578131 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:51.624145 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:51.624812 19584 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:51.452324 22587 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.581454 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.626964 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.627301 22587 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:51.627789 19579 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.628178 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.563284 22673 raft_consensus.cc:3055] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:51.629839 22673 raft_consensus.cc:740] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:51.630219 22668 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:51.631282 22483 raft_consensus.cc:3055] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:51.631851 22483 raft_consensus.cc:740] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:51.631196 22673 consensus_queue.cc:260] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.633522 19583 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:18:51.591930 19578 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
W20260709 13:18:51.634994 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 68285.1us
I20260709 13:18:51.635469 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.635869 22587 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:51.635804 19476 leader_election.cc:400] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10.
I20260709 13:18:51.636525 22587 raft_consensus.cc:697] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:51.636812 19476 leader_election.cc:403] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:18:51.637087 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.576817 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.642396 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.643721 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.645072 19587 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:51.647346 19587 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:51.648480 19587 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:51.649708 19578 raft_consensus.cc:2368] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7.
W20260709 13:18:51.650683 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.649732 19587 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:51.564831 22684 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:18:51.512686 22688 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.637486 22741 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.637568 22587 consensus_queue.cc:237] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.640247 19584 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
W20260709 13:18:51.639180 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 62092.6us
I20260709 13:18:51.638360 22673 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.576391 22667 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:51.581961 22682 consensus_queue.cc:1059] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:18:51.701124 19584 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:51.701031 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:51.663400 19582 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:51.660677 19625 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:51.665406 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.621634 22686 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:51.674615 22684 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:51.675122 22585 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:51.678609 22678 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:51.679025 22276 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:51.683315 22719 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.683676 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.684913 22666 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:51.619791 22718 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:51.686885 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 225049us
W20260709 13:18:51.713191 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.620535 19652 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:51.691442 19579 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:51.692726 19586 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:51.619891 22275 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:51.705083 19582 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:51.706929 19587 raft_consensus.cc:2368] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10.
I20260709 13:18:51.599931 22500 consensus_queue.cc:1059] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:18:51.708178 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:51.719933 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 59339.7us
I20260709 13:18:51.721160 22595 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:51.721727 22595 raft_consensus.cc:697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:18:51.714897 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.720021 22682 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:51.683745 22208 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:18:51.725291 19506 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:51.715399 19586 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:51.685460 22672 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.725965 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:51.731374 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:51.730383 19582 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:51.709987 22686 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:51.726473 22467 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:51.710543 22684 consensus_queue.cc:1243] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:51.729444 19585 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:51.734246 19581 raft_consensus.cc:2410] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:18:51.735198 19586 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:51.702816 22671 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.736819 22682 raft_consensus.cc:697] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:51.730756 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:51.717002 22719 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.710357 22585 consensus_queue.cc:1243] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:51.719038 22397 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:51.728511 22728 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:51.700191 22687 consensus_queue.cc:1059] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:18:51.743060 22683 raft_consensus.cc:3055] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:51.743435 22688 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:51.751531 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:51.778687 19406 catalog_manager.cc:5697] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:18:51.744168 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:51.752393 19507 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:51.728734 22283 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.753270 19505 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:51.750329 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:51.734081 20662 consensus_meta.cc:287] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.001s
I20260709 13:18:51.762624 19478 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:51.765340 19512 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:51.730948 22698 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.732199 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:51.722581 22595 consensus_queue.cc:237] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.793226 19652 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:18:51.769263 20665 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:51.769510 22210 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.762145 22711 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:18:51.801568 19578 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:51.802259 22210 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:51.771988 22686 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:51.769253 22672 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:51.772476 22299 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.806169 22299 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.810882 22671 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:51.798965 22687 consensus_queue.cc:1243] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:51.788537 22683 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:51.775148 19509 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:51.813771 19509 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:51.793120 22682 consensus_queue.cc:237] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.798813 22666 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:51.814592 19509 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.815500 19509 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.816599 22683 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.775813 22719 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:51.799188 22698 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.817979 22683 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:51.819458 22698 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:51.784864 22728 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.820233 22728 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.791735 22283 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.826380 22283 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:51.826951 22283 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.827672 22688 raft_consensus.cc:3055] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:51.827451 22283 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.828084 22688 raft_consensus.cc:740] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:51.829312 22688 consensus_queue.cc:260] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.830554 22688 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.831082 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1787) took 1165 ms. Trace:
I20260709 13:18:51.777732 19585 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:51.831533 19656 rpcz_store.cc:276] 0709 13:18:50.665340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.724793 (+ 59453us) service_pool.cc:224] Handling call
0709 13:18:51.830863 (+1106070us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54000adf54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:51.831017 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807829888}
I20260709 13:18:51.523248 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:51.752990 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.789065 19586 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:51.847898 19509 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:18:51.850375 19509 pending_rounds.cc:85] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 4
I20260709 13:18:51.789436 20662 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:18:51.764169 22467 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.769534 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:18:51.795890 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 45695.1us
I20260709 13:18:51.796885 19478 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:51.800168 22510 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:51.800624 19625 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:51.869743 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 69199.4us
I20260709 13:18:51.870004 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:51.723697 22739 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:18:51.848455 22719 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.850816 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:51.853893 22283 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:51.862205 22299 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.862890 19510 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 13:18:51.864547 22467 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:51.864934 22728 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:51.866433 19580 raft_consensus.cc:2410] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:18:51.867169 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 70344.4us
I20260709 13:18:51.867733 19509 pending_rounds.cc:107] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:18:51.895886 19509 raft_consensus.cc:2889] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:51.868063 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:51.765524 22208 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
W20260709 13:18:51.871428 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 104344us
I20260709 13:18:51.869112 22725 raft_consensus.cc:3055] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:51.873124 19587 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:51.874963 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:51.878525 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1791) took 1211 ms. Trace:
I20260709 13:18:51.897363 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:51.906553 19660 rpcz_store.cc:276] 0709 13:18:50.666925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.716086 (+ 49161us) service_pool.cc:224] Handling call
0709 13:18:51.878300 (+1162214us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b54002c7ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:51.878461 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1312195328}
I20260709 13:18:51.879256 19655 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: []
W20260709 13:18:51.791095 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 152554us
I20260709 13:18:51.890780 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:51.894322 19627 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:51.932248 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:51.933533 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:51.934309 19586 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:51.936046 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:51.936693 19582 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:51.935154 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:51.869374 22673 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:18:51.998623 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 104417us
I20260709 13:18:51.999637 19627 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:52.004217 19627 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:51.991822 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 61242.6us
W20260709 13:18:51.993649 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 89162.8us
I20260709 13:18:51.994989 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:51.995141 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 120306us
I20260709 13:18:52.006855 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:51.885905 22678 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:51.995580 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 86858.3us
I20260709 13:18:51.879968 22543 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:52.007850 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:51.995422 19478 leader_election.cc:400] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7.
I20260709 13:18:52.021791 19478 leader_election.cc:403] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:18:52.009248 19508 raft_consensus.cc:2393] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:52.005976 19476 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:51.896678 22510 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:52.012547 19584 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:51.873672 22664 consensus_queue.cc:1059] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 13:18:51.998045 22741 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10.
W20260709 13:18:52.001916 22692 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:18:52.011574 19627 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:52.023804 19478 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:52.044608 20663 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:52.032868 22689 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7.
I20260709 13:18:52.046855 22500 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:52.047573 22671 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:52.048105 22671 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:52.048991 22671 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.018386 22732 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:52.050390 22732 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.050736 22732 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:52.031486 19509 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:18:51.987782 22725 raft_consensus.cc:740] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:52.008683 22467 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:52.053037 19509 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:52.020427 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:52.046109 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:52.051141 22483 consensus_queue.cc:260] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.060231 22483 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:52.061823 22727 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:52.062961 22726 raft_consensus.cc:3055] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:52.063512 22726 raft_consensus.cc:740] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:52.067219 19510 pending_rounds.cc:85] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 3
I20260709 13:18:52.067555 19510 pending_rounds.cc:107] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:18:52.067812 19510 raft_consensus.cc:2889] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:52.037798 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:52.069015 20659 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:52.071131 19580 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:52.072412 19580 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:18:52.041695 22673 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:18:52.074025 19586 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:18:52.074424 19586 pending_rounds.cc:85] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 6
I20260709 13:18:52.074640 19586 pending_rounds.cc:107] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:18:52.074860 19586 raft_consensus.cc:2889] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:52.075347 22696 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:52.077642 19512 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:52.079003 22728 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:52.041610 22739 raft_consensus.cc:2764] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:18:52.012769 22694 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:18:51.886008 22719 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:52.088265 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 82366.6us
I20260709 13:18:52.061317 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:52.089921 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:51.890333 22299 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.058019 19478 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:52.017489 22397 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:52.013052 22276 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:52.093884 19512 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:52.101392 19511 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:18:52.036646 22543 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.102728 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:52.111223 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:52.111806 19652 raft_consensus.cc:2393] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:52.111939 19511 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:52.103818 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:52.113265 19656 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:52.105888 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:52.107872 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:52.114243 19661 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:52.109294 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:52.114362 19657 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:18:52.095590 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:52.110569 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:52.121052 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:52.122288 19509 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:52.122474 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:52.123188 19654 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:18:52.124846 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.123107 19656 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:52.126454 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:52.126920 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:52.127000 19476 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:52.129957 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:52.130657 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:52.131197 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 73259us
I20260709 13:18:52.131953 19478 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:52.130064 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:52.127079 19654 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:52.133744 19503 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:52.130700 19659 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:52.134285 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:52.095902 22689 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:52.037024 22678 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.136551 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:52.141160 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 51314.5us
I20260709 13:18:52.142925 19509 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:18:52.142344 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:52.145769 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:52.147842 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:52.120975 22543 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:52.151021 19654 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:18:52.154809 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.154932 19478 leader_election.cc:400] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10.
I20260709 13:18:52.164484 19509 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:18:52.168570 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 81343.9us
I20260709 13:18:52.171731 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:52.172601 19659 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:52.096840 22500 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:18:52.097204 22741 consensus_queue.cc:1059] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:18:52.179355 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:52.183073 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.143250 22535 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:52.177281 19656 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:18:52.198408 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:52.199642 19551 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:52.203639 19578 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:18:52.204051 19578 pending_rounds.cc:85] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 6
I20260709 13:18:52.204288 19578 pending_rounds.cc:107] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:18:52.204530 19578 raft_consensus.cc:2889] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:52.201095 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:52.153117 22318 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:52.168099 22672 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:52.137758 22397 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:18:52.174181 22728 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:52.227718 22686 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:52.239454 19505 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:18:52.169237 22745 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:52.200901 22587 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:52.249208 19507 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:18:52.227900 22283 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:52.196194 22535 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:52.201735 22676 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:52.153505 22595 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:52.284986 19659 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:18:52.201135 22510 consensus_queue.cc:1059] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:18:52.190045 22739 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:18:52.244182 22210 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.227456 22664 consensus_queue.cc:1059] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:18:52.250313 22711 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:52.251895 22318 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:52.287827 22686 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.291731 22587 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:52.319272 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 258011us
I20260709 13:18:52.297896 22535 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.301728 22687 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.294602 22672 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:52.150686 22725 consensus_queue.cc:260] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.295713 22728 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:18:52.331645 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 179315us
I20260709 13:18:52.329592 22318 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.310516 22711 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.307981 22745 raft_consensus.cc:697] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:52.335035 19627 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:52.302199 22585 consensus_queue.cc:1059] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:18:52.366132 19659 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:18:52.330078 22686 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:52.371212 19627 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:52.302223 22682 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:18:52.330336 22587 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.301755 22676 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.357247 22739 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.375770 19478 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:52.317090 22210 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:52.391566 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 147686us
W20260709 13:18:52.393569 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.369701 22711 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:52.355999 20659 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:18:52.399797 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:52.400990 19586 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:52.378023 22683 consensus_meta.cc:287] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.560s	user 0.011s	sys 0.000s
I20260709 13:18:52.401175 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:52.404440 19587 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:52.407173 19579 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:52.410322 19653 raft_consensus.cc:2410] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:18:52.384152 22208 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:52.411775 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:52.414669 19586 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:18:52.412485 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:52.413493 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:52.402949 22751 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.098s	user 0.000s	sys 0.002s
I20260709 13:18:52.356684 22687 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.391732 22299 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:52.403220 22725 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:52.433456 22754 log.cc:927] Time spent T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:18:52.435956 22318 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:52.396063 22747 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:52.403174 22750 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:52.402628 22695 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:18:52.427920 22672 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.442037 22728 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.382815 22673 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:18:52.443418 22673 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:52.443787 22673 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:52.371953 22738 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
W20260709 13:18:52.431839 22756 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:18:52.403013 22614 consensus_queue.cc:1059] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:18:52.397810 22739 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.426561 22719 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:52.471716 20663 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:18:52.445533 22208 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:52.471645 22738 consensus_queue.cc:1243] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:18:52.512269 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 201711us
I20260709 13:18:52.469283 22678 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:52.513571 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:52.513887 22595 consensus_queue.cc:1059] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:52.514567 19654 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:52.487424 22684 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.517359 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:52.477789 22585 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:18:52.528417 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:52.529220 19655 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:52.503953 22210 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:52.471825 22673 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.532612 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:52.528076 22510 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:52.507649 22535 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.562780 19658 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:18:52.563138 19509 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 13:18:52.540689 22595 consensus_queue.cc:1243] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:52.547315 22763 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:52.566416 19509 pending_rounds.cc:85] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 9
I20260709 13:18:52.580824 19509 pending_rounds.cc:107] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:18:52.533355 22732 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.532888 22684 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.562489 22210 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:52.502540 22745 consensus_queue.cc:237] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.569420 22759 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 13:18:52.572453 19655 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:18:52.573458 22687 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:52.565702 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:52.581214 19509 raft_consensus.cc:2889] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:52.595247 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.599550 22283 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:52.576998 22208 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:52.692744 22688 consensus_meta.cc:287] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.862s	user 0.008s	sys 0.002s
I20260709 13:18:52.649761 19652 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:18:52.719516 19582 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:18:52.683431 22535 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:52.609326 22687 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:52.689527 22711 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.697117 19653 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:18:52.659690 22500 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:52.695499 22673 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:52.614743 22739 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:52.580574 22763 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:52.719929 19582 pending_rounds.cc:85] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 4
I20260709 13:18:52.594980 22543 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.722877 19587 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:52.722980 19582 pending_rounds.cc:107] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:18:52.586475 22510 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:52.682225 22483 raft_consensus.cc:3055] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:52.686321 22749 raft_consensus.cc:3055] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:52.723632 19582 raft_consensus.cc:2889] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:52.695874 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 130268us
I20260709 13:18:52.688970 22698 raft_consensus.cc:3055] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:52.723917 22483 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:52.685329 22752 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.384s	user 0.001s	sys 0.000s
W20260709 13:18:52.613004 22727 consensus_meta.cc:287] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.001s
I20260709 13:18:52.676168 22686 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.719808 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:52.726809 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:52.724757 22732 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:52.720257 22687 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.789400 22535 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.795414 22483 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.721714 22500 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.797838 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2262) took 1037 ms. Trace:
I20260709 13:18:52.797983 19653 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:18:52.852988 19506 rpcz_store.cc:276] 0709 13:18:51.760016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.760221 (+   205us) service_pool.cc:224] Handling call
0709 13:18:51.760665 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.775864 (+ 15199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.775895 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:51.776406 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:18:51.875739 (+ 99333us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:51.875780 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.797308 (+921528us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b5400207bd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:52.797375 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.797437 (+    62us) raft_consensus.cc:1685] finished
0709 13:18:52.797457 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.797760 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2372,"raft.queue_time_us":2020,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":9298,"spinlock_wait_cycles":34080128,"thread_start_us":98900,"threads_started":1,"wal-append.queue_time_us":207837}
I20260709 13:18:52.799399 22711 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:52.764470 22698 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:52.601467 22684 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:52.875429 22698 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.876994 22698 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.877796 22483 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:52.896945 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:52.783468 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 377413us
I20260709 13:18:52.723397 22763 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.787950 22749 raft_consensus.cc:740] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:52.833787 22727 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:52.609807 22664 consensus_queue.cc:1059] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.191s
I20260709 13:18:52.788614 22510 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.850303 19658 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:18:52.849833 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 123105us
I20260709 13:18:52.872511 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:52.937258 19653 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.925016 19627 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:52.933140 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:52.937943 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:52.876313 22500 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:52.852818 22687 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:52.853909 22210 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:52.958405 19627 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:52.960088 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:52.900420 22318 raft_consensus.cc:3055] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:52.964457 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:52.966403 19652 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:52.966607 19656 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:52.967568 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:52.968982 19661 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:52.969077 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:52.969877 19656 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:52.970865 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:52.972502 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:52.970737 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:52.974417 19654 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:52.881542 22535 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.979379 19656 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:18:52.963965 22587 consensus_meta.cc:287] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.561s	user 0.011s	sys 0.000s
I20260709 13:18:52.961253 22779 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:52.984750 19627 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:52.962770 22739 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:52.961455 22728 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:18:52.994201 22535 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:52.973858 22664 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:53.000877 22749 consensus_queue.cc:260] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:52.976804 22727 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:52.962210 22318 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:53.003405 22664 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:52.962924 22688 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:18:52.983140 22500 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:53.002166 22275 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:53.041258 22286 raft_consensus.cc:3055] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:53.041345 22500 consensus_queue.cc:1059] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:53.041903 22275 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:53.041926 22286 raft_consensus.cc:740] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:18:53.043630 20662 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59442 (request call id 111) took 1956 ms (client timeout 1632 ms). Trace:
I20260709 13:18:53.044330 22286 consensus_queue.cc:260] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:53.044042 20662 rpcz_store.cc:269] 0709 13:18:51.087423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.088239 (+   816us) service_pool.cc:224] Handling call
0709 13:18:53.043429 (+1955190us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400524c54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:53.043552 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251460992}
I20260709 13:18:53.041462 19654 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:18:53.050794 19584 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:53.052513 19580 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:18:53.001084 22763 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:53.052892 19580 pending_rounds.cc:85] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 5
I20260709 13:18:53.053061 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:53.055766 19580 pending_rounds.cc:107] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:18:53.056107 19580 raft_consensus.cc:2889] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:53.056963 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:53.054523 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:53.058115 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:53.051812 19586 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:53.003589 22779 raft_consensus.cc:697] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:53.059496 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:53.079550 19586 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:53.079825 22779 consensus_queue.cc:237] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:53.082979 22275 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.083494 22275 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:53.084263 22276 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:53.084486 19627 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:53.084779 22276 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:53.085203 22397 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.085686 22397 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:53.086094 22686 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:53.087677 22397 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:53.088202 22397 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:53.089798 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:53.010063 22739 raft_consensus.cc:697] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:53.090430 19655 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:18:53.090842 22739 consensus_queue.cc:237] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:53.091845 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:53.092578 19655 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:53.092953 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1699) took 1234 ms. Trace:
I20260709 13:18:52.986227 22587 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:53.093295 19508 rpcz_store.cc:276] 0709 13:18:51.858370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.876954 (+ 18584us) service_pool.cc:224] Handling call
0709 13:18:53.092750 (+1215796us) spinlock_profiling.cc:243] Waited 79.1 ms on lock 0x7b54002201d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:53.092873 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181920640}
I20260709 13:18:53.093729 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:53.095180 22587 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:53.051589 22535 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.095865 22535 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:53.097995 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:53.063045 22727 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:53.098665 22727 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:53.054114 22762 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:53.075636 22318 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:53.100687 22762 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:53.101151 22318 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:53.102550 22777 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.452s	user 0.003s	sys 0.007s
I20260709 13:18:53.102908 22762 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:53.069069 22664 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:53.078783 22676 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:53.089520 22397 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:53.098119 22535 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:53.061149 19580 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:53.104715 19655 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:53.105146 19660 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:53.085318 22275 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:53.049011 22749 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:53.057744 19584 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 4.
I20260709 13:18:53.110332 19653 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:53.110999 19652 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:53.114887 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:53.115650 19579 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:53.116950 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:53.117862 19579 raft_consensus.cc:2410] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 13:18:53.101364 22782 log.cc:927] Time spent T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.308s	user 0.008s	sys 0.000s
I20260709 13:18:53.126355 19586 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:18:53.127482 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:53.133029 22783 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:18:53.125731 22397 raft_consensus.cc:697] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:53.142791 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:53.143774 19586 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:53.139365 22727 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:53.136021 22397 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:53.163758 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.199782 19627 leader_election.cc:336] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.573s (SENT)
I20260709 13:18:53.203907 22763 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:53.218250 22778 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.425s	user 0.004s	sys 0.009s
I20260709 13:18:53.225668 22276 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:53.230862 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2055) took 1325 ms. Trace:
I20260709 13:18:53.231353 19578 rpcz_store.cc:276] 0709 13:18:51.905112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.048713 (+143601us) service_pool.cc:224] Handling call
0709 13:18:52.199014 (+150301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.232817 (+ 33803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.230641 (+997824us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400267d50. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:53.230796 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344752000}
I20260709 13:18:53.254755 19627 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:53.257072 19627 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:53.258776 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:53.264609 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:53.265561 19581 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:53.269215 22500 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.269840 22500 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:53.272251 22500 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:53.272354 22275 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:53.272855 22275 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.273239 22275 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:53.273996 19627 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:53.274842 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2266) took 1080 ms. Trace:
I20260709 13:18:53.275236 19509 rpcz_store.cc:276] 0709 13:18:52.194323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.195810 (+  1487us) service_pool.cc:224] Handling call
0709 13:18:52.196229 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.592076 (+395847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.274536 (+682460us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b540003fa54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:53.274745 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843044224}
I20260709 13:18:53.277079 22585 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:53.272866 22727 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:18:53.277967 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2264) took 1406 ms. Trace:
W20260709 13:18:53.279232 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.279407 22727 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:53.279968 22679 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:53.280267 19478 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:53.278345 19510 rpcz_store.cc:276] 0709 13:18:51.871164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.066566 (+195402us) service_pool.cc:224] Handling call
0709 13:18:52.066968 (+   402us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:52.100565 (+ 33597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:52.100594 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:52.117754 (+ 17160us) log.cc:844] Serialized 78 byte log entry
0709 13:18:52.308197 (+190443us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:52.537939 (+229742us) log.cc:844] Serialized 14 byte log entry
0709 13:18:52.538374 (+   435us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.277349 (+738975us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b1800387b80. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e5e7c0a 00007f6c37d27219 00007f6c2e66fa40 00007f6c2e66a4e4 00007f6c2e66a455 00007f6c31752060 00007f6c31764716 00007f6c31775287 00007f6c31775208
0709 13:18:53.277548 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.277644 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:53.277762 (+   118us) raft_consensus.cc:1685] finished
0709 13:18:53.277778 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.277911 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65469,"prepare.queue_time_us":456090,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":61,"raft.queue_time_us":768544,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":27048,"spinlock_wait_cycles":2458496,"thread_start_us":321511,"threads_started":2,"wal-append.queue_time_us":227752}
I20260709 13:18:53.281663 22763 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:53.281960 22779 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:53.282361 22779 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.282251 22763 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:53.282747 22779 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.283479 22695 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.283957 22695 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:53.221385 22543 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:53.285820 22696 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:18:53.286541 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.286283 22687 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:53.288173 22696 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.288407 22687 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:53.288769 22696 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:53.289851 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.291011 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.291601 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.293485 19652 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:53.303310 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.312587 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.314157 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:53.321637 19587 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:53.325424 19587 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:53.336071 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:53.336802 19579 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:53.337867 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2268) took 1142 ms. Trace:
I20260709 13:18:53.340261 19586 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:18:53.341359 22779 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:53.284363 22763 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:53.285792 22275 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:53.341501 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:53.346979 22585 raft_consensus.cc:697] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:53.351044 19581 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:53.336858 22749 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:53.290444 22699 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:18:53.354094 19585 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:53.431430 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.353919 19627 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:53.338261 19503 rpcz_store.cc:276] 0709 13:18:52.195133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.195239 (+   106us) service_pool.cc:224] Handling call
0709 13:18:52.614657 (+419418us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635eee 0000000000375939 00007f6c366a91e0 00007f6c367720c4 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:18:52.614810 (+   153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.615013 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:52.724902 (+109889us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.337529 (+612627us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:53.337580 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:53.337645 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.337713 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.337812 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":377995,"prepare.queue_time_us":36229,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":24,"spinlock_wait_cycles":3401344,"thread_start_us":343762,"threads_started":2,"wal-append.queue_time_us":323490}
I20260709 13:18:53.764420 19505 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:53.762545 19508 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:53.610123 19511 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:18:53.999159 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.995342 19587 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.002s	sys 0.024s
W20260709 13:18:54.015683 19587 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.002s	sys 0.024s
W20260709 13:18:54.007874 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 550396us
I20260709 13:18:53.583112 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:54.020939 19506 raft_consensus.cc:2410] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:18:54.008842 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 655007us
I20260709 13:18:54.013597 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:54.025596 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:53.765348 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:53.336345 22671 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:53.444826 22695 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:54.070367 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:54.073520 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:54.079589 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:53.491626 22668 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.496294 22673 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:54.003229 20618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.003s	sys 0.016s
I20260709 13:18:54.073390 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:54.083653 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:54.132102 19478 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.021s	sys 0.038s
I20260709 13:18:53.461840 22718 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.656957 22684 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.089130 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:53.940573 22779 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:53.496567 22745 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.496611 22666 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:53.679913 22708 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.092187 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:53.869217 22696 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:54.065402 22692 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.102421 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:54.065347 22738 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:18:54.108839 22796 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.354s	user 0.000s	sys 0.000s
I20260709 13:18:54.095022 22275 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:54.109831 22800 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
W20260709 13:18:54.112192 22806 log.cc:927] Time spent T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:18:53.497191 22500 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.603s
I20260709 13:18:54.057709 22749 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:54.087457 22695 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.094277 22664 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:53.471374 22770 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:54.133370 19478 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.022s	sys 0.038s
I20260709 13:18:54.133719 19511 raft_consensus.cc:2410] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:18:54.214179 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:54.214764 19511 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:54.214828 19478 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:54.065779 22672 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.953042 22585 consensus_queue.cc:237] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:54.075186 22671 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:54.123313 22799 log.cc:927] Time spent T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.662s	user 0.001s	sys 0.000s
I20260709 13:18:54.181596 22779 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:54.195851 22275 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.270923 22275 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:54.184137 22738 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:54.275816 22738 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:54.276609 22738 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:54.277092 22738 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.147056 22708 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:54.217092 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:54.147293 22666 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:54.278707 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:54.279213 22708 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:54.279919 22666 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:54.281147 19507 raft_consensus.cc:2410] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:18:54.181520 22755 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:54.282024 22755 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:54.284929 22755 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:54.285909 22275 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:54.197950 22639 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.286855 22639 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:54.287815 22708 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.288617 22708 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:54.134820 22668 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:54.291899 22639 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:54.277540 22738 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:54.134507 22483 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:18:54.294426 19506 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:54.293257 22668 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:54.299140 22668 raft_consensus.cc:3055] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:54.299634 22668 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:54.300988 22668 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:54.143599 22684 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:54.136721 22718 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:54.216696 22543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.014s	sys 0.045s
I20260709 13:18:54.365636 19503 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 3.
I20260709 13:18:54.350762 19511 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:18:54.164279 22673 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:54.389396 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2052) took 2485 ms. Trace:
I20260709 13:18:54.378608 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:54.391993 19582 rpcz_store.cc:276] 0709 13:18:51.904147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.938140 (+ 33993us) service_pool.cc:224] Handling call
0709 13:18:51.938367 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.726376 (+788009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.389067 (+1662691us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b5400107054. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:54.389302 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1795786624}
I20260709 13:18:54.392637 19511 raft_consensus.cc:2410] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:18:54.146672 22726 consensus_queue.cc:260] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:54.377363 22275 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.228542 22664 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:54.364205 22806 log.cc:927] Time spent T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:18:54.305332 22758 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:54.265123 22179 consensus_queue.cc:1059] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 13:18:54.197124 22692 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:54.225517 22679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.026s	sys 0.048s
I20260709 13:18:54.378643 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2068) took 1264 ms. Trace:
I20260709 13:18:54.147477 22745 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:54.382449 19508 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
W20260709 13:18:54.366256 22543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.014s	sys 0.045s
I20260709 13:18:55.189517 22726 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:54.383713 22718 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:54.338388 19506 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
W20260709 13:18:54.599917 22535 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.027s	sys 0.031s
W20260709 13:18:54.465457 19625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.105s	user 0.034s	sys 0.063s
W20260709 13:18:55.191082 22535 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.320s	user 0.031s	sys 0.051s
W20260709 13:18:55.191308 19625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.831s	user 0.050s	sys 0.071s
W20260709 13:18:55.191617 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 1.83158e+06us
I20260709 13:18:55.193873 19505 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
W20260709 13:18:54.536207 19624 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.014s	sys 0.044s
W20260709 13:18:54.599481 19626 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.021s	sys 0.038s
W20260709 13:18:55.229703 19624 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.206s	user 0.029s	sys 0.058s
W20260709 13:18:54.615372 19509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.006s	sys 0.013s
W20260709 13:18:55.230319 19509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.135s	user 0.006s	sys 0.032s
I20260709 13:18:55.230703 22821 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:55.231066 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2271) took 1651 ms. Trace:
I20260709 13:18:55.231511 19509 rpcz_store.cc:276] 0709 13:18:53.580013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.581800 (+  1787us) service_pool.cc:224] Handling call
0709 13:18:53.582199 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.582542 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.582566 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:54.019949 (+437383us) log.cc:844] Serialized 26 byte log entry
0709 13:18:55.230702 (+1210753us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:55.230747 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.230818 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.230857 (+    39us) raft_consensus.cc:1685] finished
0709 13:18:55.230868 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.231010 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30366,"raft.queue_time_us":97443,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":63989,"thread_start_us":1135723,"threads_started":1,"wal-append.queue_time_us":1134619}
I20260709 13:18:54.225131 22672 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.234231 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:18:54.679435 19553 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.008s	sys 0.060s
W20260709 13:18:55.235982 19553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.141s	user 0.016s	sys 0.063s
I20260709 13:18:54.378024 22809 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:18:54.582257 19476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.008s	sys 0.012s
W20260709 13:18:55.236776 19476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.174s	user 0.014s	sys 0.014s
W20260709 13:18:55.237180 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 1.22042e+06us
W20260709 13:18:54.651429 19552 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.004s	sys 0.015s
W20260709 13:18:54.452376 22679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.084s	user 0.026s	sys 0.048s
W20260709 13:18:54.671252 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 400962us
I20260709 13:18:54.448979 19580 rpcz_store.cc:276] 0709 13:18:53.114018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.117440 (+  3422us) service_pool.cc:224] Handling call
0709 13:18:53.117800 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.135653 (+ 17853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.135685 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.136223 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.348356 (+212133us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:53.348430 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.348573 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.378430 (+1029857us) raft_consensus.cc:1685] finished
0709 13:18:54.378449 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.378580 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17450,"raft.queue_time_us":17646,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":211620,"threads_started":1,"wal-append.queue_time_us":325361}
W20260709 13:18:54.650864 19550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.012s	sys 0.007s
W20260709 13:18:55.241776 19550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.147s	user 0.012s	sys 0.015s
I20260709 13:18:54.216845 22695 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.243916 19476 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:54.304553 22779 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:54.400396 22275 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.257376 22275 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:18:54.656150 22276 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.212s	user 0.013s	sys 0.010s
W20260709 13:18:55.258123 22276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.828s	user 0.015s	sys 0.012s
I20260709 13:18:54.385046 22684 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:54.226908 22770 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.259950 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2270) took 1680 ms. Trace:
I20260709 13:18:55.260597 22770 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.263013 22695 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:55.264101 19503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 2282) took 1653 ms (client timeout 1535 ms). Trace:
W20260709 13:18:55.264690 19503 rpcz_store.cc:269] 0709 13:18:53.610299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.009553 (+399254us) service_pool.cc:224] Handling call
0709 13:18:55.263818 (+1254265us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b540037c3d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:55.263993 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":655708032}
I20260709 13:18:54.926406 22758 raft_consensus.cc:697] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:55.265734 22779 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:55.266436 22758 consensus_queue.cc:237] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.246706 22809 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.267365 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:55.269266 22809 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:55.240943 22672 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.166415 19511 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:55.167412 22692 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.168066 22699 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:55.169478 22813 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:55.171087 22749 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.280691 22749 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:55.280534 22813 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:55.281319 22749 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.283012 22813 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:55.283463 22749 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:54.226255 22696 consensus_queue.cc:1059] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.174s
I20260709 13:18:55.284967 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:55.172102 22837 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:55.285666 22543 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.286559 22543 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.287931 22699 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.285764 22837 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:55.290812 20662 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:55.175814 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2082) took 1836 ms. Trace:
I20260709 13:18:55.181167 22816 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:55.296550 22837 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.296577 22816 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.297406 22286 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:55.292543 22839 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:18:55.299060 22816 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:55.300092 22699 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:55.183477 22708 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.301393 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 2281) took 1691 ms. Trace:
I20260709 13:18:55.301947 19506 rpcz_store.cc:276] 0709 13:18:53.610006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.070028 (+460022us) service_pool.cc:224] Handling call
0709 13:18:55.301176 (+1231148us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54000ecc54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:55.301314 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":500791552}
W20260709 13:18:55.303597 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 59852.1us
I20260709 13:18:55.303653 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:55.304529 19503 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.304944 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:55.184196 22812 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.782s	user 0.008s	sys 0.033s
W20260709 13:18:55.185941 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.186547 22818 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.186636 22823 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.185407 22318 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:55.306620 22318 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:55.306480 22818 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:55.197183 22810 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.830s	user 0.004s	sys 0.013s
I20260709 13:18:55.306545 22823 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.187680 22739 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:55.307646 22318 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.308706 22318 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:55.308486 22739 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.309098 22818 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.197907 22824 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.309551 22823 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.309994 22824 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.310509 22739 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:54.651717 22805 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.001s	sys 0.010s
W20260709 13:18:55.311168 22805 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.455s	user 0.003s	sys 0.015s
I20260709 13:18:55.312160 22824 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.198865 22671 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.206303 22179 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:55.200569 22745 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.212268 22718 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.213068 22831 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.213604 22822 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.214210 22825 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.214828 22826 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.346690 22826 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.349170 22826 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:55.217404 22738 consensus_meta.cc:287] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.924s	user 0.012s	sys 0.009s
I20260709 13:18:55.348872 22822 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.349942 22738 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.352015 19504 raft_consensus.cc:2393] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:55.209056 22808 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.226485 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:55.355046 19503 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:55.196512 22664 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:18:55.229779 19626 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.360s	user 0.026s	sys 0.055s
W20260709 13:18:55.361287 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:54.655397 20663 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.008s	sys 0.015s
W20260709 13:18:55.237924 19552 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.006s	sys 0.021s
I20260709 13:18:55.238750 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:55.231360 22821 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.239864 22814 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.240334 22819 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.245296 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:55.253376 22830 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:55.260504 19510 rpcz_store.cc:276] 0709 13:18:53.579644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.581709 (+  2065us) service_pool.cc:224] Handling call
0709 13:18:53.764875 (+183166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.285906 (+521031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.285963 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.286021 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:54.286065 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.259603 (+973538us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54001ef5d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:55.259674 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.259860 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1197692288}
I20260709 13:18:55.285179 22696 raft_consensus.cc:3055] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:55.380141 22696 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:55.292922 19586 rpcz_store.cc:276] 0709 13:18:53.339248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.349441 (+ 10193us) service_pool.cc:224] Handling call
0709 13:18:54.007420 (+657979us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:54.917692 (+910272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.917725 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:54.918205 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:18:55.045544 (+127339us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:55.045660 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.045804 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.175491 (+129687us) raft_consensus.cc:1685] finished
0709 13:18:55.175520 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.175731 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86842,"raft.queue_time_us":174085,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":9664,"thread_start_us":615007,"threads_started":2,"wal-append.queue_time_us":255259}
I20260709 13:18:55.177218 22673 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:55.297968 19505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 2283) took 1542 ms (client timeout 1546 ms). Trace:
I20260709 13:18:55.307096 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2081) took 1968 ms. Trace:
I20260709 13:18:55.205454 22807 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:55.313550 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2080) took 1974 ms. Trace:
I20260709 13:18:55.316430 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1716) took 1255 ms. Trace:
I20260709 13:18:55.385752 19508 rpcz_store.cc:276] 0709 13:18:54.060976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.091835 (+ 30859us) service_pool.cc:224] Handling call
0709 13:18:55.316189 (+1224354us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54000fc654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:55.316352 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560417152}
I20260709 13:18:55.385509 19587 rpcz_store.cc:276] 0709 13:18:53.338788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.349713 (+ 10925us) service_pool.cc:224] Handling call
0709 13:18:53.350029 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.350375 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.350405 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.367333 (+ 16928us) log.cc:844] Serialized 26 byte log entry
0709 13:18:54.016446 (+649113us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:54.016508 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.016608 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.313342 (+1296734us) raft_consensus.cc:1685] finished
0709 13:18:55.313362 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.313494 (+   132us) inbound_call.cc:177] Queueing success response
0709 13:18:55.378946 (+ 65452us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b4800222258. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c36683aa1 00007f6c3667ab37 00007f6c3667a9ca 00007f6c3677226f 00007f6c36771f37 00007f6c3678655c 00007f6c36786508 00007f6c36786488 00007f6c36786443 00007f6c367856ec 00007f6c356afa96
Metrics: {"raft.queue_time_us":241,"raft.run_cpu_time_us":86260,"raft.run_wall_time_us":2028208,"spinlock_wait_cycles":4437888,"thread_start_us":544321,"threads_started":1,"wal-append.queue_time_us":748895}
I20260709 13:18:55.319290 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1823) took 1983 ms. Trace:
I20260709 13:18:55.388196 19579 rpcz_store.cc:276] 0709 13:18:53.336921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.337553 (+   632us) service_pool.cc:224] Handling call
0709 13:18:53.337863 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.231265 (+893402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.231309 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.231368 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:54.231433 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.319043 (+1087610us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b54003d0ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:55.319090 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.319230 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2054090496}
W20260709 13:18:55.205435 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.313141 22718 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.338923 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:55.339519 22831 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.345795 22823 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:55.354256 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:55.363643 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:55.398988 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.364128 19509 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:55.313004 22179 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:55.375670 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 149284us
I20260709 13:18:55.421103 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:55.376025 22770 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.377337 22821 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:55.378300 22819 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.378990 22830 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:55.379487 22818 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:55.363261 20663 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.705s	user 0.011s	sys 0.025s
I20260709 13:18:55.383513 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:55.384824 19584 rpcz_store.cc:276] 0709 13:18:53.339024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.347581 (+  8557us) service_pool.cc:224] Handling call
0709 13:18:53.347921 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.350275 (+  2354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.350305 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.350775 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.821255 (+470480us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:53.821321 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.821423 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.306856 (+1485433us) raft_consensus.cc:1685] finished
0709 13:18:55.306877 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.307036 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1935,"raft.queue_time_us":2251,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3257,"thread_start_us":369562,"threads_started":1,"wal-append.queue_time_us":839372}
W20260709 13:18:55.385095 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 139909us
W20260709 13:18:55.384728 19505 rpcz_store.cc:269] 0709 13:18:53.755488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.065257 (+309769us) service_pool.cc:224] Handling call
0709 13:18:55.297796 (+1232539us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b54001847d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:55.297906 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1976566016}
W20260709 13:18:55.425056 19625 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.129:38645 timed out after 1.535s (SENT) [suppressed 28 similar messages]
I20260709 13:18:55.394294 19652 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 7.
I20260709 13:18:55.363464 22826 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:55.408233 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:55.411098 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:55.395038 22708 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:55.381069 22696 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.412439 22822 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.375746 22738 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.394006 22814 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:55.398818 22807 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.364568 22808 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.364423 22695 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:18:55.346606 22825 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.336881 22692 consensus_queue.cc:1059] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:18:55.416497 22718 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.418414 20659 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:55.399330 22805 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:18:55.572813 22804 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 2.030s	user 0.003s	sys 0.017s
I20260709 13:18:55.572520 22805 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.575398 22805 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:55.428122 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:55.354998 22745 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.575973 22695 consensus_queue.cc:1243] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:18:55.576254 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 148185us
I20260709 13:18:55.576911 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1711) took 1517 ms. Trace:
I20260709 13:18:55.398723 22823 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.577047 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:55.577476 22823 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:55.577320 19511 rpcz_store.cc:276] 0709 13:18:54.059578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.546734 (+487156us) service_pool.cc:224] Handling call
0709 13:18:54.917413 (+370679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.271981 (+354568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.576676 (+304695us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b540012f554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:55.576852 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571783552}
I20260709 13:18:55.426285 22809 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.578663 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:55.578884 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:55.420306 22664 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.422533 22732 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.557548 22822 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:55.557735 22831 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.578035 22179 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:55.460740 19509 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:55.426997 22763 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:55.559175 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 122425us
W20260709 13:18:55.449783 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.426011 22679 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.549496 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:55.571667 22543 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:55.580013 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:55.509394 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:55.676352 19584 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 8.
I20260709 13:18:55.426198 22758 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.425154 22275 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:55.545572 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 120524us
I20260709 13:18:55.559875 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:55.426430 22824 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.431900 22286 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:55.578315 22841 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.547725 22684 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:55.427227 22276 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:18:55.634498 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:55.734095 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.645170 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:55.734862 19509 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:55.434194 22397 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.444139 22726 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:55.672380 19476 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:55.736595 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 64322.4us
I20260709 13:18:55.605440 22805 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260709 13:18:55.427153 22830 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:55.626732 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:55.426187 22770 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.679503 22666 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:18:55.675055 19587 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 10.
I20260709 13:18:55.575419 22825 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.677832 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 2284) took 1799 ms. Trace:
I20260709 13:18:55.556905 22842 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.430052 22318 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.429843 22739 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:55.589710 22696 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:55.682094 19507 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 2285) took 1685 ms (client timeout 1870 ms). Trace:
I20260709 13:18:55.594292 22809 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.432587 22818 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.679837 20631 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:18:55.740298 22671 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:55.442328 22749 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.692771 19511 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:55.775555 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1718) took 1714 ms. Trace:
I20260709 13:18:55.775916 19511 rpcz_store.cc:276] 0709 13:18:54.061504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.692289 (+1630785us) service_pool.cc:224] Handling call
0709 13:18:55.692601 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.775303 (+ 82702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.775496 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:55.725001 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2274) took 2144 ms. Trace:
I20260709 13:18:55.692073 22543 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.661276 22732 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.691023 22763 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:55.730660 19503 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:55.576280 22745 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.764530 22825 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:55.442097 22839 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:55.741107 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 164158us
I20260709 13:18:55.791191 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:55.791599 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:55.792994 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:55.794307 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:55.795084 19657 raft_consensus.cc:2393] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 8: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:55.742385 19505 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:18:55.641162 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:55.607496 22664 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.724187 22831 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:55.748898 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.799962 19657 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:55.800949 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:55.801529 19661 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:55.729825 22824 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.746534 19504 rpcz_store.cc:276] 0709 13:18:53.878912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.278419 (+399507us) service_pool.cc:224] Handling call
0709 13:18:55.677649 (+1399230us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540003cad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:55.677771 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2466563456}
I20260709 13:18:55.761224 19625 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:55.763796 19507 rpcz_store.cc:269] 0709 13:18:53.997222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.064975 (+ 67753us) service_pool.cc:224] Handling call
0709 13:18:55.681796 (+1616821us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540003d4d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:55.682011 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340276480}
W20260709 13:18:55.806846 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 45728.9us
I20260709 13:18:55.793648 19658 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:18:55.807695 19625 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:55.680300 22822 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.732036 22699 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.718822 22758 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.680552 22679 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.661206 22668 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:55.771812 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 92058.1us
I20260709 13:18:55.722676 22275 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.798302 22807 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:55.844916 22679 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:55.817101 22779 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:55.846781 22758 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:55.847048 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:55.818554 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:55.848348 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:55.848837 19655 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:55.760665 22286 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:55.678310 22738 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.819978 22813 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:55.849781 22738 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.820076 22811 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:55.850661 22286 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:55.851151 22811 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:55.781237 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1719) took 1719 ms. Trace:
I20260709 13:18:55.851665 22286 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.851927 19503 rpcz_store.cc:276] 0709 13:18:54.061792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.693162 (+1631370us) service_pool.cc:224] Handling call
0709 13:18:55.730351 (+ 37189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.780819 (+ 50468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.781124 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:55.820932 19660 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:18:55.854228 19409 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48840 (request call id 165) took 19837 ms (client timeout 15000 ms). Trace:
I20260709 13:18:55.854936 22664 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.856392 22809 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:55.802249 22839 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.858935 22839 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.861020 22822 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:55.854655 19409 rpcz_store.cc:269] 0709 13:18:36.017084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.017475 (+   391us) service_pool.cc:224] Handling call
0709 13:18:55.854132 (+19836657us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:50.194830 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:50.230409 (+ 35579us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:50.230475 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:18:50.230497 (+    22us) tablet.cc:662] Decoding operations
0709 13:18:50.231519 (+  1022us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:50.231615 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:50.231654 (+    39us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:18:50.232476 (+   822us) tablet.cc:701] Row locks acquired
0709 13:18:50.232534 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:18:50.232744 (+   210us) write_op.cc:270] Start()
0709 13:18:50.232917 (+   173us) write_op.cc:276] Timestamp: P: 1783603130232663 usec, L: 0
0709 13:18:50.232941 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:18:50.310140 (+ 77199us) log.cc:844] Serialized 2495 byte log entry
0709 13:18:50.967198 (+657058us) op_driver.cc:464] REPLICATION: finished
0709 13:18:51.046224 (+ 79026us) write_op.cc:301] APPLY: starting
0709 13:18:51.046329 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:51.046539 (+   210us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:51.046728 (+   189us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:51.120689 (+ 73961us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:51.121084 (+   395us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:18:51.121134 (+    50us) write_op.cc:312] APPLY: finished
0709 13:18:51.121473 (+   339us) log.cc:844] Serialized 52 byte log entry
0709 13:18:51.121683 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:51.121803 (+   120us) write_op.cc:454] Released schema lock
0709 13:18:51.121847 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:51.122288 (+   441us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:51.122320 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10963,"reported_tablets":51,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":78732,"apply.run_cpu_time_us":3862,"apply.run_wall_time_us":76033,"num_ops":6,"prepare.queue_time_us":360861,"prepare.run_cpu_time_us":22390,"prepare.run_wall_time_us":234960,"raft.queue_time_us":330927,"raft.run_cpu_time_us":12448,"raft.run_wall_time_us":46715,"replication_time_us":734057,"thread_start_us":482420,"threads_started":4,"wal-append.queue_time_us":166746,"wal-append.run_cpu_time_us":26046,"wal-append.run_wall_time_us":1631483}]]}
I20260709 13:18:55.819265 22483 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:55.862157 22844 log.cc:927] Time spent T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:18:55.862367 22483 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:55.744628 22276 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.760682 22842 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.842989 22275 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:55.881086 22822 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.830042 22699 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.881735 22822 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.882607 19656 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:55.883612 22822 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.738034 22841 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.884927 22483 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:55.881156 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:55.885576 22841 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.738531 22684 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.887390 22684 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.776791 19512 rpcz_store.cc:276] 0709 13:18:53.580976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.581106 (+   130us) service_pool.cc:224] Handling call
0709 13:18:53.656393 (+ 75287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.270127 (+1613734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.270176 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:55.270713 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:18:55.398806 (+128093us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:55.398846 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.688810 (+289964us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54002a9ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:55.688881 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.688958 (+    77us) raft_consensus.cc:1685] finished
0709 13:18:55.688980 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.724913 (+ 35933us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1293,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":3710186240,"thread_start_us":127418,"threads_started":1,"wal-append.queue_time_us":165435}
I20260709 13:18:55.888401 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:55.889462 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:55.890611 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:55.891563 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:55.740516 22726 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.766752 22585 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 13:18:55.811509 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:55.806169 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 115943us
I20260709 13:18:55.744863 22397 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.893656 22726 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:55.690070 19508 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:55.883630 22699 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:55.807973 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:55.894706 22397 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:55.895275 19658 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:55.817361 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:55.896183 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:55.766453 22678 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:18:55.896811 19658 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:55.784593 22825 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.758626 22666 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:55.781198 22749 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.831925 22732 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:55.805707 22831 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.835808 20663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59442 (request call id 115) took 2568 ms. Trace:
I20260709 13:18:55.842981 22824 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.880554 22276 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:55.954846 20663 rpcz_store.cc:276] 0709 13:18:53.267870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.290228 (+ 22358us) service_pool.cc:224] Handling call
0709 13:18:53.355202 (+ 64974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.431133 (+ 75931us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:55.442688 (+2011555us) log.cc:844] Serialized 14 byte log entry
0709 13:18:55.785398 (+342710us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:55.799303 (+ 13905us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:55.805577 (+  6274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.819842 (+ 14265us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.828721 (+  8879us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1739031,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":688,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":19321,"thread_start_us":2073288,"threads_started":2,"wal-append.queue_time_us":319510}
I20260709 13:18:55.843130 22835 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:55.783058 22543 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.737658 19476 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:55.866492 19657 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:18:55.831827 22840 log.cc:927] Time spent T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
W20260709 13:18:55.873456 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.868281 22826 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:55.880517 22842 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.889400 19656 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:55.885789 19504 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:55.894594 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:55.763445 22318 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:55.810356 22801 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 1.875s	user 0.005s	sys 0.000s
I20260709 13:18:55.766604 22739 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:55.818282 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:55.896811 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:55.918722 19655 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
W20260709 13:18:55.934098 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.935211 19661 raft_consensus.cc:2410] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:55.965878 19654 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:56.026551 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:55.897795 22839 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.951582 22818 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.953416 22763 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:55.953969 22808 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:55.943351 19510 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.000s	sys 0.009s
W20260709 13:18:56.028642 19551 connection.cc:256] RPC call timeout handler was delayed by -1.4542703320000783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 13:18:56.133671 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:56.135255 19510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.000s	sys 0.012s
I20260709 13:18:56.126727 19654 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
W20260709 13:18:56.026382 19553 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.007s	sys 0.003s
W20260709 13:18:56.136349 19553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.012s	sys 0.006s
I20260709 13:18:56.096714 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.137190 19658 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
W20260709 13:18:56.134477 19551 connection.cc:256] RPC call timeout handler was delayed by -1.0411703320000925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 13:18:56.137398 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.138252 19661 raft_consensus.cc:2393] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 5: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:56.028427 19659 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
W20260709 13:18:55.971443 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.897538 22825 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:56.026543 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 289012us
I20260709 13:18:56.148344 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1713) took 2088 ms. Trace:
I20260709 13:18:56.148810 19508 rpcz_store.cc:276] 0709 13:18:54.060142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.387339 (+1327197us) service_pool.cc:224] Handling call
0709 13:18:55.689571 (+302232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.894470 (+204899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.148156 (+253686us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b540003d4d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:56.148289 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693947776}
I20260709 13:18:56.149971 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:55.963268 19509 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:56.144615 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:56.152405 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.152712 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1712) took 2092 ms. Trace:
I20260709 13:18:56.153040 19660 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:56.144866 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.153069 19510 rpcz_store.cc:276] 0709 13:18:54.059860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.379384 (+1319524us) service_pool.cc:224] Handling call
0709 13:18:55.379764 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.379970 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:55.429006 (+ 49036us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.152375 (+723369us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.152431 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:56.152483 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.152541 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.152663 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16457,"prepare.queue_time_us":209936,"prepare.run_cpu_time_us":4948,"prepare.run_wall_time_us":10931,"thread_start_us":755225,"threads_started":2}
W20260709 13:18:55.966328 22846 log.cc:927] Time spent T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:18:56.153398 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:56.097687 22823 consensus_meta.cc:287] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.003s
I20260709 13:18:56.160920 19511 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:56.158416 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:56.158766 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 340588us
I20260709 13:18:56.163318 19625 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:55.975734 22666 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:56.167740 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:56.172988 19505 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:18:55.970753 22749 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:56.168830 19476 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:56.169484 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:56.167500 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:56.040311 22831 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.967037 22684 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:55.964715 22811 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:55.965375 22770 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:56.040139 22543 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:55.974184 22819 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:55.968667 22745 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:56.194581 19658 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:56.194754 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.196424 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.198217 19655 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:56.199030 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.199689 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.199973 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.200739 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.201784 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.097170 22814 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:56.182477 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.183645 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.161083 22286 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.184434 19511 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:56.185920 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.117380 22830 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:56.175462 22842 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:18:56.154127 22673 raft_consensus.cc:3055] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:18:56.213347 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 152680us
W20260709 13:18:56.237782 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 68372.3us
I20260709 13:18:56.238425 19658 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:56.187481 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.187994 19579 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:56.240557 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.241405 19579 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:56.188196 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.243824 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.188508 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.187196 22672 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:56.203100 19584 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:56.247675 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.189021 19508 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:56.203114 19580 raft_consensus.cc:2410] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:56.183800 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:56.204030 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.205055 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.096314 20666 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:56.172292 22726 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:18:56.141920 22839 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:56.206482 19578 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:56.258359 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.258652 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.259102 19578 raft_consensus.cc:2393] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 6: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:56.259428 19658 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:56.259904 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.260221 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.260444 19578 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:18:56.260942 19658 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 8: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:56.187359 22822 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:56.182092 19625 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:56.240595 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:56.266580 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:56.267194 19587 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.242681 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.213866 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:56.203603 22397 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:56.246946 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.280158 19657 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:18:56.251807 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.281224 19659 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:56.167446 22678 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:56.249646 19510 raft_consensus.cc:2393] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 5: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:56.252753 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.253059 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.249729 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.250249 19661 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:56.172674 22823 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:56.282874 19584 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:56.258719 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.299736 19656 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:18:56.210873 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.262192 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.212807 19511 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:56.302412 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2293) took 1086 ms. Trace:
I20260709 13:18:56.302728 19511 rpcz_store.cc:276] 0709 13:18:55.216247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.212245 (+995998us) service_pool.cc:224] Handling call
0709 13:18:56.212509 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.302052 (+ 89543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.302342 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.304473 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:56.160418 22732 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.263505 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2296) took 1046 ms. Trace:
I20260709 13:18:56.261415 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.180737 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:56.267920 19579 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:56.322837 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.323510 19579 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:56.324396 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:56.326433 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.217136 19585 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:56.209489 22849 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:18:56.272444 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 90414us
I20260709 13:18:56.423686 19625 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:56.278366 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:56.278960 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.241163 22673 raft_consensus.cc:740] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:56.282209 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:56.206460 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:56.272830 22672 raft_consensus.cc:697] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:56.284705 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:56.285120 22318 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:56.285332 22855 log.cc:927] Time spent T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:18:56.433883 22842 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:56.448096 22673 consensus_queue.cc:260] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:56.448814 19406 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 48) took 6501 ms. Trace:
I20260709 13:18:56.291483 22839 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:56.255100 22848 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:18:56.213539 22286 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:56.452021 22286 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:56.252090 22664 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:56.210438 22684 consensus_queue.cc:1059] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:18:56.454536 22684 raft_consensus.cc:3055] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:56.454880 22684 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:56.454950 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:56.455721 22684 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:56.456154 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:56.456807 19503 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 7.
I20260709 13:18:56.456880 22684 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:56.249329 22749 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:56.297478 19583 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:56.457894 22749 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:56.458452 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.459235 19583 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:56.458992 22672 consensus_queue.cc:237] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:56.305337 19511 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 10.
I20260709 13:18:56.459985 22749 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:56.460798 22823 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:56.460951 19511 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:56.461563 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2297) took 1244 ms. Trace:
I20260709 13:18:56.248383 22857 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.247176 22826 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:56.301501 19580 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:56.471941 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.398432 19512 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:56.343947 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:56.472960 19584 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:56.443418 22825 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:56.409807 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.474253 19581 raft_consensus.cc:2410] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:56.273168 22830 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:56.478256 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.479408 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.295611 22779 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:56.321165 19506 rpcz_store.cc:276] 0709 13:18:55.217014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.262795 (+1045781us) service_pool.cc:224] Handling call
0709 13:18:56.263043 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.263215 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.263239 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.263275 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:56.263314 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.263363 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.263454 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:56.492595 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 68988.6us
I20260709 13:18:56.457015 22835 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:56.495945 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.424721 19507 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:56.428771 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.496685 19660 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:56.497084 19582 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:18:56.497941 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.498347 19506 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:56.498605 19582 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:56.499029 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2302) took 1074 ms. Trace:
I20260709 13:18:56.499500 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.499410 19506 rpcz_store.cc:276] 0709 13:18:55.424143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.497722 (+1073579us) service_pool.cc:224] Handling call
0709 13:18:56.497989 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.498777 (+   788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.498984 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.418102 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.399396 22397 raft_consensus.cc:697] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:56.271894 22822 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:56.325793 20663 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:18:56.459463 22739 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:56.493515 19625 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:56.341476 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.460016 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.441716 22849 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:56.505096 19506 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:56.242501 19504 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:18:56.464316 19511 rpcz_store.cc:276] 0709 13:18:55.217294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.460513 (+1243219us) service_pool.cc:224] Handling call
0709 13:18:56.460785 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.461348 (+   563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.461512 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.465126 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:56.466786 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:56.468564 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:56.449152 22673 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:56.371183 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:56.524158 19510 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:18:56.526551 19625 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:56.409266 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.474315 19578 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:56.415563 19587 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5.
I20260709 13:18:56.415752 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.528620 19653 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:56.528995 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.482751 22738 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:56.484258 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:56.487442 19586 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:56.531636 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.449187 19406 rpcz_store.cc:276] 0709 13:18:49.949438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.953763 (+  4325us) service_pool.cc:224] Handling call
0709 13:18:56.448724 (+6494961us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:52.573957 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:52.574643 (+   686us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:52.574685 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:18:52.574706 (+    21us) tablet.cc:662] Decoding operations
0709 13:18:52.575285 (+   579us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:52.575342 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:52.575376 (+    34us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:18:52.575745 (+   369us) tablet.cc:701] Row locks acquired
0709 13:18:52.575764 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:18:52.575922 (+   158us) write_op.cc:270] Start()
0709 13:18:52.576039 (+   117us) write_op.cc:276] Timestamp: P: 1783603132575871 usec, L: 0
0709 13:18:52.576064 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:18:52.576793 (+   729us) log.cc:844] Serialized 1434 byte log entry
0709 13:18:53.126003 (+549210us) op_driver.cc:464] REPLICATION: finished
0709 13:18:53.999850 (+873847us) write_op.cc:301] APPLY: starting
0709 13:18:54.001478 (+  1628us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:54.068484 (+ 67006us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:54.116300 (+ 47816us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:54.185313 (+ 69013us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:54.185520 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:18:54.185568 (+    48us) write_op.cc:312] APPLY: finished
0709 13:18:54.196244 (+ 10676us) log.cc:844] Serialized 34 byte log entry
0709 13:18:54.930040 (+733796us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:55.171631 (+241591us) write_op.cc:454] Released schema lock
0709 13:18:55.171676 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:55.172203 (+   527us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:55.172232 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1498774,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":644646,"apply.run_cpu_time_us":44983,"apply.run_wall_time_us":1219418,"num_ops":3,"prepare.queue_time_us":191729,"prepare.run_cpu_time_us":12263,"prepare.run_wall_time_us":74108,"raft.queue_time_us":175443,"raft.run_cpu_time_us":17808,"raft.run_wall_time_us":218870,"replication_time_us":536294,"thread_start_us":820739,"threads_started":5,"wal-append.queue_time_us":1264752,"wal-append.run_cpu_time_us":14309,"wal-append.run_wall_time_us":2096152}]]}
I20260709 13:18:56.488776 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.532500 19579 raft_consensus.cc:2410] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:18:56.533823 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.534816 19657 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:18:56.536737 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 70024.1us
I20260709 13:18:56.539073 19507 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:56.490193 19581 raft_consensus.cc:2393] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:56.370954 22732 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:56.501411 22835 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:56.424693 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 146421us
I20260709 13:18:56.557569 19583 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:18:56.500164 19582 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:56.558868 19503 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:56.559262 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.560199 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:56.462788 22858 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:18:56.529670 19587 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:56.563885 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.539979 20619 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:56.564257 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.541864 19511 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:18:56.419260 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.584657 19511 pending_rounds.cc:85] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 5
I20260709 13:18:56.556727 22811 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:56.584904 19656 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:56.548506 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.550495 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.553516 19478 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:56.501963 22275 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:56.560046 19584 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:56.502256 19585 raft_consensus.cc:2393] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:56.555693 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:56.564548 19579 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:56.560819 19582 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:18:56.564917 19587 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:18:56.565501 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2289) took 1351 ms. Trace:
I20260709 13:18:56.564822 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2306) took 1139 ms. Trace:
I20260709 13:18:56.574110 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.570904 19653 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:18:56.540473 22779 raft_consensus.cc:697] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:56.488127 22857 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:56.549646 22813 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:56.510104 22749 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:56.592317 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.619711 19584 raft_consensus.cc:2393] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:56.591452 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.624881 19585 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:56.584939 19511 pending_rounds.cc:107] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:18:56.600745 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.626045 19580 raft_consensus.cc:2410] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:18:56.626731 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 87281.5us
I20260709 13:18:56.600632 19509 rpcz_store.cc:276] 0709 13:18:55.213855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.740313 (+526458us) service_pool.cc:224] Handling call
0709 13:18:55.740612 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.151610 (+410998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.565288 (+413678us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54002a99d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:56.565448 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491351424}
I20260709 13:18:56.600864 19506 rpcz_store.cc:276] 0709 13:18:55.425478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.501243 (+1075765us) service_pool.cc:224] Handling call
0709 13:18:56.504793 (+  3550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.559032 (+ 54239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.564771 (+  5739us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.590229 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.628911 19586 raft_consensus.cc:2410] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:18:56.629271 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.630211 19586 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:56.633634 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:56.626068 19585 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:56.671438 19586 raft_consensus.cc:1275] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:56.678867 19511 raft_consensus.cc:2889] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:56.690078 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.693886 19582 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:56.696329 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 137740us
I20260709 13:18:56.698076 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.579218 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:18:56.697333 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:56.701270 19656 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:56.701706 19653 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:56.565835 22830 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 13:18:56.711720 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 218251us
I20260709 13:18:56.718595 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.718642 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:56.719815 19587 raft_consensus.cc:2393] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:56.721208 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:56.722780 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:56.724154 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:56.721225 19627 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:56.726716 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.727824 19582 raft_consensus.cc:2410] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:18:56.731925 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:56.618825 22699 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:56.715258 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 149788us
I20260709 13:18:56.759730 19578 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:56.759665 19627 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:56.760910 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.620533 22852 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:56.767359 19653 raft_consensus.cc:2410] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 11 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:18:56.761062 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:56.762135 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.763701 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.589828 22275 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:56.692939 22813 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.796450 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.798024 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.779400 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.799136 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.800073 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:56.777194 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.804358 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.805274 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:56.770210 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:56.769706 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:56.808995 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:56.809662 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 256203us
I20260709 13:18:56.764994 22842 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:56.758919 22286 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:56.819567 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.714946 20661 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:56.813261 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.817540 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.766480 22811 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:56.820216 19653 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
W20260709 13:18:56.821151 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 193448us
I20260709 13:18:56.811671 19584 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:18:56.826876 19586 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:56.767771 22839 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:56.795665 22824 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:56.795859 22763 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:56.768857 22739 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:56.802074 22275 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:56.876362 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.771319 22543 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:56.877188 19656 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:18:56.766894 22841 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:18:56.801085 22813 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:56.885850 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 74535.5us
I20260709 13:18:56.886906 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2298) took 1465 ms. Trace:
I20260709 13:18:56.865944 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:56.589663 22397 consensus_queue.cc:237] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:56.699594 22749 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:56.903885 19653 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:56.897583 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:56.818133 22276 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:56.884769 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:56.945200 19656 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:56.868400 22666 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:56.819793 22842 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:56.766053 22862 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.166s
W20260709 13:18:56.861361 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 227889us
I20260709 13:18:56.774879 22805 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:56.887480 19508 rpcz_store.cc:276] 0709 13:18:55.421549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.461164 (+1039615us) service_pool.cc:224] Handling call
0709 13:18:56.461418 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.461657 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:56.461900 (+   243us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.886452 (+424552us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.886509 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:56.886561 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.886649 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.886804 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124802,"prepare.queue_time_us":935,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"thread_start_us":299388,"threads_started":1}
I20260709 13:18:56.881342 22739 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:56.948225 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 50699.2us
I20260709 13:18:56.982849 19478 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:56.984503 19478 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:56.828887 22286 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:56.991753 19478 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:56.906136 19476 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:56.854854 22825 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:56.853928 22839 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:56.863270 22852 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:56.876351 22763 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:56.977799 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.878526 22664 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:56.828480 22873 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.148s
I20260709 13:18:56.908272 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:56.965332 22543 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:56.993943 19656 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:56.890609 22824 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:56.990625 22823 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:56.971581 22842 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:56.938390 22672 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:18:56.971165 22738 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:56.894584 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 124421us
I20260709 13:18:57.016790 19627 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:18:57.000344 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 94344us
I20260709 13:18:56.998705 22849 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:56.963517 22666 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:57.005420 22668 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:56.943496 22678 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:18:57.027885 22666 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:56.996740 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 226588us
I20260709 13:18:56.986614 22739 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:57.038054 22865 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:18:56.876807 22779 consensus_queue.cc:237] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.010649 19587 raft_consensus.cc:2410] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:18:56.992230 22483 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:56.992027 22822 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:56.999429 22839 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:57.045861 22483 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.046617 22483 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:56.998821 19478 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:18:57.050036 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 51294.8us
I20260709 13:18:57.050731 19478 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:57.051299 22483 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.052109 22483 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:57.052577 22483 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.002941 22763 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:56.999320 22852 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:57.020931 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:57.005698 22543 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.004520 22664 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.001479 19660 raft_consensus.cc:2393] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:57.004957 22830 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:57.008816 22823 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:57.052929 22684 consensus_meta.cc:287] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.596s	user 0.004s	sys 0.004s
I20260709 13:18:57.053306 22318 raft_consensus.cc:2764] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:18:57.007390 22870 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:18:57.054593 22749 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.055071 22808 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:57.056198 22839 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.057024 22286 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.058085 22666 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:57.023355 22863 log.cc:927] Time spent T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260709 13:18:57.020396 22738 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:57.024071 22818 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.101166 22823 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:57.026029 22732 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:57.028569 22668 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.060695 22849 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.086210 22678 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:18:57.029186 22871 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:57.087450 22483 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:57.096822 22664 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:57.094561 22857 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.094177 22543 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:57.082662 22814 consensus_queue.cc:1059] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:18:57.096247 22805 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.093324 22886 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:18:57.115665 22738 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:57.120910 22871 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:57.133858 22842 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.134884 22871 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:57.136341 22842 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.138707 22839 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.121977 22849 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.141237 22849 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.117133 22818 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.143448 22818 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.112593 22824 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:57.150322 22835 consensus_meta.cc:287] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
I20260709 13:18:57.150906 22835 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:57.194715 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:57.023634 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.201339 19476 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:18:57.206161 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 153655us
I20260709 13:18:57.208390 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:57.208879 19476 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:57.210354 19410 catalog_manager.cc:5697] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 9 to 10, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 10 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:57.214808 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2295) took 1997 ms. Trace:
I20260709 13:18:57.215778 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.217136 19504 raft_consensus.cc:2376] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5. Re-sending same reply.
I20260709 13:18:57.215556 19505 rpcz_store.cc:276] 0709 13:18:55.216750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.262280 (+1045530us) service_pool.cc:224] Handling call
0709 13:18:56.294023 (+ 31743us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:56.294484 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:56.294808 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.552366 (+257558us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.561468 (+  9102us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.671657 (+110189us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b1800368a40. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:18:56.801164 (+129507us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b1800368a40. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e5e7c0a 00007f6c37d27219 00007f6c2e66fa40 00007f6c2e66a4e4 00007f6c2e66a455 00007f6c31752060 00007f6c31764716 00007f6c31775287 00007f6c31775208
0709 13:18:56.801348 (+   184us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:56.801925 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 13:18:56.802087 (+   162us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:56.802318 (+   231us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.885788 (+ 83470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.885880 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:57.213985 (+328105us) raft_consensus.cc:1685] finished
0709 13:18:57.214070 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.214469 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":303092,"prepare.queue_time_us":18109,"prepare.run_cpu_time_us":177,"prepare.run_wall_time_us":2037,"raft.queue_time_us":358113,"raft.run_cpu_time_us":505,"raft.run_wall_time_us":58318,"spinlock_wait_cycles":13088384,"thread_start_us":230554,"threads_started":1,"wal-append.queue_time_us":278446}
I20260709 13:18:57.218971 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:57.219542 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.220604 19505 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:18:57.219982 19410 catalog_manager.cc:5697] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 9 to 10, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 10 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:57.214920 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.222607 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.223335 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.223507 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1735) took 1333 ms. Trace:
I20260709 13:18:57.224113 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.224833 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:57.078963 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.225770 19509 raft_consensus.cc:2376] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8. Re-sending same reply.
W20260709 13:18:57.227114 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.227105 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.228555 19511 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:18:57.228940 19511 pending_rounds.cc:85] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 4
I20260709 13:18:57.229271 19511 pending_rounds.cc:107] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:18:57.225744 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.230123 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.230962 19512 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:18:57.231209 19509 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
W20260709 13:18:57.232642 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 462866us
I20260709 13:18:57.234155 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:57.236294 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.237330 19509 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:18:57.224220 19506 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
W20260709 13:18:57.089828 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 70026.6us
I20260709 13:18:57.244612 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:18:57.089349 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 116310us
I20260709 13:18:57.249266 22397 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.221662 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.241727 22318 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:57.252584 22318 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:57.250279 22397 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.238708 19511 raft_consensus.cc:2889] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:57.253712 22318 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:57.254179 22318 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.254770 22318 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:57.256379 22397 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:57.225710 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.224090 19507 rpcz_store.cc:276] 0709 13:18:55.890013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.551175 (+661162us) service_pool.cc:224] Handling call
0709 13:18:56.551571 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:56.566175 (+ 14604us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:56.566216 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:56.566796 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 13:18:56.858038 (+291242us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b18002fa5e0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa0d1 00007f6c31715a0f
0709 13:18:57.222546 (+364508us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:57.222648 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.222819 (+   171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:57.222920 (+   101us) raft_consensus.cc:1685] finished
0709 13:18:57.222937 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.223327 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":244630,"raft.queue_time_us":15018,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":3964672,"thread_start_us":363949,"threads_started":1,"wal-append.queue_time_us":576573}
I20260709 13:18:57.261783 19512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03f9956d44294112accb74ea1a18065b"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:18:57.262826 19512 raft_consensus.cc:606] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:18:57.263409 19512 raft_consensus.cc:614] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:57.264101 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:57.273900 22397 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:57.275128 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1868) took 1077 ms. Trace:
I20260709 13:18:57.275677 19655 rpcz_store.cc:276] 0709 13:18:56.197117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.199762 (+  2645us) service_pool.cc:224] Handling call
0709 13:18:57.274547 (+1074785us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540032aad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:57.274773 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2396172160}
I20260709 13:18:57.279126 19512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:18:57.282485 19627 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:57.283825 19627 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:57.285116 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:57.282510 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:57.288149 22397 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:57.290392 22286 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:57.290897 22286 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:57.291325 22286 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:57.119549 22668 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:57.301406 22672 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:57.304438 22672 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:57.304771 22684 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:57.301506 22678 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:57.306257 22678 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:57.306802 22678 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:57.307123 22684 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:57.307668 22684 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:57.309828 22813 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.312377 22814 raft_consensus.cc:3055] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:57.312954 22739 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.316565 22397 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.326864 22397 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:57.326706 22684 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.328281 22684 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:57.330776 22839 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:57.331749 22835 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:57.307636 19410 catalog_manager.cc:5697] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:57.326246 22666 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.339767 22739 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.340938 22849 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:57.343922 22813 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:57.344749 19583 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:57.317452 22814 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:57.335223 19410 catalog_manager.cc:5697] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 2 to 7, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 7 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:18:57.346736 22814 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.347333 19410 catalog_manager.cc:5697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 3 to 8, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 8 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:18:57.348407 22814 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:57.340567 19504 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:57.357177 19512 raft_consensus.cc:606] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:18:57.357704 19512 raft_consensus.cc:614] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:57.349144 19410 catalog_manager.cc:5697] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 8 to 9, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 9 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:57.365262 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 80366.5us
I20260709 13:18:57.321807 22824 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:18:57.372418 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.373050 22839 raft_consensus.cc:697] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:57.373544 19505 raft_consensus.cc:2410] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:18:57.374670 19627 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:57.375826 22881 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:57.365171 22849 raft_consensus.cc:697] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:57.377480 22849 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.379206 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:57.380239 19627 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:57.381806 22873 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:57.382241 22873 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.382609 22873 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:57.386001 22585 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:57.386545 22585 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.386941 22585 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:57.374318 22839 consensus_queue.cc:237] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.392108 19507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:18:57.392803 19507 raft_consensus.cc:606] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:18:57.393157 19507 raft_consensus.cc:614] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:57.394170 19509 raft_consensus.cc:1275] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:57.396531 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.397588 19507 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:57.398284 22678 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.399286 22318 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.401906 22678 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:57.402403 19653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:18:57.403074 19653 raft_consensus.cc:606] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:18:57.405484 22543 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.409117 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.409154 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.409336 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.413609 22886 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:57.413697 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:57.405946 22318 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.406992 19478 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:57.419791 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:57.439406 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 50208.7us
I20260709 13:18:57.442296 19507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
W20260709 13:18:57.439513 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 223446us
I20260709 13:18:57.418659 22397 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.444713 19507 raft_consensus.cc:606] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
W20260709 13:18:57.452558 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45753.1us
I20260709 13:18:57.452903 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.443567 22543 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:57.458959 19476 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:57.399217 22881 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:18:57.478628 22881 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:57.483028 19504 raft_consensus.cc:2393] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:57.476495 19627 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:57.484409 19504 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:57.485134 22673 consensus_meta.cc:287] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.954s	user 0.008s	sys 0.008s
I20260709 13:18:57.487005 22732 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:57.487598 22732 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:57.488040 22732 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:57.487881 22871 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.491845 22726 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:57.493834 22738 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.494722 22483 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.496243 22738 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.497140 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:57.497493 19508 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:57.498045 22839 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:57.461272 22318 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:57.533906 20661 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:57.535168 22397 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:57.536423 22483 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.540457 22823 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.540742 22763 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.568992 22668 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.574295 22852 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:57.575999 22664 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.554179 22318 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.549018 22286 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.619704 22823 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.620849 22732 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.623957 19506 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:18:57.623998 22286 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.610812 22318 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:57.622119 22275 consensus_meta.cc:287] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.010s
I20260709 13:18:57.623632 22668 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.627475 22871 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:57.628018 22664 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.628697 22732 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:57.630323 22763 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.632520 22275 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:57.635573 22275 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:57.636303 22318 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.638429 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:57.640882 22318 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.626974 22873 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.644596 22873 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:57.662004 22585 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.666630 22585 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:57.706380 22738 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:57.706578 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 252883us
I20260709 13:18:57.707610 19476 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:57.708995 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.709872 19506 raft_consensus.cc:2410] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:57.742520 19652 raft_consensus.cc:2393] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 8: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:57.756093 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2120) took 1224 ms. Trace:
I20260709 13:18:57.756517 19585 rpcz_store.cc:276] 0709 13:18:56.532086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.678177 (+146091us) service_pool.cc:224] Handling call
0709 13:18:56.678476 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.986915 (+308439us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:57.234752 (+247837us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.453556 (+218804us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.461989 (+  8433us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:57.506896 (+ 44907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.755689 (+248793us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b5400247a54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:57.755733 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.755912 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":297654,"prepare.queue_time_us":330126,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":65,"raft.queue_time_us":2759,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":63606,"spinlock_wait_cycles":709717504,"thread_start_us":207909,"threads_started":1,"wal-append.queue_time_us":247150}
I20260709 13:18:57.814779 22276 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.815510 22397 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:57.815542 22276 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.816308 22397 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:57.818485 22276 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:57.818605 22397 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:57.840343 19503 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:57.850741 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:57.852310 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:57.854112 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:57.854832 19582 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:57.853487 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:57.860785 19579 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:57.887156 19582 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:18:57.891297 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:57.894135 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 397114us
I20260709 13:18:57.892475 22849 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:57.899735 19579 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:18:57.902655 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:57.904690 19582 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:18:57.905400 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.905764 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:57.907670 19579 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:18:57.908965 20663 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:57.915426 19583 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:57.926069 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:57.942128 22749 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:57.947162 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:57.948047 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 45298.3us
I20260709 13:18:57.948522 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:57.949345 19587 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:57.949292 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:57.950402 22852 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:57.945333 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:57.951644 19510 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.025s	sys 0.022s
I20260709 13:18:57.956199 22822 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:57.965179 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:57.963102 19510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.025s	sys 0.022s
I20260709 13:18:57.966121 22849 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:57.947064 19625 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:57.966313 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:57.967679 19582 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:57.968946 19627 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:57.969810 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:57.974227 19505 consensus_meta.cc:287] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.533s	user 0.014s	sys 0.000s
I20260709 13:18:57.978284 19505 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:18:57.980124 22813 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:57.980656 22813 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.981494 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:57.983006 19507 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:57.983233 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:57.984234 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:57.983431 19579 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:57.985262 19507 raft_consensus.cc:2410] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:18:57.990510 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:57.981048 22813 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:57.992404 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:57.994501 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:57.995740 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:57.996500 19507 raft_consensus.cc:2393] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:57.997830 19507 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:57.999346 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:57.998589 22886 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:18:58.002301 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 104174us
I20260709 13:18:58.004361 19625 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:58.017334 22822 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:58.030642 19587 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:58.030714 19652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1878) took 1447 ms. Trace:
I20260709 13:18:58.032791 19652 rpcz_store.cc:276] 0709 13:18:56.583841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.584005 (+   164us) service_pool.cc:224] Handling call
0709 13:18:58.030460 (+1446455us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54002189d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:58.030650 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2399402752}
I20260709 13:18:58.034818 19579 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:18:58.032333 19585 raft_consensus.cc:1275] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:58.037294 19582 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:18:58.041560 19584 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:18:58.045575 19410 catalog_manager.cc:5697] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 1 to 5, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 5 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:58.047984 19410 catalog_manager.cc:5697] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 3 to 4, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 4 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:58.048954 19585 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:58.057286 19587 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
W20260709 13:18:58.065233 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 62133.2us
I20260709 13:18:58.068895 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:58.068869 22805 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:58.065212 22726 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:18:58.074983 22726 consensus_queue.cc:1243] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:58.078962 19410 catalog_manager.cc:5697] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:58.081065 19410 catalog_manager.cc:5697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:58.087343 19410 catalog_manager.cc:5697] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 4 to 7, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 7 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
W20260709 13:18:58.083953 19511 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.002s	sys 0.013s
W20260709 13:18:58.089511 19511 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.003s	sys 0.013s
W20260709 13:18:58.090222 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.076665 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:58.088500 22822 consensus_queue.cc:1059] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:58.092170 22822 raft_consensus.cc:3055] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:58.092571 22822 raft_consensus.cc:740] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:58.093848 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2122) took 1336 ms. Trace:
I20260709 13:18:58.093480 22822 consensus_queue.cc:260] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:58.094974 22822 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:58.094230 19586 rpcz_store.cc:276] 0709 13:18:56.757791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.855671 (+ 97880us) service_pool.cc:224] Handling call
0709 13:18:57.265566 (+409895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.266215 (+   649us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:57.266716 (+   501us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.416641 (+149925us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.416694 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:57.436507 (+ 19813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.440534 (+  4027us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.093548 (+653014us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b5400226fd0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:18:58.093687 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21390,"prepare.queue_time_us":53675,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":67,"raft.queue_time_us":47130,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":27366,"spinlock_wait_cycles":908836096,"thread_start_us":103510,"threads_started":1,"wal-append.queue_time_us":190722}
I20260709 13:18:58.091462 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:58.112527 19512 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:18:58.132826 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 56270.4us
I20260709 13:18:58.133805 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:58.135864 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:58.137960 22286 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:58.138652 22286 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:58.140975 22286 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:58.141538 22286 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:58.142551 22286 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:58.142663 22839 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:58.143247 22839 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:58.143664 22839 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:58.144963 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:58.148706 22286 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:58.162338 19410 catalog_manager.cc:5697] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 4 to 7, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 7 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:58.166972 22763 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:58.179286 19578 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:18:58.185832 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:58.186527 19580 raft_consensus.cc:2376] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 5. Re-sending same reply.
I20260709 13:18:58.187500 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:58.189221 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:58.171311 22286 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:58.193847 19410 catalog_manager.cc:5697] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 2 to 5, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 5 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:58.196148 19410 catalog_manager.cc:5697] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:58.198899 22763 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:58.200894 22763 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:58.207787 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.210391 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.211748 19653 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:58.215099 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.212714 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.216198 19655 raft_consensus.cc:2393] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:58.244505 19410 catalog_manager.cc:5697] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:58.249859 19652 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:18:58.297451 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.452456 19586 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 8.
I20260709 13:18:58.453840 19655 raft_consensus.cc:2393] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:58.394479 22839 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:58.385550 22813 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:58.465688 19410 catalog_manager.cc:5697] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 4 to 9, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 9 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:18:58.478904 22839 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:58.479549 19410 catalog_manager.cc:5697] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 4 to 7, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 7 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:58.471513 22286 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:58.483469 22286 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:58.484754 22849 consensus_meta.cc:287] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.010s
I20260709 13:18:58.487891 22852 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:58.495309 22813 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:58.501253 22886 raft_consensus.cc:697] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:58.505746 22849 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:58.508170 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 439328us
I20260709 13:18:58.508545 22813 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:58.508975 22852 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:58.511781 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 507472us
I20260709 13:18:58.513132 22726 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:58.508240 22805 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:58.520313 19627 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:58.529356 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.531549 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.532394 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.533023 19660 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:18:58.533852 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.534524 19653 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:58.538996 22852 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:58.542327 19625 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:58.542735 19657 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:18:58.543810 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.544359 19625 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:58.545722 19661 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:58.546909 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.547566 19659 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:18:58.514885 22886 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:58.556951 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:18:58.561303 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 43996.1us
I20260709 13:18:58.562860 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.565747 22678 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:58.565610 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.569598 22888 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.570291 22871 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:58.527256 22805 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:58.574376 19653 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:58.566339 22726 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:58.560983 22813 raft_consensus.cc:697] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:58.582777 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:58.566704 22849 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:58.572918 22678 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:58.595305 22678 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:58.595500 22805 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:58.596990 22805 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:58.580132 22888 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:58.582010 22871 raft_consensus.cc:697] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:58.602628 22871 consensus_queue.cc:237] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:58.603313 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.594563 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:58.613551 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:58.618769 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.618466 19653 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:58.584038 22726 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:58.576437 22814 consensus_queue.cc:1048] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 13:18:58.657240 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.604249 22849 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:58.660951 22873 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:58.661360 22888 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:58.662284 22849 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:58.654397 22726 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:58.662794 22813 consensus_queue.cc:237] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:58.665993 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 91212.9us
I20260709 13:18:58.665763 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:58.654930 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.652383 22749 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:58.688338 19661 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:58.672559 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.692189 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:58.692797 19658 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:58.693830 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.661439 22873 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:18:58.699015 22873 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:58.707130 22678 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:58.712458 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 130181us
I20260709 13:18:58.690989 22749 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:58.715829 19625 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:58.719589 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:58.722565 19661 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:58.719972 22749 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:58.734112 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:58.710675 22881 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:18:58.739408 22726 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:58.743088 22923 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:18:58.752442 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 46601.7us
I20260709 13:18:58.719542 22925 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:58.770255 19653 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:18:58.773962 19653 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13. Ops: []
W20260709 13:18:58.771438 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 166174us
I20260709 13:18:58.811280 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:58.813711 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 91781.7us
I20260709 13:18:58.844686 19625 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:58.855108 22819 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:58.862934 19655 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:18:58.866358 22726 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:58.878805 22678 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:58.885030 19551 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:58.886509 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:58.886581 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:58.887719 19653 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:58.889667 22822 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:58.890230 22822 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.890657 22822 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:58.892447 22839 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:58.893005 22839 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.893399 22839 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:58.900431 19658 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:18:58.902412 19661 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:58.904860 22397 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:58.905804 22888 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:58.925191 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:58.929392 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:58.937487 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:58.944137 19653 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:18:59.003516 22749 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:59.006632 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 152472us
I20260709 13:18:59.008407 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:59.009733 19653 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 8: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:59.009459 19627 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:58.940244 22888 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:59.018980 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:59.020089 19658 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
W20260709 13:18:59.021919 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.024451 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:59.025171 19653 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:18:58.943229 22849 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:18:59.044651 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:59.046378 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:59.047894 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:59.024974 20687 debug-util.cc:398] Leaking SignalData structure 0x7b08003cfc00 after lost signal to thread 18417
W20260709 13:18:59.049571 20687 debug-util.cc:398] Leaking SignalData structure 0x7b08002de3e0 after lost signal to thread 19444
W20260709 13:18:59.050923 20687 debug-util.cc:398] Leaking SignalData structure 0x7b08002c54e0 after lost signal to thread 19536
W20260709 13:18:59.051219 20687 debug-util.cc:398] Leaking SignalData structure 0x7b08002e04c0 after lost signal to thread 19537
W20260709 13:18:59.052307 20687 debug-util.cc:398] Leaking SignalData structure 0x7b0800329360 after lost signal to thread 19611
W20260709 13:18:59.053421 20687 debug-util.cc:398] Leaking SignalData structure 0x7b0800311e00 after lost signal to thread 19685
I20260709 13:18:59.018918 22888 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.054077 19655 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.054316 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:59.021999 22871 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:18:59.055871 20687 debug-util.cc:398] Leaking SignalData structure 0x7b08002ad5a0 after lost signal to thread 20690
I20260709 13:18:59.005553 22839 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:59.058813 20687 debug-util.cc:398] Leaking SignalData structure 0x7b080034c9a0 after lost signal to thread 20691
I20260709 13:18:59.021997 22912 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:18:59.059429 20687 debug-util.cc:398] Leaking SignalData structure 0x7b08003517a0 after lost signal to thread 22668
W20260709 13:18:59.059841 20687 debug-util.cc:398] Leaking SignalData structure 0x7b0800396ce0 after lost signal to thread 22673
W20260709 13:18:59.060079 20687 debug-util.cc:398] Leaking SignalData structure 0x7b0800396ca0 after lost signal to thread 22699
I20260709 13:18:59.057893 22888 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:59.062381 18419 debug-util.cc:398] Leaking SignalData structure 0x7b080000ff00 after lost signal to thread 19476
I20260709 13:18:59.063010 19657 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:18:59.065068 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 251152us
W20260709 13:18:59.062909 18419 kernel_stack_watchdog.cc:198] Thread 19476 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 322ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:18:59.079679 19657 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:59.080412 22839 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:59.082453 22842 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:59.082916 22842 raft_consensus.cc:697] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:59.083794 22842 consensus_queue.cc:237] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.084352 19625 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:59.087658 19655 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:18:59.094024 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2326) took 1702 ms. Trace:
W20260709 13:18:59.094568 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.094853 22738 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.095459 22738 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:59.098095 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 1.00669e+06us
I20260709 13:18:59.098775 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2333) took 1641 ms. Trace:
I20260709 13:18:59.099220 19511 rpcz_store.cc:276] 0709 13:18:57.457828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.458015 (+   187us) service_pool.cc:224] Handling call
0709 13:18:57.485529 (+ 27514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.485967 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:58.089919 (+603952us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.098365 (+1008446us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.098433 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:59.098494 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.098572 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.098705 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":967225,"prepare.queue_time_us":159135,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"thread_start_us":644205,"threads_started":2,"wal-append.queue_time_us":87129}
I20260709 13:18:59.101204 22893 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:59.102077 22893 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:59.103206 22915 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:59.103581 22915 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:59.103979 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 1.39638e+06us
I20260709 13:18:59.104573 22915 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:59.105193 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2342) took 1394 ms. Trace:
I20260709 13:18:59.110770 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.111406 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.114538 19509 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:18:59.111095 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.110441 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.110140 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.104983 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:59.065734 22749 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:59.119585 19503 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:18:59.121508 22934 log.cc:927] Time spent T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:18:59.134464 19505 raft_consensus.cc:2410] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:18:59.110589 22871 raft_consensus.cc:697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:59.105599 19506 rpcz_store.cc:276] 0709 13:18:57.710338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.710496 (+   158us) service_pool.cc:224] Handling call
0709 13:18:57.710781 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:58.096358 (+385577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.096386 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:58.096925 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:18:58.127449 (+ 30524us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:58.419321 (+291872us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.104846 (+685525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.104940 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.104991 (+    51us) raft_consensus.cc:1685] finished
0709 13:18:59.105004 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.105136 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1072320,"prepare.queue_time_us":27673,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":1173414,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":199,"thread_start_us":294889,"threads_started":2,"wal-append.queue_time_us":30500}
I20260709 13:18:59.127043 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.127751 22738 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:59.109102 22822 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:18:59.129901 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 65133.6us
I20260709 13:18:59.104574 22483 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:59.138473 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:59.139369 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:59.148756 19505 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:59.141866 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.155280 19507 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:59.142617 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:59.098131 22917 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:59.068536 22912 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:59.094580 19510 rpcz_store.cc:276] 0709 13:18:57.391850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.398296 (+  6446us) service_pool.cc:224] Handling call
0709 13:18:57.410906 (+ 12610us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:57.411574 (+   668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.411613 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:57.412496 (+   883us) log.cc:844] Serialized 52 byte log entry
0709 13:18:57.975443 (+562947us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:57.975741 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.126761 (+151020us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.093657 (+966896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.093746 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.093788 (+    42us) raft_consensus.cc:1685] finished
0709 13:18:59.093800 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.093950 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1111185,"prepare.queue_time_us":3475,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":1190302,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":390,"spinlock_wait_cycles":49408,"thread_start_us":590861,"threads_started":2,"wal-append.queue_time_us":237663}
I20260709 13:18:59.182565 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:59.184440 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:59.186343 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:18:59.189051 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.192232 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:59.192988 19511 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.193526 22912 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:59.194079 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 110924us
I20260709 13:18:59.194999 19625 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:59.189711 19586 pending_rounds.cc:85] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 3
I20260709 13:18:59.190182 19507 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:18:59.199703 19586 pending_rounds.cc:107] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:18:59.200136 19586 raft_consensus.cc:2889] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:59.199141 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.122444 22873 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.207983 19506 raft_consensus.cc:2410] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 14 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:18:59.178582 22893 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:59.214282 19627 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:18:59.212415 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:59.179023 22823 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:59.178527 22738 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.217157 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.218783 19578 raft_consensus.cc:2368] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11.
I20260709 13:18:59.196497 22666 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:59.198177 22397 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:59.231280 22673 consensus_queue.cc:1059] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:59.232165 19625 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:59.232823 19659 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:59.235564 19584 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:59.214937 22923 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:59.238049 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.218446 22893 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.240898 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:59.244030 19506 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:18:59.241887 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:59.251883 19507 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:59.209553 22318 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:18:59.233801 22678 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:59.257160 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.251351 22585 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:18:59.228478 22822 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:18:59.263896 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:59.265519 19584 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:59.199101 22917 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.251492 22893 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.268039 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.256363 22397 raft_consensus.cc:697] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:18:59.269737 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:59.229149 22823 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.268821 19507 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:59.229305 22738 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.276659 19511 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:18:59.278553 19585 raft_consensus.cc:2393] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:59.252907 22673 consensus_queue.cc:1059] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:18:59.283353 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:18:59.284526 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 238227us
I20260709 13:18:59.286392 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.284097 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:59.287282 19511 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:59.294893 19585 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:18:59.297564 19584 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 11: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:18:59.306700 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 78649.6us
I20260709 13:18:59.307956 19585 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:59.309813 19585 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:59.320616 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 60541.7us
I20260709 13:18:59.339499 19627 leader_election.cc:400] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11.
I20260709 13:18:59.339946 19627 leader_election.cc:403] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:18:59.340215 19578 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:59.258214 22871 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:59.371256 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57571.1us
I20260709 13:18:59.376231 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.371344 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:59.331413 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:59.373593 22873 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:18:59.396361 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:59.377969 22813 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:59.373991 22842 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:18:59.408291 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.409206 19507 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:18:59.409822 19578 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:59.398950 22749 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:59.392434 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:18:59.416764 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:59.398272 22318 raft_consensus.cc:3055] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:18:59.416755 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 185745us
I20260709 13:18:59.414261 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:59.431628 22940 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:59.431754 22842 consensus_queue.cc:1243] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:59.432487 22842 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:59.419737 22749 raft_consensus.cc:697] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:59.438228 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.439154 22749 consensus_queue.cc:237] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.443341 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2338) took 1734 ms. Trace:
I20260709 13:18:59.433205 22842 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:59.443902 19508 rpcz_store.cc:276] 0709 13:18:57.708995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.497998 (+789003us) service_pool.cc:224] Handling call
0709 13:18:58.498430 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.105820 (+607390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.105850 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:59.106334 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:18:59.271638 (+165304us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:59.271693 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.271785 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.443107 (+171322us) raft_consensus.cc:1685] finished
0709 13:18:59.443125 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.443271 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":606958,"raft.queue_time_us":608281,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"thread_start_us":164868,"threads_started":1,"wal-append.queue_time_us":211220}
I20260709 13:18:59.447125 22842 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.448670 22842 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:59.399075 22931 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:59.418670 20663 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:59.457151 22952 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:59.386078 22941 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:18:59.457566 19584 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13. Ops: []
W20260709 13:18:59.454252 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 110799us
I20260709 13:18:59.394984 22585 consensus_queue.cc:1059] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:18:59.473718 22952 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.474390 22952 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:59.475205 22941 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:59.475680 22941 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:59.476768 22941 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.426818 22318 raft_consensus.cc:740] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:18:59.495651 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 97440us
I20260709 13:18:59.498040 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:18:59.531215 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 117062us
I20260709 13:18:59.538975 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.539924 19507 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:18:59.416114 22397 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:18:59.549244 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 63961.5us
I20260709 13:18:59.547565 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:59.496865 22666 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:59.494444 22726 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:18:59.552289 22941 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:59.580938 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.593669 22749 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:59.594306 22749 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.596395 22749 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:59.597095 22318 consensus_queue.cc:260] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.598179 22318 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.601691 22897 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:59.602296 22897 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:18:59.604218 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.572392 19476 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:59.567260 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:59.613870 19508 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:59.615762 19625 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:59.548980 22940 raft_consensus.cc:697] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:59.566407 22823 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:18:59.636586 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 137568us
I20260709 13:18:59.632730 19503 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:18:59.638751 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:59.636125 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:18:59.614782 22839 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:59.624383 22749 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:59.664131 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1826) took 1011 ms. Trace:
I20260709 13:18:59.666077 22960 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:18:59.668780 22960 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:59.669294 22960 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:18:59.669656 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:59.664515 19659 rpcz_store.cc:276] 0709 13:18:58.652821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.694993 (+ 42172us) service_pool.cc:224] Handling call
0709 13:18:58.695315 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.236482 (+541167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.663846 (+427364us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b5400020654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:18:59.664064 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1228535040}
I20260709 13:18:59.645588 22839 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:18:59.642591 22822 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
W20260709 13:18:59.663715 22888 consensus_meta.cc:287] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.601s	user 0.012s	sys 0.000s
W20260709 13:18:59.691049 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 138342us
I20260709 13:18:59.655751 22684 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:59.651921 22749 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:18:59.645890 22823 consensus_queue.cc:1059] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:18:59.713645 22823 consensus_queue.cc:1059] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:18:59.715103 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 52070.9us
I20260709 13:18:59.718201 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:59.718964 19579 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:18:59.658071 22881 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:59.718822 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:59.722388 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:18:59.692173 22839 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.732224 19584 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:18:59.740788 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:18:59.740788 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:59.712706 22749 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.710731 22684 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.741700 19581 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:18:59.682116 22962 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:18:59.754110 19503 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:59.714964 22888 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.749661 22684 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.670816 22666 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.691020 22940 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.768646 19587 raft_consensus.cc:2368] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10.
I20260709 13:18:59.754607 22823 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.013s
W20260709 13:18:59.784339 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 44840us
I20260709 13:18:59.784919 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:18:59.800405 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 164367us
W20260709 13:18:59.785316 22959 log.cc:927] Time spent T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:18:59.781004 22915 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:59.788971 22963 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:59.782297 22672 raft_consensus.cc:3055] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:18:59.788399 22956 log.cc:927] Time spent T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
W20260709 13:18:59.814010 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 198331us
I20260709 13:18:59.784623 22952 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.803720 22318 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:59.778565 22971 raft_consensus.cc:3055] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:59.807947 22813 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11.
I20260709 13:18:59.822788 19653 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:59.823640 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:18:59.819789 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:59.825212 22888 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:59.825114 22980 consensus_queue.cc:1059] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:18:59.825810 22972 raft_consensus.cc:3055] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:59.826339 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:18:59.848779 19661 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:59.827033 22668 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:59.827562 19476 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:59.828222 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:59.822377 22318 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:59.820372 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:18:59.837978 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.759425 22960 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.843688 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:18:59.829133 22839 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.818389 22672 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:59.782522 22893 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.813513 22684 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.862632 19659 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:59.864154 19508 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:18:59.864791 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.829666 22971 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:59.848461 22972 raft_consensus.cc:740] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:59.869585 22888 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.874903 19506 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:59.852056 22668 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:18:59.831204 22931 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:18:59.881280 19586 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:59.883968 19511 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:18:59.883219 20663 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
W20260709 13:18:59.887610 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 60129.5us
I20260709 13:18:59.888154 19506 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:59.901603 19657 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:18:59.918835 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:59.919911 19586 raft_consensus.cc:2410] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:18:59.925932 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 63966.7us
I20260709 13:18:59.881040 22888 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.932732 19625 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:18:59.934130 19508 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:18:59.939872 22968 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:59.904716 22318 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.954252 19476 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:59.962253 19476 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:18:59.963932 19476 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:18:59.955312 19508 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:59.966279 22968 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:59.966514 22666 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:59.970755 22982 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:59.971372 22982 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.971787 22982 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:59.974426 22977 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:18:59.935060 22952 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:18:59.986070 19661 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:18:59.988009 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:18:59.924515 22672 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.934664 22972 consensus_queue.cc:260] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:00.007128 22672 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:00.010388 22983 log.cc:927] Time spent T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:19:00.011898 22893 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:00.016673 19510 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:18:59.948791 22749 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:18:59.926982 22668 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:00.019034 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:00.017179 22684 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:00.019752 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:00.026336 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:00.028999 19510 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.030791 19659 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:00.032207 19476 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:00.033813 19508 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:00.041232 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:00.037742 19476 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:00.041989 19508 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:59.934484 22971 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:00.041970 22952 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:00.043187 22668 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:00.062876 22749 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:00.068041 22971 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:00.068626 22738 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:00.076673 19508 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
W20260709 13:19:00.077805 18419 debug-util.cc:398] Leaking SignalData structure 0x7b080000ff60 after lost signal to thread 19476
I20260709 13:19:00.078572 19476 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:00.086020 22985 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:19:00.059095 19509 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:19:00.046880 22684 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:00.096119 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:00.108897 19510 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
W20260709 13:19:00.118485 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.090588 22952 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:00.135589 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 57128.7us
I20260709 13:19:00.118006 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:00.127328 22585 raft_consensus.cc:3055] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:00.127478 22842 raft_consensus.cc:3055] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:00.131345 22888 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:00.137858 22585 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:00.142763 22585 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:00.144485 22585 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.146687 22917 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:00.138092 22842 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:00.150619 22842 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:00.151667 22842 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.153254 22952 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:00.155267 22923 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:00.150614 22814 raft_consensus.cc:993] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:19:00.156599 19506 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:19:00.156697 22814 raft_consensus.cc:1081] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:19:00.153378 22931 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:00.158133 22931 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:00.159155 22931 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:00.160342 22931 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:00.116037 22672 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:00.162863 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:00.165864 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 233219us
I20260709 13:19:00.166059 22839 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:00.166842 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2341) took 2456 ms. Trace:
I20260709 13:19:00.167583 19625 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:00.167965 22318 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:00.168728 19625 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:00.168919 19587 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:00.171342 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 211287us
I20260709 13:19:00.172101 19625 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:00.167220 19504 rpcz_store.cc:276] 0709 13:18:57.710014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.181482 (+471468us) service_pool.cc:224] Handling call
0709 13:18:58.181885 (+   403us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:59.103551 (+921666us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:59.246458 (+142907us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.488146 (+241688us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.488313 (+   167us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:59.545649 (+ 57336us) log.cc:844] Serialized 52 byte log entry
0709 13:18:59.545889 (+   240us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:59.546161 (+   272us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.546348 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.546459 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.050034 (+503575us) spinlock_profiling.cc:243] Waited 7.3 ms on lock 0x7b18002bb820. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:19:00.150129 (+100095us) spinlock_profiling.cc:243] Waited 9.8 ms on lock 0x7b18002bb820. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d522 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:19:00.158094 (+  7965us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b18002bb820. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e63b2a6 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1
0709 13:19:00.158678 (+   584us) spinlock_profiling.cc:243] Waited 9.9 ms on lock 0x7b18002bb820. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:19:00.166648 (+  7970us) raft_consensus.cc:1685] finished
0709 13:19:00.166668 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.166792 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":921394,"prepare.queue_time_us":770464,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":113,"raft.queue_time_us":1080955,"raft.run_cpu_time_us":612,"raft.run_wall_time_us":39928,"spinlock_wait_cycles":69467136,"thread_start_us":361205,"threads_started":2,"wal-append.queue_time_us":270540}
I20260709 13:19:00.137147 19503 raft_consensus.cc:2410] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 11 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:00.177836 22814 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:00.178022 22813 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:00.178804 22871 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:19:00.186005 22979 consensus_queue.cc:1059] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:19:00.186379 22873 raft_consensus.cc:3055] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:00.186614 22976 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:00.187129 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:00.178597 22897 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:00.190387 22839 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:00.196667 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:00.198212 19506 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:00.198597 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:00.199308 19512 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:00.199491 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:00.200279 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:00.200913 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:00.201373 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.205507 22873 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:00.218614 22873 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:00.219822 22873 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.182683 22982 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:00.206970 22814 raft_consensus.cc:3055] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:00.222327 19511 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:00.209097 19509 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:00.226637 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:00.208874 22839 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:00.222106 22814 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:00.231478 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:00.231290 22814 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:00.210052 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:00.232724 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:00.233295 19506 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:00.210284 19504 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:00.236881 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:00.237460 19654 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.211067 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:00.211474 19510 raft_consensus.cc:2393] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 8: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:00.238916 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:00.244932 19653 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:00.214368 19508 raft_consensus.cc:2410] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:19:00.214648 19507 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.255463 19625 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:00.258102 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.214964 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:00.270459 19504 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:00.278476 19476 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:00.205282 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:00.315776 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.320223 19406 catalog_manager.cc:5697] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 6 to 9, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 9 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:19:00.334053 19653 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:19:00.286669 22897 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:00.356916 19654 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:00.449744 19660 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:00.449427 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 194108us
I20260709 13:19:00.403319 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:00.461341 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:00.463800 19661 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:19:00.444115 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 238933us
I20260709 13:19:00.467275 19509 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:00.456233 19655 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
W20260709 13:19:00.454299 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 175934us
W20260709 13:19:00.448676 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.470206 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:00.473763 19653 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:00.401888 22939 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:00.481163 19508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:19:00.481917 19508 raft_consensus.cc:606] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:00.482304 19508 raft_consensus.cc:614] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:00.455998 22972 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.456303 22982 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:00.455726 22940 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:00.455886 22814 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.461724 22668 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.501246 19587 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:19:00.502307 19476 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:00.471392 22871 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.471626 22842 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.504983 19627 leader_election.cc:400] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10.
I20260709 13:19:00.528716 19627 leader_election.cc:403] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:19:00.509162 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.509692 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:00.504179 19625 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:00.455452 22839 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:00.518190 19578 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:00.523058 19581 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:19:00.529676 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.499261 22961 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:00.543015 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:00.557097 19580 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:00.515004 19585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60800
I20260709 13:19:00.560715 19585 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:00.561221 19585 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:00.562419 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.533324 22982 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:00.529649 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:00.555251 22923 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10.
W20260709 13:19:00.576995 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.550956 22275 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:00.557648 22286 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:00.589442 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.590087 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.594535 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:00.537446 22842 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:00.598250 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.534818 22668 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:00.565409 22940 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.565603 22980 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:00.600157 19476 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:00.537860 22871 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:00.612095 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:00.621855 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:00.617475 20661 raft_consensus.cc:2393] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
W20260709 13:19:00.659224 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 59179.1us
I20260709 13:19:00.663043 19478 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:00.672287 19476 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
W20260709 13:19:00.674556 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 52790us
I20260709 13:19:00.663966 22982 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:00.659341 22962 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:00.665900 22849 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:00.703086 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:00.672009 22952 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:00.688803 22673 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:00.711347 19476 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:00.699060 19478 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:00.701412 22982 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.731133 19507 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:00.732926 22842 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:00.660687 22940 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:00.740989 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 163444us
W20260709 13:19:00.719636 22318 consensus_meta.cc:287] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.004s
I20260709 13:19:00.713217 22952 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:00.715447 22673 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:00.753137 19503 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:00.721736 22962 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:00.749418 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:00.738047 22982 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.735842 22961 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:00.764902 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:00.754793 22952 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:00.756729 22673 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:00.746932 22286 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:19:00.742556 22849 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:19:00.787922 19627 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:00.764618 22822 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:00.794732 22822 raft_consensus.cc:697] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:00.796186 22822 consensus_queue.cc:237] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:00.797155 22923 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:00.797845 22923 raft_consensus.cc:697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:00.798733 22923 consensus_queue.cc:237] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:00.801941 22976 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:00.748539 22980 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:19:00.748790 22941 consensus_queue.cc:1059] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:19:00.794638 22979 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:00.792227 22961 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:00.783089 22585 consensus_meta.cc:287] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.638s	user 0.016s	sys 0.000s
I20260709 13:19:00.808430 19585 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:00.828336 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 414086us
I20260709 13:19:00.803232 22672 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:00.844105 19585 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:00.850340 22940 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:19:00.851015 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 296300us
I20260709 13:19:00.852015 19625 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:00.832129 22668 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:00.835353 22871 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:00.856068 22873 consensus_meta.cc:287] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.636s	user 0.009s	sys 0.000s
I20260709 13:19:00.860517 22982 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:00.862002 23012 log.cc:927] Time spent T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 13:19:00.863195 23006 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:19:00.865646 23003 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.345s	user 0.002s	sys 0.000s
W20260709 13:19:00.870198 23002 log.cc:927] Time spent T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.420s	user 0.001s	sys 0.004s
I20260709 13:19:00.872005 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2163) took 1664 ms. Trace:
I20260709 13:19:00.873487 22940 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.874104 22940 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:00.876173 22940 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:00.872517 19583 rpcz_store.cc:276] 0709 13:18:59.207655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.208236 (+   581us) service_pool.cc:224] Handling call
0709 13:19:00.052228 (+843992us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:19:00.052419 (+   191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.052811 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.052846 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:00.053331 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:19:00.179017 (+125686us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:00.179055 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.179125 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.869297 (+690172us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:00.871692 (+  2395us) raft_consensus.cc:1685] finished
0709 13:19:00.871724 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.871930 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1594,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":20775,"spinlock_wait_cycles":32642560,"thread_start_us":125288,"threads_started":1,"wal-append.queue_time_us":231910}
I20260709 13:19:00.883342 22678 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:00.885388 19625 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:00.954957 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 69798.6us
I20260709 13:19:00.956166 19625 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:00.959765 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 113106us
W20260709 13:19:00.976962 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 265695us
I20260709 13:19:00.959631 22585 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:00.959190 22852 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:00.977669 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 212841us
W20260709 13:19:00.974341 23008 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.088s	user 0.001s	sys 0.005s
W20260709 13:19:00.968379 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.979306 23015 log.cc:927] Time spent T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:19:00.975600 22397 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:00.987353 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 195206us
I20260709 13:19:00.990172 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:00.991201 22286 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:00.991783 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:00.992591 22286 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:00.993000 22286 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:00.993347 22286 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:01.000339 19476 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:01.014587 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:01.027139 19551 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:01.032214 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:01.033044 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:01.040442 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:01.041371 19583 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
W20260709 13:19:01.056145 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 70062.6us
I20260709 13:19:01.013013 22940 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:01.063149 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:01.063993 19504 raft_consensus.cc:2368] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10.
I20260709 13:19:01.065340 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:01.067317 19476 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:01.080329 19507 raft_consensus.cc:1275] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:01.081684 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.084501 19507 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:01.024580 22961 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:01.089196 19506 raft_consensus.cc:2368] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11.
I20260709 13:19:01.089643 22822 consensus_queue.cc:1059] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:01.051214 22849 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:01.097721 23000 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.697s	user 0.006s	sys 0.000s
I20260709 13:19:01.097965 23031 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:01.114619 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 47386us
I20260709 13:19:01.102697 22972 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.115376 22972 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.115958 19476 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:01.116731 22971 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:01.023962 22839 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:19:00.984097 22852 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:01.107673 19510 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:01.138751 19511 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:19:01.108610 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:01.090150 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1854) took 1260 ms. Trace:
W20260709 13:19:01.105926 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 72947us
W20260709 13:19:01.105309 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 54358.3us
I20260709 13:19:01.051067 22897 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:01.102355 23026 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:01.030162 22941 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:19:01.139874 19656 rpcz_store.cc:276] 0709 13:18:59.830199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.830381 (+   182us) service_pool.cc:224] Handling call
0709 13:18:59.847571 (+ 17190us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:59.862019 (+ 14448us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:00.149072 (+287053us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b180042d000. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e5e7c0a 00007f6c37d27219 00007f6c3562e58f 00007f6c2e66d571 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd
0709 13:19:00.286440 (+137368us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b180042d000. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e5e7c0a 00007f6c37d27219 00007f6c2e66fa40 00007f6c2e66a4e4 00007f6c2e66a455 00007f6c351523c7 00007f6c317649a7 00007f6c317740bf 00007f6c31774038
0709 13:19:00.524421 (+237981us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.801735 (+277314us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:00.802315 (+   580us) log.cc:844] Serialized 52 byte log entry
0709 13:19:00.802491 (+   176us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:00.802532 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.802599 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:01.089916 (+287317us) raft_consensus.cc:1685] finished
0709 13:19:01.089937 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.090074 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21650,"prepare.queue_time_us":592004,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":28526,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":11991,"spinlock_wait_cycles":8758400,"thread_start_us":416285,"threads_started":2,"wal-append.queue_time_us":327660}
I20260709 13:19:01.101537 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:01.160179 19508 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:19:01.156304 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 189874us
I20260709 13:19:01.127408 19503 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:01.139211 19511 pending_rounds.cc:85] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 5
I20260709 13:19:01.160845 19511 pending_rounds.cc:107] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:19:01.161162 19511 raft_consensus.cc:2889] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:01.108171 23025 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.118002 22940 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:01.174271 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1778) took 1160 ms. Trace:
I20260709 13:19:01.126188 22814 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.183396 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:01.173646 19580 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:01.170928 19657 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:01.176918 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:01.188597 19661 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:19:01.177639 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:01.189913 19659 raft_consensus.cc:3055] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:01.190343 19659 raft_consensus.cc:740] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:01.176507 19505 rpcz_store.cc:276] 0709 13:19:00.013433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.017117 (+  3684us) service_pool.cc:224] Handling call
0709 13:19:00.017491 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.027207 (+  9716us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:00.352157 (+324950us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.765490 (+413333us) log.cc:844] Serialized 14 byte log entry
0709 13:19:01.045369 (+279879us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b1800359380. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66a455 00007f6c31752060 00007f6c31764716 00007f6c31775287 00007f6c31775208
0709 13:19:01.173876 (+128507us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:01.173935 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:01.174009 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.174079 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.174206 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21652,"prepare.queue_time_us":23892,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":88,"raft.queue_time_us":91736,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":21976,"spinlock_wait_cycles":9171584,"thread_start_us":771941,"threads_started":3,"wal-append.queue_time_us":518992}
I20260709 13:19:01.192003 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.192317 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.193022 19505 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:19:01.193974 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.194730 19505 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:01.159250 22849 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:01.205698 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:01.217635 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 101776us
I20260709 13:19:01.218132 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:01.219563 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:01.220376 19510 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:01.223088 19659 consensus_queue.cc:260] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.226293 19581 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:01.231925 19580 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:01.195248 22972 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:01.194561 22897 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:01.240259 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.204248 23026 raft_consensus.cc:697] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:01.246990 19476 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:01.254966 19625 leader_election.cc:400] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10.
I20260709 13:19:01.255441 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.256093 19510 raft_consensus.cc:2376] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13. Re-sending same reply.
I20260709 13:19:01.257083 19584 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:01.202253 22814 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:01.265653 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 164489us
I20260709 13:19:01.268541 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.269359 19503 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:19:01.271250 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.272315 22980 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.273056 22980 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.265789 22668 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:01.241540 23028 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.277705 19659 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:01.286343 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.293015 19627 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:01.252846 22678 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.298950 19625 leader_election.cc:400] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11.
I20260709 13:19:01.255241 22726 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.201061 23025 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.302260 19580 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:19:01.275303 22972 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:01.298589 23022 log.cc:927] Time spent T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:19:01.318567 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.309976 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:01.303727 19580 pending_rounds.cc:85] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 6
I20260709 13:19:01.322048 19580 pending_rounds.cc:107] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:19:01.322451 19580 raft_consensus.cc:2889] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:01.299973 23028 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.330157 23037 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.330840 22814 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:01.330765 23037 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:01.331503 22814 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:01.331710 23028 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:01.335328 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 97688.6us
I20260709 13:19:01.297498 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:01.338045 19659 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:01.333199 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.332476 23026 consensus_queue.cc:237] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:01.333119 23037 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:01.368435 23037 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:01.292497 23023 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:19:01.369225 23037 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.370751 23023 raft_consensus.cc:3055] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:01.371335 23023 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:01.372287 23037 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:01.245918 22961 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.348868 19511 raft_consensus.cc:2376] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11. Re-sending same reply.
I20260709 13:19:01.305387 23031 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:01.374722 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.375597 19511 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:19:01.375232 23031 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.376643 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:01.357956 20619 leader_election.cc:336] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Timed out: RequestConsensusVote RPC to 127.17.251.129:38645 timed out after 1.868s (SENT)
I20260709 13:19:01.377882 20619 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:01.379453 20619 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.129:38645 timed out after 1.881s (SENT) [suppressed 28 similar messages]
I20260709 13:19:01.382778 22852 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:01.383610 22852 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:01.344678 20661 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:19:01.306572 23014 consensus_queue.cc:1048] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:19:01.387486 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:01.331910 22814 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.392459 22814 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:01.395860 23039 log.cc:927] Time spent T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:19:01.366035 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.377331 19511 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:19:01.397261 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:01.305694 22937 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:19:01.397560 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.398159 19511 raft_consensus.cc:2410] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:19:01.398298 19503 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:01.399034 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.399376 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.400096 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:01.400225 19503 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:19:01.400915 19657 raft_consensus.cc:2410] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:01.401382 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:01.402387 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:01.403194 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:01.403870 22980 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:01.326337 22726 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.399681 19511 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
W20260709 13:19:01.340931 22673 consensus_meta.cc:287] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.005s
W20260709 13:19:01.405880 20619 leader_election.cc:336] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Timed out: RequestConsensusVote RPC to 127.17.251.129:38645 timed out after 1.663s (SENT)
I20260709 13:19:01.402711 19661 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:01.406317 22726 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:01.404067 19652 raft_consensus.cc:2410] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:01.402755 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:01.342533 22897 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.411734 19510 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:19:01.413173 20619 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:01.405521 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.414042 19511 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
W20260709 13:19:01.414690 22952 consensus_meta.cc:287] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.000s
I20260709 13:19:01.372563 23023 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.414973 22852 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:01.415110 22952 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.415530 19511 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:19:01.416009 19511 pending_rounds.cc:85] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 4
I20260709 13:19:01.416275 19511 pending_rounds.cc:107] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:19:01.416499 19511 raft_consensus.cc:2889] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:01.304368 22678 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.416035 23023 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:01.419474 22678 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:01.420877 22888 raft_consensus.cc:3055] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:01.406045 22673 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.421285 22888 raft_consensus.cc:740] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:01.422561 19510 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:01.422284 22888 consensus_queue.cc:260] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.423161 22673 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:01.423347 22888 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:01.425838 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:01.426779 19503 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:01.402400 19656 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:19:01.430169 19653 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
W20260709 13:19:01.432617 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.432646 19658 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:19:01.417405 22952 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:01.304535 22849 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:01.450392 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.450284 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:01.453299 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:01.456051 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:01.471354 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:01.474270 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:01.469652 19653 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 11: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:19:01.470849 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 171016us
I20260709 13:19:01.466506 22971 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:01.487329 19503 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:01.499645 19656 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:01.500283 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:01.487334 22678 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:01.502135 19503 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:01.502591 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 209633us
I20260709 13:19:01.495946 22972 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:01.510597 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:01.490187 22940 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:01.514823 19656 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:01.523253 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:01.526086 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:01.478024 22941 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:19:01.503114 23037 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:01.495641 22672 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:19:01.534032 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:01.541137 19584 raft_consensus.cc:2410] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:19:01.534363 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:01.512528 23042 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:01.537889 19580 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:01.539120 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:01.535698 19585 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:01.541671 19656 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:01.541862 19581 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:19:01.543632 23037 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.551857 23037 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:01.544276 23036 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:01.530079 23051 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:01.572477 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:01.518071 22972 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.556511 23031 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:01.600942 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 46755.6us
I20260709 13:19:01.630609 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:01.544008 22839 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 13:19:01.584192 23046 log.cc:927] Time spent T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:19:01.651738 23048 log.cc:927] Time spent T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:19:01.632679 23002 log.cc:927] Time spent T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:19:01.639055 22286 consensus_meta.cc:287] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.001s
I20260709 13:19:01.653983 22286 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.655979 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:01.633927 23045 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:19:01.656522 22286 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:01.656932 19509 raft_consensus.cc:2393] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 8: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:01.657301 19587 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:01.638928 22940 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.660847 19658 raft_consensus.cc:1240] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:01.661010 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.662858 19511 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 10.
I20260709 13:19:01.669816 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:01.590610 23036 raft_consensus.cc:697] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:01.671468 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:01.653010 22814 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.636914 23031 raft_consensus.cc:697] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:01.689898 23031 consensus_queue.cc:237] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.675164 19658 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:01.679827 22814 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:01.682538 19660 raft_consensus.cc:2368] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12.
I20260709 13:19:01.686199 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.688133 22972 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:01.699983 19583 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:01.702280 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:01.703030 19583 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:01.713999 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:01.714344 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:01.714898 19658 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:01.726190 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:01.727432 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:01.728204 19510 raft_consensus.cc:2393] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 8: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:01.731755 19509 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 9.
I20260709 13:19:01.745252 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.746265 19510 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 10.
I20260709 13:19:01.754827 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:01.757181 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.761689 19658 raft_consensus.cc:2410] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:01.741040 22814 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:01.765143 19656 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:01.766860 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:01.768463 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:01.769073 19510 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 10.
I20260709 13:19:01.741173 23028 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:19:01.773077 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.774233 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:01.764904 22814 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.762543 22871 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:19:01.810408 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:01.810739 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:01.811937 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:01.813331 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:01.814002 19654 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:01.816196 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:01.816272 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:01.816808 19653 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:01.817327 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:01.817536 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:01.819536 19583 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:01.788648 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:01.793918 23021 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:01.794242 23063 consensus_queue.cc:1059] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:19:01.822746 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:01.820628 19658 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:19:01.823450 19584 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:19:01.825350 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:01.827504 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:01.828112 19583 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:01.832309 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:01.833184 19657 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:19:01.833963 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:01.834744 19661 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:01.838214 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:01.838881 20661 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
W20260709 13:19:01.839151 23067 log.cc:927] Time spent T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:19:01.840385 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:19:01.841212 23068 log.cc:927] Time spent T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:19:01.840415 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:01.785264 22814 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:01.843292 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:01.844820 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:01.837401 19654 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:19:01.832309 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:01.847299 19587 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:19:01.848493 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:01.849104 19582 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:19:01.850328 19583 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:01.851575 19476 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:01.852136 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:01.854789 22672 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:01.855268 19476 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:01.855283 22672 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.856606 22672 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:01.857805 22972 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:01.857967 23057 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:01.859107 22962 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:01.859731 22962 raft_consensus.cc:697] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:01.860610 22962 consensus_queue.cc:237] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.863049 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:01.861347 19478 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:01.870669 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:01.873224 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 82771.4us
I20260709 13:19:01.876067 23066 raft_consensus.cc:3055] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:01.878607 23037 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:01.879208 23037 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.879557 23037 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:01.822980 22937 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:19:01.881521 19476 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:01.875231 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:01.886826 19476 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:01.893479 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:01.895597 19659 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:01.878662 23066 raft_consensus.cc:740] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:01.876685 22972 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:01.864413 23023 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:19:01.918500 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.874648 22982 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:01.883200 23072 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:19:01.775296 23036 consensus_queue.cc:237] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.885429 22673 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:01.887779 23063 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.887814 22897 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:01.890215 22952 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:01.889923 22813 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:01.897250 22668 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:01.900221 23019 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:01.957194 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 55414.8us
I20260709 13:19:01.965764 19627 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:01.964365 22952 raft_consensus.cc:697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:01.957960 22813 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.958765 23057 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:01.970570 22952 consensus_queue.cc:237] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.967429 23075 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:01.973209 23066 consensus_queue.cc:260] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.973786 23065 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:01.974726 23064 log.cc:927] Time spent T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:19:01.958448 22972 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:01.959064 23042 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:01.996289 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 109533us
I20260709 13:19:01.958578 23063 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:01.995556 23075 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:02.026229 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:02.026918 19654 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:02.027859 19652 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:02.034678 22672 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:02.012814 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 47145.4us
I20260709 13:19:01.965982 22668 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:02.016551 19661 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:02.022193 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:02.050982 19657 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:02.051548 19510 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:19:02.040638 22672 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:02.040702 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:02.053184 20661 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:02.053352 19510 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:19:02.054796 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:02.025250 19476 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:02.044656 19625 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:02.045920 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.058585 19508 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:02.059896 23023 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.064644 19652 raft_consensus.cc:2410] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:02.065863 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:02.001684 23065 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:02.109405 19512 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:02.048281 23066 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:02.111495 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 66965.5us
I20260709 13:19:02.110386 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:02.112938 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:02.117063 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:02.161070 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:02.060427 23023 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:02.172019 23023 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:02.172674 19503 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:02.156142 22939 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.191385 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.195819 23013 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:02.169221 22672 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.197095 23078 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.196667 22672 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:02.197650 23078 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:02.199571 23049 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:02.200099 23049 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:02.200770 20661 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:02.202271 23049 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:02.193562 23050 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.221856 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 64154.1us
W20260709 13:19:02.223656 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 213355us
I20260709 13:19:02.214102 23065 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:02.252415 19476 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:02.203876 22939 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:02.267282 19625 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:02.185503 22972 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:02.279065 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:02.280285 19476 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:02.267241 22897 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:02.282591 22897 consensus_queue.cc:1059] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:02.283700 22897 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:02.284399 22897 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:02.284957 22897 raft_consensus.cc:3055] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:02.287830 22673 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:02.288271 22673 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:02.186305 23082 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:19:02.243690 23049 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:19:02.301337 23063 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:02.310532 23037 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:02.289013 22673 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:02.312021 22673 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:02.312777 23037 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:02.314388 22939 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:02.243646 23050 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:02.285252 22897 raft_consensus.cc:740] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:02.316402 22897 consensus_queue.cc:260] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:02.326092 22897 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:03.335867 19441 debug-util.cc:398] Leaking SignalData structure 0x7b08002aa740 after lost signal to thread 18414
W20260709 13:19:03.336431 19441 debug-util.cc:398] Leaking SignalData structure 0x7b08002cb500 after lost signal to thread 18417
W20260709 13:19:03.866720 19626 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.700s	user 0.035s	sys 0.009s
W20260709 13:19:03.867347 19626 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.701s	user 0.036s	sys 0.010s
I20260709 13:19:03.869403 23027 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:03.870097 23027 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:03.871099 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1914) took 2020 ms. Trace:
I20260709 13:19:03.871445 19582 rpcz_store.cc:276] 0709 13:19:01.850268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.850433 (+   165us) service_pool.cc:224] Handling call
0709 13:19:01.867047 (+ 16614us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:01.867473 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:01.867507 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:01.870792 (+  3285us) log.cc:844] Serialized 26 byte log entry
0709 13:19:01.958338 (+ 87546us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:01.958386 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.958453 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:02.994936 (+1036483us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b240009a4d8. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e4f39c4 00007f6c2e4f1acb 00007f6c2e6acdc9 00007f6c2e6aca55 00007f6c2e6abfb0 00007f6c31322488 00007f6c31322be8 00007f6c312fa398 00007f6c312f576a 00007f6c312f4bb6
0709 13:19:03.870786 (+875850us) raft_consensus.cc:1685] finished
0709 13:19:03.870803 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.871047 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1556,"raft.queue_time_us":125,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":6663,"spinlock_wait_cycles":16063232,"thread_start_us":69373,"threads_started":1,"wal-append.queue_time_us":91568}
I20260709 13:19:03.872424 23027 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:02.258694 23014 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 1.624s
W20260709 13:19:03.883350 22972 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.602s	user 0.011s	sys 0.006s
W20260709 13:19:03.883795 22972 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.603s	user 0.011s	sys 0.006s
I20260709 13:19:03.913291 23078 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:03.917461 19652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1918) took 2107 ms (client timeout 2186 ms). Trace:
W20260709 13:19:03.917963 19652 rpcz_store.cc:269] 0709 13:19:01.810351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.810479 (+   128us) service_pool.cc:224] Handling call
0709 13:19:03.917228 (+2106749us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54002c88d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:03.917373 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498146176}
W20260709 13:19:03.922314 22962 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.717s	user 0.014s	sys 0.020s
W20260709 13:19:03.923033 22962 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.718s	user 0.014s	sys 0.020s
I20260709 13:19:03.929409 23019 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.930275 23019 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:02.259267 23057 consensus_queue.cc:1059] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 1.672s
I20260709 13:19:03.932410 23057 raft_consensus.cc:3055] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:03.932753 23057 raft_consensus.cc:740] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:03.933405 23057 consensus_queue.cc:260] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:02.281375 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:03.934442 23057 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:03.936321 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:03.937661 23019 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:03.938323 23019 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:03.938925 23019 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:03.939550 22961 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:03.941049 22962 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:19:03.942090 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 1.66069e+06us
I20260709 13:19:03.942407 23019 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:03.944041 19476 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:03.944929 22971 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:03.945389 19476 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:03.946305 22971 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:03.946714 22971 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:03.947093 22971 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:03.937508 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:03.953342 22961 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:03.953815 22961 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:03.954197 22961 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:03.956940 22971 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:03.961001 22971 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:03.958441 19476 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:03.962427 19476 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:03.963248 22962 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:03.963948 22962 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:03.965119 19476 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:03.965739 23065 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:03.965934 22962 raft_consensus.cc:2764] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:03.966310 23065 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:03.966216 23028 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:03.968924 23028 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:03.969400 22952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.960s	user 0.019s	sys 0.025s
W20260709 13:19:03.969923 22952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.961s	user 0.020s	sys 0.025s
I20260709 13:19:03.970021 23065 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:03.971374 23028 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:03.973268 23027 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:03.973419 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:03.973843 23027 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:03.974481 22813 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:03.975114 22813 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.975842 23027 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:03.975692 22813 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:03.978299 23042 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:03.983093 23065 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.983481 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1825) took 1959 ms. Trace:
I20260709 13:19:03.975041 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:03.983703 23065 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:03.983927 19511 rpcz_store.cc:276] 0709 13:19:02.023896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.024230 (+   334us) service_pool.cc:224] Handling call
0709 13:19:02.060735 (+ 36505us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:02.061101 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.061126 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:02.065472 (+  4346us) log.cc:844] Serialized 52 byte log entry
0709 13:19:02.276453 (+210981us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:02.276526 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.276629 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:03.983178 (+1706549us) raft_consensus.cc:1685] finished
0709 13:19:03.983204 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.983407 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5879,"raft.queue_time_us":508,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":47785,"thread_start_us":92475,"threads_started":1,"wal-append.queue_time_us":194230,"wal-append.run_cpu_time_us":2472,"wal-append.run_wall_time_us":1002496}
I20260709 13:19:03.986404 23027 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.989140 22842 raft_consensus.cc:3055] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:03.989576 22842 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:03.990394 22842 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:03.991313 22842 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:03.992838 23042 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:03.986984 23027 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:04.001176 22897 consensus_meta.cc:287] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 1.674s	user 0.021s	sys 0.002s
I20260709 13:19:04.002350 19406 catalog_manager.cc:5697] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 9 to 10, leader changed from 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 10 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:19:04.004194 22961 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.004904 23027 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:04.001902 23019 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:03.985793 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:04.005702 23019 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:04.006548 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:04.007517 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:04.008363 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:04.002880 23065 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:04.011960 23019 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.013144 22842 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:04.018189 22842 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:04.016069 22961 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.019778 22961 raft_consensus.cc:2764] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:19:04.017000 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51952.7us
I20260709 13:19:04.015763 22813 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:04.021153 19476 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:04.019012 19551 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:04.022529 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:04.023171 23057 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:04.023695 23057 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:04.024151 23057 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.027878 22842 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:04.027976 22672 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.028796 22842 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:04.029201 22842 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.029567 22842 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.032116 23057 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.035151 23017 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:04.035696 23017 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:04.036839 23057 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.036545 23017 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.037886 22813 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.038902 19508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.870s	user 0.028s	sys 0.039s
W20260709 13:19:04.039999 19508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.872s	user 0.028s	sys 0.040s
I20260709 13:19:04.040019 22961 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:04.034647 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:04.043197 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:04.040135 19476 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:04.045526 22672 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:04.046536 22672 raft_consensus.cc:697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:04.048117 22672 consensus_queue.cc:237] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.043211 23075 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:04.050431 19625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.782s	user 0.023s	sys 0.019s
W20260709 13:19:04.051010 19625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.783s	user 0.023s	sys 0.019s
W20260709 13:19:04.051564 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 1.78431e+06us
W20260709 13:19:04.052090 23066 consensus_meta.cc:287] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 1.890s	user 0.006s	sys 0.014s
I20260709 13:19:04.052254 19625 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:04.052735 19476 leader_election.cc:400] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12.
I20260709 13:19:04.053049 22668 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.044183 23057 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:19:04.053438 19625 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:04.054092 23057 consensus_queue.cc:1243] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:04.054459 23075 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:04.055106 23075 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:04.055681 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:19:04.056697 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:04.058208 23065 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:04.058651 23014 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:04.058779 23065 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.038589 22813 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.061070 23065 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:04.068050 23083 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 1.899s	user 0.007s	sys 0.008s
I20260709 13:19:04.072027 22813 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:04.074040 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2380) took 2010 ms. Trace:
W20260709 13:19:04.069509 22814 consensus_meta.cc:287] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 2.213s	user 0.014s	sys 0.013s
I20260709 13:19:04.074472 19512 rpcz_store.cc:276] 0709 13:19:02.063140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.155978 (+ 92838us) service_pool.cc:224] Handling call
0709 13:19:02.166170 (+ 10192us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.174174 (+  8004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.174223 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:02.195522 (+ 21299us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.038078 (+1842556us) spinlock_profiling.cc:243] Waited 9.35 ms on lock 0x7b18003f9520. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa0d1 00007f6c31715a0f
0709 13:19:04.073555 (+ 35477us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:04.073599 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.073705 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.073755 (+    50us) raft_consensus.cc:1685] finished
0709 13:19:04.073769 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.073979 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1719,"raft.queue_time_us":7909,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":9675,"spinlock_wait_cycles":21505920,"thread_start_us":35269,"threads_started":1,"wal-append.queue_time_us":1854604}
I20260709 13:19:04.076057 22814 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.077459 22842 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:04.078336 22814 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:04.080960 22842 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:04.081830 22842 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:04.082240 22842 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:04.082690 22842 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:04.083458 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.084081 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.085364 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.085819 22813 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.098117 22813 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:04.099079 19504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.039s	user 0.009s	sys 0.018s
W20260709 13:19:04.099612 19504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.039s	user 0.009s	sys 0.018s
I20260709 13:19:04.100440 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2375) took 2042 ms. Trace:
I20260709 13:19:04.100558 22813 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:04.086464 22814 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.101961 22814 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.089521 19656 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:04.087025 22976 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.103058 22976 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.105136 22976 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:04.106464 23112 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:04.106989 22814 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:04.092633 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:19:04.102352 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.100798 19504 rpcz_store.cc:276] 0709 13:19:02.058325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.059464 (+  1139us) service_pool.cc:224] Handling call
0709 13:19:02.059724 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.059950 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:02.060171 (+   221us) log.cc:844] Serialized 14 byte log entry
0709 13:19:04.100063 (+2039892us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:04.100123 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:04.100171 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.100242 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.100381 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":593,"prepare.run_cpu_time_us":12764,"prepare.run_wall_time_us":43239,"thread_start_us":2039558,"threads_started":1,"wal-append.queue_time_us":318312,"wal-append.run_cpu_time_us":1386,"wal-append.run_wall_time_us":1001404}
I20260709 13:19:04.109514 22842 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.117471 23023 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:04.111105 23112 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:04.111248 22952 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.118924 22842 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.118724 22952 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.119516 22842 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:04.119118 23112 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.111022 23113 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.120409 23113 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.120863 19503 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:19:04.043751 22961 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:04.122154 22961 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:04.122464 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.123241 19503 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:04.113216 22897 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:04.124962 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.127204 22897 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.128545 19504 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:04.113466 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.113754 23078 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.132296 22897 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.132438 23078 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.135278 23078 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.113088 23025 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.113795 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.122607 22961 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:04.131441 23042 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.140580 19507 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:19:04.136968 19506 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:19:04.147615 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 55064us
I20260709 13:19:04.094401 23110 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:04.163226 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.164135 19509 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:04.167395 22940 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:04.168092 22940 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.168509 22940 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:04.159734 23114 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.139837 22678 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.172668 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.113854 22972 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:04.116446 22962 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:04.176235 19506 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:04.188463 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.112635 22668 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:04.136489 22971 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:04.196159 19509 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.198352 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:04.165858 23110 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:04.199142 19587 raft_consensus.cc:2393] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:04.200322 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.139662 22842 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:04.186391 19476 connection.cc:256] RPC call timeout handler was delayed by -1.3223767599999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 13:19:04.173087 23078 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:04.210597 19509 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:04.175542 22897 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:04.205204 19506 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:04.207906 23113 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.190213 23114 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.203213 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.186347 23025 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:04.211867 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.214082 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.199290 22672 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.201949 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 72525.3us
I20260709 13:19:04.223652 19506 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
W20260709 13:19:04.223726 19658 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.021s	user 0.007s	sys 0.019s
W20260709 13:19:04.227538 19658 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.025s	user 0.007s	sys 0.019s
I20260709 13:19:04.227626 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.191078 22678 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.228811 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.206764 23110 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.208726 23111 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:19:04.234225 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1875) took 2211 ms. Trace:
I20260709 13:19:04.197268 22972 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.196334 22962 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.235798 19658 rpcz_store.cc:276] 0709 13:19:02.016617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.016784 (+   167us) service_pool.cc:224] Handling call
0709 13:19:02.042508 (+ 25724us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.111112 (+ 68604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.111143 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:02.156760 (+ 45617us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.228039 (+2071279us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:04.228079 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.228161 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.228218 (+    57us) raft_consensus.cc:1685] finished
0709 13:19:04.228229 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.228349 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77707,"raft.queue_time_us":69032,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":45958,"thread_start_us":2025027,"threads_started":1,"wal-append.queue_time_us":1098571}
I20260709 13:19:04.204617 22668 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.239178 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2383) took 2175 ms. Trace:
I20260709 13:19:04.229172 22672 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.246747 23037 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.245894 19508 rpcz_store.cc:276] 0709 13:19:02.063814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.165993 (+102179us) service_pool.cc:224] Handling call
0709 13:19:02.166242 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.057675 (+1891433us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:04.058152 (+   477us) log.cc:844] Serialized 14 byte log entry
0709 13:19:04.116613 (+ 58461us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.117089 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.117255 (+   166us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:04.117290 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.138480 (+ 21190us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.238870 (+100390us) raft_consensus.cc:1685] finished
0709 13:19:04.238904 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.239099 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9121,"prepare.queue_time_us":113358,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":51149,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":19703,"thread_start_us":1930055,"threads_started":2,"wal-append.queue_time_us":37698}
I20260709 13:19:04.247229 23037 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.247762 22672 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.214479 23078 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.247988 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.248306 22672 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.248845 19508 raft_consensus.cc:2410] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:04.248788 22672 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.239847 22952 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.249593 23078 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.250259 23078 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.249198 23037 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.250721 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:04.251387 19507 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:04.247488 22668 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.242564 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.262812 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.263258 19511 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:04.263428 19508 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:04.264106 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.206116 22971 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:04.250728 23078 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:04.286152 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 137604us
W20260709 13:19:04.286572 19656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1915) took 2520 ms (client timeout 1540 ms). Trace:
W20260709 13:19:04.286942 19656 rpcz_store.cc:269] 0709 13:19:01.766481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.766596 (+   115us) service_pool.cc:224] Handling call
0709 13:19:04.286358 (+2519762us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b54001ecb54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:04.286497 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5337590656}
I20260709 13:19:04.227596 23114 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.233451 22814 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.255023 19509 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:04.226359 22897 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.264645 19511 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:19:04.268149 22962 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.268863 19506 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:04.271065 22678 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:04.225158 23025 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:04.271204 22972 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:04.280429 19475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.124s	user 0.025s	sys 0.026s
I20260709 13:19:04.282855 22672 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.272351 22940 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.284458 23042 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:04.287103 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:04.229542 22397 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:04.293838 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 82470.3us
W20260709 13:19:04.295974 19475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.139s	user 0.026s	sys 0.027s
I20260709 13:19:04.288482 22842 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.307451 23112 consensus_queue.cc:1059] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:04.307969 22897 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.308622 22842 raft_consensus.cc:3055] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:04.309007 22842 raft_consensus.cc:740] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:04.294262 22814 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.310590 19625 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:04.311668 19625 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:04.313829 19625 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:04.317741 19625 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:04.321372 19625 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:04.309955 23114 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:04.326120 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:04.309160 23110 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:04.329361 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.330336 19512 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:19:04.330747 19625 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:04.316756 22813 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:04.316191 22979 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:04.314684 22871 consensus_queue.cc:1059] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:19:04.328222 22931 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:19:04.322639 22976 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:04.344053 22976 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.336299 23121 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:04.344491 22976 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:04.337363 22888 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
W20260709 13:19:04.345439 22873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.039s	user 0.007s	sys 0.005s
W20260709 13:19:04.345813 22873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.040s	user 0.008s	sys 0.005s
I20260709 13:19:04.325270 23118 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.346999 23118 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.322405 22726 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:04.349833 22726 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:04.350219 22726 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:04.309924 22842 consensus_queue.cc:260] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.354771 22842 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.357738 23027 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:04.358417 23027 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.358814 23027 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:04.328053 22585 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:04.359314 22585 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:04.359853 22585 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:04.334113 23114 raft_consensus.cc:697] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:04.363042 23114 consensus_queue.cc:237] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.335767 22813 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:04.366343 22813 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:04.366739 19505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.164s	user 0.009s	sys 0.022s
I20260709 13:19:04.368919 23050 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:04.370059 23078 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:04.343575 23110 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:04.334986 22979 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.376797 22979 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:04.377163 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:04.325451 22672 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:04.377874 20663 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:04.378034 22672 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.378995 22871 raft_consensus.cc:3055] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:04.379383 22871 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:04.380173 22672 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.380232 22871 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:04.382537 23084 log.cc:927] Time spent T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 2.224s	user 0.009s	sys 0.007s
I20260709 13:19:04.382737 22814 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:04.342505 23025 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:04.343696 22940 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.395155 22961 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:04.396250 23032 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 3.056s	user 0.013s	sys 0.007s
I20260709 13:19:04.349521 23118 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.407377 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.408282 19507 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 9.
I20260709 13:19:04.408357 23075 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.409091 23075 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.410169 22672 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.410678 22672 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:04.411365 22673 consensus_meta.cc:287] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 2.099s	user 0.014s	sys 0.011s
I20260709 13:19:04.411790 23075 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:04.412103 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.412672 22672 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.412737 19509 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 10.
I20260709 13:19:04.413919 19508 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:04.334236 19625 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:04.419332 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:04.420014 19583 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 10.
I20260709 13:19:04.330044 22971 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:04.422413 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:04.423004 19506 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 8.
I20260709 13:19:04.381531 22871 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.426719 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:19:04.428740 19505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.226s	user 0.009s	sys 0.023s
I20260709 13:19:04.429991 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1826) took 2405 ms. Trace:
W20260709 13:19:04.430696 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 96370.1us
I20260709 13:19:04.397449 22961 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.430326 19505 rpcz_store.cc:276] 0709 13:19:02.024690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.024830 (+   140us) service_pool.cc:224] Handling call
0709 13:19:02.025272 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.061672 (+ 36400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.061700 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:02.116290 (+ 54590us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.429305 (+2313015us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:04.429343 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.429420 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.429456 (+    36us) raft_consensus.cc:1685] finished
0709 13:19:04.429467 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.429576 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35946,"raft.queue_time_us":84630,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":10963,"thread_start_us":2226814,"threads_started":1,"wal-append.queue_time_us":194480,"wal-append.run_cpu_time_us":1926,"wal-append.run_wall_time_us":1001950}
I20260709 13:19:04.431625 19625 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:04.421100 22976 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.431318 19627 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:04.442865 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:04.443830 19659 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:04.445009 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.446110 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:04.447189 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:04.447854 19661 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:04.441970 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.461395 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.464771 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.467299 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:04.467989 19659 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.470863 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.471662 19658 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:04.429890 22982 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:04.489795 22982 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.465591 23050 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:04.494093 23050 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.494557 23050 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:04.475996 19510 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.272s	user 0.024s	sys 0.008s
I20260709 13:19:04.476841 19652 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:04.477136 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.500553 19660 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 8.
I20260709 13:19:04.502689 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:04.504436 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 72878.9us
I20260709 13:19:04.505735 22678 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.506338 22678 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.508781 22678 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:04.508538 22979 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.509830 23014 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:04.510363 23028 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:04.510915 23028 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.511242 23028 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.510317 23014 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.513163 23014 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:04.513947 23034 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:04.514408 23034 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:04.514760 23034 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:04.482149 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.488373 22726 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.489113 22976 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:04.516212 19658 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:19:04.426301 22585 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.466568 19657 pending_rounds.cc:85] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 4
I20260709 13:19:04.518309 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.542171 19657 pending_rounds.cc:107] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:19:04.542233 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.542613 19657 raft_consensus.cc:2889] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:04.543340 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.534566 22672 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.535106 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.525544 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:04.478933 22275 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.549714 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.550163 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.533968 23127 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:04.519580 22971 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.463011 22814 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.509483 22678 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.478133 22397 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.536911 23027 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:04.556941 19441 debug-util.cc:398] Leaking SignalData structure 0x7b08002492c0 after lost signal to thread 19444
W20260709 13:19:04.565665 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 230637us
I20260709 13:19:04.566339 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.486483 19661 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
W20260709 13:19:04.571849 19510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.368s	user 0.024s	sys 0.009s
I20260709 13:19:04.576347 19659 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
W20260709 13:19:04.623596 19441 debug-util.cc:398] Leaking SignalData structure 0x7b0800220c00 after lost signal to thread 19536
W20260709 13:19:04.611135 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.624187 19441 debug-util.cc:398] Leaking SignalData structure 0x7b0800220bc0 after lost signal to thread 19537
I20260709 13:19:04.623582 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.624401 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.624770 19661 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:04.515924 22813 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.625028 19659 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
W20260709 13:19:04.597859 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.625937 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.627385 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.632194 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.565697 22673 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:04.633052 19661 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:04.634030 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.638834 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.648139 19655 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:04.649312 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.650835 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.652448 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.653141 19659 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:04.653362 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.654055 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:04.654949 19659 raft_consensus.cc:2410] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:04.655823 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:04.656919 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.657405 19659 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:19:04.657665 19504 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:04.658303 19659 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:04.659417 19659 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:19:04.638270 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 211615us
I20260709 13:19:04.664904 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:04.665098 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:04.665970 19503 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.662731 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:04.667234 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 161983us
I20260709 13:19:04.669103 19659 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:04.651559 19655 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:04.662890 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:04.672199 19508 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:04.663789 19504 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:04.673643 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:04.674233 19476 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:04.669411 19625 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:04.679443 19511 raft_consensus.cc:2393] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:04.624786 22931 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.666890 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:04.625411 22397 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.565060 22275 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.555219 22672 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.577390 22971 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.747001 19476 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:04.580484 22814 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.693797 23075 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:04.746065 22972 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:04.698426 22931 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.796844 19654 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:04.757835 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:04.578248 23127 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.762692 23113 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.623461 22678 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:04.764075 19441 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2180 after lost signal to thread 19611
I20260709 13:19:04.661677 22673 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:04.752996 20619 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:04.775740 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2379) took 2712 ms. Trace:
I20260709 13:19:04.795003 23019 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:04.776840 19508 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
W20260709 13:19:04.778470 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.747136 23129 log.cc:927] Time spent T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.084s	user 0.006s	sys 0.000s
I20260709 13:19:04.783900 19476 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:04.784860 19660 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:04.638605 23042 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:19:04.811019 19476 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:04.813251 20665 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:04.760385 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:04.748217 23135 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.749259 22726 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:04.802397 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:04.815585 19652 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.800987 19656 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:04.788771 23118 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:04.803752 19441 debug-util.cc:398] Leaking SignalData structure 0x7b08000b51e0 after lost signal to thread 19612
I20260709 13:19:04.802214 22940 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:04.776021 19503 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:19:04.795070 22972 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:04.805797 19510 rpcz_store.cc:276] 0709 13:19:02.062863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.064866 (+  2003us) service_pool.cc:224] Handling call
0709 13:19:02.065163 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.161111 (+ 95948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.161148 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:02.166823 (+  5675us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.623664 (+2456841us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:04.632122 (+  8458us) log.cc:844] Serialized 14 byte log entry
0709 13:19:04.775345 (+143223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.775531 (+   186us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.775572 (+    41us) raft_consensus.cc:1685] finished
0709 13:19:04.775584 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.775688 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88066,"prepare.queue_time_us":12689,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":8358,"raft.queue_time_us":106314,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":13009,"thread_start_us":2560314,"threads_started":2,"wal-append.queue_time_us":1084641,"wal-append.run_cpu_time_us":1986,"wal-append.run_wall_time_us":1007831}
I20260709 13:19:04.812355 19505 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.800587 22961 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:04.814128 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:04.826399 19476 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:04.828389 19476 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:04.820469 19441 debug-util.cc:398] Leaking SignalData structure 0x7b0800103f00 after lost signal to thread 19685
W20260709 13:19:04.830768 19441 debug-util.cc:398] Leaking SignalData structure 0x7b080039e6e0 after lost signal to thread 20690
W20260709 13:19:04.831168 19441 debug-util.cc:398] Leaking SignalData structure 0x7b080035c120 after lost signal to thread 20691
W20260709 13:19:04.831470 19441 debug-util.cc:398] Leaking SignalData structure 0x7b0800324640 after lost signal to thread 22286
W20260709 13:19:04.831920 19441 debug-util.cc:398] Leaking SignalData structure 0x7b08001bf9e0 after lost signal to thread 22839
W20260709 13:19:04.832569 19441 debug-util.cc:398] Leaking SignalData structure 0x7b08002253e0 after lost signal to thread 22986
W20260709 13:19:04.833032 19441 debug-util.cc:398] Leaking SignalData structure 0x7b080039f860 after lost signal to thread 23020
W20260709 13:19:04.833366 19441 debug-util.cc:398] Leaking SignalData structure 0x7b0800355c20 after lost signal to thread 23026
I20260709 13:19:04.788668 23075 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.809828 23019 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:04.873760 19441 debug-util.cc:398] Leaking SignalData structure 0x7b08002d1360 after lost signal to thread 23030
W20260709 13:19:04.884262 19441 debug-util.cc:398] Leaking SignalData structure 0x7b08003b5a00 after lost signal to thread 23041
W20260709 13:19:04.880231 19551 connection.cc:256] RPC call timeout handler was delayed by -1.8899573060000421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
I20260709 13:19:04.817334 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:19:04.884864 19441 debug-util.cc:398] Leaking SignalData structure 0x7b0800378d60 after lost signal to thread 23062
W20260709 13:19:04.889895 19551 connection.cc:256] RPC call timeout handler was delayed by -1.6946573059999537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
W20260709 13:19:04.890338 19551 connection.cc:256] RPC call timeout handler was delayed by -1.5893573060000108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
W20260709 13:19:04.890611 19551 connection.cc:256] RPC call timeout handler was delayed by -1.5155573059998915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2218s for a response
W20260709 13:19:04.890878 19551 connection.cc:256] RPC call timeout handler was delayed by -1.1467820299999403s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
I20260709 13:19:04.872267 19476 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:04.818974 23025 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:04.824453 20666 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.881307 22897 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:04.820809 23128 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:04.836802 22972 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:04.804828 23113 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.821723 23118 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.914387 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:04.879840 23078 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:04.881162 23120 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:04.885339 23075 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.838708 22940 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.924635 19652 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:19:04.894687 23121 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:04.899024 22979 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:04.935251 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 182387us
I20260709 13:19:04.905823 23027 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:04.944996 19505 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:19:04.896163 23019 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:04.881498 22961 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.955008 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:04.925015 22897 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.824021 23135 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:04.975189 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.964543 19478 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:04.937425 23078 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.927739 23143 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:04.923498 22673 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:04.965281 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.937541 23118 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.975991 19652 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:04.939234 23110 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:19:04.948735 22813 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:04.983912 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:04.986524 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:04.953833 23111 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:19:04.976714 22897 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:04.947134 23120 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:04.975606 23042 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:05.026028 23034 consensus_meta.cc:287] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.000s
I20260709 13:19:04.983165 22397 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:04.981053 23078 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:04.998884 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 45410.7us
I20260709 13:19:04.978713 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:05.010612 22940 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.995879 23050 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.011772 22961 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:05.012555 23140 log.cc:927] Time spent T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:19:05.013305 23127 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:04.964440 23121 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.014595 23075 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:04.991729 23025 raft_consensus.cc:697] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:04.996909 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:05.015682 23120 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:05.046823 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:05.017776 23042 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:05.024886 22814 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:05.032446 23128 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:05.026528 23034 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:04.986478 23143 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.029488 22971 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.083616 19658 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:05.078881 19652 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:05.085479 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 121378us
I20260709 13:19:05.099140 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:05.047034 23152 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:05.097306 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 212878us
I20260709 13:19:05.103129 19476 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:05.080722 23042 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:05.027082 23148 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:19:05.067488 23127 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:05.053179 22678 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:05.123849 19652 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:05.054680 23158 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:05.160079 23147 log.cc:927] Time spent T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:19:05.082818 22941 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:19:05.167026 20666 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
W20260709 13:19:05.167567 23028 consensus_meta.cc:287] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.656s	user 0.004s	sys 0.008s
W20260709 13:19:05.168407 22871 consensus_meta.cc:287] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.744s	user 0.009s	sys 0.001s
I20260709 13:19:05.167939 23128 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:05.168697 23014 consensus_meta.cc:287] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.000s
I20260709 13:19:05.102053 22971 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:05.170150 23034 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.170328 23135 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:05.170923 23127 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:05.171316 22897 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.171757 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.213904 19587 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 9.
I20260709 13:19:05.215057 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.216218 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.168773 23042 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.216902 19587 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:19:05.215509 20631 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:19:05.172228 23019 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:05.173411 23162 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:05.174748 23050 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:05.177487 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.178594 19586 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:05.230576 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.231600 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.117995 23155 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:05.158227 23153 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:05.182163 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.111395 23152 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.239601 23152 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:05.240206 22982 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.240799 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.240623 23118 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.242023 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.243155 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.244238 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.244993 19583 raft_consensus.cc:2393] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:05.244385 23078 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.245280 23145 raft_consensus.cc:2764] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:05.182994 23161 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.252665 23161 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.183135 23051 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:05.168852 23025 consensus_queue.cc:237] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.184388 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.183530 23075 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:05.185797 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.185859 19652 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:19:05.186357 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 147907us
W20260709 13:19:05.266413 19553 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:60800 dropped due to backpressure: service queue is full with 50 items [suppressed 4 similar messages]
I20260709 13:19:05.266623 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.267792 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.268064 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.188743 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.269450 19579 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:05.270290 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.270998 19579 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:05.270879 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.271576 19652 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:05.191974 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.202577 19653 raft_consensus.cc:2410] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:05.271733 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.274078 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.274098 19579 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:05.266763 19553 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:60800 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2225)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35102 (request call id 246)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1933)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1940)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1936)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1924)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2234)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2235)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1921)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1939)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1925)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1937)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1916)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2216)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2237)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1919)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2238)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2240)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2247)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2227)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2221)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2220)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2243)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1942)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2246)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1928)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2223)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2219)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 245)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2224)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2231)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2232)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2236)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2244)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1918)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1922)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1926)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 1927)
I20260709 13:19:05.210341 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.276979 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.277282 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.191547 23028 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.278249 19578 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:19:05.278424 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.278985 19579 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:05.279075 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.279332 23042 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.279739 19578 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:05.280109 23121 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.280534 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.281422 22931 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:05.208992 23014 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:05.282035 19661 raft_consensus.cc:2368] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8.
I20260709 13:19:05.282918 23028 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:05.223758 19410 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48852 (request call id 173) took 26168 ms (client timeout 15000 ms). Trace:
I20260709 13:19:05.228793 23143 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.283499 19661 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:05.283886 23014 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:05.281535 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.284658 19661 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:05.234712 23162 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.285104 19654 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:05.285236 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.188468 23023 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:19:05.286365 19654 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:05.283841 19658 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:05.235281 19585 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:05.287590 23162 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.281520 22897 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.288044 19656 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:05.288197 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.289292 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.234901 23114 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:05.248605 19660 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: []
W20260709 13:19:05.249473 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.251813 23019 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.254515 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.256990 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.258441 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.259059 23161 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.260078 23078 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.260730 22585 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:05.249222 22972 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.261916 22672 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.233577 23135 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:05.266754 23051 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.187844 23158 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.290266 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.290518 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.322971 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:05.296595 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:05.364414 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:05.365504 19510 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:19:05.366672 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:05.367642 19510 raft_consensus.cc:2393] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:05.323784 19658 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:05.300710 19579 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 11.
W20260709 13:19:05.310945 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 557460us
I20260709 13:19:05.314745 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:05.315948 19512 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:05.372490 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:05.316710 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:05.317818 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:05.374403 19505 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:19:05.321003 19587 raft_consensus.cc:2410] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:05.287592 19654 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:05.290539 19652 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:05.321173 19583 raft_consensus.cc:2410] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:05.321976 19478 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:05.286360 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.378427 19578 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:05.318259 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:05.299973 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:05.210173 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 96967.8us
I20260709 13:19:05.362052 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:05.380599 19506 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:05.380391 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:05.380301 19511 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:19:05.381590 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 59673.4us
I20260709 13:19:05.373282 19512 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:05.383930 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.261528 23118 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.299643 23017 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:05.385200 19478 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:05.037943 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:05.386361 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.387878 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:05.413009 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.412505 19586 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:05.320317 23023 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.292346 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:05.415084 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.415266 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.415607 19507 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:05.424650 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 44506.9us
I20260709 13:19:05.418677 19476 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:05.425483 19553 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:05.427412 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.429883 23023 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.430267 23120 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.431761 23152 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.416242 19406 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 49) took 8107 ms. Trace:
W20260709 13:19:05.283867 19410 rpcz_store.cc:269] 0709 13:18:39.055505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.055664 (+   159us) service_pool.cc:224] Handling call
0709 13:19:05.223635 (+26167971us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:58.613543 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:58.614246 (+   703us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:58.614296 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:18:58.614331 (+    35us) tablet.cc:662] Decoding operations
0709 13:18:58.616053 (+  1722us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:58.616145 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:58.616174 (+    29us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:18:58.617583 (+  1409us) tablet.cc:701] Row locks acquired
0709 13:18:58.652932 (+ 35349us) write_op.cc:260] PREPARE: finished
0709 13:18:58.686572 (+ 33640us) write_op.cc:270] Start()
0709 13:18:58.698175 (+ 11603us) write_op.cc:276] Timestamp: P: 1783603138672873 usec, L: 0
0709 13:18:58.698210 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:18:58.699067 (+   857us) log.cc:844] Serialized 6800 byte log entry
0709 13:18:59.660600 (+961533us) op_driver.cc:464] REPLICATION: finished
0709 13:18:59.930041 (+269441us) write_op.cc:301] APPLY: starting
0709 13:18:59.933535 (+  3494us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:59.940166 (+  6631us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:59.940352 (+   186us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:59.977467 (+ 37115us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:00.052747 (+ 75280us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:19:00.052810 (+    63us) write_op.cc:312] APPLY: finished
0709 13:19:00.053246 (+   436us) log.cc:844] Serialized 118 byte log entry
0709 13:19:00.053429 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:00.053640 (+   211us) write_op.cc:454] Released schema lock
0709 13:19:00.053711 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:00.105237 (+ 51526us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:00.105267 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3154140,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":243127,"apply.run_cpu_time_us":6634,"apply.run_wall_time_us":175073,"num_ops":17,"prepare.queue_time_us":94041,"prepare.run_cpu_time_us":21628,"prepare.run_wall_time_us":319709,"raft.queue_time_us":324749,"raft.run_cpu_time_us":10379,"raft.run_wall_time_us":200945,"replication_time_us":941038,"thread_start_us":502738,"threads_started":4,"wal-append.queue_time_us":244245,"wal-append.run_cpu_time_us":13756,"wal-append.run_wall_time_us":2170682}]]}
I20260709 13:19:05.433895 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.434022 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:05.416559 23078 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:05.434746 19585 raft_consensus.cc:2393] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:05.435019 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.435293 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:05.435573 19586 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:05.436465 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:05.436836 19504 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:05.437021 19509 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:19:05.437440 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.438055 19584 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:05.438877 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.438907 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:05.439955 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.440968 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.441884 23112 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:05.417583 22672 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:05.379659 23135 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.432153 23023 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.452009 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.452555 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:05.452831 19476 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:05.444003 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.444200 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:05.454494 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:05.444473 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.290518 23114 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.446662 19579 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:05.448001 19656 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:05.464380 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:05.435577 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.414119 22897 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:05.456002 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.457042 19584 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:05.465981 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.457309 19581 raft_consensus.cc:2393] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:05.457245 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:05.420293 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.458491 19478 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:05.467219 19578 raft_consensus.cc:2410] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:05.432276 23120 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.456097 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:05.470011 19654 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:05.470999 19661 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:05.473441 19476 leader_election.cc:400] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8.
I20260709 13:19:05.474016 22897 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:05.474380 23118 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:05.474656 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:05.481356 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 727915us
I20260709 13:19:05.475250 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.450510 23153 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.477164 23057 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:05.477973 19478 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:05.474656 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:05.490821 19655 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:05.478626 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.480422 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.451674 23127 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:05.487938 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.498188 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:05.498521 19581 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:05.483171 19476 leader_election.cc:403] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:05.432627 19406 rpcz_store.cc:276] 0709 13:18:57.277977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.278288 (+   311us) service_pool.cc:224] Handling call
0709 13:19:05.384943 (+8106655us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:04.158938 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:04.159507 (+   569us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:04.159544 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:19:04.159561 (+    17us) tablet.cc:662] Decoding operations
0709 13:19:04.160062 (+   501us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:04.160166 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:04.160208 (+    42us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:19:04.160577 (+   369us) tablet.cc:701] Row locks acquired
0709 13:19:04.160604 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:19:04.160791 (+   187us) write_op.cc:270] Start()
0709 13:19:04.160937 (+   146us) write_op.cc:276] Timestamp: P: 1783603144160731 usec, L: 0
0709 13:19:04.160978 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:19:04.161987 (+  1009us) log.cc:844] Serialized 988 byte log entry
0709 13:19:04.366091 (+204104us) op_driver.cc:464] REPLICATION: finished
0709 13:19:04.758628 (+392537us) write_op.cc:301] APPLY: starting
0709 13:19:04.758743 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:04.758867 (+   124us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:04.758996 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:04.759352 (+   356us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:04.759581 (+   229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:19:04.759643 (+    62us) write_op.cc:312] APPLY: finished
0709 13:19:04.759852 (+   209us) log.cc:844] Serialized 28 byte log entry
0709 13:19:04.760035 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:04.760127 (+    92us) write_op.cc:454] Released schema lock
0709 13:19:04.760169 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:04.760598 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:04.760627 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4240168,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":314644,"apply.run_cpu_time_us":1971,"apply.run_wall_time_us":14129,"num_ops":2,"prepare.queue_time_us":144569,"prepare.run_cpu_time_us":22545,"prepare.run_wall_time_us":54983,"raft.queue_time_us":72231,"raft.run_cpu_time_us":13319,"raft.run_wall_time_us":246538,"replication_time_us":204885,"spinlock_wait_cycles":1792,"thread_start_us":463387,"threads_started":4,"wal-append.queue_time_us":88704}]]}
I20260709 13:19:05.493566 19586 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:05.486498 19625 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:05.455793 23135 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:05.497229 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.505215 19584 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:05.503360 19625 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:05.505925 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.506395 19625 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:05.468725 22961 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:05.514853 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.508797 19503 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:05.509539 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:05.516144 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 61710.8us
I20260709 13:19:05.483559 23161 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:05.517689 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.518782 19661 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:05.484992 22897 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:05.526850 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:05.529814 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 56570.2us
I20260709 13:19:05.531255 19585 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:05.531442 19476 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:05.504338 23127 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.530040 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.504490 23155 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:05.530656 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:05.538755 23113 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.539743 23112 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:05.539918 23121 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:05.507879 23014 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:05.516330 22814 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:05.547035 19507 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:05.576294 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.578168 19478 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:05.531857 23025 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:05.540488 23042 consensus_queue.cc:1059] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:19:05.550866 23163 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:05.551688 22275 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:05.553081 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.554567 23152 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.555357 23161 raft_consensus.cc:697] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:05.555831 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.497495 23153 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.517362 22813 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:05.521051 22961 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:05.650998 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 64919us
I20260709 13:19:05.562216 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 1930) took 1121 ms. Trace:
I20260709 13:19:05.562734 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.565414 19627 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:05.652362 19578 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:19:05.520614 22672 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.582471 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:19:05.652712 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 87377.7us
W20260709 13:19:05.653126 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 70725.4us
I20260709 13:19:05.653285 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.653789 19478 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:05.654471 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.542346 23127 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:05.534242 22941 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:05.547645 19476 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:05.578524 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
W20260709 13:19:05.603055 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.578254 22873 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:05.534130 22842 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:19:05.579896 22814 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.669399 19503 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:05.584992 23113 consensus_queue.cc:1059] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:19:05.717422 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.717653 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:05.718710 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.719455 19578 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:05.561456 23023 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:19:05.601943 23162 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:19:05.724081 19654 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:05.590974 22673 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:05.650342 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:05.726372 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 69459.9us
I20260709 13:19:05.540936 23131 consensus_queue.cc:1059] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:19:05.645556 23042 consensus_queue.cc:1243] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:05.712422 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:05.579077 23014 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:05.670235 22982 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:05.676020 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:05.649951 22813 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:05.649197 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.655472 22961 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:05.713583 22873 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:05.670485 23128 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:05.651542 19653 rpcz_store.cc:276] 0709 13:19:04.440323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.445845 (+  5522us) service_pool.cc:224] Handling call
0709 13:19:05.540917 (+1095072us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b54001ec654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:05.562148 (+ 21231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1737517824}
I20260709 13:19:05.664194 22972 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.586989 23045 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.136s
I20260709 13:19:05.731261 23139 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.154s
I20260709 13:19:05.730976 23161 consensus_queue.cc:237] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:05.732481 23170 log.cc:927] Time spent T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:19:05.733246 23169 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:19:05.750512 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.785110 22873 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:05.809821 23139 consensus_queue.cc:1243] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:05.810559 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.811753 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.812865 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:05.773129 19658 raft_consensus.cc:2410] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:19:05.814833 23168 log.cc:927] Time spent T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:19:05.815912 23151 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.816434 23151 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:05.670982 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.779506 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:05.824846 19582 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:05.717005 22814 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:05.727306 19627 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:05.720072 23036 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:19:05.722904 22941 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:05.670619 22937 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:19:05.831992 22941 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.666749 23110 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 13:19:05.737534 23078 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:05.746150 23138 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:05.797192 19652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1884) took 1141 ms. Trace:
I20260709 13:19:05.834266 23138 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.663173 23111 consensus_queue.cc:1059] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.112s
I20260709 13:19:05.663496 22672 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.834751 23138 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:05.836496 22672 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.781653 22813 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:05.777041 23014 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:05.743682 23160 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:05.842015 23160 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.842474 23160 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:05.774575 22982 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:05.745914 23051 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.743372 23153 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.843420 22982 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:05.843907 22873 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:05.829056 23175 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:19:05.818521 23151 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.846331 23025 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 7. Current term is 8.
I20260709 13:19:05.846590 23118 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:05.848181 22873 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:05.848654 23128 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:05.834472 19652 rpcz_store.cc:276] 0709 13:19:04.655941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.272586 (+616645us) service_pool.cc:224] Handling call
0709 13:19:05.290237 (+ 17651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.377665 (+ 87428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.786547 (+408882us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5400021550. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:05.797113 (+ 10566us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28691712}
I20260709 13:19:05.853768 19581 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:05.856088 19585 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:05.829195 22961 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.857036 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:05.865229 19503 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:19:05.856630 23127 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.807312 23135 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:05.861246 23158 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.860078 19582 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:05.859730 22897 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:05.863824 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 136603us
I20260709 13:19:05.873199 19581 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:05.876886 19627 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:05.878684 19505 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:05.883385 19585 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:05.883942 19582 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:05.884575 19581 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:19:05.885226 19582 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:05.887019 19582 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:05.849102 22814 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.858894 22937 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.859864 23128 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:05.890890 19507 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:05.892122 19583 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:05.899909 19582 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:05.903213 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:05.904006 19585 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:05.909127 19581 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:05.878486 23158 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:05.934178 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:05.886164 23173 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.906106 22871 raft_consensus.cc:2764] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:05.926136 23051 raft_consensus.cc:3055] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:05.999153 19578 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:19:05.941684 23139 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:05.953326 20659 raft_consensus.cc:2368] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 11.
I20260709 13:19:06.007201 22961 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:05.989183 23045 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:06.008771 23158 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.948311 23036 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:05.989125 23144 log.cc:927] Time spent T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:05.926330 22937 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:05.951395 23151 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.990432 23111 raft_consensus.cc:3055] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:05.942087 23173 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.012202 22585 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:06.046627 22814 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:06.051930 19511 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:06.072423 23050 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:06.053694 23127 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:06.055881 23017 consensus_meta.cc:287] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.000s
I20260709 13:19:06.056931 23014 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.092168 23111 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:19:06.069561 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 133815us
W20260709 13:19:06.071693 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 395809us
I20260709 13:19:06.103310 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:06.103924 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:06.104501 19578 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.105031 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:06.106942 22937 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:06.107566 23163 raft_consensus.cc:3055] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:06.080914 23158 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:06.108188 23155 consensus_meta.cc:287] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 13:19:06.108639 23155 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:06.109855 23158 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:06.110337 23173 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:06.093231 23151 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.112274 23151 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:06.112891 23014 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:06.113952 23111 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.115566 23111 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.118073 22849 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:06.091487 23036 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.052826 23135 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:06.060712 22813 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.100350 19656 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:06.091161 22897 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:06.107957 23163 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:06.099974 23050 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.118582 22849 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:05.925328 23028 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:06.131811 23036 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:06.128568 23158 raft_consensus.cc:2764] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:19:06.137953 19655 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:06.140066 23114 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:06.141856 20659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59444 (request call id 124) took 1382 ms (client timeout 1716 ms). Trace:
W20260709 13:19:06.142359 20659 rpcz_store.cc:269] 0709 13:19:04.759211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.788258 (+ 29047us) service_pool.cc:224] Handling call
0709 13:19:05.292137 (+503879us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b5800042f98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635eee 0000000000375939 00007f6c366a91e0 00007f6c367720c4 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:19:06.141558 (+849421us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b5400599054. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:06.141761 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1072945408}
I20260709 13:19:06.146665 23163 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.147929 23163 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.127710 22931 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.150058 22931 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.120275 19511 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:19:06.121018 19507 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:06.122308 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:06.080014 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 145953us
I20260709 13:19:06.158682 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:06.068413 23051 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:06.063529 22982 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.125523 19578 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 11.
I20260709 13:19:06.075325 23045 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:06.160338 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:06.162755 19507 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:06.166659 19507 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:06.163335 19627 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:06.171756 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:06.172706 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:06.175859 20631 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:19:06.176926 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:06.179222 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:06.180544 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:06.129431 23151 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:06.178385 23188 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:06.178128 23114 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:06.189756 23189 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:06.178114 23173 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.191705 23173 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.194216 20659 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:06.194523 23128 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.196626 23128 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:06.197762 23045 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.198798 23045 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:06.140066 22813 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:06.201898 23051 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.203298 23051 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:06.177889 23036 raft_consensus.cc:2764] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:06.164755 23158 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:06.206543 23158 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:06.206938 23158 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:06.183823 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:06.161559 22961 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:06.208483 23190 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:06.215585 20662 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:06.207737 23135 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:06.216854 23135 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 11 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:19:06.217710 23135 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:06.212798 23036 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:06.226969 23036 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:06.227023 22888 raft_consensus.cc:3055] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:06.227510 23036 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:06.227577 22888 raft_consensus.cc:740] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:06.228716 22888 consensus_queue.cc:260] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.178241 23131 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:06.229949 23131 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:06.230352 23131 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:06.230547 22849 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.231555 22849 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.183420 23195 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:06.239122 23195 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.238903 22961 consensus_queue.cc:1059] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:06.239579 23195 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:06.241493 23112 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:06.241935 23112 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:06.242868 23050 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:06.242718 23112 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.243708 23112 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:06.246521 22982 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:06.249884 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.234105 22888 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:06.175494 23160 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.259037 22961 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:06.260670 22961 raft_consensus.cc:3055] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:06.261163 22961 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:06.262036 23162 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:06.262488 23162 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:06.262329 22961 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.264082 22961 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.254563 22937 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:19:06.267141 23143 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:06.268352 22937 raft_consensus.cc:3055] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:06.268177 23162 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.270095 23173 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:06.213374 23151 raft_consensus.cc:697] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:06.271795 23151 consensus_queue.cc:237] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.268725 22937 raft_consensus.cc:740] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:19:06.287937 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:06.300593 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:06.301728 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:06.303035 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.299639 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:06.275751 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:06.310691 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:06.315178 19653 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:19:06.311726 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:06.323097 19652 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:19:06.323632 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:06.324283 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.325320 23188 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:06.330555 23188 consensus_queue.cc:1059] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:06.332250 23113 raft_consensus.cc:3055] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:06.332785 23113 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:06.334028 23113 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.342000 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:06.342763 19661 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:19:06.343851 19661 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:06.344583 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:06.345381 19658 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:06.236394 22813 consensus_queue.cc:1059] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:19:06.349916 23162 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:06.265522 22931 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:06.369088 19661 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:06.299387 23111 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:19:06.281172 23143 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:19:06.267187 23138 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.373788 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:06.338758 23114 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:06.377068 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:06.391103 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:06.390444 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:06.393422 19661 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:19:06.404336 23189 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:06.406509 23189 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.406924 23189 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:06.407222 23158 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.400307 23143 consensus_queue.cc:1243] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:06.410019 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:06.404572 23112 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:06.415077 23042 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:06.400746 22937 consensus_queue.cc:260] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:06.432577 23112 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.446244 23173 raft_consensus.cc:3055] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:06.446502 23112 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:06.446729 23173 raft_consensus.cc:740] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:06.447624 23173 consensus_queue.cc:260] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:06.448920 23173 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.433635 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:06.433706 23042 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.387701 23190 consensus_queue.cc:1059] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:19:06.458827 23138 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:06.466610 22937 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:06.450003 23148 raft_consensus.cc:3055] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:19:06.481670 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.456562 23042 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:06.487104 19658 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:19:06.491107 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 955353us
W20260709 13:19:06.497217 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.506433 23160 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:06.508157 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.510051 19476 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:06.512570 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.479244 23188 raft_consensus.cc:3055] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:06.519352 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:06.480242 23148 raft_consensus.cc:740] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:06.526054 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1853) took 1206 ms. Trace:
I20260709 13:19:06.526641 19508 rpcz_store.cc:276] 0709 13:19:05.320068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.563291 (+243223us) service_pool.cc:224] Handling call
0709 13:19:05.570988 (+  7697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.571249 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:05.717010 (+145761us) log.cc:844] Serialized 14 byte log entry
0709 13:19:06.525717 (+808707us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.525771 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:06.525822 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.525887 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.526001 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":672255,"prepare.queue_time_us":91419,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":4315,"thread_start_us":267454,"threads_started":2,"wal-append.queue_time_us":215333}
W20260709 13:19:06.521364 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 159449us
I20260709 13:19:06.534910 19627 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:06.535027 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:06.533084 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1862) took 1201 ms. Trace:
I20260709 13:19:06.535960 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:06.539319 19503 rpcz_store.cc:276] 0709 13:19:05.331392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.866059 (+534667us) service_pool.cc:224] Handling call
0709 13:19:05.871434 (+  5375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.871641 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:05.898140 (+ 26499us) log.cc:844] Serialized 14 byte log entry
0709 13:19:06.532745 (+634605us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.532797 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:06.532843 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.532911 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.533027 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":504141,"prepare.queue_time_us":31572,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"thread_start_us":136952,"threads_started":1,"wal-append.queue_time_us":144238}
I20260709 13:19:06.541661 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:06.544514 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:06.533385 23110 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:19:06.551106 22275 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:19:06.554329 23203 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:19:06.555989 23198 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:19:06.557279 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.560087 23160 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.560699 23160 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.533842 23120 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:06.562211 23120 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.566124 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:06.518091 23188 raft_consensus.cc:740] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:06.569763 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:06.525317 22673 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:06.574179 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:06.584132 19512 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:19:06.526341 23051 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:06.586433 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:06.587548 19508 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:06.590315 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:06.591202 19586 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:06.583226 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:06.596976 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:06.598598 19507 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:06.599063 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.602485 19553 leader_election.cc:400] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Vote denied by peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615) with higher term. Message: Invalid argument: T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 11.
I20260709 13:19:06.602977 19553 leader_election.cc:403] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:19:06.604357 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.589000 19627 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:06.603438 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 76421.6us
I20260709 13:19:06.605767 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:06.606323 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:06.606463 19512 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:19:06.608326 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:06.610273 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 100310us
I20260709 13:19:06.611986 19504 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:06.617089 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.607211 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:06.618896 19507 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:19:06.619895 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.620508 19507 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.616755 23065 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:06.584569 23057 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:06.632648 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.633446 19512 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.619127 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:06.623456 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:06.623772 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.634414 19586 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:06.634845 19504 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.580168 19579 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:06.637642 22813 consensus_queue.cc:1059] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:06.638979 22813 raft_consensus.cc:3055] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:06.639386 22813 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:06.635063 19583 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
W20260709 13:19:06.617046 23201 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:19:06.644006 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:06.611533 23127 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:06.662194 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:06.657759 19579 raft_consensus.cc:2393] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:06.662981 19511 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:06.663460 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:06.664062 19579 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:19:06.664861 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:06.666887 19508 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:06.667939 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:06.668635 19579 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:06.668715 19627 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:06.672139 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.673542 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:06.674738 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:06.594579 22939 consensus_queue.cc:1059] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:19:06.683353 19586 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:19:06.642311 23114 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615) with higher term. Message: Invalid argument: T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 11.
I20260709 13:19:06.690030 19504 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:06.644845 22961 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:06.690997 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:06.640362 22813 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.694977 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1859) took 1365 ms. Trace:
I20260709 13:19:06.696651 19627 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:06.613772 23112 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.698257 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:06.698822 19507 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:06.698854 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.661018 23065 raft_consensus.cc:697] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:06.714504 19586 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:06.709669 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.686334 22397 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:06.717744 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:06.681402 23163 consensus_meta.cc:287] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.533s	user 0.013s	sys 0.000s
I20260709 13:19:06.722268 19504 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:06.724026 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.726392 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:06.727720 19504 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.648583 23057 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.694384 22897 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.667218 23036 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.763756 19585 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:06.697862 22961 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:06.615557 23148 consensus_queue.cc:260] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:06.765097 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:06.740769 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.744261 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.765947 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.709138 22873 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:06.736222 19580 raft_consensus.cc:2410] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:06.686757 23127 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:06.783599 19508 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:06.726388 22931 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.795058 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1906) took 1350 ms. Trace:
I20260709 13:19:06.719992 22726 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:06.795459 19659 rpcz_store.cc:276] 0709 13:19:05.444389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.447017 (+  2628us) service_pool.cc:224] Handling call
0709 13:19:05.450549 (+  3532us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:05.450928 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.450954 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:06.255728 (+804774us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b2c0002b1b8. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:19:06.259425 (+  3697us) log.cc:844] Serialized 52 byte log entry
0709 13:19:06.418630 (+159205us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:06.418671 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.418738 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:06.794713 (+375975us) raft_consensus.cc:1685] finished
0709 13:19:06.794737 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.794996 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":361,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":12506,"spinlock_wait_cycles":9420544,"thread_start_us":158773,"threads_started":1,"wal-append.queue_time_us":233456}
I20260709 13:19:06.772900 22813 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:06.794373 19582 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:06.725795 23153 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:06.767961 23187 log.cc:927] Time spent T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:19:06.798120 22873 raft_consensus.cc:697] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:06.770736 22897 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.726015 23165 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:06.821560 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:06.793002 19504 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 11.
I20260709 13:19:06.774516 22961 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:06.647877 23189 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.734063 23210 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:06.697359 23195 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.793408 19507 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
W20260709 13:19:06.829665 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 67222.7us
I20260709 13:19:06.830149 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:06.820039 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.814198 22931 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.832607 19507 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:06.817015 22873 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.813175 22726 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.825516 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.897433 19504 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:06.833951 19507 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:06.834327 19627 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:06.898267 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 64088.6us
I20260709 13:19:06.849819 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.854756 23160 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:06.856109 23206 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:19:06.866637 23221 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.900192 22939 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:06.900837 22939 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:06.900671 23221 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:06.901804 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.902621 19508 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:06.869261 23036 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:06.823025 23065 consensus_queue.cc:237] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:06.903934 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.904047 23221 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:06.870668 19510 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:19:06.871450 22931 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:06.871887 23042 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.872057 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:06.833926 23192 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:06.874598 19657 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:06.875699 23195 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:06.876511 19586 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:06.909488 22726 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:06.931427 23215 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 13:19:06.879554 23131 consensus_meta.cc:287] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.000s
I20260709 13:19:06.880115 19581 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:06.881104 23189 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:06.829227 23165 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.883302 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:06.889079 23120 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:06.890671 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:06.891808 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:06.893307 23113 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.666960 23188 consensus_queue.cc:260] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.794799 23196 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:19:06.901889 22939 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.909085 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:06.956743 19654 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:06.868913 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:06.873749 22897 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:06.934238 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:06.962612 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.962641 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:06.820165 23153 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.937656 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.877202 23057 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:06.940462 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:06.940711 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:06.966715 19510 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:06.967018 19509 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:19:06.968077 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:06.968502 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:06.878137 23112 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:06.937582 23216 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:19:06.950033 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:06.839197 23210 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.970994 19652 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:06.971928 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:06.972270 23210 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:06.950843 19661 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:06.973706 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:06.974251 19661 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.950616 23131 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:06.978143 19579 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:06.978354 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:06.979525 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:06.980551 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:06.953305 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 226989us
I20260709 13:19:06.937425 22842 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:06.957720 19658 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 7.
I20260709 13:19:06.963970 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:06.969137 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.992514 19625 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:07.030426 19509 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:06.992916 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:07.010437 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.031597 19655 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:06.986357 19476 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:06.993366 19512 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:06.972564 19652 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:06.990770 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:06.969250 19507 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:19:06.981582 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:07.034080 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:07.034373 19659 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:07.034469 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:07.000591 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.034758 19507 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:07.036376 19654 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:07.039340 19661 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:06.994195 23075 raft_consensus.cc:3055] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:07.041214 23224 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:07.003487 23127 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:07.041999 23057 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:07.001457 23173 consensus_meta.cc:287] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.552s	user 0.008s	sys 0.004s
I20260709 13:19:06.981407 23131 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:07.043174 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 56909.4us
I20260709 13:19:07.050400 19476 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:06.988819 23220 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:19:07.043752 19507 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:07.046629 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 439135us
I20260709 13:19:07.043480 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:07.041245 22842 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:07.042976 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:06.963528 22961 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.051844 19476 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:07.043443 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 51038.4us
I20260709 13:19:07.093698 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:07.116739 19625 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
W20260709 13:19:07.118817 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 67059.7us
W20260709 13:19:07.119405 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 75978.4us
I20260709 13:19:07.121129 19625 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:07.120146 19476 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:07.011215 23153 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.128415 19625 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:07.129918 19476 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:07.002959 23165 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.131346 19476 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:06.995126 23042 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.057601 23057 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:07.048797 22397 raft_consensus.cc:697] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:07.138814 19625 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:07.137646 23196 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:07.144608 19625 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:07.125918 23192 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:07.136526 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:07.041245 23075 raft_consensus.cc:740] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:07.149451 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:07.150384 19658 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:19:07.151208 19476 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:07.151485 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:07.152318 19658 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:07.152789 19476 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:07.154412 23165 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:07.155359 23165 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:07.156162 23165 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:07.156771 23165 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:07.159133 19476 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:07.105746 23127 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.161783 23127 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.162030 22842 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.164898 23127 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.132838 23223 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:07.165881 23223 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:07.166421 23223 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:07.128010 23155 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:07.149015 23196 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:07.170826 23196 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:07.172082 23196 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.146781 23017 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:07.145895 19625 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:07.131834 23065 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:07.174324 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.133810 22897 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:07.132000 23210 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:07.153455 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:07.059809 23050 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:07.177119 19625 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:07.137006 23153 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:07.177495 19476 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:07.183027 19658 raft_consensus.cc:2393] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:07.133790 23173 consensus_queue.cc:1059] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:19:07.160271 23165 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.187465 19625 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:07.192363 19625 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:07.187073 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:07.178658 22937 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:07.193786 19503 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:07.180750 23155 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:07.198390 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:07.199046 19658 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 9.
I20260709 13:19:07.200467 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:07.200723 23017 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:07.181344 23151 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.016s	sys 0.038s
I20260709 13:19:07.201120 19512 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 9.
W20260709 13:19:07.201480 23151 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.016s	sys 0.038s
I20260709 13:19:07.195844 19503 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:07.179584 23192 raft_consensus.cc:697] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 11 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:19:07.202391 19503 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:07.203362 19503 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:07.195698 19625 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:07.201323 23017 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:07.186153 23153 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.190042 22897 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:07.220642 19584 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:07.213119 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 1942) took 1960 ms. Trace:
I20260709 13:19:07.222635 20619 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:07.224992 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.190910 22873 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:07.203048 23192 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:07.222560 19503 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:19:07.229652 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:07.256009 19503 pending_rounds.cc:85] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 9
I20260709 13:19:07.256275 19503 pending_rounds.cc:107] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:19:07.256515 19503 raft_consensus.cc:2889] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:07.256897 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:07.235260 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.193756 23057 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:07.252687 19587 rpcz_store.cc:276] 0709 13:19:05.253128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.514593 (+261465us) service_pool.cc:224] Handling call
0709 13:19:07.212909 (+1698316us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400101154. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:07.213038 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2374247680}
W20260709 13:19:07.258093 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.259578 19476 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:07.259811 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 51897.6us
I20260709 13:19:07.259470 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:07.260802 19655 raft_consensus.cc:2410] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:07.260459 19476 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:07.260461 19625 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:07.198006 23050 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:07.209008 22961 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.252305 23153 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:07.208447 22678 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:07.265056 23127 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:07.258749 23057 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.267634 19655 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:19:07.266224 19625 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:07.209218 22726 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.272009 23057 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.254590 23173 consensus_queue.cc:1059] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:19:07.320792 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 54661.4us
W20260709 13:19:07.321043 19656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 1910) took 1875 ms (client timeout 1626 ms). Trace:
I20260709 13:19:07.324107 19625 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:07.323896 19656 rpcz_store.cc:269] 0709 13:19:05.448756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.464073 (+ 15317us) service_pool.cc:224] Handling call
0709 13:19:07.320860 (+1856787us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54003f3754. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:07.320970 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453443328}
I20260709 13:19:07.325680 23210 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:19:07.327297 23158 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.207055 22397 consensus_queue.cc:237] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.213376 23017 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.339387 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:07.272166 23120 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:07.336994 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 114452us
I20260709 13:19:07.343370 19478 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:07.266495 23155 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:07.266590 22897 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:07.268198 22939 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:07.323202 23234 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:07.341557 23211 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:07.336709 23210 consensus_queue.cc:1243] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:07.356505 19625 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:07.270581 23127 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.346217 23120 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.341794 23173 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:07.350435 23160 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:07.352856 22972 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:07.384099 20662 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 11 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:07.386878 23138 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:07.387404 22726 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:07.390461 23208 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.758s	user 0.003s	sys 0.000s
I20260709 13:19:07.381585 23146 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:07.383556 22939 raft_consensus.cc:697] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:06.695497 19506 rpcz_store.cc:276] 0709 13:19:05.330623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.588428 (+257805us) service_pool.cc:224] Handling call
0709 13:19:05.588682 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.588875 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:05.724879 (+136004us) log.cc:844] Serialized 14 byte log entry
0709 13:19:06.682946 (+958067us) log.cc:844] Serialized 14 byte log entry
0709 13:19:06.694563 (+ 11617us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.694633 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:06.694706 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.694781 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.694901 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":620797,"prepare.queue_time_us":144738,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":603502,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":29316,"thread_start_us":439874,"threads_started":3,"wal-append.queue_time_us":349946}
I20260709 13:19:07.339438 23223 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.386024 23152 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:07.355485 23155 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:07.404376 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 56989.4us
I20260709 13:19:07.382992 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:07.355676 23023 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:19:07.355355 23050 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:07.397640 22678 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:07.397984 23120 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:07.417235 23138 consensus_queue.cc:1243] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:07.440778 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:07.427033 19625 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:07.419800 23146 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.385102 23210 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:19:07.458695 23153 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.460987 23153 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.433436 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1922) took 1150 ms. Trace:
I20260709 13:19:07.426092 22897 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.425498 23155 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:07.434993 23127 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.439357 23057 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:07.446154 22939 consensus_queue.cc:237] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.419910 23236 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:07.449750 23148 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:07.450750 23234 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:07.384099 23211 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.417577 23221 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:19:07.452852 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:07.495447 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:07.454571 19659 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:07.462268 19660 rpcz_store.cc:276] 0709 13:19:06.283184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.283329 (+   145us) service_pool.cc:224] Handling call
0709 13:19:06.337301 (+ 53972us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.353947 (+ 16646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.354002 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.354655 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.472962 (+118307us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:06.473024 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.473121 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.389900 (+916779us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:07.433100 (+ 43200us) raft_consensus.cc:1685] finished
0709 13:19:07.433123 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.433370 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1391,"raft.queue_time_us":1589,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":8532,"spinlock_wait_cycles":70317824,"thread_start_us":89132,"threads_started":1,"wal-append.queue_time_us":172263}
I20260709 13:19:07.470533 19625 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:07.461920 23146 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:07.471280 23138 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:07.470908 23057 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:07.477648 23234 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:07.440637 23050 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.508059 22842 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:07.509804 23050 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:07.510739 23211 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.511852 19658 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:07.514650 23120 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.515609 23138 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.516139 23138 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:07.517097 23120 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.467655 23065 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:07.518052 19625 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:07.482784 23223 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:07.461367 23075 consensus_queue.cc:260] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.519682 23075 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:07.520689 23065 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:07.521226 23065 raft_consensus.cc:697] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:07.502970 19659 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:07.514724 23057 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.522095 23065 consensus_queue.cc:237] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.522845 23057 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:07.478174 23236 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:07.508122 23234 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.531137 23234 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:07.534524 23236 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.550040 23138 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.553531 23138 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:07.568289 23155 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:07.471187 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 118488us
W20260709 13:19:07.621703 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.626765 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:07.633723 19653 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 8: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:07.638018 19625 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:07.639269 23120 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:07.641299 23120 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:07.644272 23120 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:07.648280 23120 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:07.649684 23138 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:07.650444 23138 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.650979 23138 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:07.640940 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 112939us
I20260709 13:19:07.681265 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2266) took 1147 ms. Trace:
I20260709 13:19:07.681826 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2270) took 1143 ms. Trace:
I20260709 13:19:07.682406 19581 rpcz_store.cc:276] 0709 13:19:06.537832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.537952 (+   120us) service_pool.cc:224] Handling call
0709 13:19:07.681178 (+1143226us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b5400303754. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:07.681494 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776422272}
W20260709 13:19:07.687186 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 563569us
I20260709 13:19:07.699760 23110 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:07.702214 23111 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:07.702926 23111 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:07.673883 23173 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:07.714102 23148 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.715301 23148 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.718236 23162 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.718758 23161 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:07.719277 23162 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.719662 23161 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.722082 23163 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.722837 23148 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.722993 23163 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.726503 23155 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.682113 19578 rpcz_store.cc:276] 0709 13:19:06.533059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.533715 (+   656us) service_pool.cc:224] Handling call
0709 13:19:06.534070 (+   355us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:06.723382 (+189312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.723412 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:06.794032 (+ 70620us) log.cc:844] Serialized 52 byte log entry
0709 13:19:06.944191 (+150159us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:06.953731 (+  9540us) log.cc:844] Serialized 14 byte log entry
0709 13:19:06.958575 (+  4844us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.272925 (+314350us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b18002ab080. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:19:07.675779 (+402854us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b18002ab080. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e5e7c0a 00007f6c37d27219 00007f6c2e66fa40 00007f6c2e66a4e4 00007f6c2e66a455 00007f6c31752060 00007f6c31764716 00007f6c31775287 00007f6c31775208
0709 13:19:07.680117 (+  4338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.680315 (+   198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.680410 (+    95us) raft_consensus.cc:1685] finished
0709 13:19:07.680432 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.680817 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5646,"prepare.queue_time_us":331222,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":15818,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":2292,"spinlock_wait_cycles":13841408,"thread_start_us":302847,"threads_started":2,"wal-append.queue_time_us":240097}
W20260709 13:19:07.728559 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.728619 23237 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.276s	user 0.000s	sys 0.003s
W20260709 13:19:07.729063 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.729346 23161 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.648818 23120 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:07.729851 23110 consensus_queue.cc:1059] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:07.730603 23121 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.731257 23110 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.731734 23121 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.731734 23120 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.732425 23110 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.733868 23120 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:07.734386 23112 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:07.736655 23112 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:07.737156 23112 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:19:07.729528 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.756026 23235 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.305s	user 0.004s	sys 0.000s
I20260709 13:19:07.761150 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1864) took 2427 ms. Trace:
I20260709 13:19:07.761684 19505 rpcz_store.cc:276] 0709 13:19:05.333927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.081683 (+747756us) service_pool.cc:224] Handling call
0709 13:19:06.082028 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.535649 (+453621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.535686 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:07.214918 (+679232us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b2c00000c88. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:19:07.215311 (+   393us) log.cc:844] Serialized 26 byte log entry
0709 13:19:07.383142 (+167831us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:07.383178 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.383245 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.754881 (+371636us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:07.760633 (+  5752us) raft_consensus.cc:1685] finished
0709 13:19:07.760660 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.760922 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":469621,"raft.queue_time_us":459088,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":41212,"spinlock_wait_cycles":47735808,"thread_start_us":166877,"threads_started":1,"wal-append.queue_time_us":209221}
I20260709 13:19:07.766340 23152 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:07.766943 23152 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:07.767671 19580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2230) took 2544 ms (client timeout 1922 ms). Trace:
W20260709 13:19:07.768141 19580 rpcz_store.cc:269] 0709 13:19:05.223326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.323304 (+1099978us) service_pool.cc:224] Handling call
0709 13:19:07.767218 (+1443914us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b5400268754. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:07.767469 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":946072448}
I20260709 13:19:07.770624 23112 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.772692 23112 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:07.775115 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1976) took 1149 ms. Trace:
I20260709 13:19:07.775655 19655 rpcz_store.cc:276] 0709 13:19:06.625986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.280290 (+654304us) service_pool.cc:224] Handling call
0709 13:19:07.281059 (+   769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:07.281423 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:07.281455 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:07.319536 (+ 38081us) log.cc:844] Serialized 26 byte log entry
0709 13:19:07.382962 (+ 63426us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:07.383014 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.383084 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.727363 (+344279us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:07.774453 (+ 47090us) raft_consensus.cc:1685] finished
0709 13:19:07.774472 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.774864 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8436,"raft.queue_time_us":38322,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":3137,"spinlock_wait_cycles":39103232,"thread_start_us":60181,"threads_started":1,"wal-append.queue_time_us":130020}
I20260709 13:19:07.779382 23213 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.779774 23121 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.780172 23213 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.704816 23111 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.798040 22937 consensus_queue.cc:1059] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:07.798211 23146 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:07.802759 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 69838.7us
I20260709 13:19:07.805178 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:07.786926 23163 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.806234 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2277) took 1222 ms. Trace:
I20260709 13:19:07.808787 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:07.810170 19582 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:07.810271 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:07.814919 23162 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.817790 19581 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:19:07.825915 23155 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:07.827929 23110 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:07.798059 19627 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.570s (SENT) [suppressed 12 similar messages]
I20260709 13:19:07.817243 19579 rpcz_store.cc:276] 0709 13:19:06.584123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.669742 (+ 85619us) service_pool.cc:224] Handling call
0709 13:19:06.669974 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.978586 (+308612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.787923 (+809337us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b5400268254. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:07.806032 (+ 18109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707617664}
I20260709 13:19:07.832551 23057 consensus_queue.cc:1059] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:07.833369 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:07.833696 23057 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:07.834314 19504 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:07.834584 23057 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.816337 23146 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.843918 19584 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:07.844877 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:07.845356 23057 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.845691 19507 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:07.846052 23057 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.846671 23057 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.848740 23057 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.848780 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:07.849496 23210 raft_consensus.cc:3055] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:07.849592 19505 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:07.850085 23210 raft_consensus.cc:740] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:07.851466 23210 consensus_queue.cc:260] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.852175 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:07.853143 23210 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:07.860244 23138 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:07.853211 19508 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:07.855823 23213 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:07.856040 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:07.858193 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:07.930537 19509 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:07.933485 19578 raft_consensus.cc:2410] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:07.938784 19584 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:19:07.940270 19505 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:07.939909 19507 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:19:07.943534 19504 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 10.
W20260709 13:19:07.948130 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 150276us
I20260709 13:19:07.949762 23112 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:07.950688 23112 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:07.951649 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 93757.5us
I20260709 13:19:07.951747 23057 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:07.952293 23057 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:07.952538 23188 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:07.952750 23057 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:07.953051 22971 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:07.949883 23213 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:07.970203 19506 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:19:07.970649 19506 pending_rounds.cc:85] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 5
I20260709 13:19:07.970934 19506 pending_rounds.cc:107] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:19:07.971218 19506 raft_consensus.cc:2889] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:07.972090 23017 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.972915 23017 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:07.974537 23138 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:07.975508 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1883) took 1339 ms. Trace:
I20260709 13:19:07.978924 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:07.979661 19507 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:07.981276 23173 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:07.983776 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:07.984069 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:07.984788 19660 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:07.985651 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:07.986176 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:07.986626 19658 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:07.986868 19655 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:19:07.976275 19511 rpcz_store.cc:276] 0709 13:19:06.601221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.678388 (+ 77167us) service_pool.cc:224] Handling call
0709 13:19:06.695388 (+ 17000us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:06.722942 (+ 27554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.722974 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:06.723765 (+   791us) log.cc:844] Serialized 52 byte log entry
0709 13:19:07.665428 (+941663us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b180024fdc0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa0d1 00007f6c31715a0f
0709 13:19:07.820439 (+155011us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:07.839178 (+ 18739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.927728 (+ 88550us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.927771 (+    43us) raft_consensus.cc:1685] finished
0709 13:19:07.927783 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.940344 (+ 12561us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27094,"raft.queue_time_us":38498,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":21610,"spinlock_wait_cycles":17836928,"thread_start_us":118278,"threads_started":1,"wal-append.queue_time_us":1064625}
W20260709 13:19:08.010762 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.011445 22931 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.016125 22931 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:08.019200 22931 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:08.019369 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:08.020362 19652 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:08.020581 19625 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:08.020838 22931 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:08.023662 19507 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:08.036962 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:08.038573 19625 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:08.038790 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:08.039718 19655 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:08.039960 19625 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:07.988041 23017 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:08.030897 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:08.043216 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.053490 19505 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:08.054507 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:08.055269 23195 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:08.055531 19656 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:08.055912 23195 raft_consensus.cc:697] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:08.059804 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 1969) took 1435 ms. Trace:
I20260709 13:19:08.060226 19511 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:08.060256 19654 rpcz_store.cc:276] 0709 13:19:06.623909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.203071 (+579162us) service_pool.cc:224] Handling call
0709 13:19:07.203377 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:07.203763 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:07.734637 (+530874us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b1800180520. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66a455 00007f6c351523c7 00007f6c317649a7 00007f6c317740bf 00007f6c31774038
0709 13:19:07.797933 (+ 63296us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.041892 (+243959us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:08.054643 (+ 12751us) log.cc:844] Serialized 52 byte log entry
0709 13:19:08.054825 (+   182us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:08.054857 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.054980 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.059346 (+  4366us) raft_consensus.cc:1685] finished
0709 13:19:08.059463 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.059603 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20371,"prepare.queue_time_us":354355,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":29506,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":31901,"spinlock_wait_cycles":49897344,"thread_start_us":256691,"threads_started":2,"wal-append.queue_time_us":258445}
I20260709 13:19:08.061767 23223 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:19:08.064010 23223 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:19:08.064291 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 72010.5us
I20260709 13:19:08.064678 23223 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:08.069366 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 264413us
I20260709 13:19:08.070485 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:08.072238 23213 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:08.073020 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:08.054798 19508 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:07.997335 23152 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.049283 23112 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:08.099184 22275 raft_consensus.cc:3055] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:08.099761 22275 raft_consensus.cc:740] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:08.100811 22275 consensus_queue.cc:260] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.114519 23050 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:08.115531 23050 raft_consensus.cc:697] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:08.083585 22937 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:08.057206 23195 consensus_queue.cc:237] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.136911 19476 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:08.085476 23213 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:08.144515 19655 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 10.
I20260709 13:19:08.122347 22937 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:19:08.151012 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 109627us
I20260709 13:19:08.152771 19660 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
W20260709 13:19:08.152942 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 54772.5us
I20260709 13:19:08.116991 23050 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.154013 19476 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:08.143961 22275 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:08.154318 19625 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:08.149799 22937 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:08.159466 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 86583.3us
I20260709 13:19:08.163388 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:08.163635 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:08.164366 20662 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:08.165604 23197 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:08.165916 23228 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:08.159272 22931 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:08.165643 20619 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:08.160277 23120 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:08.161684 23210 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:08.171679 23210 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:08.172156 23210 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:08.171981 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:08.172550 19476 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:08.174371 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.174939 22931 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:08.176162 22931 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.180684 23152 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:08.181875 23152 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:08.182109 23210 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.184351 23213 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:08.185179 23234 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.184971 23213 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.185808 23234 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.187455 23213 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:08.188202 23234 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:08.189639 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.200292 19395 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d05498e224814b9b8f31e3f965ab2583 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d56df3728fc04e37b2d29a3bcd91d167 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:19:08.200789 23210 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:08.201923 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:08.201975 19659 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: [12.8-13.9]
I20260709 13:19:08.200556 19660 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:08.208197 19657 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:08.170382 23120 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.210916 19652 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 13:19:08.212136 19582 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:08.207227 23228 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:08.214890 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:08.215202 23228 raft_consensus.cc:697] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 10 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:19:08.216471 23228 consensus_queue.cc:237] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:08.220885 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:08.221336 19504 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:08.215598 19578 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:08.224629 19511 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:08.225947 19584 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:08.227420 23223 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:08.252753 19507 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:08.254276 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:08.255090 19507 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:08.256841 19503 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:08.260645 19654 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.261426 19510 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:08.262873 23057 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.263468 23075 raft_consensus.cc:3055] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:08.264050 23075 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:08.231576 23127 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:08.266335 23127 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:08.268537 23127 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:08.229759 23152 raft_consensus.cc:697] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:08.269758 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:08.222880 23120 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:08.279529 19654 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:08.282773 20659 raft_consensus.cc:2393] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:19:08.283671 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:08.284472 19507 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:08.286698 23165 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:19:08.287415 19503 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:08.291574 23234 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:08.292694 23195 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:08.293078 23195 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:08.294040 23195 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.295140 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:08.295840 23195 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:08.298353 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:08.299206 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:08.300194 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.300935 19585 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 12.
I20260709 13:19:08.301748 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:08.301884 19625 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:08.297834 19503 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:08.302832 23017 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:08.229336 23225 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:19:08.303144 19580 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:08.370559 23065 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:19:08.380584 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:08.341508 23138 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:19:08.379052 19654 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:08.358390 19508 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:08.374620 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:08.401719 19656 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:08.403613 19578 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:08.303313 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:08.347954 19509 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:08.371270 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:08.361964 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:08.375941 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:08.422621 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 65595.5us
I20260709 13:19:08.429226 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:08.429936 19583 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:08.430260 19582 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:08.430397 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:08.431196 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.431865 19583 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:08.432010 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.432878 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:08.432976 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.433454 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:08.342002 19625 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:08.432135 19587 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:08.431216 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:08.434914 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 93023.9us
I20260709 13:19:08.435436 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:08.435736 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:08.434178 19585 raft_consensus.cc:2376] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12. Re-sending same reply.
I20260709 13:19:08.436573 19655 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 8: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:08.437058 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.435436 19579 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:08.436281 23065 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:08.437589 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:08.437824 19503 raft_consensus.cc:1275] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:08.437991 23065 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:08.438340 19660 raft_consensus.cc:2393] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:08.438473 23065 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:08.438814 19579 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:08.439870 19580 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:19:08.440271 19580 pending_rounds.cc:85] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 6
I20260709 13:19:08.440487 19580 pending_rounds.cc:107] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:19:08.440730 19580 raft_consensus.cc:2889] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:08.436123 19587 raft_consensus.cc:2376] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11. Re-sending same reply.
I20260709 13:19:08.433856 19583 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:08.433848 19586 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:19:08.301103 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:08.283010 19627 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:08.435674 19582 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:08.456099 19507 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 8: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:08.444435 19476 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:08.462322 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 179395us
I20260709 13:19:08.433964 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:08.265039 23057 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:08.303249 23017 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.461478 23155 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.341521 23165 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:08.468420 23155 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.468504 23165 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:08.469573 22939 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:08.470048 22939 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.470383 22939 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.470813 23155 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:08.471391 23165 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:08.472280 23017 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:08.473760 23225 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:08.471431 23155 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:08.477020 23155 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:08.478058 23155 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.481837 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:08.480888 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.482532 19506 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:08.483474 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:08.484189 19506 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:08.481178 23017 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.487550 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:08.489352 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.491405 19653 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:08.492041 23017 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:08.493871 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:08.494225 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:08.495082 19508 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:19:08.496245 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:08.497943 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:08.503355 22939 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:08.505604 19655 raft_consensus.cc:2368] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11.
I20260709 13:19:08.508355 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:19:08.517244 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.521600 23131 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:08.522333 23131 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.524228 23111 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:08.524777 23131 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:08.527146 22937 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.527875 23265 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:08.528672 19658 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:19:08.538439 23188 consensus_meta.cc:287] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.585s	user 0.013s	sys 0.000s
I20260709 13:19:08.265074 23075 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.545469 23075 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:08.549721 23138 consensus_queue.cc:1175] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d56df3728fc04e37b2d29a3bcd91d167" responder_term: 12 status { last_received { term: 11 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:08.558882 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:08.560820 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:08.329129 23152 consensus_queue.cc:237] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.562354 19655 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:08.561231 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:08.485281 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:08.610574 19506 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:08.614562 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:08.615419 19507 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:08.617976 23146 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:08.618888 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:08.618949 23197 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:08.620229 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:08.621295 19658 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:08.622025 20662 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:08.623234 19408 catalog_manager.cc:5697] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 7 to 8, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 8 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:08.627434 23120 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.630132 22937 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:08.631063 23188 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.631585 23188 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.631920 23192 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:19:08.633533 23188 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:08.634176 23188 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.635179 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.635392 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:08.636124 19582 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:08.636931 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:08.637038 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:08.637825 19585 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:08.638250 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:08.639822 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:08.640276 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.634656 23188 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.641458 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:08.642715 23188 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:08.616220 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:08.643816 19509 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:08.640976 19584 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:08.637176 19582 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:19:08.652926 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.652989 19656 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:08.659730 19476 leader_election.cc:400] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11.
I20260709 13:19:08.660223 19476 leader_election.cc:403] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:08.625428 19408 catalog_manager.cc:5697] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 10 to 11, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 11 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:08.664513 19586 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
W20260709 13:19:08.667236 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.670094 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.671222 22275 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:08.672289 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.674156 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:08.675552 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:08.676318 19655 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
W20260709 13:19:08.679586 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.679839 19582 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:08.682634 19586 raft_consensus.cc:2393] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:19:08.684934 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 107727us
W20260709 13:19:08.686885 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.678906 19584 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:19:08.691565 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.694877 22971 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.697085 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:08.698441 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.671519 23188 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.702049 22275 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.705581 19504 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:19:08.703593 19408 catalog_manager.cc:5697] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:08.713732 19653 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:19:08.701148 19580 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:08.734886 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.704962 23075 consensus_queue.cc:1059] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:19:08.744599 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.761060 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:08.735277 23269 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:19:08.775743 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.792940 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.792925 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.794868 19579 raft_consensus.cc:2410] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:08.710214 23065 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.806209 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.796123 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:08.780655 19551 connection.cc:256] RPC call timeout handler was delayed by -1.4619868849999875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
I20260709 13:19:08.810544 19661 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:08.810237 19408 catalog_manager.cc:5697] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.811638 23065 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:08.811830 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.823573 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.826323 19504 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:19:08.835266 19583 raft_consensus.cc:2410] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:19:08.742532 23188 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.834648 23131 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.827935 23155 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.854611 19587 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:08.836351 22939 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:19:08.864415 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.867465 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:08.868409 19584 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:08.847862 23210 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.878185 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:08.881915 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.861091 23131 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.884683 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:08.885237 19659 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:08.884178 20659 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 10 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:08.884310 19408 catalog_manager.cc:5697] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
W20260709 13:19:08.891295 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.891194 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:08.892163 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:08.866995 23155 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.867990 23065 consensus_queue.cc:1059] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:19:08.897541 19654 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:08.898623 19408 catalog_manager.cc:5697] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:08.899616 19627 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:08.895550 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:08.903532 19584 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:08.900341 19586 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:08.903466 19408 catalog_manager.cc:5697] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.912065 19583 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:19:08.893942 22939 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:08.922021 22931 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:08.922304 23245 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.027s	sys 0.021s
W20260709 13:19:08.925061 23245 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.028s	sys 0.021s
I20260709 13:19:08.924882 22931 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:08.934213 23270 log.cc:927] Time spent T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:19:08.936640 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:08.948877 19580 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:19:08.949370 19580 pending_rounds.cc:85] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 8
I20260709 13:19:08.949592 19580 pending_rounds.cc:107] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:19:08.949903 19580 raft_consensus.cc:2889] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:08.950098 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.950239 23275 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:19:08.950663 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.951368 19586 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
W20260709 13:19:08.952234 23272 log.cc:927] Time spent T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:19:08.952435 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.953233 19578 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
W20260709 13:19:08.953576 23271 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:19:08.954538 19504 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:08.954768 19583 raft_consensus.cc:2393] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:08.959645 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:08.967913 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:08.969954 23234 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:08.970530 23234 raft_consensus.cc:697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:08.971396 23234 consensus_queue.cc:237] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.972265 19476 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:08.973451 23057 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:08.973295 23284 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:08.974129 19586 raft_consensus.cc:3055] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:08.974722 19586 raft_consensus.cc:740] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:19:08.974961 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 73023.2us
W20260709 13:19:08.972726 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 73201.4us
I20260709 13:19:08.975565 19586 consensus_queue.cc:260] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:08.976874 19586 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:08.977202 23050 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:08.974207 23057 raft_consensus.cc:697] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:08.979341 22275 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:08.986322 19584 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:08.981948 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:08.982347 19509 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:08.912736 23017 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.989133 19408 catalog_manager.cc:5697] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:08.991968 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.994886 23131 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:09.002913 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:08.901965 23210 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:08.927420 22931 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:08.928503 22939 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:19:09.014967 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 147126us
I20260709 13:19:08.980218 23120 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:09.038663 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:09.049860 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.050329 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:09.051090 19509 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:09.051146 19408 catalog_manager.cc:5697] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 4 to 6, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 6 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:09.071487 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 64105.3us
I20260709 13:19:09.031986 22939 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:09.072196 23271 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 13:19:09.080958 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 169839us
W20260709 13:19:09.050576 23211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.008s	sys 0.040s
I20260709 13:19:09.076068 19408 catalog_manager.cc:5697] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.089107 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:09.090078 19584 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:09.219199 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:09.097585 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:09.220395 19583 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
W20260709 13:19:09.208572 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 206403us
W20260709 13:19:09.087559 23211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.008s	sys 0.041s
I20260709 13:19:09.218343 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:09.174575 23277 log.cc:927] Time spent T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:19:09.116340 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:09.089361 19408 catalog_manager.cc:5697] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 5 to 7, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 7 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.229148 19580 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:09.233496 19586 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:19:09.233918 19586 pending_rounds.cc:85] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 6
I20260709 13:19:09.234123 19586 pending_rounds.cc:107] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 9.7
W20260709 13:19:09.234156 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.234431 19586 raft_consensus.cc:2889] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:09.197593 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 220471us
W20260709 13:19:09.213716 23285 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:19:09.081821 23188 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:09.237074 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:09.243568 19504 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:19:09.208774 22971 consensus_meta.cc:287] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.000s
I20260709 13:19:09.072674 23017 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.241272 19408 catalog_manager.cc:5697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:09.251199 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.244570 23210 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:09.251729 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.256582 23042 raft_consensus.cc:2764] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:09.252050 23213 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.258210 23213 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.260296 23213 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:09.257150 19408 catalog_manager.cc:5697] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 5 to 8, leader changed from 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 8 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.261759 19652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:09.262591 19652 raft_consensus.cc:606] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:09.262648 19408 catalog_manager.cc:5697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 3 to 7, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 7 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:09.264173 19408 catalog_manager.cc:5697] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 6 to 7, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 7 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.265959 19659 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:09.265937 19625 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:09.267843 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.253137 23281 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.290s	user 0.001s	sys 0.001s
W20260709 13:19:09.268836 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 171388us
I20260709 13:19:09.267462 19509 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:19:09.268987 19408 catalog_manager.cc:5697] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:09.273710 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:09.247818 23065 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.247125 22971 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11.
I20260709 13:19:09.283670 19408 catalog_manager.cc:5697] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 7 to 9, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 9 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.188724 23057 consensus_queue.cc:237] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.286047 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:09.247968 23293 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.287835 19627 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:09.300055 19625 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:09.286919 19581 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.287652 19578 raft_consensus.cc:1275] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:09.291720 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:09.292165 23295 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:09.293247 23283 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:19:09.293875 23292 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.246325 23294 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:19:09.273341 23210 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.306701 19580 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:09.307485 19584 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:19:09.308502 19627 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:19:09.309542 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:09.286002 23042 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.300303 23293 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.314015 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:09.314786 23017 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:09.315166 23075 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:09.317838 23152 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.299973 19478 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:09.318135 23138 raft_consensus.cc:3055] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:09.317751 23065 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:09.320932 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.325929 19408 catalog_manager.cc:5697] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 8 to 11, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 11 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:09.287236 23155 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:09.328231 19509 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:09.328789 19512 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
I20260709 13:19:09.324501 19584 pending_rounds.cc:85] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 6
W20260709 13:19:09.338043 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.362028 19584 pending_rounds.cc:107] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:19:09.362406 19584 raft_consensus.cc:2889] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:09.322952 23131 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:09.330420 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:09.331777 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:09.336361 19511 raft_consensus.cc:1217] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Deduplicated request from leader. Original: 7.3->[8.4-8.4]   Dedup: 8.4->[]
I20260709 13:19:09.331365 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:09.325484 23173 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:09.367182 19511 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:19:09.324923 23295 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.362675 23075 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:09.336987 23138 raft_consensus.cc:740] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:09.395345 19476 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:09.393525 19508 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:09.400327 19408 catalog_manager.cc:5697] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.365720 23173 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.413172 23173 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.414327 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:09.382129 23131 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.409781 23297 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:09.411136 23075 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.412139 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:09.412679 23245 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.331844 23042 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.429800 19510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:19:09.430051 23295 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:09.430444 19510 raft_consensus.cc:606] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:09.421833 23155 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:09.431327 23042 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:09.408651 23293 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:09.423889 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:09.438512 19584 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:09.426169 19578 raft_consensus.cc:2410] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:09.423081 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:09.423712 23146 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 13:19:09.428073 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 128261us
I20260709 13:19:09.430801 19510 raft_consensus.cc:614] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:09.360646 23152 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.364748 23210 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.446333 19581 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:09.419934 19408 catalog_manager.cc:5697] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 6 to 8, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 8 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:09.448504 19586 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:19:09.447957 19408 catalog_manager.cc:5697] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.451371 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:09.452092 19659 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:19:09.334276 23292 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.448908 19586 pending_rounds.cc:85] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 5
I20260709 13:19:09.453508 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:09.459470 19586 pending_rounds.cc:107] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 10.6
W20260709 13:19:09.459698 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.459813 19586 raft_consensus.cc:2889] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:09.461067 19509 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:09.468117 22939 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:09.472777 23274 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.576s	user 0.002s	sys 0.002s
I20260709 13:19:09.472433 19408 catalog_manager.cc:5697] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 6 to 7, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 7 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.473969 19656 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:09.474982 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2487) took 1248 ms. Trace:
I20260709 13:19:09.430825 23211 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:19:09.454470 23287 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:19:09.486081 19478 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:09.485242 19505 rpcz_store.cc:276] 0709 13:19:08.226435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.226569 (+   134us) service_pool.cc:224] Handling call
0709 13:19:08.268758 (+ 42189us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:19:08.268956 (+   198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.269358 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:08.278190 (+  8832us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.534221 (+256031us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b180032ea80. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d522 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:19:08.793171 (+258950us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.793819 (+   648us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.793992 (+   173us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:08.794037 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.794128 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.472188 (+678060us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:09.474774 (+  2586us) raft_consensus.cc:1685] finished
0709 13:19:09.474796 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.474927 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13655,"prepare.queue_time_us":11467,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":35918,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":16822,"spinlock_wait_cycles":75437952,"thread_start_us":446821,"threads_started":1,"wal-append.queue_time_us":562914}
I20260709 13:19:09.474787 23138 consensus_queue.cc:260] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.481576 19582 raft_consensus.cc:3055] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:09.429802 23131 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:09.496874 19582 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:09.497553 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:09.498281 19408 catalog_manager.cc:5697] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 5 to 6, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 6 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.453428 23293 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:09.527144 19505 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:09.509302 19509 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:09.535540 19505 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:09.537264 19505 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:09.535277 19408 catalog_manager.cc:5697] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 7 to 8, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 8 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.549067 23292 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:09.549726 23292 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.550227 23292 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.533964 23131 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.551740 23131 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.552517 23292 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:09.554378 23065 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:09.555806 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2507) took 1025 ms. Trace:
I20260709 13:19:09.556198 19512 rpcz_store.cc:276] 0709 13:19:08.530465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.410941 (+880476us) service_pool.cc:224] Handling call
0709 13:19:09.411282 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.446305 (+ 35023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.446343 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.451939 (+  5596us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.500420 (+ 48481us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:09.500459 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.500526 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.555611 (+ 55085us) raft_consensus.cc:1685] finished
0709 13:19:09.555633 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.555750 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46202,"raft.queue_time_us":46981,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":18476,"thread_start_us":48093,"threads_started":1,"wal-append.queue_time_us":101705}
I20260709 13:19:09.558167 22939 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:09.558504 23112 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:09.526579 23293 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.559007 23112 raft_consensus.cc:697] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:09.559250 23293 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:09.559908 23112 consensus_queue.cc:237] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.561676 23138 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.561998 23131 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:09.429837 23245 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.545557 19582 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.571516 19582 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:09.578727 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 119465us
I20260709 13:19:09.579739 19478 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:09.579883 23225 raft_consensus.cc:3055] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:09.580384 23225 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:09.581832 23304 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:09.582613 23304 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:09.565414 23152 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:09.584405 23245 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:09.587987 23291 log.cc:927] Time spent T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:19:09.590502 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1885) took 1365 ms. Trace:
I20260709 13:19:09.590953 19511 rpcz_store.cc:276] 0709 13:19:08.225337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.225442 (+   105us) service_pool.cc:224] Handling call
0709 13:19:08.369292 (+143850us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:19:08.369553 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.370590 (+1001037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.590225 (+219635us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b5400184cd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:09.590438 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2220660224}
W20260709 13:19:09.592092 23303 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:19:09.591909 23173 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.593039 23210 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:09.594139 23131 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.593987 23225 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.594688 23131 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.595366 23225 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.596941 23131 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:09.508116 23211 raft_consensus.cc:697] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:09.618888 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.621181 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.623253 19408 catalog_manager.cc:5697] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
W20260709 13:19:09.626504 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 318039us
I20260709 13:19:09.631209 19408 catalog_manager.cc:5697] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.605436 23295 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:09.642766 19511 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:19:09.647951 19511 raft_consensus.cc:606] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:09.641889 19408 catalog_manager.cc:5697] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.648422 19511 raft_consensus.cc:614] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:09.655689 19582 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:09.626080 23210 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.680377 23211 consensus_queue.cc:237] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.691668 20659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59444 (request call id 127) took 1201 ms. Trace:
I20260709 13:19:09.692251 20659 rpcz_store.cc:276] 0709 13:19:08.490012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.490171 (+   159us) service_pool.cc:224] Handling call
0709 13:19:08.490526 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.897469 (+406943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.691268 (+793799us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b5400599cd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:09.691522 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889759616}
I20260709 13:19:09.693866 19478 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:09.695370 19478 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:09.696635 19478 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:09.699644 19654 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:09.701428 23127 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:09.702142 23127 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:09.702767 23127 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:09.703217 23293 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:09.704417 23290 log.cc:927] Time spent T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.422s	user 0.000s	sys 0.002s
I20260709 13:19:09.708082 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2502) took 1252 ms. Trace:
W20260709 13:19:09.708885 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 79142.3us
I20260709 13:19:09.708616 19507 rpcz_store.cc:276] 0709 13:19:08.455238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.674128 (+218890us) service_pool.cc:224] Handling call
0709 13:19:08.674555 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.836928 (+162373us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:08.858195 (+ 21267us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.067972 (+209777us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.082724 (+ 14752us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.082911 (+   187us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:09.082963 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.083061 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.586673 (+503612us) spinlock_profiling.cc:243] Waited 7.79 ms on lock 0x7b4800270258. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c36683aa1 00007f6c3667ab37 00007f6c3667a9ca 00007f6c3677226f 00007f6c36771f37 00007f6c3678655c 00007f6c36786508 00007f6c36786488 00007f6c36786443 00007f6c367856ec 00007f6c356afa96
0709 13:19:09.703812 (+117139us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:09.707781 (+  3969us) raft_consensus.cc:1685] finished
0709 13:19:09.707812 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.708002 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58520,"prepare.queue_time_us":19374,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":53936,"raft.run_cpu_time_us":3901,"raft.run_wall_time_us":528257,"spinlock_wait_cycles":24594688,"thread_start_us":295381,"threads_started":2,"wal-append.queue_time_us":395059}
I20260709 13:19:09.715638 19627 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:09.715830 23050 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:09.717329 22931 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:09.717981 22931 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:09.717801 23050 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:09.720625 19408 catalog_manager.cc:5697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 1 to 5, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 5 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:09.718878 19476 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:09.722960 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 422963us
I20260709 13:19:09.723696 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:09.729899 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:09.730840 19656 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
W20260709 13:19:09.732519 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 276649us
I20260709 13:19:09.705475 23293 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:09.724097 23120 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:09.722790 23138 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:19:09.746063 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:09.746168 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:09.748771 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:09.750856 19659 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:09.751271 19503 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:09.658422 23284 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:19:09.747958 19476 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:09.748438 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.752970 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:09.661854 23165 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:19:09.720149 23173 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:09.758666 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:09.753554 19653 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:09.761636 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:09.761826 19661 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:09.754420 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:09.754040 19408 catalog_manager.cc:5697] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 3 to 7, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 7 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:09.753576 19507 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.755362 19656 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:09.745051 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:09.758030 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.720320 23228 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:19:09.777179 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 53573.4us
I20260709 13:19:09.777565 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:09.777782 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:09.712610 23210 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.745772 23306 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.779341 19510 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:09.757759 23152 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:09.782397 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:09.719026 22931 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.751398 23120 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.777697 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:09.785425 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.786499 19627 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:09.789963 23321 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:09.791916 23305 raft_consensus.cc:3055] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:09.792472 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:09.793931 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:09.796013 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2504) took 1312 ms. Trace:
I20260709 13:19:09.788713 19658 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:09.801120 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:09.804764 19625 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:09.805667 19652 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:09.750396 23292 consensus_queue.cc:1059] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:19:09.803424 19504 rpcz_store.cc:276] 0709 13:19:08.483144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.382141 (+898997us) service_pool.cc:224] Handling call
0709 13:19:09.399415 (+ 17274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.491502 (+ 92087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.491551 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.528470 (+ 36919us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.734545 (+206075us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:09.734582 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.734647 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.795802 (+ 61155us) raft_consensus.cc:1685] finished
0709 13:19:09.795818 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.795956 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18392,"raft.queue_time_us":31789,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":230177,"threads_started":2,"wal-append.queue_time_us":225304}
I20260709 13:19:09.806991 23313 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:09.784688 23315 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:09.810976 23313 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.813158 23313 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:09.785333 23293 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:09.813967 23293 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.815973 23293 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:09.817876 19657 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:09.819221 19657 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:09.820358 19657 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:09.803419 19661 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:19:09.761077 23127 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:19:09.802862 23305 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:09.828972 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:09.797427 23152 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.830413 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:09.837944 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:09.839414 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:09.838532 19658 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:09.842316 19507 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:09.842374 19579 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:09.830718 19652 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:09.844430 19582 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:09.847184 23234 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:09.848861 23311 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:09.841948 23165 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:09.849997 23165 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:09.831921 23292 raft_consensus.cc:3055] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:09.799382 23120 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.807533 23321 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.861742 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:09.869920 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.869637 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 135529us
W20260709 13:19:09.863009 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 52644.5us
W20260709 13:19:09.871894 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 67421.9us
W20260709 13:19:09.872754 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 139319us
I20260709 13:19:09.872831 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:09.877859 19478 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:09.873905 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:09.873916 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:09.874632 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:09.873973 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:09.876580 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:09.843181 23152 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.879671 19579 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.884020 19582 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:19:09.872170 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:09.851071 23017 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:09.887643 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:09.891644 19580 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:09.889564 19478 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:09.886611 19586 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:09.869575 23292 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:09.898470 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:09.899085 19580 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.901075 19660 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:09.903359 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:09.904111 19627 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:09.905709 23017 raft_consensus.cc:697] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:09.906112 23210 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:09.906736 23017 consensus_queue.cc:237] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.909739 23314 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:09.910344 23314 raft_consensus.cc:697] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:09.911247 23314 consensus_queue.cc:237] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.902245 22931 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.912568 22931 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:09.913825 23322 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:19:09.914115 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:09.914844 20659 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:09.862613 23138 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:19:09.916524 22931 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:09.941462 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:09.943513 23224 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:19:09.888388 23245 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:09.951066 19580 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:09.914119 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:09.920710 19655 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
W20260709 13:19:09.958129 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 68644.2us
I20260709 13:19:09.960317 19586 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:09.961217 22971 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:09.950829 23225 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:19:09.950608 23234 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
W20260709 13:19:09.940608 23328 log.cc:927] Time spent T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:19:09.971050 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 69357.7us
I20260709 13:19:09.965520 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:09.974074 19625 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:09.977922 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:09.977046 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:09.977356 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:09.980628 19504 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:09.981405 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:09.982798 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 110740us
I20260709 13:19:09.983819 19511 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:09.985107 19510 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:09.987754 19512 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:09.987715 19503 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:09.988967 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:09.997219 19627 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:09.996331 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:10.004570 19503 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:10.006443 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:10.003906 19625 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:09.975162 23309 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:09.975257 23293 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:10.007815 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:10.020889 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.008186 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:10.008055 19627 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:10.064906 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:10.065047 19503 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:10.070983 19504 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:09.972672 22931 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:19:09.977084 23311 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:19:09.987579 23297 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:10.084156 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:09.895507 23305 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:10.065402 23065 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:10.067502 23265 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.101598 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:10.102177 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:10.104200 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 127965us
I20260709 13:19:10.103029 19503 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:10.087507 23309 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:10.102396 19657 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:10.110433 23329 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:19:10.107872 23297 raft_consensus.cc:697] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:19:10.112108 23280 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 1.003s	user 0.000s	sys 0.004s
I20260709 13:19:10.112414 23297 consensus_queue.cc:237] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:10.119004 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 115244us
I20260709 13:19:10.097886 23225 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:10.116215 23309 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.122740 23309 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:10.008620 23292 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:10.128506 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 263) took 1490 ms. Trace:
I20260709 13:19:10.135798 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:10.138458 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.132517 19585 rpcz_store.cc:276] 0709 13:19:08.637942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.638360 (+   418us) service_pool.cc:224] Handling call
0709 13:19:08.638681 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.639099 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.639161 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.639662 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.854000 (+214338us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:08.854038 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.854114 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.111408 (+1257294us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:10.114801 (+  3393us) raft_consensus.cc:1685] finished
0709 13:19:10.114826 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.128419 (+ 13593us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":284,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":169,"spinlock_wait_cycles":6886272,"thread_start_us":209847,"threads_started":1,"wal-append.queue_time_us":339561}
I20260709 13:19:10.147650 19476 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:10.148870 23298 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:10.149288 23298 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.149835 23298 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:10.150451 23330 log.cc:927] Time spent T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:10.164266 19657 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
W20260709 13:19:10.165844 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.126626 23225 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.178936 23225 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:10.180282 23321 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:10.180575 23331 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:19:10.181512 23332 log.cc:927] Time spent T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:19:10.181843 23245 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:10.183151 19625 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:10.187911 23225 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:10.195760 19579 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:10.171398 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:10.181761 23211 consensus_queue.cc:1059] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:10.178577 23315 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:10.175087 19478 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:10.202509 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 194523us
I20260709 13:19:10.109318 23265 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:10.212966 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:10.211596 19627 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:10.219717 19478 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:10.228184 19512 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
W20260709 13:19:10.246701 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.228706 19512 pending_rounds.cc:85] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 4
I20260709 13:19:10.255183 19512 pending_rounds.cc:107] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:19:10.255518 19512 raft_consensus.cc:2889] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:10.256374 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 43498.2us
I20260709 13:19:10.257493 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:10.259093 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:10.259960 19504 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:10.266579 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:10.267719 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:10.268926 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:10.226665 23065 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:10.217998 23188 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:10.189368 23298 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:10.310482 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.177444 22971 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:19:10.240538 23057 raft_consensus.cc:3055] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:10.225986 23299 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:10.272480 23042 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:10.287045 23294 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:10.437819 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 168992us
I20260709 13:19:10.441403 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:10.428292 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 210481us
I20260709 13:19:10.240430 23321 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:10.467555 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:10.503786 19504 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:10.422022 23313 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:10.510666 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:10.428333 23304 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:10.516760 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 310072us
I20260709 13:19:10.522123 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:10.431234 23225 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:10.438297 23131 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:10.440047 23057 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:10.466624 23299 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:10.503496 23294 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.484084 23065 raft_consensus.cc:697] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:10.570376 19478 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:10.510084 23313 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:10.528019 23336 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:10.568688 23299 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:10.564193 23294 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:10.607518 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 82092.7us
I20260709 13:19:10.609479 19478 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:10.530022 23188 consensus_queue.cc:1059] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:19:10.587889 23313 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:10.585786 23042 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:10.617177 23225 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:10.597361 23319 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 13:19:10.623811 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 101746us
I20260709 13:19:10.642452 19478 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:10.651576 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:10.655314 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:10.666666 23341 log.cc:927] Time spent T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:19:10.667896 23339 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:10.632591 23042 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:10.650431 23284 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:10.601099 23336 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:10.658007 22971 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:10.645247 23351 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:10.661753 23225 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:10.666654 23298 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:10.674957 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 164375us
I20260709 13:19:10.676296 19504 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
W20260709 13:19:10.703536 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.707674 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 52455.8us
I20260709 13:19:10.676654 23042 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:10.710696 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:10.686335 22971 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:10.672742 23350 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:10.696177 23210 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:10.731081 19478 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:10.733440 23335 log.cc:927] Time spent T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.426s	user 0.001s	sys 0.001s
W20260709 13:19:10.734863 20659 consensus_meta.cc:287] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.819s	user 0.007s	sys 0.006s
I20260709 13:19:10.735235 20659 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:10.736351 19505 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:10.672374 23065 consensus_queue.cc:237] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:10.661655 23057 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:10.741048 23120 consensus_meta.cc:287] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.856s	user 0.011s	sys 0.001s
I20260709 13:19:10.710351 23351 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:10.724505 22971 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:10.748798 23120 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:10.758778 19509 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:19:10.749670 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 45197.1us
I20260709 13:19:10.713099 23265 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:10.723909 23350 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:10.754479 23344 log.cc:927] Time spent T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:19:10.777114 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 44341us
I20260709 13:19:10.769871 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:10.746058 23304 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:10.750488 23320 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:10.757278 23120 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:10.769819 23188 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:10.793540 23057 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:10.769960 23350 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:10.801319 23343 log.cc:927] Time spent T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:19:10.827905 23065 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.839656 23357 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:10.839999 23065 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:10.842645 23065 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:10.754698 23351 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:10.856478 23306 consensus_meta.cc:287] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 1.054s	user 0.003s	sys 0.011s
I20260709 13:19:10.857002 23306 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:10.857733 19660 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:10.859001 23305 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:10.862162 23336 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:10.800375 23225 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:10.831641 23365 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:19:10.874090 23293 raft_consensus.cc:3055] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:10.874567 23293 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:10.875438 23293 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:10.848349 23309 consensus_meta.cc:287] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.722s	user 0.012s	sys 0.002s
I20260709 13:19:10.887071 19625 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:10.887951 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 71359.3us
I20260709 13:19:10.892198 23234 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:10.894047 23165 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:10.895471 23165 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:10.897888 23306 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:10.898341 23306 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.898684 23306 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:10.902937 19625 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:10.903074 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.904204 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.905788 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:10.906886 19580 raft_consensus.cc:2393] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:10.908387 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:10.910323 19580 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:10.916004 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59942 (request call id 201) took 1013 ms. Trace:
I20260709 13:19:10.916736 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:10.917397 23295 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:10.918015 23295 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:10.917449 19585 raft_consensus.cc:2376] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12. Re-sending same reply.
I20260709 13:19:10.924561 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:10.916484 19656 rpcz_store.cc:276] 0709 13:19:09.902335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.902489 (+   154us) service_pool.cc:224] Handling call
0709 13:19:09.902826 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.914111 (+ 11285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.914150 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.914649 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.976271 (+ 61622us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:09.976298 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.976352 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.881271 (+904919us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b2400397208. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e4f39c4 00007f6c2e4f1acb 00007f6c2e6acdc9 00007f6c2e6aca55 00007f6c2e6abfb0 00007f6c31322488 00007f6c31322be8 00007f6c312fa398 00007f6c312f576a 00007f6c312f4bb6
0709 13:19:10.913201 (+ 31930us) raft_consensus.cc:1685] finished
0709 13:19:10.913221 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.915931 (+  2710us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10831,"raft.queue_time_us":12185,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":73,"spinlock_wait_cycles":47664512,"thread_start_us":61265,"threads_started":1,"wal-append.queue_time_us":167036}
I20260709 13:19:10.930748 19579 raft_consensus.cc:3055] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:10.932693 19579 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:10.926270 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:10.935115 19580 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:19:10.936502 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:10.938280 19580 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:10.941761 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:10.944937 19587 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:10.947165 19584 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:10.947351 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:10.947525 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:10.925019 23152 consensus_meta.cc:287] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 1.025s	user 0.009s	sys 0.004s
I20260709 13:19:10.948060 19581 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:10.920406 23234 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:10.941643 19579 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:10.995080 19579 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:10.888850 23309 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:10.934358 23188 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:10.991880 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:11.003598 19657 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:10.991087 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:10.999032 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:10.939601 23297 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.000380 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:11.006348 19586 raft_consensus.cc:3055] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:11.006673 19585 raft_consensus.cc:2410] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:11.004570 19659 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:11.004770 19584 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.006728 19586 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:10.986053 23127 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:11.010053 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 94456.3us
W20260709 13:19:11.020651 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.051049 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 238893us
I20260709 13:19:11.059302 19579 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:19:11.059573 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 105890us
I20260709 13:19:11.062371 19579 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:19:11.063903 19580 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:11.086141 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:11.086319 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 69443.1us
I20260709 13:19:11.086809 19585 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:10.994489 23152 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.093640 19657 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:11.122639 19659 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:11.092576 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:11.016155 23297 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.129709 19506 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:11.129516 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:11.073547 23127 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.152251 23374 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:19:11.154527 23374 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:11.078001 23294 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:11.185714 23369 log.cc:927] Time spent T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:19:11.186499 23338 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:19:11.186655 23313 consensus_meta.cc:287] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.537s	user 0.006s	sys 0.005s
I20260709 13:19:11.187124 23338 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.187723 23294 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:11.187870 23313 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.190181 23313 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:11.193323 23370 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:19:11.198293 23292 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:11.199201 23127 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:11.201510 23165 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.202011 23165 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:11.202556 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.202658 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.204128 23165 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:11.204828 19504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:19:11.205439 19504 raft_consensus.cc:606] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:11.205545 23298 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.205848 19504 raft_consensus.cc:614] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:11.206080 23298 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.207717 23304 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:11.208115 23298 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:11.208254 23304 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.210574 19578 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:11.211630 23152 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:11.132884 23042 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.212570 23350 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.214538 23304 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:11.214618 23042 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:11.215054 23165 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:11.216885 23165 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.220999 19587 raft_consensus.cc:2410] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:19:11.169977 23314 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:11.229910 23368 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:19:11.260349 23127 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:11.261018 23127 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:11.262377 23342 log.cc:927] Time spent T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.645s	user 0.002s	sys 0.002s
I20260709 13:19:11.263381 23127 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:11.263886 23165 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:11.264277 23359 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:11.264322 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2336) took 1331 ms. Trace:
I20260709 13:19:11.279948 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:11.278409 19476 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:11.277000 19505 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:11.282523 19659 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:11.278004 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:11.284307 19582 raft_consensus.cc:2368] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10.
I20260709 13:19:11.239770 23294 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.284482 19476 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:11.285888 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 225003us
W20260709 13:19:11.288455 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 201264us
I20260709 13:19:11.284204 19586 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.290225 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:11.291464 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:11.292073 19587 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:11.290149 19504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:19:11.292981 19504 raft_consensus.cc:606] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:11.293347 19504 raft_consensus.cc:614] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:11.293485 19586 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.293537 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:11.279270 19583 rpcz_store.cc:276] 0709 13:19:09.932813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.152117 (+219304us) service_pool.cc:224] Handling call
0709 13:19:10.152474 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.152876 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.152909 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.153413 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.204906 (+ 51493us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:10.204946 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.205015 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.261655 (+1056640us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:11.264024 (+  2369us) raft_consensus.cc:1685] finished
0709 13:19:11.264047 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.264259 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":39973120,"thread_start_us":50999,"threads_started":1,"wal-append.queue_time_us":410841}
W20260709 13:19:11.294791 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 166259us
I20260709 13:19:11.295660 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:11.295816 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:11.296954 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:11.298342 19581 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:11.300132 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:11.300347 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:11.300377 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:11.300954 19582 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:11.301882 23057 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:11.301734 19508 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:11.289702 23165 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:11.252386 23314 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.307165 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:11.303813 19656 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:11.322433 19584 raft_consensus.cc:2410] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:11.324827 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:11.343061 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:11.355747 19582 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:11.289608 23384 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.251379 23306 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.254168 22971 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:11.294606 23294 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.308832 23057 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:11.361822 23384 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.409754 23388 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:11.419973 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:11.420928 19654 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:19:11.413909 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 53872.8us
I20260709 13:19:11.424482 19510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db4589d6497c49308384eacc43241a32"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:19:11.415978 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:11.425872 19657 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:11.415181 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:11.426643 19656 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:11.424806 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:11.417714 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:11.429709 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:11.311108 23374 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:11.391021 19582 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:11.467525 23349 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.465636 23304 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:11.472203 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:11.436764 19586 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:11.362609 23131 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 13:19:11.362409 23305 consensus_meta.cc:287] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.503s	user 0.012s	sys 0.000s
I20260709 13:19:11.357278 23120 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.359853 23234 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:11.497036 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:11.357007 23165 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:11.469838 23349 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.429188 23152 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:11.429821 23338 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:11.483107 23322 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:11.501145 19661 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:11.416885 23384 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:11.435019 23354 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:19:11.495342 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 204565us
I20260709 13:19:11.504338 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:11.470137 23304 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.468036 23374 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:11.499224 23299 consensus_meta.cc:287] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.884s	user 0.013s	sys 0.000s
I20260709 13:19:11.490901 23292 raft_consensus.cc:2764] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:19:11.538818 23304 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:11.524632 23165 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.543329 22971 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:11.499620 19586 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.510861 23388 consensus_queue.cc:1059] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:19:11.520893 19478 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:11.521763 23057 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.497960 23389 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:11.522560 23294 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:11.523365 23234 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.524050 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:11.524778 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:11.503245 23120 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.525522 23042 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:11.494334 23350 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:11.528388 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.534646 19510 raft_consensus.cc:606] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:11.535091 23374 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:11.526209 23354 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.535665 23299 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.514863 23152 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.551152 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 2041) took 1485 ms. Trace:
W20260709 13:19:11.555366 19509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1917) took 1584 ms (client timeout 1627 ms). Trace:
I20260709 13:19:11.580967 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:11.581220 19509 rpcz_store.cc:269] 0709 13:19:09.971313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.984701 (+ 13388us) service_pool.cc:224] Handling call
0709 13:19:11.555043 (+1570342us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b5400250654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:11.555243 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1584620288}
I20260709 13:19:11.582597 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:11.582934 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:11.583489 19507 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:11.584295 19507 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.570791 19586 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
W20260709 13:19:11.572337 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.574047 19510 raft_consensus.cc:614] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:11.574096 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.580446 19660 rpcz_store.cc:276] 0709 13:19:10.060542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.060684 (+   142us) service_pool.cc:224] Handling call
0709 13:19:10.060992 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.858116 (+797124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.532921 (+674805us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b54001eb254. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:11.545846 (+ 12925us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1831862016}
I20260709 13:19:11.554347 23389 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.573233 23292 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.585871 19508 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:11.576215 23042 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.596140 19503 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:11.576426 23349 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:11.610674 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:11.611832 19586 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:11.590274 23389 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.616007 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:11.617941 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:11.617103 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 102283us
I20260709 13:19:11.618564 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:11.618069 19581 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:11.616238 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:11.619982 19507 raft_consensus.cc:1275] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:11.620373 19584 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:11.595134 23042 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:11.625037 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:11.625876 23406 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.629576 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:11.640306 19587 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:11.593520 23388 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:11.622421 20659 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:11.638818 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:11.595799 23292 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:11.595038 23313 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:11.613912 23320 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:11.658787 23293 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.673498 23406 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:11.709555 23357 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
W20260709 13:19:11.702600 23295 consensus_meta.cc:287] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.752s	user 0.012s	sys 0.000s
I20260709 13:19:11.722114 23295 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:11.723863 19659 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:11.633919 23314 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:11.727424 23377 raft_consensus.cc:3055] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:11.727933 23377 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:19:11.713827 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.729938 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.719529 19582 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:11.715273 23152 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:11.785982 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 55913.6us
I20260709 13:19:11.785202 23410 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:19:11.790059 23407 consensus_queue.cc:1059] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:11.791327 23407 raft_consensus.cc:3055] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:11.791680 23407 raft_consensus.cc:740] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:19:11.792649 23407 consensus_queue.cc:260] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:11.793699 23042 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:11.709796 23397 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:19:11.712689 23396 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 13:19:11.728473 23387 log.cc:927] Time spent T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Append to log took a long time: real 0.215s	user 0.003s	sys 0.000s
I20260709 13:19:11.713160 23320 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.719942 23188 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:11.719182 23292 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:11.703047 23388 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:11.721592 23357 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:11.719336 23313 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:11.756474 23377 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:11.829038 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 237593us
I20260709 13:19:11.833480 19583 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:19:12.253578 19503 consensus_meta.cc:287] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.654s	user 0.012s	sys 0.016s
I20260709 13:19:12.262415 19503 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:12.266647 23377 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:12.260049 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:12.272544 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:12.276810 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:11.831425 23389 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:11.833884 23404 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.181s	user 0.002s	sys 0.008s
I20260709 13:19:11.869920 23293 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.830776 23042 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:12.001748 23120 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:12.265028 23188 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:12.249332 23406 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:12.273877 23292 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.276072 23297 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:12.279321 23407 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.834771 23299 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:12.295934 23042 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:12.293679 23374 consensus_meta.cc:287] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.713s	user 0.007s	sys 0.004s
W20260709 13:19:12.316882 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.295255 23293 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.328510 23413 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:12.317219 23295 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:12.328224 23042 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:12.311748 23374 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.333158 23389 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:12.338183 23413 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:12.353690 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.308727 23292 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:12.357098 20618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.025s	sys 0.032s
I20260709 13:19:12.356657 23413 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:12.368153 20618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.025s	sys 0.034s
I20260709 13:19:12.370239 23313 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:12.380059 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:12.386432 19652 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 12.
I20260709 13:19:12.402012 19657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 2050) took 1119 ms. Trace:
I20260709 13:19:12.402493 19657 rpcz_store.cc:276] 0709 13:19:11.282219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.282351 (+   132us) service_pool.cc:224] Handling call
0709 13:19:11.293946 (+ 11595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.426427 (+132481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.401736 (+975309us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54002c7ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:12.401939 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302365056}
W20260709 13:19:12.405051 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 128341us
W20260709 13:19:12.403522 20618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.410496 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:12.414974 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:12.416692 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:12.416828 23293 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:12.420884 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:12.421674 23042 raft_consensus.cc:2764] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:19:12.422148 23354 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:12.427626 19503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1925) took 2205 ms (client timeout 2127 ms). Trace:
I20260709 13:19:12.427650 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:12.428117 19503 rpcz_store.cc:269] 0709 13:19:10.221995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.439992 (+217997us) service_pool.cc:224] Handling call
0709 13:19:12.427434 (+1987442us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000744d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:12.427550 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2553837440}
I20260709 13:19:12.429054 23377 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:12.433218 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:12.435235 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:12.415122 23313 raft_consensus.cc:2764] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:12.413864 23357 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:12.439935 23293 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:12.485080 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 49916.7us
W20260709 13:19:12.497522 23417 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:19:12.498077 23292 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:12.440501 23188 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.499200 23388 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:12.493180 23377 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:19:12.616091 23351 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.617s	user 0.012s	sys 0.025s
W20260709 13:19:12.710634 19660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.035s	sys 0.044s
W20260709 13:19:12.692178 23351 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.697s	user 0.012s	sys 0.026s
I20260709 13:19:12.734912 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59942 (request call id 205) took 1102 ms. Trace:
I20260709 13:19:12.699954 23377 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:12.736472 19660 rpcz_store.cc:276] 0709 13:19:11.632149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.632375 (+   226us) service_pool.cc:224] Handling call
0709 13:19:11.632754 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.633026 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:12.099996 (+466970us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.734405 (+634409us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.734485 (+    80us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:12.734561 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.734661 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.734844 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":679107,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":1704,"thread_start_us":1027341,"threads_started":2}
I20260709 13:19:12.749516 23377 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.755697 23188 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:12.757146 23320 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.759500 23320 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:12.760342 19586 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:12.711643 23413 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.767204 23413 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:12.774150 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 2029) took 1160 ms. Trace:
I20260709 13:19:12.774700 19582 rpcz_store.cc:276] 0709 13:19:11.614052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.614190 (+   138us) service_pool.cc:224] Handling call
0709 13:19:12.773954 (+1159764us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5400247554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:12.774081 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230721920}
I20260709 13:19:12.783895 19627 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:12.790390 22275 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:12.784854 23188 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.793534 22275 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.785033 23313 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.785486 23357 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.786033 23075 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:19:12.795392 23428 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:12.795962 23428 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.795617 23357 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.796391 23428 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:12.785185 23388 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:12.784415 23413 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.784535 23320 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.798803 23075 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:12.797216 23388 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:12.798887 23313 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:12.799687 23357 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:12.802671 23173 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:12.803951 23429 consensus_queue.cc:1059] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:12.806649 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2550) took 1504 ms. Trace:
W20260709 13:19:12.812839 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.808104 19627 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:12.818255 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.813280 22275 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:12.806915 23188 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.822288 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2341) took 1835 ms. Trace:
I20260709 13:19:12.823437 23188 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:12.822683 19578 rpcz_store.cc:276] 0709 13:19:10.987207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.211360 (+224153us) service_pool.cc:224] Handling call
0709 13:19:11.211674 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.228884 (+ 17210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.228932 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:11.249551 (+ 20619us) log.cc:844] Serialized 26 byte log entry
0709 13:19:11.467121 (+217570us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:12.821767 (+1354646us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.821989 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.822060 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.822097 (+    37us) raft_consensus.cc:1685] finished
0709 13:19:12.822109 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.822230 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1347519,"raft.queue_time_us":20390,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":4072,"thread_start_us":187052,"threads_started":1,"wal-append.queue_time_us":252089}
I20260709 13:19:12.824365 23042 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:12.826170 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 1.3053e+06us
I20260709 13:19:12.827582 19478 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:12.815860 23350 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:12.810254 23413 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.830490 23413 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:12.811625 23320 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.831494 23428 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.833246 23320 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:12.833770 23354 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:12.836508 19551 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.129:38645 timed out after 2.127s (SENT) [suppressed 14 similar messages]
I20260709 13:19:12.815009 19505 rpcz_store.cc:276] 0709 13:19:11.302779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.303135 (+   356us) service_pool.cc:224] Handling call
0709 13:19:11.303549 (+   414us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:11.304082 (+   533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.304122 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:11.308614 (+  4492us) log.cc:844] Serialized 52 byte log entry
0709 13:19:11.535210 (+226596us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:11.535571 (+   361us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.806249 (+1270678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.806340 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.806389 (+    49us) raft_consensus.cc:1685] finished
0709 13:19:12.806405 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.806578 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1270420,"prepare.queue_time_us":14521,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":1270757,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":141,"thread_start_us":226196,"threads_started":1,"wal-append.queue_time_us":304310,"wal-append.run_cpu_time_us":2588,"wal-append.run_wall_time_us":1111663}
W20260709 13:19:12.840907 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 1.13282e+06us
W20260709 13:19:12.849367 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.850296 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2026) took 1906 ms. Trace:
I20260709 13:19:12.811091 23309 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:12.833827 23428 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:12.850853 19585 rpcz_store.cc:276] 0709 13:19:10.944265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.087659 (+143394us) service_pool.cc:224] Handling call
0709 13:19:11.126501 (+ 38842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.126676 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:11.422820 (+296144us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b18003fe680. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c313024bc 00007f6c2e65048b 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66a455 00007f6c351523c7 00007f6c317649a7 00007f6c317740bf
0709 13:19:11.423001 (+   181us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.849758 (+1426757us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.849948 (+   190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.849997 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:12.850045 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.850108 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.850219 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1012922,"prepare.queue_time_us":1048444,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":2535,"raft.queue_time_us":247237,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":1522,"spinlock_wait_cycles":11109120,"thread_start_us":419959,"threads_started":3,"wal-append.queue_time_us":206657}
I20260709 13:19:12.858556 23120 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.875242 23245 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:12.877434 23120 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.878365 23245 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.880191 23120 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:12.882745 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:12.883358 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:12.883721 19503 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:12.884037 19505 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:12.884931 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:12.846592 23152 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:19:12.885687 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:12.847014 23357 consensus_queue.cc:1048] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:19:12.854542 23354 raft_consensus.cc:697] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:12.888625 23245 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:12.848258 23420 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:19:12.890777 19507 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:12.881110 20618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.858732 23210 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:12.894361 23365 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:12.894830 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 43694.7us
I20260709 13:19:12.895324 23211 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:12.896661 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 69151.4us
I20260709 13:19:12.957792 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:12.897199 23351 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:12.899549 23306 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:12.876011 22971 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:12.911602 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2551) took 1600 ms. Trace:
I20260709 13:19:12.893716 23349 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:12.889938 23165 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:12.912729 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 2042) took 1926 ms. Trace:
I20260709 13:19:12.964422 19476 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:12.890236 23298 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:12.914759 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 2034) took 1297 ms. Trace:
I20260709 13:19:12.915202 23313 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:12.887265 23350 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:12.923571 19506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 2525) took 3188 ms (client timeout 3260 ms). Trace:
I20260709 13:19:12.954250 23410 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.924623 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2346) took 1629 ms. Trace:
I20260709 13:19:12.978000 19583 rpcz_store.cc:276] 0709 13:19:11.295429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.295545 (+   116us) service_pool.cc:224] Handling call
0709 13:19:11.295796 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.260592 (+964796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.924391 (+663799us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b54002fd354. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:12.924565 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1235527552}
I20260709 13:19:12.912227 23388 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:12.979398 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:12.959259 19512 rpcz_store.cc:276] 0709 13:19:11.311705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.311972 (+   267us) service_pool.cc:224] Handling call
0709 13:19:11.312374 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.316396 (+  4022us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:11.427078 (+110682us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.386242 (+959164us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b180042a1e0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa23a 00007f6c31764a2a
0709 13:19:12.854861 (+468619us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:12.855350 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:19:12.855513 (+   163us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:12.855562 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.855656 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.911283 (+ 55627us) raft_consensus.cc:1685] finished
0709 13:19:12.911394 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.911539 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":454703,"prepare.queue_time_us":149086,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":8936,"raft.queue_time_us":422049,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":15056,"spinlock_wait_cycles":13835520,"thread_start_us":51926,"threads_started":1,"wal-append.queue_time_us":1206235}
I20260709 13:19:12.963214 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2024) took 2019 ms. Trace:
I20260709 13:19:12.968637 23211 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.971979 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:12.957669 23210 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:12.969981 19586 rpcz_store.cc:276] 0709 13:19:11.617243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.638443 (+ 21200us) service_pool.cc:224] Handling call
0709 13:19:12.914575 (+1276132us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400268754. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:12.914694 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2430674816}
W20260709 13:19:12.973273 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 155808us
I20260709 13:19:12.965152 23131 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.948832 23356 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.993683 19652 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:12.954313 23358 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.996376 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:12.954540 23393 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:12.969594 23321 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:12.976651 23152 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:12.943707 23413 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.981364 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:12.982312 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:12.977105 19506 rpcz_store.cc:269] 0709 13:19:09.734824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.735888 (+  1064us) service_pool.cc:224] Handling call
0709 13:19:12.923334 (+3187446us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400081454. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:12.923476 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3147217664}
I20260709 13:19:12.966041 19658 rpcz_store.cc:276] 0709 13:19:10.986680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.988764 (+  2084us) service_pool.cc:224] Handling call
0709 13:19:10.989101 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:11.281375 (+292274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.281409 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:11.289928 (+  8519us) log.cc:844] Serialized 52 byte log entry
0709 13:19:11.579883 (+289955us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:11.594456 (+ 14573us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.594719 (+   263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.594825 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.910563 (+1315738us) spinlock_profiling.cc:243] Waited 9.95 ms on lock 0x7b18003275e0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:19:12.912438 (+  1875us) raft_consensus.cc:1685] finished
0709 13:19:12.912538 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.912671 (+   133us) inbound_call.cc:177] Queueing success response
0709 13:19:12.925183 (+ 12512us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b18003275e0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
Metrics: {"mutex_wait_us":27276,"prepare.queue_time_us":15328,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":100223,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":29323,"spinlock_wait_cycles":29161088,"thread_start_us":422311,"threads_started":2,"wal-append.queue_time_us":303116}
I20260709 13:19:12.985059 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:12.985697 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:13.012192 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.013201 19657 raft_consensus.cc:2368] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15.
I20260709 13:19:12.965127 23389 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:12.990254 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:12.990388 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:12.984884 19579 rpcz_store.cc:276] 0709 13:19:10.943661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.063177 (+119516us) service_pool.cc:224] Handling call
0709 13:19:11.063425 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.063619 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:11.082513 (+ 18894us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.784236 (+1701723us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b18003475c0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa23a 00007f6c31764a2a
0709 13:19:12.948323 (+164087us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.962893 (+ 14570us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.962946 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:12.962988 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.963055 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.963160 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44000,"prepare.queue_time_us":18723,"prepare.run_cpu_time_us":7068,"prepare.run_wall_time_us":29554,"raft.queue_time_us":16311,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":16267,"spinlock_wait_cycles":8257280,"thread_start_us":147571,"threads_started":2,"wal-append.queue_time_us":1833386}
I20260709 13:19:12.958884 23351 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:12.989156 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.015460 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.015499 19512 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:12.997907 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.016556 19655 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:13.016932 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:12.987624 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:12.965284 22971 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.968670 23320 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:13.005479 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.028146 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:12.980194 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:13.028980 19579 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:13.029238 19659 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:12.983311 23313 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.032287 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:12.987744 23422 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.014093 19584 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:12.999786 23057 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:12.959905 23365 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.983071 23433 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:12.998832 19583 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:12.987586 23349 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.977291 23298 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.984292 23165 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.033895 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.047405 19586 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:13.007988 23353 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.055572 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:13.055791 23353 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:13.056522 20661 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:13.033396 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:12.990142 23315 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:19:13.017525 19506 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:19:13.059325 19579 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:13.037253 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:12.999886 23131 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.990305 23127 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:19:13.077554 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.079161 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:12.976042 19507 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:12.988332 23410 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:12.988055 23350 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.026489 23351 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.052002 19584 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:13.054246 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:13.033794 23320 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:13.061789 19585 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:13.009044 23017 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:19:13.069943 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.000675 23358 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.043731 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:13.005599 23354 consensus_queue.cc:237] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.007688 23304 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:13.035717 23152 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:13.008735 23393 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.084929 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:54532 (request call id 16) took 1643 ms. Trace:
I20260709 13:19:13.087675 19505 raft_consensus.cc:2410] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:13.087455 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.020359 23413 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.042795 23433 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:13.020684 23321 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.234643 19510 rpcz_store.cc:276] 0709 13:19:11.424108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.424355 (+   247us) service_pool.cc:224] Handling call
0709 13:19:13.066911 (+1642556us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b54002071d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c31754853 00007f6c3672260a 00007f6c2fca87d4 00007f6c2fca8762 00007f6c2fca8691 00007f6c2fca860c 00007f6c2fca78c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:13.067054 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155439872}
I20260709 13:19:13.275367 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:13.033224 23377 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.006582 23356 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.225793 19582 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:13.225669 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.285384 19659 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:19:13.229157 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.066591 23042 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:19:13.085563 19661 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 2051) took 1787 ms (client timeout 1502 ms). Trace:
I20260709 13:19:13.076705 23391 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:13.046342 23057 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.086262 23234 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:13.270484 19507 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:13.038332 23313 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.093786 23173 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.275503 19656 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:13.193795 19581 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:13.314416 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:13.287770 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:13.288111 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 324049us
I20260709 13:19:13.225562 23383 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.228027 23388 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:13.290987 19661 rpcz_store.cc:269] 0709 13:19:11.282621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.282735 (+   114us) service_pool.cc:224] Handling call
0709 13:19:13.069964 (+1787229us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54000e88d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:13.070102 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475591424}
I20260709 13:19:13.043351 23422 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.338709 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:13.315469 19578 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:13.274405 23433 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.260546 23152 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.331386 19512 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:13.332836 23383 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:13.333746 19510 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:19:13.333726 20618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.336505 23388 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.290479 23377 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.337726 23315 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:13.338096 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.342724 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.355906 19503 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:13.356317 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:13.346105 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.352864 19625 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:13.356901 19512 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:13.366562 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.382874 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.388785 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.382468 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:13.392222 19510 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.275184 23304 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.349862 23410 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:13.370709 23429 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.024s	sys 0.049s
W20260709 13:19:13.397782 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 412765us
I20260709 13:19:13.353579 23413 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.351598 23321 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.396024 19507 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:13.370575 23422 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.419934 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:13.423314 19512 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:13.314090 23042 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.359174 23353 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:13.430677 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.433125 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.442731 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.446702 23383 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.402667 22971 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:13.448267 23435 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:19:13.449687 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:13.450022 23298 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.450246 23377 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.450990 23350 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.443832 23211 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.452567 23437 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:13.371001 23173 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.453570 23306 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:13.453877 23447 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:13.454115 23356 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:13.454432 23131 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.402840 23315 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.455827 23374 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.447461 19478 leader_election.cc:400] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10.
I20260709 13:19:13.524287 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1928) took 2002 ms. Trace:
I20260709 13:19:13.460021 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1932) took 1936 ms. Trace:
I20260709 13:19:13.494324 19507 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:13.525557 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.457317 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2342) took 2179 ms. Trace:
I20260709 13:19:13.526243 19579 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:13.355943 23391 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.496237 19585 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:13.454711 23393 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:13.495357 19512 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:19:13.444299 23322 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:13.516268 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 147302us
I20260709 13:19:13.453486 23210 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:13.465929 23152 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.452605 20663 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:13.522259 23173 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:13.523293 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:13.320569 23234 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.524457 19478 leader_election.cc:403] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:13.416364 23429 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.025s	sys 0.049s
I20260709 13:19:13.495857 19661 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:13.527249 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:13.525254 19509 rpcz_store.cc:276] 0709 13:19:11.523359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.584084 (+ 60725us) service_pool.cc:224] Handling call
0709 13:19:11.584487 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:12.820657 (+1236170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.820688 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:12.821180 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:19:13.232529 (+411349us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:13.232592 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.232688 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:13.459776 (+227088us) raft_consensus.cc:1685] finished
0709 13:19:13.459798 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.459950 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1279385,"raft.queue_time_us":1235800,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":328907,"threads_started":1,"wal-append.queue_time_us":534813}
I20260709 13:19:13.526371 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.457307 23042 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.455173 23349 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.527470 23120 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:13.539304 23322 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:13.456287 23304 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.454823 23365 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.524758 19511 rpcz_store.cc:276] 0709 13:19:11.522317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.525271 (+  2954us) service_pool.cc:224] Handling call
0709 13:19:11.525662 (+   391us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:12.806167 (+1280505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.806203 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:12.806829 (+   626us) log.cc:844] Serialized 52 byte log entry
0709 13:19:12.941532 (+134703us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:12.941592 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.941703 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:13.524024 (+582321us) raft_consensus.cc:1685] finished
0709 13:19:13.524054 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.524205 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1280021,"raft.queue_time_us":1280244,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":46,"thread_start_us":117243,"threads_started":1,"wal-append.queue_time_us":270000}
I20260709 13:19:13.537681 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.556744 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.538825 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:13.537547 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2552) took 2212 ms. Trace:
W20260709 13:19:13.540367 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 187635us
I20260709 13:19:13.457195 23358 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:13.545075 19586 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:13.548358 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.570152 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.570210 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.571264 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:13.571529 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.572083 19507 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:13.572388 19512 raft_consensus.cc:2410] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:19:13.458069 23127 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:19:13.573019 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:13.573161 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.526595 19580 rpcz_store.cc:276] 0709 13:19:11.277982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.278368 (+   386us) service_pool.cc:224] Handling call
0709 13:19:11.278686 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.291086 (+ 12400us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:12.813709 (+1522623us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b1800417160. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e5e7c0a 00007f6c37d27219 00007f6c2e66fa40 00007f6c2e66a4e4 00007f6c2e66a455 00007f6c351523c7 00007f6c317649a7 00007f6c317740bf 00007f6c31774038
0709 13:19:12.814502 (+   793us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.084076 (+269574us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:13.135158 (+ 51082us) log.cc:844] Serialized 26 byte log entry
0709 13:19:13.135391 (+   233us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:13.135441 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.135540 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:13.457017 (+321477us) raft_consensus.cc:1685] finished
0709 13:19:13.457117 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.457239 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50798,"prepare.queue_time_us":1542212,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":15507,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":112113,"spinlock_wait_cycles":7208704,"thread_start_us":246799,"threads_started":1,"wal-append.queue_time_us":571473}
I20260709 13:19:13.573779 19512 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:13.574072 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.574402 19580 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:13.574587 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.574690 19511 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:13.565327 23448 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10.
I20260709 13:19:13.575237 19512 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:19:13.575572 19580 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:13.575696 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:13.576094 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.576372 19511 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:13.577091 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.577176 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.578110 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.553560 23131 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.584975 19512 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:13.582314 19580 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:13.586122 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.585450 23131 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.582911 19511 raft_consensus.cc:2410] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:13.578747 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.555022 23320 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:19:13.536211 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 164378us
I20260709 13:19:13.571945 19585 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 12.
I20260709 13:19:13.553349 23120 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.592720 23057 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.592828 23391 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:13.593860 23313 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.594048 20631 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:13.594602 23234 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:13.595319 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 148001us
I20260709 13:19:13.595212 23376 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:13.596447 23376 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.596799 23376 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:13.596974 19478 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:13.597409 19586 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:13.585664 19507 raft_consensus.cc:2376] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15. Re-sending same reply.
I20260709 13:19:13.598242 23388 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.536348 23315 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.601845 19504 rpcz_store.cc:276] 0709 13:19:11.315761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.315977 (+   216us) service_pool.cc:224] Handling call
0709 13:19:11.358751 (+ 42774us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.358958 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:11.467546 (+108588us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.805380 (+1337834us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b18002cec00. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e5e7c0a 00007f6c37d27219 00007f6c2e66fa40 00007f6c2e66a4e4 00007f6c2e66a455 00007f6c31752060 00007f6c31764716 00007f6c31775287 00007f6c31775208
0709 13:19:13.092924 (+287544us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.527120 (+434196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:13.527228 (+   108us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:13.527310 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.527424 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.527572 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78320,"prepare.queue_time_us":562619,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":90,"raft.queue_time_us":1353597,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":3324,"spinlock_wait_cycles":7182720,"thread_start_us":710074,"threads_started":3,"wal-append.queue_time_us":451744}
I20260709 13:19:13.604413 19507 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:13.606766 19507 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:13.608039 19507 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:13.609054 19507 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:13.609854 19504 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:13.612473 19625 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:13.613903 23457 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:13.615566 23446 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:13.615899 23457 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:13.616763 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:13.617708 23165 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.617995 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:13.618716 19661 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:19:13.618758 19508 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1926) took 2097 ms (client timeout 2124 ms). Trace:
I20260709 13:19:13.619524 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:13.619369 19508 rpcz_store.cc:269] 0709 13:19:11.521699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.523767 (+  2068us) service_pool.cc:224] Handling call
0709 13:19:13.618554 (+2094787us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b54002071d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:13.618686 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47247744}
I20260709 13:19:13.620709 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:13.546761 23374 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:13.621924 23374 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.623994 23374 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.624138 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.624653 19627 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:13.625231 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.626152 19627 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:13.627022 23429 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:13.627172 23075 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:13.628616 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:13.628803 23351 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.633723 19478 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:13.649250 19478 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:13.650709 19478 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:13.621366 19508 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:19:13.633741 19510 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 6.
I20260709 13:19:13.634133 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.586802 19512 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:19:13.650328 23429 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:13.656293 23429 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:13.658613 23315 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.662074 23433 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.664446 23433 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.665218 19506 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:13.556607 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:19:13.666241 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 110860us
I20260709 13:19:13.666381 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.668879 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.670013 19661 raft_consensus.cc:2410] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:19:13.647167 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:13.645848 19625 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:13.672736 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:19:13.673691 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:13.675452 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:13.676265 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:13.677255 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.677783 19653 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:13.678541 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.679270 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.680110 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:13.681413 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.682129 19652 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:13.687165 19551 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:13.691211 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:13.692152 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.694169 19652 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:13.695333 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.692945 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.697068 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.690146 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:13.702672 19625 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:13.703605 19653 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:13.650157 23057 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:13.707377 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:13.708544 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:13.667609 23448 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:13.674569 23365 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:13.643461 23131 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.710606 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.699121 23313 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:13.736346 23313 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:13.737520 23313 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.739017 19652 raft_consensus.cc:2410] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:13.711241 23437 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:13.709498 23320 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:13.709508 23165 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:13.705282 23358 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:13.712982 23450 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:13.683280 23433 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:13.683228 23389 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:13.684322 23292 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:13.698832 23374 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:13.680032 23234 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:13.718072 19551 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:13.719878 23460 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:13.706159 23075 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:13.735322 23351 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.759965 23389 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.764582 23075 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:13.764642 23389 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:13.765196 23075 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:13.745898 23437 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:13.767217 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 49248.9us
I20260709 13:19:13.711938 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.758055 23349 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:13.713737 23365 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:13.757100 23433 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.711887 23042 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:13.757360 23450 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:13.774096 19583 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:13.788070 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.775076 19581 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:13.775947 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.789143 19580 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:13.789546 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.789945 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.790143 19581 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:13.776197 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.770507 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:13.778307 23444 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:13.779709 23337 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:13.779989 23173 consensus_queue.cc:1059] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:13.781354 19584 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:13.766592 23234 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.784727 19587 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:13.760968 23292 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:13.757570 23358 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.706020 23434 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:19:13.788637 19583 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:19:13.763589 23374 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.803836 19507 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:13.715553 23376 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:13.795390 23042 raft_consensus.cc:697] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:13.783293 23320 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:13.783910 23437 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:13.796271 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:13.817538 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.818228 19587 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:13.796991 23450 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:13.796491 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.821485 19585 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:13.792208 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:13.797456 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:13.824098 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:13.799377 19653 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: [11.6-13.7]
I20260709 13:19:13.781454 23120 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.806097 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.830271 19512 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:13.804236 23234 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:13.807163 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.792685 23433 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:13.807888 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.842341 19510 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:13.843457 19510 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:13.809321 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.809985 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.845196 19511 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:19:13.797271 23388 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:13.803957 23292 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:13.787874 23365 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:13.813102 23309 raft_consensus.cc:3055] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:13.856966 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.857592 19584 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:13.833561 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:13.804030 23358 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.805841 23374 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:13.846207 19511 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:13.787724 23349 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:13.849818 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.849261 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:13.809945 23320 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.868901 19511 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:13.848829 23455 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:13.831663 19627 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:13.898343 23455 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:13.898772 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 67205us
I20260709 13:19:13.899608 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:13.900079 23457 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:13.900701 23457 raft_consensus.cc:697] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:13.901050 23337 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:13.853037 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.901994 23356 consensus_queue.cc:1059] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:13.901782 23457 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:13.902633 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:13.902890 23356 consensus_queue.cc:1059] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:13.854153 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:13.903345 23337 raft_consensus.cc:3055] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:13.810941 23393 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:19:13.904073 20665 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:13.903904 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.905181 19627 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:13.908476 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 73642.2us
I20260709 13:19:13.850683 23388 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:13.841602 23306 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:13.851346 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:13.869554 23320 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:13.879384 23349 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:13.895246 23042 consensus_queue.cc:237] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.896327 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:13.869100 23131 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:13.862679 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.867260 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:13.909756 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:13.903846 23337 raft_consensus.cc:740] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:13.912822 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.913933 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:13.929932 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 62740.3us
I20260709 13:19:13.930127 19584 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:13.900724 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:13.855888 23309 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:13.932627 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:13.898803 23455 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:13.915616 23388 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:13.952574 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.953354 19586 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:13.948026 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.918982 23336 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:13.945811 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:13.919854 23306 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:13.905416 23322 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.927812 23131 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:13.953701 23377 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:13.942272 23188 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:13.974567 19586 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:13.966264 20663 raft_consensus.cc:2368] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13.
I20260709 13:19:13.965236 23306 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:13.984906 19579 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:19:13.926826 23374 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.990792 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:13.992590 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 82957.5us
I20260709 13:19:13.975149 23131 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:13.953349 23359 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:19:13.992004 23336 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:13.964538 23075 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:13.978137 23188 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:13.984320 23321 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:13.997594 23467 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:13.986550 23377 raft_consensus.cc:697] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:14.003508 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:13.983484 23429 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.032492 19478 leader_election.cc:400] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Vote denied by peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615) with higher term. Message: Invalid argument: T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13.
I20260709 13:19:14.047344 23313 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:14.049575 19586 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:14.004052 19581 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:14.118103 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 124792us
I20260709 13:19:13.996483 23337 consensus_queue.cc:260] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.032183 23321 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.048326 23467 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.007498 23188 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.060536 23336 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.128652 23365 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.127100 23357 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.135367 19478 leader_election.cc:403] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:19:14.134904 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:14.002840 23358 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:14.156556 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 134904us
W20260709 13:19:14.163795 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 156538us
I20260709 13:19:14.153879 23321 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:14.144737 23469 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:19:14.171998 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:14.177241 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 231551us
I20260709 13:19:14.265326 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:14.204753 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 59372.3us
I20260709 13:19:14.269377 19478 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:14.272342 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:14.272977 19583 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:14.273826 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:14.275077 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:14.275794 19507 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:19:14.277115 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:14.290167 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:14.277654 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:14.293762 19655 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:19:14.293917 23481 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.282910 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:14.276846 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:14.294533 23481 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.295377 19583 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:14.296185 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:14.296200 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:14.161579 23322 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:14.192854 23357 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.309633 23322 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.310158 23322 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.311416 23357 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:14.192906 23165 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:14.312058 23322 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:14.154486 23313 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.315317 23320 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:14.301375 23455 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.296921 23481 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:14.300170 23304 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:14.301183 23365 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:14.301967 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:14.293002 19512 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:14.321365 19504 raft_consensus.cc:2410] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:14.224471 23450 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:14.308291 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:14.271756 23374 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:14.308514 19658 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:14.318058 19583 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 11: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:14.318490 19587 raft_consensus.cc:2368] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13.
I20260709 13:19:14.222072 23376 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:14.168238 23429 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:14.207442 23472 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:19:14.163091 23467 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:14.317541 23313 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:14.317580 23455 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:14.205240 23389 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.353883 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:14.355247 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:14.326134 23075 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:14.330552 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:14.356564 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:14.319468 23304 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:14.367807 19653 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:14.317523 23433 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.359525 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:14.363550 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:14.365517 19507 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:14.361739 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 84159.9us
I20260709 13:19:14.365530 19583 raft_consensus.cc:2393] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:14.319996 23292 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:14.235024 23377 consensus_queue.cc:237] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.371847 23304 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.396744 23295 consensus_queue.cc:1059] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:14.398157 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:14.401938 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:14.402925 23450 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:19:14.427778 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 158539us
I20260709 13:19:14.380620 23322 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:14.434765 19478 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:14.437449 19653 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 13.
I20260709 13:19:14.439097 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:14.439338 19507 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:14.439422 23481 raft_consensus.cc:3055] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:19:14.440375 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45234us
W20260709 13:19:14.411652 23234 consensus_meta.cc:287] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.000s
W20260709 13:19:14.428858 23435 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:19:14.448418 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:14.478592 19586 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:14.444232 20662 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:19:14.444231 23322 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.480165 23485 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:14.455288 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2374) took 1183 ms. Trace:
I20260709 13:19:14.457340 23309 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.470589 23388 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.447492 23365 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:14.481377 23311 raft_consensus.cc:3055] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:14.488183 23365 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.488334 23311 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:14.488796 23365 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:14.489434 23337 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.490331 23388 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:14.489893 23311 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:14.490953 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.491504 23234 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.493697 19579 rpcz_store.cc:276] 0709 13:19:13.271562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.546782 (+275220us) service_pool.cc:224] Handling call
0709 13:19:13.547111 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:13.985378 (+438267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.454979 (+469601us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54002279d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:14.455213 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1006261504}
I20260709 13:19:14.494330 23234 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:14.491462 23311 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:14.495225 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:14.496598 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:14.497262 19579 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:19:14.498842 19579 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:14.468737 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 93377.9us
I20260709 13:19:14.477658 19627 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:14.481422 23322 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:14.471661 19584 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:14.504803 23306 consensus_meta.cc:287] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.000s
I20260709 13:19:14.505184 23234 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:14.505249 23306 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.505954 23234 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.506568 23234 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:14.507558 23306 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:14.501385 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:14.515420 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:14.475044 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:14.501550 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:14.518177 19551 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:14.518307 19584 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
W20260709 13:19:14.518972 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 44001.3us
I20260709 13:19:14.474144 23481 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:14.519630 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:14.525271 19551 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:14.478753 23358 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:14.537699 19627 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:14.542176 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:14.544991 23486 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:14.547003 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:14.547832 23428 consensus_queue.cc:1059] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:19:14.548169 23388 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:14.548647 23495 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:14.549173 23495 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.548841 23388 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.551429 23388 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:14.533205 23057 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:14.552439 23057 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.533427 23410 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:14.553704 23437 consensus_meta.cc:287] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.721s	user 0.004s	sys 0.008s
I20260709 13:19:14.554330 23437 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.556953 23437 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:14.557704 23485 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:14.559943 23410 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:14.560534 23410 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.552788 23057 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.581957 19579 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:14.535893 23306 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:14.538825 23450 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:14.535048 23322 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:14.579202 23311 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:14.589007 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2360) took 1586 ms. Trace:
I20260709 13:19:14.591147 19582 rpcz_store.cc:276] 0709 13:19:13.002220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.002398 (+   178us) service_pool.cc:224] Handling call
0709 13:19:13.005767 (+  3369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.285015 (+279248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.588703 (+1303688us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b540011e9d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:14.588940 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505163136}
I20260709 13:19:14.549554 23495 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.593591 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:14.593937 23490 log.cc:927] Time spent T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:19:14.592542 23311 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.586289 23388 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:14.586509 23481 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.602152 23488 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:14.630970 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:14.580721 23321 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.603392 23304 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.604599 19582 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:14.635785 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 110681us
W20260709 13:19:14.590602 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 43748.3us
I20260709 13:19:14.598989 23188 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.587599 23306 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:14.587463 23485 consensus_queue.cc:1059] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:19:14.589177 23450 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.614112 23433 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:14.603538 23320 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:19:14.651644 19506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1944) took 1758 ms (client timeout 1793 ms). Trace:
W20260709 13:19:14.652343 19506 rpcz_store.cc:269] 0709 13:19:12.893344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.078856 (+185512us) service_pool.cc:224] Handling call
0709 13:19:14.651371 (+1572515us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54002aa3d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:14.651550 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1344180480}
I20260709 13:19:14.653156 23234 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.654268 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:14.655517 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:14.656647 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:14.627851 23292 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:14.660779 23234 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:14.662055 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:14.650211 23450 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.664935 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:14.630173 23389 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:14.665696 19578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2359) took 1664 ms (client timeout 2037 ms). Trace:
I20260709 13:19:14.638448 23481 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:14.666160 19578 rpcz_store.cc:269] 0709 13:19:13.001323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.001465 (+   142us) service_pool.cc:224] Handling call
0709 13:19:14.665510 (+1664045us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b5400268254. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:14.665614 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687921408}
I20260709 13:19:14.669243 19578 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:14.631482 23488 raft_consensus.cc:3055] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:19:14.641499 23131 consensus_meta.cc:287] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.639s	user 0.012s	sys 0.000s
I20260709 13:19:14.641088 23502 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:14.642059 23500 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:14.626806 23311 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:14.665522 19581 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.629494 23492 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:14.637643 19478 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:14.689458 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:14.708370 19510 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 11.
W20260709 13:19:14.709035 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 71554.8us
I20260709 13:19:14.709440 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:14.664583 23365 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.646595 23306 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.700683 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:14.691681 23488 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:19:14.710002 19582 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:14.710278 19627 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:14.637660 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:14.714421 19578 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:14.730616 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 93107.3us
I20260709 13:19:14.731374 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:14.711846 19478 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:14.725957 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:14.733870 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:14.737653 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:14.737905 19661 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:14.740514 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:14.747627 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:14.748456 19582 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:14.750485 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.755311 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:14.764942 19581 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:14.767365 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:14.768750 19582 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:14.724449 23433 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:14.704878 23492 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:14.771870 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:14.775234 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:14.699299 23131 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.780367 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:14.780416 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:14.783072 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:14.783335 19503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1945) took 1856 ms (client timeout 1956 ms). Trace:
W20260709 13:19:14.783720 19503 rpcz_store.cc:269] 0709 13:19:12.926533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.375052 (+448519us) service_pool.cc:224] Handling call
0709 13:19:14.771678 (+1396626us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:19:14.783267 (+ 11589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16051968}
I20260709 13:19:14.788806 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:14.790933 19581 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:14.705222 23383 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:19:14.743460 23165 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615) with higher term. Message: Invalid argument: T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13.
I20260709 13:19:14.748086 23460 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:14.748481 23389 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:14.746335 23292 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:14.747175 23320 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:14.797768 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:14.836696 19582 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:14.836980 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:14.797216 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 53047.2us
I20260709 13:19:14.770112 23388 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:14.771087 23468 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:14.812180 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:14.856593 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:14.856961 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 73243.5us
I20260709 13:19:14.857156 19504 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.818856 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:14.828836 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:14.724140 23485 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:19:14.792042 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
W20260709 13:19:14.834671 23299 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.518s	user 0.005s	sys 0.001s
I20260709 13:19:14.780082 23322 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:14.835475 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:14.840914 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:14.890803 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:14.781692 23492 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:14.776307 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:14.784303 23486 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:14.706063 23500 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:14.908001 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 2066) took 1928 ms. Trace:
I20260709 13:19:14.908492 19656 rpcz_store.cc:276] 0709 13:19:12.979613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.980998 (+  1385us) service_pool.cc:224] Handling call
0709 13:19:14.907777 (+1926779us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b540032a5d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:14.907931 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598347008}
I20260709 13:19:14.909396 23500 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:14.780151 23356 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.910518 23356 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.848034 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:14.914462 19505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 1941) took 2030 ms (client timeout 1708 ms). Trace:
I20260709 13:19:14.858279 19506 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
W20260709 13:19:14.915275 19505 rpcz_store.cc:269] 0709 13:19:12.883567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.884685 (+  1118us) service_pool.cc:224] Handling call
0709 13:19:14.914191 (+2029506us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54001ef0d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:14.914373 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460292480}
I20260709 13:19:14.792940 23359 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:14.861006 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:14.735702 23467 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.866516 23478 consensus_queue.cc:1059] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:14.867215 23057 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.769971 23358 consensus_queue.cc:1059] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:19:14.796478 23293 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:19:14.854779 23388 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:14.829620 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 82330.4us
I20260709 13:19:14.957477 19478 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:14.873113 23321 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:14.881414 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 2046) took 1027 ms. Trace:
I20260709 13:19:14.883069 19581 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:19:14.887485 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 68633.4us
I20260709 13:19:14.900722 19504 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:14.972966 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:14.836095 23433 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:14.906565 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:14.747541 23234 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:19:14.792768 23457 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:19:14.854960 23460 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:14.925894 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:14.976938 19661 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:19:14.878123 23299 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.580s	user 0.005s	sys 0.001s
I20260709 13:19:14.932528 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:14.934145 19653 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:14.880280 19625 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:14.966446 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:14.978726 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:14.979918 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:14.890362 23468 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:14.928942 23292 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.891032 23320 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:14.972294 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:14.971414 19585 rpcz_store.cc:276] 0709 13:19:13.854322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.942105 (+ 87783us) service_pool.cc:224] Handling call
0709 13:19:14.871971 (+929866us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b540011dad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:14.881313 (+  9342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1543754496}
I20260709 13:19:14.967955 23293 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:14.982133 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:14.989573 19660 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:14.925007 23356 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:14.971397 23388 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:14.985316 19510 raft_consensus.cc:2393] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 14: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:14.969485 19476 leader_election.cc:400] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15.
W20260709 13:19:14.986246 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 106049us
I20260709 13:19:14.999253 19625 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:14.984781 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:15.001214 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:15.002161 19504 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:15.002578 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.003134 19476 leader_election.cc:403] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:19:14.977120 23433 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.008921 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:15.008622 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:15.012483 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:14.854391 23488 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:14.968497 23311 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.013828 23357 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:15.078053 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:15.078750 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:15.078959 19661 raft_consensus.cc:2368] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11.
I20260709 13:19:15.080291 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:15.082163 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:15.083221 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:15.084117 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:15.084467 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2558) took 2153 ms. Trace:
I20260709 13:19:15.084751 19656 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:19:15.084869 19509 rpcz_store.cc:276] 0709 13:19:12.930639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.588576 (+657937us) service_pool.cc:224] Handling call
0709 13:19:13.636461 (+ 47885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.636842 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:13.636880 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:13.636940 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:13.636994 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.637071 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.084302 (+1447231us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b54002071d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:15.084411 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108619648}
I20260709 13:19:15.063582 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:15.090165 19659 raft_consensus.cc:2368] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11.
I20260709 13:19:14.990862 23337 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:14.935212 23495 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:14.989208 23293 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:15.071244 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:15.023448 19504 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:15.139300 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:14.990023 23320 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.015329 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.019860 23356 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:19:14.992827 23188 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:15.031889 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.122936 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 153642us
I20260709 13:19:15.127368 22275 raft_consensus.cc:3055] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:15.144939 22275 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:19:15.128371 19587 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 2036) took 1309 ms (client timeout 1534 ms). Trace:
I20260709 13:19:15.145181 19476 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.064582 23512 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:15.132058 19652 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:15.132251 23468 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.011924 23321 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:15.134277 19660 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:15.135418 23495 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:15.145483 19587 rpcz_store.cc:269] 0709 13:19:13.819308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.823791 (+  4483us) service_pool.cc:224] Handling call
0709 13:19:15.128165 (+1304374us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54002fbf54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:15.128308 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1134679424}
W20260709 13:19:15.021127 23498 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 13:19:15.150456 19652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1985) took 2077 ms. Trace:
I20260709 13:19:14.995443 23292 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.143656 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:15.061120 23309 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:15.013581 23433 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:15.012087 23467 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:15.149111 19476 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.098986 23365 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:15.149706 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:15.141280 23320 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:15.172091 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:15.172703 19512 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.997241 23502 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.142s
I20260709 13:19:15.141476 19510 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:19:15.142014 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 126761us
I20260709 13:19:15.180907 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:15.148010 23357 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:15.146423 23356 consensus_queue.cc:1243] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:15.048661 23358 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:15.150863 19652 rpcz_store.cc:276] 0709 13:19:13.073300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.756379 (+683079us) service_pool.cc:224] Handling call
0709 13:19:13.757983 (+  1604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:15.131898 (+1373915us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54004095a0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316d1dc0 00007f6c3175c1c0 00007f6c3175d231 00007f6c31759d8f 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c
0709 13:19:15.150219 (+ 18321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.150402 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344255360}
I20260709 13:19:15.049335 23518 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:15.058895 23304 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:15.027915 19625 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:15.020016 23478 consensus_queue.cc:1059] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.140s
W20260709 13:19:15.152881 20629 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.166992 19587 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:15.077500 23460 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.167622 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:15.168136 22275 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.147858 23512 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.168773 23513 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:15.153067 23245 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:15.168947 23410 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:15.218689 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 261333us
I20260709 13:19:15.183027 19551 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:15.056725 23510 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15.
I20260709 13:19:15.181104 23131 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:15.192523 23057 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:15.226749 23479 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:15.212450 23383 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:19:15.191509 23502 consensus_queue.cc:1243] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:15.217975 23337 raft_consensus.cc:3055] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:15.229092 23337 raft_consensus.cc:740] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:15.230000 23337 consensus_queue.cc:260] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.231160 23337 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:15.233126 23042 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:15.194171 23311 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:15.234283 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.236563 23467 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:15.237097 23467 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.238220 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 1982) took 2165 ms. Trace:
I20260709 13:19:15.238821 23292 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:15.239060 23467 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:15.240159 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2392) took 1444 ms. Trace:
W20260709 13:19:15.241811 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.240653 19580 rpcz_store.cc:276] 0709 13:19:13.797656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.797770 (+   114us) service_pool.cc:224] Handling call
0709 13:19:13.798050 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:13.798387 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:13.798413 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:13.798876 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:19:14.406216 (+607340us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b18003fe800. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa0d1 00007f6c31715a0f
0709 13:19:14.589598 (+183382us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:14.604620 (+ 15022us) log.cc:844] Serialized 14 byte log entry
0709 13:19:14.625135 (+ 20515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.625213 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.239858 (+614645us) raft_consensus.cc:1685] finished
0709 13:19:15.239970 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.240098 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":110,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":20368,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":3843,"spinlock_wait_cycles":7254912,"thread_start_us":183154,"threads_started":1,"wal-append.queue_time_us":833015}
I20260709 13:19:15.197965 19505 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:15.242651 19512 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
W20260709 13:19:15.242911 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.201134 23437 raft_consensus.cc:3055] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:15.243611 23437 raft_consensus.cc:740] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:15.243763 23492 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.244515 23437 consensus_queue.cc:260] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.187721 23389 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:15.245802 23389 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:15.246249 23389 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:15.246059 23388 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.247833 20666 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:15.238631 19658 rpcz_store.cc:276] 0709 13:19:13.072455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.712564 (+640109us) service_pool.cc:224] Handling call
0709 13:19:13.712860 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.324425 (+611565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.237993 (+913568us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b540039a654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:15.238157 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1369343360}
I20260709 13:19:15.250082 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2589) took 1440 ms. Trace:
I20260709 13:19:15.250452 19508 rpcz_store.cc:276] 0709 13:19:13.809586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.845408 (+ 35822us) service_pool.cc:224] Handling call
0709 13:19:14.916406 (+1070998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.916635 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:14.960053 (+ 43418us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.248998 (+288945us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:15.249048 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:15.249094 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.249153 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.249923 (+   770us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001ef0d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:15.250029 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43293,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"spinlock_wait_cycles":2462023936,"thread_start_us":257244,"threads_started":1}
I20260709 13:19:15.212951 23513 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:15.253158 23471 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.253764 23471 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:15.172811 23488 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:15.213500 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 185686us
I20260709 13:19:15.156265 23450 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.150365 23321 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:15.176928 19476 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.202294 23376 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:15.192269 23293 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.213043 23512 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:15.249095 19507 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 13.
I20260709 13:19:15.259683 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:15.254733 23306 consensus_meta.cc:287] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.000s
I20260709 13:19:15.260986 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:15.279716 19654 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:15.240245 23500 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:15.196184 23520 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:15.265381 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45439.2us
I20260709 13:19:15.267684 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.267856 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:15.268785 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:15.286580 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:15.287695 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:15.267014 23437 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:15.271242 23376 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:19:15.295423 23376 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:15.296851 23376 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:15.271391 23321 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:15.272768 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:15.273681 23388 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:15.259946 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:15.277524 19553 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:15.278992 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:15.280824 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:15.261294 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:15.283360 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 106484us
I20260709 13:19:15.222949 23518 raft_consensus.cc:697] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:15.282122 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:15.270895 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:15.290560 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.291581 19586 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:15.292331 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:15.291857 23492 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:15.294418 23428 raft_consensus.cc:3055] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:15.296866 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:15.304615 19625 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:15.306170 19657 raft_consensus.cc:2410] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:15.308434 19478 leader_election.cc:400] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13.
W20260709 13:19:15.335397 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 57995.2us
I20260709 13:19:15.338142 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:15.338804 19578 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:15.338727 19587 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:15.306207 19476 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.292032 23042 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:15.330504 23320 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.289182 23127 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:15.284162 23500 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:15.346304 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:15.347383 19661 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:15.350816 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:15.351413 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:15.269702 23510 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:19:15.349133 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:15.352022 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 81220.4us
I20260709 13:19:15.354439 19584 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:19:15.354347 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:15.372737 19587 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 15: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:15.357066 19583 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:15.356285 19504 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:15.371647 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:15.374879 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:15.375805 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:15.376658 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:15.377375 19507 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:15.379424 23188 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:15.379861 23188 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.380213 23188 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:15.380683 23518 consensus_queue.cc:237] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.332396 23418 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:15.383369 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:15.289529 23306 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.384184 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:15.394050 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:15.420553 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:15.421324 19581 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:15.332332 23322 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:15.424067 19579 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:15.347666 23388 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:15.334877 23428 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:15.346508 23336 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:15.523876 19583 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:19:15.411583 23460 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:15.347829 23520 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.518797 19655 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:15.425469 19512 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:15.373768 23313 consensus_queue.cc:1059] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.151s
I20260709 13:19:15.546224 19586 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:15.553126 19654 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:19:15.555537 19654 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:19:15.517680 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:15.283986 23513 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:15.524847 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 218708us
I20260709 13:19:15.530745 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:15.531024 23322 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:15.536160 19581 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:15.385901 19627 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:15.586126 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 200402us
I20260709 13:19:15.385658 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.527534 23315 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:15.537670 22275 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:15.538335 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:15.526515 23533 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.191s	user 0.002s	sys 0.005s
I20260709 13:19:15.424867 19652 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:15.547379 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:15.612277 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:15.554970 23460 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:15.561816 23321 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.565069 23188 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.568112 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:15.522133 23492 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:15.525501 23131 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.572459 19653 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:15.574551 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:15.524513 23467 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:15.577965 19654 pending_rounds.cc:85] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 7
I20260709 13:19:15.526738 23418 raft_consensus.cc:697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:15.670985 19654 pending_rounds.cc:107] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:19:15.671337 19654 raft_consensus.cc:2889] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:15.581689 19656 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:15.582978 19476 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:15.596165 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 261689us
W20260709 13:19:15.606987 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 221437us
I20260709 13:19:15.608630 19582 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 11: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:19:15.673188 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 90301.9us
I20260709 13:19:15.674243 19476 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.675172 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.559054 23510 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:15.658282 23321 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:15.683128 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.614660 19586 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 11: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:15.424799 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:15.655972 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:15.656533 23293 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:15.657267 23526 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
I20260709 13:19:15.325960 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:15.575927 23455 raft_consensus.cc:3055] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:15.661583 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:15.647667 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.668522 19585 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:15.692807 19586 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:15.533079 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:15.694149 19583 raft_consensus.cc:2393] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:15.555995 23520 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.693526 19582 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:19:15.691629 19627 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:15.679076 19476 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.684511 19581 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:15.658283 23529 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:19:15.696938 19625 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:15.702761 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.685356 19658 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:19:15.571053 23389 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.657451 23471 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:15.688725 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.732237 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.732450 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:15.690264 19579 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:15.681639 23510 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.733978 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.612093 23357 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:15.611140 23337 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:15.720340 19476 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.614073 23513 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:15.682767 19399 maintenance_manager.cc:419] P 5aff2c187289436a846acba13255b21f: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033373
W20260709 13:19:15.723038 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.683286 23349 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:15.685926 23057 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:15.768151 23520 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:15.730851 23127 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:15.768774 19503 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:15.735507 23165 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:15.613808 23309 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:19:15.738241 19656 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:15.692530 23321 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:15.738423 23481 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:15.730660 23120 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:19:15.770663 23481 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.770864 23349 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:15.770852 23418 consensus_queue.cc:237] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.741780 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.702368 23306 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:15.682606 23493 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:19:15.771787 23460 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.772634 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:15.773478 23042 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:15.774192 23389 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:15.754839 23502 consensus_queue.cc:1059] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:19:15.743737 19581 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:15.758746 19410 catalog_manager.cc:5697] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 10 to 11, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 11 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.610971 23500 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.775631 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:15.771083 23481 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:15.782243 23377 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:15.783321 23488 consensus_meta.cc:287] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.000s
I20260709 13:19:15.692740 23455 raft_consensus.cc:740] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:15.784618 23455 consensus_queue.cc:260] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.689661 23315 consensus_queue.cc:1059] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:19:15.760111 23510 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:15.610821 23322 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.786083 23455 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:15.786346 23510 raft_consensus.cc:3055] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:15.760088 23188 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:15.786899 23510 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:15.787221 23188 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:15.770040 23165 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:15.687206 23131 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:15.788008 19584 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:15.787757 23510 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.788823 19587 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:15.789036 23510 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:15.787787 23322 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:15.685763 23467 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.790295 23131 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:15.686293 23492 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.783612 23377 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:15.757972 23388 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:15.791944 23377 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.758944 23297 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:15.736595 23320 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:15.792507 23492 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:15.766150 23534 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 13:19:15.689882 23391 consensus_queue.cc:1059] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:19:15.774272 23042 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:15.793794 23075 consensus_queue.cc:1059] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:15.794106 23042 raft_consensus.cc:697] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:15.794863 23075 raft_consensus.cc:3055] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:15.795253 23075 raft_consensus.cc:740] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:15.795104 23042 consensus_queue.cc:237] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.796205 23075 consensus_queue.cc:260] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.798617 23075 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:15.798738 23481 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.801177 23481 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:15.793509 23467 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:15.820606 23467 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.821199 23467 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.821789 23297 raft_consensus.cc:697] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:15.792392 23377 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:15.822741 23297 consensus_queue.cc:237] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:15.827996 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.802096 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 56202.9us
I20260709 13:19:15.691179 23410 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:15.586990 23428 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.741257 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:15.815806 23510 raft_consensus.cc:3055] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:15.802649 23356 consensus_queue.cc:1059] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:19:15.817672 23337 raft_consensus.cc:697] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:15.818944 23450 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:15.814064 20629 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.842568 23428 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:15.849017 23391 raft_consensus.cc:3055] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:19:15.841732 23433 consensus_meta.cc:287] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.659s	user 0.006s	sys 0.004s
I20260709 13:19:15.836042 23510 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:15.876645 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 175454us
I20260709 13:19:15.835415 23448 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:19:15.881739 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 52490.8us
I20260709 13:19:15.891327 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:15.902051 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.902139 20631 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:15.877439 23391 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:15.907776 23391 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.909047 23391 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:15.901033 19627 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:15.931103 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:15.933735 19578 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:19:15.934448 19581 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:19:15.935705 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 203333us
I20260709 13:19:15.936877 19581 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:15.940125 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:15.941938 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:15.943045 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.948782 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.903476 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:19:15.925906 23437 consensus_meta.cc:287] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.003s
W20260709 13:19:15.979350 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.977257 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:15.910310 23358 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:15.929860 23356 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:15.937824 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:15.975415 22275 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:15.976612 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:16.092571 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 154804us
I20260709 13:19:16.092722 19584 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:15.893729 23433 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:15.925207 23528 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:15.899689 23309 consensus_queue.cc:1059] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:19:15.967638 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:15.953871 23512 consensus_meta.cc:287] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.679s	user 0.010s	sys 0.000s
W20260709 13:19:16.129026 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.899967 23448 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.201946 19581 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:15.930537 23434 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.199s
I20260709 13:19:16.211557 19506 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:16.108683 23299 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.110705 23356 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:16.128803 23245 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:16.220988 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 500716us
I20260709 13:19:16.235453 19476 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:16.232050 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 1979) took 1429 ms. Trace:
W20260709 13:19:16.243880 19625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.023s	sys 0.059s
I20260709 13:19:16.244004 19476 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:16.244426 19625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.024s	sys 0.060s
W20260709 13:19:16.244984 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 506197us
I20260709 13:19:16.245826 19476 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:16.248432 19476 leader_election.cc:400] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11.
I20260709 13:19:16.248850 19476 leader_election.cc:403] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:19:16.200860 23467 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:16.250187 19584 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:16.137678 23311 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 13:19:16.210212 23165 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:16.123149 23420 consensus_queue.cc:1059] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 13:19:16.209568 23315 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:16.256546 19476 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:16.213634 23492 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:16.207074 23358 raft_consensus.cc:697] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:16.291463 19476 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:16.292713 19476 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:16.295172 19503 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:19:16.297709 19511 raft_consensus.cc:1275] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:19:16.299664 19509 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:19:15.974313 23510 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.238804 19510 rpcz_store.cc:276] 0709 13:19:14.803141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.188396 (+385255us) service_pool.cc:224] Handling call
0709 13:19:15.188695 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:15.188891 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:15.215324 (+ 26433us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.299733 (+ 84409us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b1800395500. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa23a 00007f6c31764a2a
0709 13:19:16.231678 (+931945us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:16.231738 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:16.231799 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.231866 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.231991 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26253,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":11276,"raft.queue_time_us":32346,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":3762432,"thread_start_us":931616,"threads_started":2,"wal-append.queue_time_us":551781}
I20260709 13:19:16.242302 23356 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:16.063241 23337 consensus_queue.cc:237] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:16.252712 23376 consensus_meta.cc:287] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.954s	user 0.011s	sys 0.000s
I20260709 13:19:16.196882 23512 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.300046 19476 leader_election.cc:400] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11.
I20260709 13:19:16.349735 19476 leader_election.cc:403] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:16.350066 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:16.350569 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 50741us
I20260709 13:19:16.322022 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:16.254792 23520 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:16.245386 23299 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:16.312109 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.258381 23349 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:16.229446 20666 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:16.348126 19508 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:16.255367 23245 raft_consensus.cc:697] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:16.231732 23517 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:19:16.377082 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:16.288856 19551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.042s	sys 0.051s
W20260709 13:19:16.431003 19551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.047s	sys 0.052s
W20260709 13:19:16.431434 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 653906us
I20260709 13:19:16.351629 19476 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:16.434337 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:16.372659 20663 consensus_meta.cc:287] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.536s	user 0.003s	sys 0.003s
I20260709 13:19:16.436596 20663 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:16.380210 23354 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.410758 23510 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:16.286408 23057 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11.
I20260709 13:19:16.375016 23541 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11.
I20260709 13:19:16.422051 23234 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:16.424042 23075 consensus_meta.cc:287] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.000s
I20260709 13:19:16.429082 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:16.515303 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:16.376827 23349 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:16.516000 19508 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:16.521688 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.475339 23389 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:16.457049 23321 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:19:16.484964 23410 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:16.416851 23245 consensus_queue.cc:237] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.352303 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:16.378969 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 403995us
I20260709 13:19:16.357847 19511 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:16.621424 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:16.622838 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:16.623700 19511 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:16.624557 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:16.625145 19511 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:16.413043 19509 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:16.303362 23524 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:16.303717 23539 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:16.626950 23410 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.629038 23410 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:16.438472 19512 raft_consensus.cc:2410] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:19:16.303362 23120 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:16.347391 23437 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:19:16.454550 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 103002us
I20260709 13:19:16.380020 23297 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:16.346833 23315 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:16.461292 23311 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:16.454005 23309 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.307938 23467 raft_consensus.cc:3055] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:19:16.461318 23391 consensus_meta.cc:287] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.552s	user 0.007s	sys 0.003s
W20260709 13:19:16.464105 23293 consensus_meta.cc:287] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.770s	user 0.007s	sys 0.003s
I20260709 13:19:16.465837 23127 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:16.466665 23468 consensus_queue.cc:1059] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:19:16.469780 20629 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.470813 23538 log.cc:927] Time spent T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:19:16.470710 23448 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:16.482193 19510 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:19:16.512748 23358 consensus_queue.cc:237] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.253264 23493 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:16.570457 23349 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:16.644996 19476 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:16.675534 23410 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.670554 23467 raft_consensus.cc:740] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:19:16.629302 23455 consensus_meta.cc:287] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.843s	user 0.007s	sys 0.006s
I20260709 13:19:16.655434 19508 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:16.710145 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:16.711472 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:16.712342 19508 raft_consensus.cc:2410] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:19:16.713167 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:16.656659 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.581377 23042 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.455859 23519 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.664057 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:16.509938 23354 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.616300 23389 raft_consensus.cc:697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:16.518990 23234 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:16.674079 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 265160us
I20260709 13:19:16.639472 23313 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:16.676798 19587 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:19:16.674561 23309 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.662118 23292 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.660272 23433 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:16.685896 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:16.461472 23428 consensus_meta.cc:287] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.583s	user 0.003s	sys 0.006s
I20260709 13:19:16.309131 23492 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:16.694411 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 49552.6us
I20260709 13:19:16.350854 23165 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:16.697604 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2598) took 1885 ms. Trace:
I20260709 13:19:16.700503 23512 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:16.744051 23512 consensus_queue.cc:1059] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:16.745134 23524 raft_consensus.cc:3055] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:16.744081 23165 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:16.745663 23524 raft_consensus.cc:740] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:16.745999 23165 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:16.746084 23389 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.746658 23524 consensus_queue.cc:260] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.747608 22275 raft_consensus.cc:3055] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:16.747990 22275 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:16.748040 23524 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:16.748788 22275 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.751408 23234 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:16.753229 23354 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:16.705206 23315 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:16.707417 19661 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260709 13:19:16.759573 20663 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59444 (request call id 136) took 2055 ms (client timeout 1852 ms). Trace:
W20260709 13:19:16.760196 20663 rpcz_store.cc:269] 0709 13:19:14.704173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.711215 (+  7042us) service_pool.cc:224] Handling call
0709 13:19:16.759254 (+2048039us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b5400018454. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:16.759430 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2128525056}
I20260709 13:19:16.716845 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:16.658880 23437 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.766203 23437 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:16.766516 23481 raft_consensus.cc:3055] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:16.767067 23481 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:16.768026 23481 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.721472 19504 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:16.771564 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:16.771898 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:16.772735 19504 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:16.719697 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:16.661401 23297 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:16.779834 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57429.7us
I20260709 13:19:16.784724 23311 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:16.785429 23311 raft_consensus.cc:697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:16.786808 23311 consensus_queue.cc:237] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.794981 23165 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:16.797504 23555 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:19:16.735523 23292 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.800457 23165 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:16.800972 23292 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:16.726197 20619 leader_election.cc:336] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Timed out: RequestConsensusVote RPC to 127.17.251.129:38645 timed out after 2.051s (SENT)
W20260709 13:19:16.842271 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 116115us
W20260709 13:19:16.664963 23537 log.cc:927] Time spent T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.390s	user 0.001s	sys 0.000s
W20260709 13:19:16.727226 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 224302us
I20260709 13:19:16.851377 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2422) took 1498 ms. Trace:
I20260709 13:19:16.851651 22275 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:16.851760 19580 rpcz_store.cc:276] 0709 13:19:15.352598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.352730 (+   132us) service_pool.cc:224] Handling call
0709 13:19:15.353039 (+   309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:15.357667 (+  4628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:15.373857 (+ 16190us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:15.413426 (+ 39569us) log.cc:844] Serialized 52 byte log entry
0709 13:19:15.757844 (+344418us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:16.281725 (+523881us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.282329 (+   604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.282439 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.851078 (+568639us) raft_consensus.cc:1685] finished
0709 13:19:16.851107 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.851308 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129384,"prepare.queue_time_us":725025,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":20372,"raft.run_cpu_time_us":5820,"raft.run_wall_time_us":151728,"thread_start_us":656847,"threads_started":2,"wal-append.queue_time_us":398934}
I20260709 13:19:16.854328 19658 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:16.855540 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:16.856420 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:16.857008 19652 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:16.740020 19505 rpcz_store.cc:276] 0709 13:19:14.812653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.242935 (+430282us) service_pool.cc:224] Handling call
0709 13:19:15.243230 (+   295us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:15.283388 (+ 40158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:15.283451 (+    63us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:15.293679 (+ 10228us) log.cc:844] Serialized 52 byte log entry
0709 13:19:15.839836 (+546157us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:15.888160 (+ 48324us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.888412 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.888499 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.697334 (+808835us) raft_consensus.cc:1685] finished
0709 13:19:16.697359 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.697538 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39687,"prepare.queue_time_us":48073,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":7425,"raft.queue_time_us":49393,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":21073,"thread_start_us":495057,"threads_started":1,"wal-append.queue_time_us":607168}
I20260709 13:19:16.742970 23120 consensus_queue.cc:1059] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:16.753131 19410 catalog_manager.cc:5697] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 3 to 11, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 11 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:19:16.701901 23448 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:16.679652 23518 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:16.725404 23519 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:16.723605 23042 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.815265 23517 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:16.818996 19506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 2608) took 1994 ms (client timeout 2103 ms). Trace:
W20260709 13:19:16.910588 19506 rpcz_store.cc:269] 0709 13:19:14.824110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.106317 (+282207us) service_pool.cc:224] Handling call
0709 13:19:16.818714 (+1712397us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000fc654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:16.818920 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2429899648}
I20260709 13:19:16.820302 23075 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.821349 23428 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.722450 23410 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.827399 23309 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:16.836524 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:16.837869 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:16.949133 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:16.839696 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:16.844681 23173 raft_consensus.cc:3055] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:19:16.734514 23513 consensus_meta.cc:287] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.939s	user 0.007s	sys 0.005s
W20260709 13:19:16.723905 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 110005us
I20260709 13:19:16.910328 23304 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.881083 23120 consensus_queue.cc:1243] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:16.880806 23518 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.881644 23506 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:16.948906 23428 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.781670 23297 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:16.890287 19410 catalog_manager.cc:5697] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 8 to 11, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 11 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.957010 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:16.830629 23299 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:16.927207 19661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 2027) took 1664 ms. Trace:
I20260709 13:19:16.928323 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:17.102471 19661 rpcz_store.cc:276] 0709 13:19:15.262362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.544797 (+282435us) service_pool.cc:224] Handling call
0709 13:19:15.545137 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.757015 (+1211878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.926977 (+169962us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400102554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:16.927148 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2671932288}
W20260709 13:19:17.103183 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 174932us
I20260709 13:19:17.104126 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:16.939463 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2429) took 1014 ms. Trace:
I20260709 13:19:17.105788 19587 rpcz_store.cc:276] 0709 13:19:15.924809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.926300 (+  1491us) service_pool.cc:224] Handling call
0709 13:19:15.926766 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:16.727651 (+800885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.939154 (+211503us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b5400247054. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:16.939386 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1721534720}
I20260709 13:19:16.949095 19652 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:16.957885 19653 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:19:16.998257 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.109476 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.111510 19581 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:17.112865 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.113708 19581 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:17.114037 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:17.115362 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:17.116562 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.117517 19584 raft_consensus.cc:2393] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:19:16.880152 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:17.118414 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.008495 19659 raft_consensus.cc:2410] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:19:16.920104 23448 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:16.920380 23165 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:16.951804 23313 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.122124 19580 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:16.962647 23292 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:17.025522 19511 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:17.123143 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.123714 19511 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:16.881745 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:17.125015 19660 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 15: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:16.769558 23481 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:17.038903 23293 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:17.075832 20666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59444 (request call id 137) took 1174 ms. Trace:
I20260709 13:19:16.997798 23173 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:17.138362 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:17.139132 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.139609 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.140580 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:17.141237 19655 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
W20260709 13:19:17.142313 19659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2021) took 1883 ms (client timeout 2103 ms). Trace:
W20260709 13:19:17.142820 19659 rpcz_store.cc:269] 0709 13:19:15.259344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.259456 (+   112us) service_pool.cc:224] Handling call
0709 13:19:17.142117 (+1882661us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54000e7ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:17.142259 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3982979840}
I20260709 13:19:17.048849 23506 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.145392 23506 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:16.957367 23512 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:17.146073 23512 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.148180 23512 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.001008 23541 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.148773 23541 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.939474 23524 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:19:17.037842 23120 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:17.151171 23541 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.022555 23304 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.153187 23304 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:16.873787 23467 consensus_queue.cc:260] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.923355 23517 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.053982 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.155885 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.156600 19512 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:17.051887 23519 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:17.056090 23437 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.161175 23437 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.161772 23165 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:16.946555 23188 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:17.163304 23188 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.164762 23165 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:16.945677 23450 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:17.166031 23450 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.168546 23450 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:17.057775 23377 consensus_meta.cc:287] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 1.235s	user 0.011s	sys 0.000s
I20260709 13:19:17.169916 23377 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.171512 19582 raft_consensus.cc:2393] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:17.172153 23377 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.062942 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:17.173319 19656 raft_consensus.cc:2368] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11.
I20260709 13:19:17.174484 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:17.174687 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2434) took 1245 ms. Trace:
I20260709 13:19:17.001879 23321 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.175139 19582 rpcz_store.cc:276] 0709 13:19:15.929340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.930266 (+   926us) service_pool.cc:224] Handling call
0709 13:19:17.174471 (+1244205us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54001013d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:17.174624 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2850272000}
W20260709 13:19:17.065135 19507 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.007s	sys 0.018s
W20260709 13:19:17.176187 19507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.007s	sys 0.018s
I20260709 13:19:17.078048 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.176431 19578 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:19:17.082055 23336 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.086817 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.064493 23297 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.090788 23492 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:17.091741 23042 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.072849 23349 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.100967 23433 raft_consensus.cc:3055] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:17.071014 20662 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:17.126417 19504 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: [10.6-14.8]
I20260709 13:19:17.128166 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.237399 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:16.938642 23075 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.128907 19625 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:17.142266 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:17.150698 23120 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.040308 23455 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.244117 19507 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:17.055188 23518 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.179616 19512 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:17.246855 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:17.247489 19655 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:17.194259 19505 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:17.248683 19505 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:17.195585 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.176896 19510 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:17.100582 23493 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:17.132614 20666 rpcz_store.cc:276] 0709 13:19:15.901816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.903184 (+  1368us) service_pool.cc:224] Handling call
0709 13:19:17.064891 (+1161707us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5400524c54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:17.072599 (+  7708us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543029504}
I20260709 13:19:17.221701 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:17.196455 23321 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.127554 23448 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.222357 23336 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.178799 23293 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.226195 23188 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.309638 19586 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:17.310024 23304 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:17.228410 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.310576 23304 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.312697 23304 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.232240 23428 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:17.314087 23321 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.314603 23457 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:17.315142 23437 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:17.129153 23389 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:17.136612 23563 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:19:17.254382 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:17.257513 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 128752us
I20260709 13:19:17.259450 19512 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:19:17.259953 19661 raft_consensus.cc:2393] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:17.233369 23042 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.260915 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.335069 19505 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 12.
I20260709 13:19:17.335955 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:17.264025 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
W20260709 13:19:17.337703 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 73729.8us
I20260709 13:19:17.338769 19476 leader_election.cc:400] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11.
I20260709 13:19:17.339146 19476 leader_election.cc:403] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:17.340260 19476 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:17.253654 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 325855us
I20260709 13:19:17.240082 23524 consensus_queue.cc:1243] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:17.133817 23309 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.110s
I20260709 13:19:17.230298 23433 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:17.230518 23478 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:17.355911 23478 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.358107 23478 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:17.133500 23313 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.360250 23313 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.360364 23448 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.225728 23297 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.361047 19586 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:17.361873 19579 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:17.363413 23297 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:17.366192 23517 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:17.368716 19509 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:17.366230 19586 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:19:17.374753 23075 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:17.375937 19509 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:19:17.376530 23541 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:17.376915 23541 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:17.377905 23410 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.378026 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:17.379815 23293 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.380690 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:17.381321 19656 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:17.178587 23544 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:19:17.301756 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.395628 19508 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 11.
W20260709 13:19:17.306593 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.321436 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.398013 19580 raft_consensus.cc:2410] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:17.323837 19625 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:17.297889 23518 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:17.308580 19657 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2034) took 2044 ms (client timeout 2133 ms). Trace:
I20260709 13:19:17.336509 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.258294 23512 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:17.350179 19655 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:17.267854 23337 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:17.355240 23120 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.354904 23433 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.374900 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2080) took 1435 ms. Trace:
I20260709 13:19:17.133137 23292 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.423326 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:17.394972 23245 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.018s	sys 0.018s
W20260709 13:19:17.399222 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 75463.2us
I20260709 13:19:17.427008 19625 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:17.403829 19657 rpcz_store.cc:269] 0709 13:19:15.263607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.376208 (+112601us) service_pool.cc:224] Handling call
0709 13:19:17.302795 (+1926587us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b5400020654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:17.308485 (+  5690us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3929917696}
I20260709 13:19:17.256642 23455 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.409487 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:17.418737 19505 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 13.
W20260709 13:19:17.408892 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 389396us
I20260709 13:19:17.428839 19625 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:17.429294 22275 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:17.384018 23356 consensus_meta.cc:287] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 1.008s	user 0.010s	sys 0.000s
I20260709 13:19:17.387682 19586 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:17.352746 23511 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:17.411298 20619 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:17.350020 23165 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:17.445891 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2621) took 1124 ms. Trace:
I20260709 13:19:17.446457 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:17.446313 19504 rpcz_store.cc:276] 0709 13:19:16.321493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.773345 (+451852us) service_pool.cc:224] Handling call
0709 13:19:17.126006 (+352661us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:17.236245 (+110239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.445679 (+209434us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54000fd550. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:17.445832 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673380096}
I20260709 13:19:17.423034 19578 rpcz_store.cc:276] 0709 13:19:15.939143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.947342 (+  8199us) service_pool.cc:224] Handling call
0709 13:19:17.176207 (+1228865us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.176863 (+   656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.374710 (+197847us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54001013d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:17.374843 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2825255296}
I20260709 13:19:17.424127 19661 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:19:17.448535 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.448875 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:17.352984 23304 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11.
I20260709 13:19:17.402068 23437 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:17.436975 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.436317 19625 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:17.438089 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 309791us
W20260709 13:19:17.442070 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.353080 23042 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.409372 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:17.449199 19578 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:17.326797 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:17.450524 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:17.431428 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:17.444201 23120 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.473981 23120 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.474313 23410 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.475109 23410 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.476384 23120 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.476689 23500 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:17.477190 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:17.477814 23313 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.478744 23313 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.383967 23173 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.482124 23173 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:17.482904 20666 raft_consensus.cc:2376] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11. Re-sending same reply.
I20260709 13:19:17.484598 19660 raft_consensus.cc:2410] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:19:17.484643 19553 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:17.485847 23450 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:17.486429 23450 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:17.486536 23349 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.486809 23313 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.487480 23450 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:17.465035 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:17.485831 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:17.444526 23356 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.489082 19660 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:17.489830 23321 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:17.490026 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:17.490620 23356 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:17.490737 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:17.490980 23321 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:17.491312 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:17.492092 19660 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 9: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:17.468850 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.492249 19551 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:17.464505 19653 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:17.492918 23321 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:17.493197 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.485783 23075 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:17.494057 23075 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.494454 23075 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:17.494488 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.495546 23292 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.495695 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.496510 19586 raft_consensus.cc:2393] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 15: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:17.465764 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:17.423615 23512 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.491925 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:17.491523 19658 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 15: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:17.472920 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:17.428678 23245 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.018s	sys 0.018s
I20260709 13:19:17.509225 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.497324 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.477885 19661 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:17.465143 23540 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:17.435027 23511 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.517833 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:17.518708 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 192033us
I20260709 13:19:17.519271 19660 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:17.519979 19627 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:17.453192 23309 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:17.507150 19625 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:17.421866 23518 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.510418 19586 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:17.472952 23336 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:17.536376 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.537330 19586 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 12.
I20260709 13:19:17.453413 23570 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:17.500134 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:17.540270 19653 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:17.532565 19627 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:17.469873 23433 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:17.511010 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:17.402412 23541 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.511332 23410 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.471925 23563 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.501766 19478 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:17.504251 23547 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:17.533241 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:17.508569 23321 raft_consensus.cc:697] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:19:17.568249 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 66557.7us
I20260709 13:19:17.561100 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:17.569998 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:17.573025 23547 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:17.573756 23547 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:17.524610 23544 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:17.578668 23544 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.582034 23544 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.589779 19661 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:17.564164 19653 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:17.522063 23511 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:17.611213 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 44519.1us
I20260709 13:19:17.628636 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:17.629871 19505 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:17.540211 23309 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.539814 23570 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.505084 23337 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:19:17.532910 23356 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:17.652755 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:17.621878 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 51981.8us
W20260709 13:19:17.631484 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 120566us
I20260709 13:19:17.563055 23420 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:17.632261 19504 raft_consensus.cc:3055] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:17.508833 23437 consensus_queue.cc:1059] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:19:17.561431 23519 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:17.633003 19655 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:17.522789 23358 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:17.612036 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:19:17.635113 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 186354us
W20260709 13:19:17.637531 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.510329 23349 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.104s
W20260709 13:19:17.668843 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 80918.1us
I20260709 13:19:17.591601 23311 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:19:17.631304 23173 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:17.640491 23541 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:17.652457 19511 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:17.655014 19508 raft_consensus.cc:2410] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:19:17.654364 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.660039 19504 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:17.611071 23492 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:17.662097 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.664753 19661 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:19:17.643005 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.683367 19505 raft_consensus.cc:2410] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:17.670316 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.592068 23234 consensus_queue.cc:1059] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:19:17.651839 23309 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:17.639444 23410 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.672093 19478 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:17.651988 23354 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.684468 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:17.652133 23468 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:17.651829 23570 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:17.662396 23420 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.683091 19512 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:17.713172 19512 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:17.714675 19512 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:17.688933 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.658051 23478 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.715556 19505 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:17.686663 19504 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.716363 19504 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:17.619364 23563 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:17.691869 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.633308 23553 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:19:17.664317 23576 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:17.711138 19586 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:17.706758 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2632) took 1246 ms. Trace:
I20260709 13:19:17.714937 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.691356 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:17.748037 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.661784 23297 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:19:17.750432 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.751302 19510 raft_consensus.cc:2410] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:19:17.752017 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.753031 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.720276 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.684650 23578 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:17.714876 23420 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:17.672331 23519 raft_consensus.cc:697] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 13 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:19:17.687048 23492 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.687084 23500 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:17.758236 19505 raft_consensus.cc:2393] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:17.758526 19504 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:17.685746 23315 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.746872 19509 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:17.763370 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.712025 23245 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:17.785972 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.779289 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.771836 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.787096 19508 raft_consensus.cc:2393] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:19:17.753129 23568 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:19:17.786266 19586 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:17.792316 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.792982 19505 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:17.793174 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:17.793826 19586 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:17.788038 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:17.788731 19504 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:17.693910 23572 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:17.719628 23321 consensus_queue.cc:237] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.710717 23410 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.806604 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.838805 19508 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:19:17.792153 23315 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.808979 19505 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:17.809099 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.847215 19512 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:17.796718 23572 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:17.809810 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.847628 23075 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.818961 19586 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:17.849575 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.850183 19586 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:17.850978 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.851961 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.852522 19586 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:17.787075 23455 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:17.827003 23569 log.cc:927] Time spent T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 13:19:17.827180 23519 consensus_queue.cc:237] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:17.828627 23565 log.cc:927] Time spent T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.309s	user 0.001s	sys 0.001s
I20260709 13:19:17.743876 23434 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:19:17.786914 23553 consensus_queue.cc:1243] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:17.744786 23478 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:17.830623 23481 consensus_meta.cc:287] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.698s	user 0.009s	sys 0.002s
I20260709 13:19:17.782162 23306 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:17.790158 23500 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.833227 23563 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:17.833813 23042 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.790004 23492 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:17.744932 23575 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 13:19:17.767016 23576 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:17.849009 23572 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.785122 23512 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.711347 23354 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.717216 23468 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:17.856668 23460 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:17.890293 23572 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:17.891323 23576 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:17.880275 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:17.886133 23500 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:17.788185 23578 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:17.912753 23478 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:17.914330 23410 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.898885 23518 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:17.907092 23468 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:17.889154 23306 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:17.914618 23467 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:17.923717 23578 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:19:17.933970 23574 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:19:17.940512 23570 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:17.854518 19478 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:19:17.979456 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 239817us
I20260709 13:19:17.981360 19507 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:17.825222 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.984493 19584 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:19:17.985810 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:17.987016 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.856364 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:17.978247 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.912778 23354 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:18.004364 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.019908 19579 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:18.020328 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:18.022720 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:18.024205 19506 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:17.997961 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:18.029508 19585 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:18.036814 19582 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:17.995083 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 139372us
I20260709 13:19:18.039387 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 2100) took 1127 ms. Trace:
I20260709 13:19:18.042330 19653 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:18.042780 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 2112) took 1126 ms. Trace:
I20260709 13:19:18.045925 19586 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:18.036901 19584 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:18.047480 19655 rpcz_store.cc:276] 0709 13:19:16.911993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.431092 (+519099us) service_pool.cc:224] Handling call
0709 13:19:18.038874 (+607782us) spinlock_profiling.cc:243] Waited 86.6 ms on lock 0x7b54003f3254. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:18.039103 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199120768}
I20260709 13:19:18.054955 23306 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:17.996265 23572 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:18.061568 23572 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:18.062249 23572 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:18.063000 23575 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.063973 23575 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.065007 23313 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.065306 23512 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:18.066015 23349 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:18.066196 23512 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.067036 23349 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.069687 23313 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.071530 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:18.072386 23570 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:18.072693 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:18.073452 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2048) took 1206 ms. Trace:
I20260709 13:19:18.073984 19658 rpcz_store.cc:276] 0709 13:19:16.840544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.855292 (+ 14748us) service_pool.cc:224] Handling call
0709 13:19:18.041302 (+1186010us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b54001ed054. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:18.046654 (+  5352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1460876160}
I20260709 13:19:18.074872 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:18.075253 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2624) took 1681 ms. Trace:
I20260709 13:19:18.075688 19511 rpcz_store.cc:276] 0709 13:19:16.369442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.124270 (+754828us) service_pool.cc:224] Handling call
0709 13:19:17.124520 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.681289 (+556769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.050346 (+369057us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54000fda54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:18.051221 (+   875us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1213395328}
I20260709 13:19:17.745675 19503 rpcz_store.cc:276] 0709 13:19:16.459871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.202583 (+742712us) service_pool.cc:224] Handling call
0709 13:19:17.202866 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.203075 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:17.426871 (+223796us) log.cc:844] Serialized 14 byte log entry
0709 13:19:17.706375 (+279504us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:17.706440 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:17.706487 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.706554 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.706686 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12393,"prepare.queue_time_us":335708,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":17113,"raft.queue_time_us":12972,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":30383,"thread_start_us":490176,"threads_started":2}
I20260709 13:19:18.080420 19503 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: [10.6-14.8]
I20260709 13:19:18.076193 19660 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:18.047715 19659 rpcz_store.cc:276] 0709 13:19:16.916400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.898138 (+981738us) service_pool.cc:224] Handling call
0709 13:19:17.898459 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.986683 (+ 88224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.986753 (+    70us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:17.986839 (+    86us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:17.986896 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.042256 (+ 55360us) spinlock_profiling.cc:243] Waited 87.5 ms on lock 0x7b54000ada54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:18.042306 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.042548 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201190784}
I20260709 13:19:18.077255 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:17.904170 23075 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:18.090497 19581 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:18.097189 19579 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:18.095471 23518 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:19:18.100641 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:18.103022 19581 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:18.103806 23420 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.106197 19582 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:18.107352 23420 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:18.109817 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 2102) took 1197 ms. Trace:
I20260709 13:19:18.110304 19660 rpcz_store.cc:276] 0709 13:19:16.912555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.571687 (+659132us) service_pool.cc:224] Handling call
0709 13:19:17.572100 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:18.075837 (+503737us) spinlock_profiling.cc:243] Waited 85.7 ms on lock 0x7b54004045a0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316d1dc0 00007f6c3175c1c0 00007f6c3175d231 00007f6c31759d8f 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c
0709 13:19:18.085461 (+  9624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.109727 (+ 24266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197208448}
I20260709 13:19:18.111467 23578 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:18.112100 23578 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.113166 23512 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:18.115900 23349 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:18.118709 23575 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:18.112226 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:18.121940 19510 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:19:18.122495 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.123907 19478 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:18.120122 19579 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:18.120136 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:18.130199 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:18.133487 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:18.134678 19586 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:18.139532 23349 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:18.140441 23349 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:18.143608 23457 raft_consensus.cc:3055] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:18.166108 23457 raft_consensus.cc:740] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:18.166275 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:18.166916 20663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59442 (request call id 143) took 1293 ms. Trace:
I20260709 13:19:18.167544 23457 consensus_queue.cc:260] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.168788 19581 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:18.145391 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:18.172314 19625 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:18.173291 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 72966.8us
I20260709 13:19:18.173805 23572 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.175971 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:18.176779 23572 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:18.178457 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2634) took 1718 ms. Trace:
I20260709 13:19:18.178857 19507 rpcz_store.cc:276] 0709 13:19:16.460355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.245120 (+784765us) service_pool.cc:224] Handling call
0709 13:19:17.293789 (+ 48669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.982358 (+688569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.178172 (+195814us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b54000749d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:18.178399 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1579152128}
I20260709 13:19:18.167418 20663 rpcz_store.cc:276] 0709 13:19:16.873672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.879176 (+  5504us) service_pool.cc:224] Handling call
0709 13:19:17.069426 (+190250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.070199 (+   773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.070255 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:17.073273 (+  3018us) log.cc:844] Serialized 26 byte log entry
0709 13:19:17.423901 (+350628us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:17.423943 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.424009 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:17.989417 (+565408us) raft_consensus.cc:1685] finished
0709 13:19:17.989463 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.151820 (+162357us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400524c50. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:18.166621 (+ 14801us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":236,"raft.queue_time_us":1026,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5419,"spinlock_wait_cycles":425076608,"thread_start_us":350313,"threads_started":1,"wal-append.queue_time_us":646233}
I20260709 13:19:18.141593 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:18.188455 19511 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:18.141654 23349 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:18.168967 23457 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:18.195691 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:18.195940 19581 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:18.196286 23518 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:18.197309 23576 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:18.191072 23575 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:18.148715 23581 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.387s	user 0.000s	sys 0.003s
I20260709 13:19:18.200742 19654 raft_consensus.cc:2410] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:19:18.202859 23321 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.149857 23512 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.206301 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:18.176783 23500 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.213946 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.216091 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.216311 23354 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.216473 19655 raft_consensus.cc:1275] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:18.210278 23306 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:18.217787 19476 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:18.217346 19659 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:19:18.270668 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 66512us
I20260709 13:19:18.271132 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2442) took 1158 ms. Trace:
I20260709 13:19:18.271008 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:18.271878 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.272568 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.223441 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.273967 23165 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:18.274034 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.224257 23311 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.227131 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:18.227696 23313 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:18.228490 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:18.228890 23315 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:18.224989 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.228657 23321 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.277944 23420 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.278211 19657 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:18.278621 23420 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.279220 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.279616 23321 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:18.225319 23576 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:18.280373 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.280746 23420 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:18.271660 19583 rpcz_store.cc:276] 0709 13:19:17.112546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.255549 (+143003us) service_pool.cc:224] Handling call
0709 13:19:17.297005 (+ 41456us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:17.297462 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.297500 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:17.298235 (+   735us) log.cc:844] Serialized 52 byte log entry
0709 13:19:17.512149 (+213914us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:17.512197 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.512278 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:18.147571 (+635293us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:18.270612 (+123041us) raft_consensus.cc:1685] finished
0709 13:19:18.270633 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.270946 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":3811,"spinlock_wait_cycles":13798272,"thread_start_us":213529,"threads_started":1,"wal-append.queue_time_us":392649}
I20260709 13:19:18.281445 23354 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:18.233966 23309 consensus_meta.cc:287] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.526s	user 0.016s	sys 0.003s
I20260709 13:19:18.282542 23309 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.283587 19658 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:19:18.283695 23354 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:18.284533 23309 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:18.244415 23500 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:18.253857 23512 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:18.257944 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 82118.2us
W20260709 13:19:18.258726 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.260171 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:18.261354 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 89210.6us
W20260709 13:19:18.262023 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 54693us
I20260709 13:19:18.228498 23437 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:18.266942 19506 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:18.268678 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.224272 19660 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:18.293663 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.294551 23512 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:18.294947 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.272605 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.273424 19476 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:18.277107 19585 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:18.281075 23576 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.245551 23578 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:18.281100 19657 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:18.297597 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.296624 19579 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 13.
I20260709 13:19:18.277091 23311 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.299890 23512 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:18.300951 20631 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:19:18.301131 23512 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:18.301528 23512 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:18.303050 19476 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:18.304344 23315 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:18.304693 19476 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:18.305905 23500 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:18.305774 23572 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:19:18.292387 23437 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:18.313386 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 2111) took 1236 ms. Trace:
I20260709 13:19:18.312861 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.317265 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:18.320281 20662 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:18.320493 23336 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.321290 19659 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:18.319621 23165 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:18.321120 23336 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.321372 23311 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:18.322408 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:18.326076 23571 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:18.326154 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:18.326764 23571 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:18.328085 19654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2044) took 1492 ms (client timeout 1605 ms). Trace:
I20260709 13:19:18.328218 23571 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:18.328717 19654 rpcz_store.cc:269] 0709 13:19:16.836109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.836240 (+   131us) service_pool.cc:224] Handling call
0709 13:19:18.327768 (+1491528us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002c83d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:18.328004 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2875192704}
I20260709 13:19:18.331061 23578 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:18.330212 19660 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:18.323414 19586 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:18.322049 23165 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:18.334235 23165 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:18.337725 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:18.314966 19656 rpcz_store.cc:276] 0709 13:19:16.915906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.894670 (+978764us) service_pool.cc:224] Handling call
0709 13:19:18.014787 (+120117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:18.015498 (+   711us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:18.016300 (+   802us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.096655 (+ 80355us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.152124 (+ 55469us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:18.152172 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:18.152220 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.152284 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.152612 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122625,"prepare.queue_time_us":589,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":58900,"raft.run_cpu_time_us":444,"raft.run_wall_time_us":6655,"spinlock_wait_cycles":17942144,"thread_start_us":67560,"threads_started":1,"wal-append.queue_time_us":176115}
I20260709 13:19:18.350297 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2082) took 1241 ms. Trace:
I20260709 13:19:18.351064 23349 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.346498 23311 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.352751 23311 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.350363 19625 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:18.350922 19587 rpcz_store.cc:276] 0709 13:19:17.108390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.108592 (+   202us) service_pool.cc:224] Handling call
0709 13:19:17.108959 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.378660 (+269701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.378690 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:17.378731 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:17.378776 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.348254 (+969478us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54003bf954. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:18.349702 (+  1448us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.349968 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":619813760}
I20260709 13:19:18.352002 23297 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.348587 23315 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:18.364315 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:18.365675 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 61114.4us
I20260709 13:19:18.367760 19657 raft_consensus.cc:2393] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:18.388358 19582 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:18.388141 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:18.377873 23511 consensus_meta.cc:287] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.646s	user 0.011s	sys 0.008s
I20260709 13:19:18.365136 23315 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.388562 23571 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:18.396661 23297 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:18.400074 23188 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:18.397132 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.400942 19654 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:18.408433 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.395889 23315 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:18.409137 19656 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
W20260709 13:19:18.417647 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.418246 23321 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:18.400131 23517 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:19:18.422673 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.421398 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.416601 19625 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:18.434111 19657 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:18.435400 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:18.413528 23354 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:18.440068 23354 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.441171 23354 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:18.446470 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:18.447351 19659 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:18.440276 23572 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.451022 23572 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.452857 23517 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:18.453393 23517 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.453817 23517 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:18.456105 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 2109) took 1540 ms. Trace:
I20260709 13:19:18.431478 19476 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:18.456578 19653 rpcz_store.cc:276] 0709 13:19:16.915326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.653306 (+737980us) service_pool.cc:224] Handling call
0709 13:19:18.041602 (+388296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:18.077685 (+ 36083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.455861 (+378176us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54001ed050. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:18.456039 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":890829184}
I20260709 13:19:18.457688 23433 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:18.458360 23336 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:18.438935 23601 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:19:18.416952 23437 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.460059 23437 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:18.462023 19625 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:18.463043 23420 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:18.465859 23336 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:18.462028 19627 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:18.466503 23336 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.467218 23336 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:18.467243 23460 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:18.468040 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.468218 23460 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:18.468747 19661 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:18.417127 23519 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:18.469919 23519 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 13 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:19:18.469525 23460 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.471324 23519 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:18.475579 23188 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:18.476159 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 133356us
I20260709 13:19:18.441171 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:18.478391 19505 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:18.469959 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.479619 19660 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 6.
I20260709 13:19:18.465401 23420 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:19:18.476277 23188 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:18.397758 23511 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.499859 19508 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:18.503535 23511 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:18.506219 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 75916.2us
W20260709 13:19:18.509884 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 48019.5us
I20260709 13:19:18.533847 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:18.535741 19661 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:18.542166 19627 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:18.541322 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:18.555584 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:18.556224 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 147899us
I20260709 13:19:18.561563 23297 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:18.562943 23297 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:18.563259 19625 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:18.564595 19627 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:18.566273 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:18.572238 23547 consensus_meta.cc:287] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.998s	user 0.009s	sys 0.012s
I20260709 13:19:18.541213 23349 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:18.578415 19578 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:18.580981 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:18.584070 23511 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.584791 23511 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.539283 23311 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:18.590688 19476 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:18.591351 23512 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.591858 23576 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:18.592160 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 53370.8us
I20260709 13:19:18.558943 23572 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:18.593654 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:18.595580 19585 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:18.603000 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:18.603220 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:18.603832 19583 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:18.604146 23297 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:18.604707 23297 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.605294 23297 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:18.606462 19660 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:18.609972 19578 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:19:18.561743 23492 consensus_meta.cc:287] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.662s	user 0.013s	sys 0.002s
I20260709 13:19:18.572820 23547 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:18.610888 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 46390us
I20260709 13:19:18.604614 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:18.625160 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:18.595216 23511 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:18.629669 19652 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:18.635032 19509 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:18.589354 23165 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.636358 23075 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:18.639323 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 67528.7us
W20260709 13:19:18.644824 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51336.1us
I20260709 13:19:18.619092 23433 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:18.605780 23596 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:18.628980 23576 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:18.635852 23512 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:18.641891 22275 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:19:18.641782 23428 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.659786 19478 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:18.654841 22275 consensus_queue.cc:1243] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:18.639062 23519 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 13:19:18.665323 23604 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.266s	user 0.000s	sys 0.005s
W20260709 13:19:18.668941 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.670224 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 79648.9us
I20260709 13:19:18.671128 19476 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:18.671986 23500 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:18.673194 19476 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:18.673921 23500 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:18.676679 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2455) took 1422 ms. Trace:
I20260709 13:19:18.683837 23315 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:18.639639 23173 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:19:18.687845 23584 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:18.701843 23584 consensus_queue.cc:1243] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:18.699213 23578 consensus_queue.cc:1059] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:19:18.706066 23578 raft_consensus.cc:3055] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:18.706487 23578 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:18.707579 23578 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.658648 23596 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:18.708891 23578 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:18.699503 23500 raft_consensus.cc:697] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:18.711233 23596 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:18.712930 19510 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:18.714526 19504 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:18.630964 23492 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.695016 23428 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.691511 19580 rpcz_store.cc:276] 0709 13:19:17.253990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.406002 (+152012us) service_pool.cc:224] Handling call
0709 13:19:17.406411 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.407031 (+   620us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:18.151637 (+744606us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b18001a95c0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66a455 00007f6c351523c7 00007f6c317649a7 00007f6c317740bf 00007f6c31774038
0709 13:19:18.223263 (+ 71626us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.333166 (+109903us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.390632 (+ 57466us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.390833 (+   201us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:18.390869 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.398154 (+  7285us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:18.650645 (+252491us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:18.676343 (+ 25698us) raft_consensus.cc:1685] finished
0709 13:19:18.676366 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.676518 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":357246,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":78,"raft.queue_time_us":6590,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":19701,"spinlock_wait_cycles":20598016,"thread_start_us":143551,"threads_started":2,"wal-append.queue_time_us":121143}
W20260709 13:19:18.694557 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.706308 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:18.718930 19509 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 13.
I20260709 13:19:18.719022 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:18.720165 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.717903 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:18.726168 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.721874 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:18.723534 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:18.733173 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.734652 23576 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:18.735111 23576 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:18.735116 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:18.735538 23576 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:18.721474 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:18.742244 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:18.756036 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:18.752415 19510 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:18.749138 19582 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:18.712164 23500 consensus_queue.cc:237] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.722426 23511 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:18.802346 19503 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
W20260709 13:19:18.805768 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 132680us
W20260709 13:19:18.807037 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 138955us
I20260709 13:19:18.790920 19508 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:18.782878 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:18.992111 20631 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:18.791124 19625 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:18.899590 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:19.018790 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 227746us
I20260709 13:19:18.938380 19506 pending_rounds.cc:85] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 5
I20260709 13:19:18.790383 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:18.950603 19656 pending_rounds.cc:85] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 4
I20260709 13:19:18.805794 19512 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
W20260709 13:19:18.802925 23607 log.cc:927] Time spent T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:19:19.009593 23511 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:18.886819 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:18.944880 23297 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.027439 23460 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:19.031088 19511 raft_consensus.cc:2410] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:19:18.939040 23512 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.022941 19506 pending_rounds.cc:107] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:19:19.056304 19506 raft_consensus.cc:2889] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:19.024083 19656 pending_rounds.cc:107] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:19:19.057098 19656 raft_consensus.cc:2889] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:19.057574 19656 pending_rounds.cc:107] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:19:19.057899 19656 raft_consensus.cc:2889] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:18.914215 23492 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:18.794785 23457 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:18.958019 23315 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:18.913655 23433 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.798750 23571 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:18.823513 23428 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:19.017400 23349 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.944514 23336 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:18.826370 23547 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:18.757172 23075 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.277s
I20260709 13:19:18.911767 23354 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.052525 23460 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.751838 23311 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.294s
I20260709 13:19:19.037400 23511 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:18.952965 23517 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.092592 23517 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:19.072495 23622 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:19.093668 23622 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.094300 23354 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:18.971791 23576 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.097632 19654 raft_consensus.cc:2368] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13.
I20260709 13:19:18.947703 23188 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:19.077636 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 196049us
I20260709 13:19:18.881168 23321 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.182s
I20260709 13:19:19.089942 23481 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:19.089742 23433 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.079720 23460 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.106736 23618 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:19.082386 23349 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.109953 19478 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:19.111685 23349 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:19.112211 23349 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:19.112640 23349 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:19.114290 19408 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48826 (request call id 179) took 28508 ms (client timeout 15000 ms). Trace:
I20260709 13:19:19.114769 23297 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:19.116776 23437 consensus_meta.cc:287] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.656s	user 0.009s	sys 0.000s
W20260709 13:19:19.117307 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.947693 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:19.118654 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 70888.9us
I20260709 13:19:19.113481 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:19.119611 19585 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:19.099151 23571 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:19.118407 23188 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:19.139626 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:19.076566 23512 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.131779 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:19.140630 19478 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:19.143796 19582 raft_consensus.cc:2368] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13.
I20260709 13:19:19.124452 23578 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.154317 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:19.163153 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:19.164331 19585 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:19.166828 19504 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:19.133415 23433 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:19.172875 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:19.179391 19478 leader_election.cc:400] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13.
I20260709 13:19:19.179702 19478 leader_election.cc:403] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:19:19.136155 23354 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:19:19.166153 23622 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:19.154850 23633 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:19.184115 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60692 (request call id 185) took 1115 ms. Trace:
I20260709 13:19:19.167169 23630 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:19.185750 23512 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:19.194196 19625 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:19.192929 19509 rpcz_store.cc:276] 0709 13:19:18.064412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.074262 (+  9850us) service_pool.cc:224] Handling call
0709 13:19:19.179268 (+1105006us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b54002076d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:19.179376 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1286189440}
I20260709 13:19:19.136009 23349 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.187134 23188 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:19.114687 19408 rpcz_store.cc:269] 0709 13:18:50.605281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.625802 (+ 20521us) service_pool.cc:224] Handling call
0709 13:19:19.113969 (+28488167us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:10.611312 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:10.667645 (+ 56333us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:10.667692 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:19:10.667720 (+    28us) tablet.cc:662] Decoding operations
0709 13:19:10.791978 (+124258us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:10.792057 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:10.792091 (+    34us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:19:10.843366 (+ 51275us) tablet.cc:701] Row locks acquired
0709 13:19:10.843436 (+    70us) write_op.cc:260] PREPARE: finished
0709 13:19:10.843632 (+   196us) write_op.cc:270] Start()
0709 13:19:10.843818 (+   186us) write_op.cc:276] Timestamp: P: 1783603150843557 usec, L: 0
0709 13:19:10.843839 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:19:10.994018 (+150179us) log.cc:844] Serialized 11483 byte log entry
0709 13:19:12.400508 (+1406490us) op_driver.cc:464] REPLICATION: finished
0709 13:19:12.839443 (+438935us) spinlock_profiling.cc:243] Waited 67.3 ms on lock 0x7b180008f980. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:19:12.839671 (+   228us) write_op.cc:301] APPLY: starting
0709 13:19:12.846316 (+  6645us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:12.897139 (+ 50823us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:12.897195 (+    56us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:13.333358 (+436163us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:13.333912 (+   554us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=29
0709 13:19:13.333962 (+    50us) write_op.cc:312] APPLY: finished
0709 13:19:13.334537 (+   575us) log.cc:844] Serialized 193 byte log entry
0709 13:19:13.334769 (+   232us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:13.334997 (+   228us) write_op.cc:454] Released schema lock
0709 13:19:13.335083 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:13.335633 (+   550us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:13.335659 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11631,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":105196,"apply.run_cpu_time_us":11599,"apply.run_wall_time_us":495930,"num_ops":29,"prepare.queue_time_us":449297,"prepare.run_cpu_time_us":72154,"prepare.run_wall_time_us":716449,"raft.queue_time_us":115575,"raft.run_cpu_time_us":11498,"raft.run_wall_time_us":91085,"replication_time_us":1556457,"spinlock_wait_cycles":154784000,"thread_start_us":410222,"threads_started":4,"wal-append.queue_time_us":300799,"wal-append.run_cpu_time_us":18023,"wal-append.run_wall_time_us":2992436}]]}
W20260709 13:19:19.199244 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 67688.3us
I20260709 13:19:19.178359 23492 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:19.135926 23481 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:19.211428 22275 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:19.211886 22275 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.171168 23578 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.212347 22275 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:19.211444 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 82177.2us
I20260709 13:19:19.214890 19625 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:19.193282 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:19.219715 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:19.221813 23512 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:19.192360 23633 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:19.196524 23630 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:19.230901 19625 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:19.207084 23572 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13.
I20260709 13:19:19.210484 23188 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.216054 23309 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.211665 23576 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:19.258121 19580 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:19.259613 19476 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:19.239578 23633 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:19.245435 23630 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:19.251364 23188 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:19.266068 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:19.251978 23336 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:19.257740 23309 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.324539 23434 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:19.325140 23434 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.325521 23434 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:19.328168 23622 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:19.330014 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:19.331056 23628 consensus_queue.cc:1059] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:19.332139 23628 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:19.332502 23628 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:19.332854 23628 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:19.333787 23321 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:19.334266 23321 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:19.335245 23321 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.300442 23571 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:19.338871 22275 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.301086 23433 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:19.300793 23576 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:19.305095 23467 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:19.350198 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 96598.9us
I20260709 13:19:19.353817 23641 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.352407 23467 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.354427 23641 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.355086 23467 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:19.355490 23165 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:19.356693 23641 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:19.359354 22275 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:19.366901 23638 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.367564 23638 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.372618 23309 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:19.343086 23519 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:19.380450 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:19.382051 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:19.383409 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:19.383999 19581 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:19.385987 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:19.386533 20663 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:19.390254 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:19.391840 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:19.392930 19656 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:19.346194 23634 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:19:19.395663 23578 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:19.375087 23547 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:19.396570 23547 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.398752 23547 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:19.399430 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:19.400604 20662 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:19.400760 23188 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.378583 23321 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.407740 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:19.410679 23572 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.411440 23572 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:19.418190 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 119011us
I20260709 13:19:19.423291 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:19.353272 23576 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.376784 23433 raft_consensus.cc:697] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:19.432293 19476 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:19.433923 19476 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:19.433696 23433 consensus_queue.cc:237] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.435316 19476 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:19.438529 19627 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:19.444566 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:19.446059 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:19.451074 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:19.442363 23512 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:19.452899 23492 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.453718 23492 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:19.433979 23165 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:19.460703 23165 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:19.461102 23165 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:19.464428 20663 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:19.446108 23306 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:19:19.447382 23547 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:19.467824 23547 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:19.424343 23519 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:19.469097 20666 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:19.475176 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:19.475452 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:19.476039 19659 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:19.476799 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:19.478111 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:19.478468 19476 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:19.478643 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:19.479259 19505 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:19.479526 23571 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:19.480517 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:19.481151 19509 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:19.481467 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:19.481994 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:19.482580 19503 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:19.482785 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:19.483387 19508 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:19.486353 19511 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:19.490157 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 2128) took 1097 ms. Trace:
I20260709 13:19:19.490599 19654 rpcz_store.cc:276] 0709 13:19:18.392602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.412171 (+ 19569us) service_pool.cc:224] Handling call
0709 13:19:19.489957 (+1077786us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b5400102054. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:19.490095 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1516618496}
I20260709 13:19:19.491950 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:19.492856 19657 raft_consensus.cc:2410] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:19:19.494161 19661 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:19:19.494534 19661 pending_rounds.cc:85] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 4
I20260709 13:19:19.494769 19661 pending_rounds.cc:107] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:19:19.482503 19476 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:19.494995 19661 raft_consensus.cc:2889] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:19.495898 19476 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:19.496738 19505 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:19.497825 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:19.468305 23547 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:19.498165 19503 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:19.518327 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:19.519158 19661 raft_consensus.cc:2393] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:19.419266 23511 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.497826 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:19.529124 19511 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:19.529340 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:19.415532 23460 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.498468 19510 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:19.427129 23576 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:19.499042 19581 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:19.448773 23572 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:19.538647 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:19.540704 19661 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:19.537189 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:19.537276 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:19.537742 19657 raft_consensus.cc:2410] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:19:19.538146 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:19.523108 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:19.517503 23512 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:19.546728 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:19.547300 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51499us
I20260709 13:19:19.548473 19504 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:19.520926 23420 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:19.554503 19509 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:19.525933 23571 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:19.556861 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:19.449407 23638 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:19.558337 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 119865us
I20260709 13:19:19.524458 23309 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:19.559094 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:19.560501 19476 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:19.562691 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:19.564014 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:19.530656 23354 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:19.571249 19476 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:19.575452 23637 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.319s	user 0.004s	sys 0.000s
I20260709 13:19:19.576234 23500 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:19.556221 23512 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:19.577222 23512 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:19.578457 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:19.559580 23492 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:19.579079 23460 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:19.579332 23641 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:19.580124 23309 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.584033 23630 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.585817 19583 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:19.569816 23578 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:19.586618 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.586515 23578 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.587692 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:19.588529 23631 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:19.588663 23578 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:19.588936 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:19.589083 23631 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.589836 23622 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:19.590334 23188 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:19.591554 23631 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:19.593892 23519 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:19.595181 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:19.589255 23578 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:19.596675 19508 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:19.599555 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:19.600543 19508 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:19.560132 23571 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.601580 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:19.617475 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 58467.1us
I20260709 13:19:19.617307 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:19.616943 19508 raft_consensus.cc:2368] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11.
W20260709 13:19:19.623880 19410 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 50) took 11783 ms (client timeout 15000 ms). Trace:
I20260709 13:19:19.629751 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:19.633790 19627 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:19.624332 19410 rpcz_store.cc:269] 0709 13:19:07.812225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.812552 (+   327us) service_pool.cc:224] Handling call
0709 13:19:19.595182 (+11782630us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:18.698579 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:18.713004 (+ 14425us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:18.713060 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:19:18.713096 (+    36us) tablet.cc:662] Decoding operations
0709 13:19:18.713805 (+   709us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:18.713881 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:18.713913 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:19:18.714372 (+   459us) tablet.cc:701] Row locks acquired
0709 13:19:18.714428 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:19:18.714619 (+   191us) write_op.cc:270] Start()
0709 13:19:18.714766 (+   147us) write_op.cc:276] Timestamp: P: 1783603158714539 usec, L: 0
0709 13:19:18.714791 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:19:18.720766 (+  5975us) log.cc:844] Serialized 1438 byte log entry
0709 13:19:19.167298 (+446532us) op_driver.cc:464] REPLICATION: finished
0709 13:19:19.342544 (+175246us) write_op.cc:301] APPLY: starting
0709 13:19:19.342655 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:19.346306 (+  3651us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:19.349878 (+  3572us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:19.366184 (+ 16306us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:19.366629 (+   445us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:19:19.366700 (+    71us) write_op.cc:312] APPLY: finished
0709 13:19:19.367111 (+   411us) log.cc:844] Serialized 34 byte log entry
0709 13:19:19.367327 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:19.367422 (+    95us) write_op.cc:454] Released schema lock
0709 13:19:19.367473 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:19.367962 (+   489us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:19.367997 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3528050,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":172093,"apply.run_cpu_time_us":3615,"apply.run_wall_time_us":25396,"num_ops":3,"prepare.queue_time_us":251087,"prepare.run_cpu_time_us":10433,"prepare.run_wall_time_us":173697,"raft.queue_time_us":145900,"raft.run_cpu_time_us":21231,"raft.run_wall_time_us":162039,"replication_time_us":420357,"spinlock_wait_cycles":66432,"thread_start_us":338330,"threads_started":4,"wal-append.queue_time_us":141015}]]}
I20260709 13:19:19.640056 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:19.596957 23437 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:19.646844 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:19.615619 23571 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:19.649062 19625 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:19.602415 23460 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.616459 23500 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:19.654964 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:19.656589 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:19.649968 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:19.658596 19508 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:19.666106 23311 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:19.597164 23354 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.660965 19625 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:19.671316 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:19.648451 23420 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:19.619799 23467 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.679579 19625 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:19.648645 20662 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:19.658290 23297 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:19.589252 23628 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.602898 23633 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.684023 19625 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:19.684264 22275 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:19.644187 23075 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:19:19.681352 23437 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:19.688271 23512 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.698489 23467 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:19.681505 23460 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.699350 23512 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:19.699664 23165 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.700860 23460 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:19.702145 23647 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:19:19.702725 23633 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:19.705340 19653 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:19.703547 19506 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
W20260709 13:19:19.706665 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 57992.1us
I20260709 13:19:19.689947 23297 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.690757 23173 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:19.692965 23578 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:19.704438 23572 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.721048 19625 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:19.723239 23336 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:19.706108 23437 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:19.683171 23500 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:19.712313 23630 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:19.727145 23336 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.728933 23354 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:19.729393 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.730175 23437 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:19.731442 23651 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:19:19.732363 23428 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:19.713084 23309 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:19.717934 23297 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.733584 23075 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:19.726522 19625 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:19.725543 23173 raft_consensus.cc:697] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:19.740880 19504 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:19.837999 19476 leader_election.cc:400] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13.
I20260709 13:19:19.900383 19476 leader_election.cc:403] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:19:19.742187 19511 raft_consensus.cc:1275] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
W20260709 13:19:19.909632 23434 consensus_meta.cc:287] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.000s
I20260709 13:19:19.725193 23165 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:19.770625 19627 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:19.947289 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 225473us
I20260709 13:19:20.028635 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:19.946779 23434 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.030292 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:20.013832 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:20.031476 22275 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.031019 23188 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:20.031562 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:20.032195 19585 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:20.030303 23500 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:20.033918 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:20.034437 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:20.034703 19583 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:20.035162 19652 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:20.032054 22275 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.008890 19508 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:20.037221 22275 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:20.007385 23571 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.037983 23306 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:20.038487 23306 raft_consensus.cc:697] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:20.039358 23306 consensus_queue.cc:237] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.040017 19505 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:20.039657 23571 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:20.007890 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:20.002588 23481 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:20.025270 23173 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.004710 23467 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:20.033347 19586 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:20.042923 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:20.043081 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:20.025214 19510 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:20.044219 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:20.046022 19655 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:20.046864 19504 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:19.775292 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:20.096513 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:20.097146 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 321880us
I20260709 13:19:20.007656 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:20.048235 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:20.072357 19509 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:20.021961 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:19.981101 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:20.056195 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 285646us
W20260709 13:19:19.917925 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 191475us
I20260709 13:19:20.099840 19509 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:20.104187 19661 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:20.104549 19659 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:19:20.105333 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 76783.4us
I20260709 13:19:20.101464 19585 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:19.727394 23420 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:20.116015 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:19.900384 23336 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:20.119091 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 346417us
I20260709 13:19:19.984498 23631 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:19.917685 23309 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.966877 23517 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:20.124519 19656 raft_consensus.cc:2368] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14.
I20260709 13:19:19.979386 23512 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13.
I20260709 13:19:20.124331 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:19.891010 23638 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:19.884671 23630 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:20.023898 23649 log.cc:927] Time spent T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.330s	user 0.000s	sys 0.007s
I20260709 13:19:19.872153 23578 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:20.122776 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:20.137459 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:20.084362 23641 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
W20260709 13:19:20.014889 20619 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.129:38645 timed out after 1.519s (SENT) [suppressed 12 similar messages]
I20260709 13:19:19.725340 23572 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.128306 19587 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:20.118949 23467 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.117722 19478 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:20.144475 19476 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:20.110206 23165 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:20.155119 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:19.908466 23547 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.164069 23517 raft_consensus.cc:697] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:20.378562 23467 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:20.379257 23512 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:20.379043 23517 consensus_queue.cc:237] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.379832 23512 raft_consensus.cc:697] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:20.166241 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:20.381043 23512 consensus_queue.cc:237] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.381954 19512 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 11.
I20260709 13:19:20.383071 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:20.384316 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:20.384899 19512 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:20.149583 23309 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.386796 19657 raft_consensus.cc:2410] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:19:20.387704 23309 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:20.178714 23578 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.189232 19661 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:20.389783 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:20.390648 19661 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:20.391077 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:20.199658 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:20.391616 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:20.392035 23547 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:20.392452 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 192883us
I20260709 13:19:20.392844 19503 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:20.150113 23420 raft_consensus.cc:697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:20.394407 23420 consensus_queue.cc:237] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.198016 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:20.124329 23075 consensus_queue.cc:1059] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:19:20.146364 23631 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.401947 23075 raft_consensus.cc:3055] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:20.402410 23075 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:20.402760 23631 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:20.193910 23628 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:20.403527 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:20.403337 23075 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.404174 19506 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:20.404553 19653 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:19:20.404733 23075 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:20.405221 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:20.158717 23638 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.228454 23433 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:20.267554 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:20.410648 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:20.237834 23434 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:20.284406 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:20.198395 23630 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.298369 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:20.304055 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.207523 23641 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:20.333288 23663 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:19:20.340070 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 146267us
I20260709 13:19:20.343783 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:20.364079 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:20.375590 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 262491us
W20260709 13:19:20.376482 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 232090us
I20260709 13:19:20.434513 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:20.377731 23571 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:20.407831 19625 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:20.412546 19503 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:20.411048 19509 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:20.422323 19504 raft_consensus.cc:2393] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 7: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:20.374490 23165 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:20.442632 19478 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:20.408849 23188 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:20.425058 23433 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.429569 19506 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:19:20.437805 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:20.455197 19578 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:20.430325 23641 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:20.426699 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:20.456497 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:20.456925 19478 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:20.450973 19476 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:20.458796 19476 leader_election.cc:400] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14.
I20260709 13:19:20.459338 19476 leader_election.cc:403] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:19:20.457515 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:20.462945 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:20.463826 19578 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:20.464918 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:20.464918 19476 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:20.466102 19582 raft_consensus.cc:2410] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:19:20.465255 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:20.466904 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:20.467586 19578 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:20.467736 19584 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:20.461655 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:20.477690 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:20.473541 19478 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:20.480094 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:20.481510 19506 raft_consensus.cc:606] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:20.482051 19506 raft_consensus.cc:614] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:20.449435 23165 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:20.449743 23188 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.449671 23173 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:20.485055 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:20.480237 19476 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:20.487869 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:20.453876 23547 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:20.456379 23492 raft_consensus.cc:2764] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:19:20.491380 19579 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:20.491623 19580 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:20.456188 23511 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:20.478238 23349 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:20.482050 23633 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:20.493530 19584 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:20.478940 23641 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:20.507336 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 97159.6us
I20260709 13:19:20.482321 23512 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:20.484110 23628 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:20.494639 23173 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.518953 23173 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:20.521687 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:20.524377 23433 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:20.526690 23631 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:20.528069 23631 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:20.528425 23631 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.528712 23631 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:20.531320 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:20.532099 19585 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:20.493290 23188 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:20.514921 23512 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:20.535915 23671 log.cc:927] Time spent T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:19:20.536885 23336 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.503345 23660 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:20.558238 23656 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:20.558537 23660 raft_consensus.cc:697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:20.558897 23656 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.559638 23660 consensus_queue.cc:237] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.516412 23578 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:20.548496 23512 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:20.538740 19625 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:20.545208 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:20.545578 23630 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:20.546348 23668 log.cc:927] Time spent T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:19:20.531538 23547 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:20.547443 23572 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:20.549557 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:20.512322 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 545624us
I20260709 13:19:20.552192 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:20.557570 23659 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.401s	user 0.000s	sys 0.003s
W20260709 13:19:20.538556 23297 consensus_meta.cc:287] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.572s	user 0.012s	sys 0.000s
I20260709 13:19:20.586027 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:20.596081 19587 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:20.605441 19583 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:20.541441 19578 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:20.608816 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:20.609910 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 76313.8us
I20260709 13:19:20.606510 19579 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:20.610628 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:20.611143 19585 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:20.587731 23578 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.611152 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:20.612936 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:20.609524 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:20.618906 19578 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:20.620247 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2708) took 1076 ms. Trace:
I20260709 13:19:20.612241 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:20.615867 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:20.620704 19508 rpcz_store.cc:276] 0709 13:19:19.544100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.036581 (+492481us) service_pool.cc:224] Handling call
0709 13:19:20.036862 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:20.037059 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:20.257089 (+220030us) log.cc:844] Serialized 14 byte log entry
0709 13:19:20.509095 (+252006us) spinlock_profiling.cc:243] Waited 9.46 ms on lock 0x7b18002290c0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c313024bc 00007f6c2e65048b 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa23a
0709 13:19:20.619745 (+110650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:20.619794 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:20.619847 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.620070 (+   223us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.620195 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":279005,"prepare.run_cpu_time_us":135,"prepare.run_wall_time_us":2617,"raft.queue_time_us":17944,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":74,"spinlock_wait_cycles":21749632,"thread_start_us":417005,"threads_started":3,"wal-append.queue_time_us":115318}
W20260709 13:19:20.632232 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 110614us
I20260709 13:19:20.611387 23669 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:20.645896 19579 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:19:20.618932 23354 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:20.626227 23576 consensus_meta.cc:287] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 1.081s	user 0.013s	sys 0.001s
I20260709 13:19:20.618157 23481 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:19:20.660756 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 180618us
I20260709 13:19:20.613536 23297 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.679936 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:20.683244 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:20.666725 23354 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.620990 23578 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.670019 23638 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:20.669309 23656 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:20.700129 19584 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:20.700614 19661 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:20.676823 23481 raft_consensus.cc:697] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:20.694121 23354 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:20.671047 23576 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:20.727618 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 90901.7us
I20260709 13:19:20.738943 19512 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:20.663476 23669 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.743170 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:20.747169 19579 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
W20260709 13:19:20.748811 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 76406us
I20260709 13:19:20.751053 23687 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:20.753321 23677 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
W20260709 13:19:20.755535 23674 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 13:19:20.758999 23576 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:20.762121 23675 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:19:20.762010 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:20.763967 19627 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:20.769991 19627 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:20.771152 19580 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:20.775676 19583 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:20.774060 23434 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:20.784725 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:20.793565 23297 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:20.793318 20665 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:20.806633 19587 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:20.808243 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:20.808104 23481 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:20.809911 23684 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:19:20.811801 23173 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:20.817970 23673 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:19:20.819060 23173 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:20.824154 23188 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.825289 19585 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:19:20.826253 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:20.826500 23578 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:20.780974 23460 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:20.828660 19510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:19:20.829242 19510 raft_consensus.cc:606] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:20.829556 19510 raft_consensus.cc:614] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:20.832500 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:20.813074 23165 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:20.835675 23690 log.cc:927] Time spent T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:19:20.834884 23669 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:20.850625 19653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:20.851344 19653 raft_consensus.cc:606] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
W20260709 13:19:20.851621 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 189422us
I20260709 13:19:20.852418 19476 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:20.853240 19579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45038
I20260709 13:19:20.853853 19579 raft_consensus.cc:606] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Received request to transfer leadership
I20260709 13:19:20.854283 19579 raft_consensus.cc:614] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:20.853693 19476 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:20.856599 23633 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:20.858889 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:20.860086 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:20.860364 23188 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:20.863641 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.865401 23433 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:20.862648 23682 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:20.865878 23433 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:20.866330 23433 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:20.867921 23336 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:20.870044 19505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:19:20.870651 19505 raft_consensus.cc:606] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:20.870954 19505 raft_consensus.cc:614] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:20.873824 19505 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:20.874001 23646 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.874596 23646 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.875643 19476 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:20.876330 19625 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:20.876420 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:20.876719 23646 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:20.876891 19506 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:20.877065 19512 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:20.877136 22275 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:20.877784 22275 raft_consensus.cc:697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:20.878981 19476 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:20.880265 19587 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:20.882033 23572 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:20.877436 23547 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:20.879959 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:20.883805 19511 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:20.886029 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:20.886266 19505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:19:20.886945 19505 raft_consensus.cc:606] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:20.887316 19505 raft_consensus.cc:614] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:20.888537 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:20.889336 19510 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:20.889400 23638 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:20.888710 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 108937us
I20260709 13:19:20.891289 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:20.891508 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:20.892545 19660 raft_consensus.cc:1275] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:20.892800 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:20.893224 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:20.893571 19659 raft_consensus.cc:2393] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 7: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:20.894955 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:20.889488 23682 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:20.895463 23687 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:20.896754 23632 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:20.898048 23584 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:19:20.898977 23694 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:19:20.899415 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:20.927572 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:20.901816 19657 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:19:20.881327 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 238306us
I20260709 13:19:20.903512 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:20.905176 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:20.931360 19655 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:20.878611 22275 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.917943 19512 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:20.863109 23641 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14.
I20260709 13:19:20.925181 19511 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:20.931556 19659 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:20.910413 19504 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:20.918593 19510 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:20.936273 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:20.936916 19509 raft_consensus.cc:2376] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 13. Re-sending same reply.
I20260709 13:19:20.934610 19476 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:20.935827 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:20.935922 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:20.941713 19655 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:20.941776 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:20.946432 23685 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:20.946952 23685 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.947328 23685 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:20.948279 23695 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:20.948707 23695 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:20.949072 23695 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:20.952677 19505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f949ff511e844749624dedf436dff50"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:19:20.953316 19505 raft_consensus.cc:606] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:20.953606 19505 raft_consensus.cc:614] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:20.955621 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:20.932395 23188 raft_consensus.cc:2764] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:19:20.959538 23165 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:20.902724 23354 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:20.962442 23693 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.111s	user 0.002s	sys 0.000s
I20260709 13:19:20.963092 23354 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:20.874596 23512 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.965914 19653 raft_consensus.cc:2368] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14.
I20260709 13:19:20.966038 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:20.966796 23434 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:20.966924 23188 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:20.974241 19551 leader_election.cc:400] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11.
I20260709 13:19:20.967964 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:20.933171 23547 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:20.993947 19551 leader_election.cc:403] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:19:20.950135 23682 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:20.901543 23297 consensus_queue.cc:1059] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:19:20.922353 23572 consensus_queue.cc:1048] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:19:21.001363 19585 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:21.005105 19406 catalog_manager.cc:5697] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 10 to 13, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 13 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:21.007548 19406 catalog_manager.cc:5697] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 10 to 14, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 14 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.011718 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:21.012517 19585 raft_consensus.cc:2410] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:20.992009 23576 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:19:21.015082 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 115758us
I20260709 13:19:21.017544 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:21.018603 19581 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:21.018640 19580 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:21.026119 19406 catalog_manager.cc:5697] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 8 to 10, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 10 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:21.017558 23576 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:19:21.036252 23701 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:19:21.036721 23576 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:20.999382 23638 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 10. Current term is 11.
I20260709 13:19:21.038853 19476 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:21.038007 19625 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:21.046761 19625 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:21.047798 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:21.049579 23576 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:21.053960 19625 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:20.998778 23646 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:19:21.057406 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:21.058017 19585 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:21.065133 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:21.092995 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 54200.5us
I20260709 13:19:21.002457 23631 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.094719 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:21.095173 19476 leader_election.cc:400] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14.
I20260709 13:19:21.095482 19476 leader_election.cc:403] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:19:21.097039 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:21.098345 19585 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:21.049894 23578 raft_consensus.cc:2764] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:19:21.100862 19406 catalog_manager.cc:5697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 7 to 9, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 9 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.109504 19627 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:21.111897 19580 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:21.055056 23428 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:21.108544 19406 catalog_manager.cc:5697] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 7 to 8, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 8 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:21.114672 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:21.115375 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.117763 19583 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:21.065394 23173 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:21.122991 19582 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:19:21.123086 19583 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:21.123087 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:21.053609 23630 consensus_queue.cc:1059] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:19:21.123909 19580 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:21.126971 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:21.141971 19587 raft_consensus.cc:2368] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16.
I20260709 13:19:21.141863 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:21.143033 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:21.125726 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:21.126264 19581 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:21.145414 19478 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:21.145926 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:21.146477 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:21.130071 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:21.147969 19478 leader_election.cc:400] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16.
I20260709 13:19:21.148339 19580 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:21.148314 19478 leader_election.cc:403] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:19:21.134779 19406 catalog_manager.cc:5697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 8 to 10, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 10 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.117507 23660 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:21.155850 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:21.155923 19584 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:21.161306 19583 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:21.142640 23683 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:21.159795 19406 catalog_manager.cc:5697] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.106031 23572 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:19:21.172602 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:21.183555 19586 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:21.177477 19585 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:21.122977 23309 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:21.157379 23632 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.155975 23492 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:21.143235 23173 raft_consensus.cc:697] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:21.201229 19406 catalog_manager.cc:5697] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 8 to 12, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 12 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.112905 23571 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:19:21.159790 23656 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:21.117749 23638 consensus_queue.cc:1059] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:19:21.176972 23457 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:21.168181 23641 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:21.120189 23433 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:21.232991 23188 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.206872 23492 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:21.248832 19406 catalog_manager.cc:5697] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 11 to 12, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 12 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:21.258095 19507 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:21.230217 23683 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16.
I20260709 13:19:21.243739 23512 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:21.275693 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 97703.6us
I20260709 13:19:21.276897 19478 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:21.233752 23500 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:19:21.255733 23492 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:21.210180 23632 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:21.258190 23641 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.236229 23633 consensus_queue.cc:1059] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:19:21.257905 23691 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:21.255565 23457 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.316852 19586 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:21.258000 23428 raft_consensus.cc:697] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:21.349118 19406 catalog_manager.cc:5697] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 9 to 10, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 10 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.359617 23691 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:21.321916 23660 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14.
W20260709 13:19:21.360219 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 83408.3us
I20260709 13:19:21.257992 23670 consensus_queue.cc:1059] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.223s
I20260709 13:19:21.255272 23188 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.368002 19478 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:21.253998 23697 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.298s
I20260709 13:19:21.369997 23188 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:21.370219 23697 raft_consensus.cc:3055] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:21.365450 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 246180us
I20260709 13:19:21.370862 23697 raft_consensus.cc:740] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:21.371943 23697 consensus_queue.cc:260] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.291579 23630 raft_consensus.cc:3055] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:21.373633 23630 raft_consensus.cc:740] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:21.374500 19406 catalog_manager.cc:5697] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 7 to 10, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 10 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:21.382876 19406 catalog_manager.cc:5697] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 7 to 8, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 8 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.362517 23173 consensus_queue.cc:237] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.385310 23670 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.386180 23670 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.387610 23428 consensus_queue.cc:237] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.389076 23691 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.363183 23631 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:21.392589 23685 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.393989 19505 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:21.366326 23656 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:21.381870 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:21.395773 19655 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:21.395898 23641 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:21.397908 19406 catalog_manager.cc:5697] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:21.398336 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:21.404259 23706 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:19:21.408025 19627 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:21.414937 23685 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:21.415921 23433 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:21.409577 19406 catalog_manager.cc:5697] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.419098 23457 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:21.420662 23699 log.cc:927] Time spent T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.244s	user 0.000s	sys 0.002s
I20260709 13:19:21.422673 23692 raft_consensus.cc:3055] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:21.423153 23692 raft_consensus.cc:740] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:19:21.385361 23707 log.cc:927] Time spent T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:19:21.420555 23632 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:21.426021 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 58140.8us
I20260709 13:19:21.418289 19406 catalog_manager.cc:5697] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 8 to 12, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 12 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.385525 23646 raft_consensus.cc:3055] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:21.437945 19510 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:21.425748 23075 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:21.424093 23692 consensus_queue.cc:260] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:21.429329 23633 raft_consensus.cc:3055] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:21.449725 19406 catalog_manager.cc:5697] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.432296 23683 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:21.439704 23646 raft_consensus.cc:740] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:21.452907 23306 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:21.455792 23698 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 13:19:21.456497 23630 consensus_queue.cc:260] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.474771 23630 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:21.477804 23683 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:21.478168 23692 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:21.451972 23633 raft_consensus.cc:740] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:21.463527 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:21.463754 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:21.449286 23670 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:21.481329 23633 consensus_queue.cc:260] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.483119 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:21.465061 19627 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:21.459050 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:21.472992 23646 consensus_queue.cc:260] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.486958 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:21.487847 19652 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:21.488580 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 433814us
I20260709 13:19:21.487910 19406 catalog_manager.cc:5697] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 7 to 9, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 9 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.485598 19478 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:21.495102 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:21.495677 19585 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:21.498657 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:21.497490 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 422943us
I20260709 13:19:21.499933 19504 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:21.500751 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:21.500991 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.501587 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:21.501987 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:21.502759 19657 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:21.502636 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:21.502920 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:21.503846 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:21.505671 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:21.507776 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:21.509200 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:21.510213 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:21.510490 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:21.511456 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:21.488559 23713 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:21.515507 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:21.512748 19512 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:21.515923 19658 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:21.512858 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:21.517081 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:21.511832 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 46837us
I20260709 13:19:21.507741 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:21.517102 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:21.517768 19406 catalog_manager.cc:5697] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.518196 19627 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:21.497305 23481 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.005s	sys 0.023s
I20260709 13:19:21.515547 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:21.521063 19585 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:21.505144 23646 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:21.524533 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:21.530594 19659 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:21.533027 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:21.530630 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:21.498872 23683 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:21.544834 23683 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:21.523730 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:21.522958 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:21.531762 19406 catalog_manager.cc:5697] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 8 to 9, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 9 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:21.549486 19511 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:19:21.534446 19657 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
W20260709 13:19:21.535236 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.535697 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:21.537344 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:21.532390 23075 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:21.538188 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:21.539425 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:21.539760 19478 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:21.539942 23711 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:19:21.528249 19627 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:21.551704 19507 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:21.551766 19653 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:21.552315 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:21.552889 19503 raft_consensus.cc:2368] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12.
I20260709 13:19:21.559122 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:21.560412 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:21.560683 19627 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:21.498175 23631 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:19:21.569787 23631 consensus_queue.cc:1243] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:21.570106 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:21.571664 23725 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:19:21.563898 20665 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:21.578088 19655 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:21.578358 23721 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:19:21.564749 23709 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:21.563840 19406 catalog_manager.cc:5697] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.557863 20631 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:21.531075 23481 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.010s	sys 0.029s
W20260709 13:19:21.558195 23695 consensus_meta.cc:287] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.605s	user 0.008s	sys 0.006s
I20260709 13:19:21.530205 23306 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:21.583552 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:21.547078 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
W20260709 13:19:21.691454 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.746196 19586 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:21.746836 19406 catalog_manager.cc:5697] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 7 to 10, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 10 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.749301 19586 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:21.731427 23714 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:21.750367 23714 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.580420 23547 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:21.589895 23721 consensus_queue.cc:1243] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:21.562500 23641 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:21.558358 23512 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:21.762602 23713 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
W20260709 13:19:21.767057 19686 heartbeater.cc:646] Failed to heartbeat to 127.17.251.190:33289 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.251.190:33289 timed out after 15.000s (SENT)
I20260709 13:19:21.766450 23512 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.760408 23500 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:19:21.768189 19505 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:21.769651 23713 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.769802 23656 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:21.770167 23713 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.613386 23695 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:21.545879 23683 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.589206 23632 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:21.737329 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 151145us
I20260709 13:19:21.746927 23492 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.734584 19511 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:19:21.742499 19652 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:21.736095 23433 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.755900 19653 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:21.753638 19586 raft_consensus.cc:3055] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:21.742385 23306 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:21.762437 23571 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:19:21.778949 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:21.734663 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 146823us
I20260709 13:19:21.737044 23709 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:21.781764 19505 raft_consensus.cc:2410] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:19:21.783358 19586 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:21.784098 19655 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: [11.6-14.8]
I20260709 13:19:21.786810 19406 catalog_manager.cc:5697] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 4 to 6, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 6 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:21.793978 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.774570 23547 raft_consensus.cc:697] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:21.785320 23437 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:21.790238 23306 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:21.811622 23492 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:21.815786 23512 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:21.815903 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2505) took 1287 ms. Trace:
I20260709 13:19:21.809394 23695 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:21.813191 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:21.826196 19653 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:21.825803 23709 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.824714 19582 rpcz_store.cc:276] 0709 13:19:20.528929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.535715 (+  6786us) service_pool.cc:224] Handling call
0709 13:19:20.536093 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.140287 (+604194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.815589 (+675302us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b5400267854. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:21.815821 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1344392576}
I20260709 13:19:21.780179 23297 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.817301 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:21.795778 23420 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:21.829413 23297 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.831858 23714 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:21.833784 23297 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:21.796247 23433 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.837594 23433 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:21.838757 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:21.839618 19652 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:21.843151 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:21.843360 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:21.795928 23628 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:19:21.848558 19652 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:19:21.844704 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:21.842156 19476 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:21.849789 19580 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:19:21.847579 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:21.855006 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:21.855901 23433 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:21.856390 23433 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:21.856761 23433 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:21.857302 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:21.858596 19627 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:21.860153 23715 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:21.860644 23646 raft_consensus.cc:2764] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:19:21.860711 23420 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:21.860407 22275 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:21.861987 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:21.863447 19476 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:21.864189 23714 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:21.864538 23714 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.864832 23714 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:21.855931 19582 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:21.868937 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:21.869724 19580 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:21.871260 19478 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:21.871703 19406 catalog_manager.cc:5697] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.874285 19584 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:21.875272 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:21.860181 19627 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:21.880384 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:21.880609 19580 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:21.883832 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:21.887588 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:21.839644 23713 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:21.899055 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:21.883637 23685 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:21.902670 19584 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:21.897861 23711 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:21.901180 23685 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.886219 23512 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:21.904311 23646 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:21.887116 23457 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:21.868443 23434 consensus_queue.cc:1059] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:19:21.918102 23434 raft_consensus.cc:3055] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:21.867789 23517 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:19:21.919320 23457 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:21.918529 23434 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:21.898172 23692 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:21.907223 23685 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:21.904646 23720 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:21.920508 23512 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:21.911832 23722 consensus_queue.cc:1059] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:19:21.920719 23646 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.970628 23722 raft_consensus.cc:3055] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:19:21.971082 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.983348 23737 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:21.928997 23692 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.991247 23297 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:21.990041 23434 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.921383 23547 consensus_queue.cc:237] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.011090 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:22.026263 19458 auto_rebalancer.cc:893] Removing replace marker failed: Replica 2cfd02601ea44976833027665abc93bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:19:22.026966 19458 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:19:22.027336 19458 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:19:22.028697 23434 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:21.934593 23457 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.937559 23720 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:21.995301 23722 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:21.985062 23712 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:19:22.084548 23571 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:22.085343 23633 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:22.087170 23660 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:22.087726 23500 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:22.098019 23697 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:22.108697 23433 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.117391 19578 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:22.149695 23660 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.152452 23660 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:22.009169 23737 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.156601 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:22.159118 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:22.212219 23722 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.213557 23722 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:22.215586 23433 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:22.122663 23571 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.216785 23720 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:22.123010 23682 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:22.218372 23571 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:22.218642 23646 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:22.218133 23682 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.147899 23500 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.220268 23692 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:22.221854 23500 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:22.222062 23714 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.227329 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:22.227582 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:22.227842 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:22.228231 19653 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:22.228446 19658 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:22.228614 23729 log.cc:927] Time spent T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.361s	user 0.002s	sys 0.000s
I20260709 13:19:22.229990 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:22.118294 23492 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:22.236606 19578 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:22.237629 19658 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:22.244565 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:22.245599 19578 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:22.224087 23714 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:22.247144 19627 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:22.245028 19476 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:22.250516 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:22.248890 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:22.256973 19653 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:22.255944 19578 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
W20260709 13:19:22.261561 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.266290 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:22.246817 23297 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:19:22.276145 23709 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:22.262385 23500 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:22.276736 23709 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:22.277292 23500 raft_consensus.cc:697] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:22.277992 23744 log.cc:927] Time spent T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:19:22.278503 23500 consensus_queue.cc:237] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.274340 19476 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:22.081405 23512 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:22.164350 23733 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:19:22.271999 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:22.277313 23709 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:22.249650 23492 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.287009 23336 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:22.289604 23547 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:22.310570 23572 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:19:22.346479 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.359508 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 145613us
I20260709 13:19:22.337235 23685 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.338634 23336 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:22.375062 23437 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:22.375767 23437 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:22.377765 23336 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:22.378788 23571 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:22.379580 23571 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:22.382323 23743 log.cc:927] Time spent T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:19:22.345937 23572 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:22.384398 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:22.385100 23572 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.385689 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:22.386271 23572 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:22.386905 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:22.387603 19580 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:22.387531 19586 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:22.390923 19586 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:22.391235 19508 raft_consensus.cc:2410] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:22.312974 23306 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.392201 19478 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:22.351424 23697 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:22.393859 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:22.352170 23547 raft_consensus.cc:697] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:22.400665 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:22.402513 19581 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:22.405416 19586 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:19:22.406077 19586 pending_rounds.cc:85] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 9
I20260709 13:19:22.406386 19586 pending_rounds.cc:107] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:19:22.406661 19586 raft_consensus.cc:2889] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:22.407974 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.409365 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60692 (request call id 194) took 1388 ms. Trace:
I20260709 13:19:22.409945 19509 rpcz_store.cc:276] 0709 13:19:21.020700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.020903 (+   203us) service_pool.cc:224] Handling call
0709 13:19:21.049397 (+ 28494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.092555 (+ 43158us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:21.113070 (+ 20515us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.751147 (+638077us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b1800422e00. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa23a 00007f6c31764a2a
0709 13:19:22.050064 (+298917us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.080726 (+ 30662us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:22.083872 (+  3146us) log.cc:844] Serialized 26 byte log entry
0709 13:19:22.084032 (+   160us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:22.084322 (+   290us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.101958 (+ 17636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.102136 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.409079 (+306943us) raft_consensus.cc:1685] finished
0709 13:19:22.409100 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.409259 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48931,"prepare.queue_time_us":147299,"prepare.run_cpu_time_us":140,"prepare.run_wall_time_us":145,"raft.queue_time_us":62327,"raft.run_cpu_time_us":414,"raft.run_wall_time_us":36294,"spinlock_wait_cycles":4770048,"thread_start_us":297044,"threads_started":3,"wal-append.queue_time_us":669933}
I20260709 13:19:22.412484 19586 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:22.403362 23697 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.420025 19511 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:19:22.420377 23697 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:22.420641 19511 raft_consensus.cc:606] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:22.420989 19511 raft_consensus.cc:614] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:22.421293 23711 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:22.422124 23711 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.424422 19511 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:19:22.401549 19580 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:22.425076 19511 raft_consensus.cc:606] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:22.454181 19661 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:22.456874 23547 consensus_queue.cc:237] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.462028 23737 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:22.375090 23633 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:22.463125 23492 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:22.463865 23734 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.459s	user 0.001s	sys 0.000s
I20260709 13:19:22.486181 19659 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:22.465819 23685 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:22.467129 23306 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:22.459610 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:22.470851 19511 raft_consensus.cc:614] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:22.473416 19581 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:22.478000 23717 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.527908 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:22.477782 23641 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:22.468593 23752 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:22.534579 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:22.556365 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.556205 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 164116us
I20260709 13:19:22.534749 23336 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.535657 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:22.536996 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:22.538094 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.507702 23638 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:22.548393 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 88930.8us
I20260709 13:19:22.569674 19478 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:22.576671 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:22.498222 23633 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:22.563237 23734 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:19:22.587642 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:22.596371 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:22.600029 19580 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:22.625365 19503 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:22.627147 19503 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:22.627589 23760 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:22.628551 23757 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:22.629012 23757 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:22.629387 23757 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:22.559453 23697 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
W20260709 13:19:22.646350 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 69788.1us
I20260709 13:19:22.563227 23711 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:22.567337 23492 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:22.573288 23572 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.647549 19551 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:22.570035 23685 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.658675 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:22.652611 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.660243 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 79033.8us
I20260709 13:19:22.591348 23638 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:22.581651 23752 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:22.667104 19585 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:19:22.691682 23754 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:19:22.694837 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:22.560729 23641 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:22.706755 19478 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:22.704438 19503 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:22.712261 19585 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:19:22.712769 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 65354.9us
W20260709 13:19:22.713253 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 136205us
I20260709 13:19:22.713541 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:22.716512 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.716274 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:22.717024 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:22.719473 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:22.720803 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:22.693107 23631 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:22.724421 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:22.724263 19551 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:22.692623 23731 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:22.658479 23512 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:19:22.651113 23720 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:19:22.730466 22275 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:19:22.659700 23697 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:22.719449 23711 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:22.692893 23572 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.667258 23492 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.704154 23685 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.746394 20665 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:22.750432 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:22.728528 23638 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:22.628206 23760 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:22.781150 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 56971.5us
I20260709 13:19:22.782409 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:22.711710 23752 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:22.786741 19512 raft_consensus.cc:2410] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:22.738133 23708 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:19:22.547591 23717 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.798837 23669 raft_consensus.cc:3055] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:22.799459 23760 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:22.799538 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:22.763170 23492 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:22.800096 23767 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:22.747987 23631 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:22.746271 23711 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:22.761969 23763 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.813066 19503 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:19:22.775139 20666 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:22.826233 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:22.829684 23428 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:22.830452 19625 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:22.831736 23720 consensus_queue.cc:1059] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:22.831774 23311 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:22.833438 23309 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:22.841781 23759 log.cc:927] Time spent T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:19:22.860831 19506 raft_consensus.cc:2393] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:22.738137 23731 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.806104 23669 raft_consensus.cc:740] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:19:22.846580 23756 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:19:22.847339 23760 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:22.847565 23711 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:22.867882 23467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.001s	sys 0.018s
W20260709 13:19:22.878474 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 48156.1us
I20260709 13:19:22.856431 23512 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.854499 23763 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:22.886376 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:22.888195 19625 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:22.890345 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:22.891149 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:22.872013 23631 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:22.872982 23297 raft_consensus.cc:3055] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:22.893610 23512 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:22.894230 23758 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 13:19:22.895161 23761 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:19:22.898991 23717 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:22.899421 23752 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:19:22.899817 23730 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 1.033s	user 0.004s	sys 0.000s
I20260709 13:19:22.900254 23457 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:22.874476 23309 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:22.902990 23709 consensus_meta.cc:287] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.000s
I20260709 13:19:22.848578 23767 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:22.903350 19661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 2180) took 1167 ms. Trace:
W20260709 13:19:22.904026 23437 consensus_meta.cc:287] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.001s
I20260709 13:19:22.904292 23697 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:19:22.904470 23751 log.cc:927] Time spent T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:19:22.905153 23669 consensus_queue.cc:260] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:22.905804 23641 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:22.907413 23737 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:22.939272 23737 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.941697 23737 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:22.870957 23769 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.942416 23769 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.942934 23309 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:22.867710 23428 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.944622 23769 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:22.909215 19503 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:22.947577 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2158) took 1451 ms. Trace:
I20260709 13:19:22.948922 19507 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:22.947981 19579 rpcz_store.cc:276] 0709 13:19:21.496307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.497639 (+  1332us) service_pool.cc:224] Handling call
0709 13:19:21.497971 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:21.501170 (+  3199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.501208 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:21.522880 (+ 21672us) log.cc:844] Serialized 52 byte log entry
0709 13:19:21.788845 (+265965us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:21.788885 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.788946 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.811472 (+1022526us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:22.947302 (+135830us) raft_consensus.cc:1685] finished
0709 13:19:22.947323 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.947516 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2783,"raft.queue_time_us":3100,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4709,"spinlock_wait_cycles":36465408,"thread_start_us":250933,"threads_started":1,"wal-append.queue_time_us":328621}
I20260709 13:19:22.892477 23715 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:22.882462 23646 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:22.926435 23457 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:19:22.885211 23467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.001s	sys 0.019s
I20260709 13:19:22.950088 23457 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:22.951340 23763 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:22.951941 23437 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.910674 23297 raft_consensus.cc:740] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:22.883433 23714 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:22.953862 23297 consensus_queue.cc:260] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:22.932670 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 196831us
I20260709 13:19:22.955233 23297 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:22.955960 23731 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:22.954243 23437 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:22.944826 23428 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:22.953931 23714 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.939534 23768 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:22.960531 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:22.961220 19579 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 13.
I20260709 13:19:22.934639 19661 rpcz_store.cc:276] 0709 13:19:21.735808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.743083 (+  7275us) service_pool.cc:224] Handling call
0709 13:19:21.743340 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.471057 (+727717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.903065 (+432008us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b5400103454. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:22.903262 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1597250816}
I20260709 13:19:22.964762 19660 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:22.895174 23757 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:22.929227 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 146942us
I20260709 13:19:22.986114 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:22.986860 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:22.987603 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:22.983556 19507 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:19:22.908514 23760 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:22.997361 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:22.998086 19658 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 13.
I20260709 13:19:22.999536 19507 raft_consensus.cc:1275] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:19:22.988580 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:23.003279 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:23.008365 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:22.999706 23777 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.033692 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:23.004190 23697 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:22.936596 23709 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.009158 23467 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:23.020241 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:23.020918 23631 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:23.004346 23731 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:19:23.052146 23641 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.045403 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:23.045826 23685 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.020511 23638 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
W20260709 13:19:23.111965 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 55671.3us
I20260709 13:19:23.116510 23774 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:23.038021 23777 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.116309 19551 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:23.129118 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 85035.1us
I20260709 13:19:23.132619 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 2063) took 1619 ms. Trace:
I20260709 13:19:23.134058 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:23.133270 19505 rpcz_store.cc:276] 0709 13:19:21.513072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.560158 (+ 47086us) service_pool.cc:224] Handling call
0709 13:19:23.132397 (+1572239us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5400208ad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:23.132558 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476382080}
I20260709 13:19:23.059463 23717 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:19:23.143420 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:23.138827 20659 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:19:23.148761 19508 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 2052) took 1649 ms (client timeout 1843 ms). Trace:
W20260709 13:19:23.149215 19508 rpcz_store.cc:269] 0709 13:19:21.498967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.500512 (+  1545us) service_pool.cc:224] Handling call
0709 13:19:23.148548 (+1648036us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b54001847d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:23.148698 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2005296512}
I20260709 13:19:23.059331 23768 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:19:23.150367 23757 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:23.153836 23747 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.826s	user 0.012s	sys 0.000s
I20260709 13:19:23.109586 23467 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:23.158617 23467 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:23.139030 23631 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:23.129135 23641 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.135684 23774 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:23.116066 23769 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:19:23.159618 23731 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:19:23.178628 23731 raft_consensus.cc:3055] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:23.179024 23731 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:23.179381 23785 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:23.179934 23731 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:23.180631 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 45468.2us
I20260709 13:19:23.181319 23731 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:23.167073 23714 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.169271 23777 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.173346 23641 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:23.187003 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 43674.9us
I20260709 13:19:23.192548 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:23.174891 23760 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:23.179033 23773 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 13:19:23.175982 23776 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:23.202627 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:23.203938 23646 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:23.166064 23778 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:23.175745 23767 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:23.197014 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:23.182852 23434 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:19:23.207418 19625 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:23.193568 23774 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:23.212802 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.213327 19654 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:23.202632 23709 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:23.218218 19653 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:19:23.218721 19655 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:19:23.219237 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.219822 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.220099 19652 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
W20260709 13:19:23.222827 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.224538 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:23.207227 23697 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:23.210276 23778 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:23.227532 19510 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:23.228926 23457 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.230458 23336 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:23.220494 23297 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:23.227532 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:23.192222 23711 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.235996 19505 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:23.253381 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:23.254580 19509 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:23.236456 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:23.237367 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:23.257252 19510 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:23.256701 19505 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:23.258452 19510 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:19:23.262542 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.245224 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:23.213191 23512 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.249881 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:23.251700 23778 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:23.252068 23173 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.263778 19504 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:23.275169 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:23.275390 19510 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:23.276050 23638 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:23.277333 23638 consensus_queue.cc:1059] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:23.225607 23697 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.248765 23631 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:23.225716 23774 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:23.246515 23787 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:23.300486 19655 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:23.223835 23467 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:19:23.306739 19503 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:23.304618 23697 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:23.293844 23769 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:23.334594 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2550) took 1358 ms. Trace:
I20260709 13:19:23.301769 23173 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.335196 19582 rpcz_store.cc:276] 0709 13:19:21.976206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.980638 (+  4432us) service_pool.cc:224] Handling call
0709 13:19:21.981094 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.981562 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.981601 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.982250 (+   649us) log.cc:844] Serialized 26 byte log entry
0709 13:19:22.070152 (+ 87902us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:22.070752 (+   600us) log.cc:844] Serialized 14 byte log entry
0709 13:19:23.333962 (+1263210us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b5400164a20. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316d5733 00007f6c3175adbf 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c
0709 13:19:23.334019 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.334140 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:23.334227 (+    87us) raft_consensus.cc:1685] finished
0709 13:19:23.334334 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.334513 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3228,"prepare.queue_time_us":159,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":5861,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":23831,"spinlock_wait_cycles":15716736,"thread_start_us":87453,"threads_started":1,"wal-append.queue_time_us":68483,"wal-append.run_cpu_time_us":4285,"wal-append.run_wall_time_us":1164063}
I20260709 13:19:23.327105 23631 raft_consensus.cc:3055] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:19:23.347007 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 70500.9us
I20260709 13:19:23.347976 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:23.349812 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:23.351820 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:23.352123 23753 log.cc:927] Time spent T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.860s	user 0.003s	sys 0.003s
I20260709 13:19:23.356135 23420 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:23.357384 19625 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:23.357888 23572 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.358220 23712 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:23.358583 23336 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:23.359189 23336 consensus_queue.cc:1243] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:23.359040 23434 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:23.359694 23709 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:23.360119 23709 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:23.360507 23709 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:23.360415 23336 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:23.313896 23787 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.353374 23769 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:23.346400 23631 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:23.361559 23336 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:23.377065 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:23.382414 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 2190) took 1226 ms. Trace:
I20260709 13:19:23.383152 23787 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.313603 23774 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.388561 23336 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:23.388959 19659 rpcz_store.cc:276] 0709 13:19:22.156024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.156249 (+   225us) service_pool.cc:224] Handling call
0709 13:19:23.382219 (+1225970us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b5400010ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:23.382335 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":575127296}
I20260709 13:19:23.399858 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.400614 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.391954 23457 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:23.362425 23711 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.407081 23173 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:23.389796 19507 pending_rounds.cc:85] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 5
I20260709 13:19:23.347934 23778 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.408028 19507 pending_rounds.cc:107] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:19:23.408452 19507 raft_consensus.cc:2889] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:23.414065 23774 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.404575 23769 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:23.416088 23336 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.417749 23336 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:23.402124 23787 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:23.425808 23433 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:23.426533 23433 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:23.392933 23631 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.431954 23631 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:23.435457 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.435979 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.436388 19656 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:23.437139 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.438086 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.439484 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.440065 19652 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:23.440841 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.442198 19657 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:23.437492 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.425246 19476 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:23.448930 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.450021 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.451723 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.452610 19656 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:23.454361 19656 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:19:23.457799 19476 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:23.460013 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:23.387382 23798 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:23.461292 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:23.474222 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.487296 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:23.487550 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:23.462329 23711 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:23.462697 23572 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:23.496383 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 119397us
I20260709 13:19:23.497753 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.475313 23752 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:23.500384 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:23.504458 23785 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.505028 23785 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:23.498764 23165 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:23.506649 23165 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:23.507159 23165 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:23.509116 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:23.509680 23704 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.510378 23704 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:23.511916 23571 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.520234 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:23.522154 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:23.523113 19585 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 12.
I20260709 13:19:23.509783 19505 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:23.528579 20631 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:19:23.529073 19476 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:23.536675 19551 leader_election.cc:400] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12.
I20260709 13:19:23.537031 19476 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:23.515339 19654 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:23.537077 19551 leader_election.cc:403] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:19:23.524145 23433 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:19:23.513909 23750 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.973s	user 0.004s	sys 0.004s
I20260709 13:19:23.538867 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.547513 23764 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:23.548228 23764 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.534409 23778 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:23.541219 19476 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:23.480465 23547 consensus_queue.cc:1059] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:19:23.544831 23638 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12.
I20260709 13:19:23.550101 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.534166 23792 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:23.550724 19476 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:23.512562 23704 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:23.554956 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:23.552923 19654 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:23.557024 19505 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:23.538939 23752 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:23.552179 23433 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:23.559473 19625 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:23.559671 23800 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:23.560716 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:23.561646 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:23.562224 23709 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.562386 23697 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.546554 23572 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:23.558169 19504 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:19:23.565577 19476 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:23.577196 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:23.566787 23433 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.572337 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:23.583316 19510 raft_consensus.cc:2393] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:23.584158 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:23.556089 23792 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.584960 19510 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:23.588595 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:23.572137 19505 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 12.
I20260709 13:19:23.577636 19625 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:23.586232 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:23.590322 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:23.578754 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:23.568899 23512 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.592006 19657 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:23.591138 19510 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:19:23.551915 23798 consensus_queue.cc:1059] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:19:23.595347 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:23.573078 23547 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:23.595896 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:23.598814 19505 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:23.593961 23584 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:23.587266 23752 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:19:23.587292 23760 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:19:23.620043 23709 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:23.591820 23792 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:23.622152 23697 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.612048 23512 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.625361 23512 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.606859 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2552) took 1569 ms. Trace:
I20260709 13:19:23.609759 23682 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.610565 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 2196) took 1111 ms. Trace:
I20260709 13:19:23.626559 19660 rpcz_store.cc:276] 0709 13:19:22.499641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.499835 (+   194us) service_pool.cc:224] Handling call
0709 13:19:22.530069 (+ 30234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.985656 (+455587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.610328 (+624672us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b54003f3254. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:23.610509 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":984952576}
I20260709 13:19:23.610837 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 2762) took 1004 ms. Trace:
I20260709 13:19:23.595134 23691 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:23.578217 23467 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:23.579164 23572 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.585773 23571 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:23.618541 19504 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:23.587070 23433 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:23.625911 19583 rpcz_store.cc:276] 0709 13:19:22.037868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.038120 (+   252us) service_pool.cc:224] Handling call
0709 13:19:22.038540 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:22.071644 (+ 33104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.071675 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:22.079042 (+  7367us) log.cc:844] Serialized 26 byte log entry
0709 13:19:22.320449 (+241407us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:22.320517 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.320616 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:23.513334 (+1192718us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:23.594495 (+ 81161us) raft_consensus.cc:1685] finished
0709 13:19:23.594517 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.606789 (+ 12272us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33024,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6207,"spinlock_wait_cycles":45532032,"thread_start_us":156294,"threads_started":1,"wal-append.queue_time_us":303471}
I20260709 13:19:23.627764 19512 rpcz_store.cc:276] 0709 13:19:22.606811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.606963 (+   152us) service_pool.cc:224] Handling call
0709 13:19:23.610672 (+1003709us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400250654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:23.610786 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266156288}
I20260709 13:19:23.627897 23691 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.631989 23798 raft_consensus.cc:3055] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:23.634090 23572 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:23.633891 23571 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.656157 19504 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:23.636200 23467 raft_consensus.cc:697] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:23.657784 19510 pending_rounds.cc:85] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 5
I20260709 13:19:23.658808 19510 pending_rounds.cc:107] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:19:23.659597 19510 raft_consensus.cc:2889] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:23.659015 19504 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:23.640343 23691 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:23.641868 23798 raft_consensus.cc:740] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:23.666124 23798 consensus_queue.cc:260] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.667269 23798 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:23.669140 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2766) took 1003 ms. Trace:
I20260709 13:19:23.655665 23571 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:23.669548 19503 rpcz_store.cc:276] 0709 13:19:22.665422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.946844 (+281422us) service_pool.cc:224] Handling call
0709 13:19:22.947127 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.313024 (+365897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.668912 (+355888us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54002a99d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:23.669080 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826566016}
I20260709 13:19:23.673205 23467 consensus_queue.cc:237] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.680812 19652 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:23.613592 23165 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.684593 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:23.684763 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:23.686007 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:23.689025 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 146904us
I20260709 13:19:23.689738 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:23.690897 19580 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:23.693754 19580 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:23.696003 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:23.696586 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:23.696655 19582 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:23.696828 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:23.687827 23800 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.711715 23638 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:23.715059 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:23.720584 19581 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:23.721419 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:23.713173 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:23.729297 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:23.734977 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:23.691547 23697 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:23.746644 23796 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:23.747224 23796 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:23.747622 23796 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:23.720474 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:23.688067 23785 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:23.769776 23708 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:23.707873 23778 consensus_queue.cc:1059] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:19:23.719053 23774 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:23.707360 23731 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:23.748991 23715 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:23.782613 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:23.744639 19580 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:23.772213 23638 consensus_queue.cc:1243] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:23.796396 23731 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:23.917101 23731 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:23.854789 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.785673 23697 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:23.795190 23708 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.866971 23785 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.738719 23800 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.803387 23774 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:23.876837 23812 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:19:23.884227 23777 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.885366 23796 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.894292 23633 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.858578 23571 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.858198 23792 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:23.894287 23165 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.895577 23691 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.899063 23433 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.913470 23572 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.927057 23777 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.939997 23697 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:23.942888 20659 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:19:23.937342 23800 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.952523 23796 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.953116 23571 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.954294 23774 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.954746 23777 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.954746 23708 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:23.942467 23433 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.965500 23792 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:23.955822 23572 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.970309 23731 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:23.972821 23731 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:23.981822 23691 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:24.027416 23737 raft_consensus.cc:3055] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:24.027953 23737 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:24.056653 23787 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:24.057247 23787 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:24.058918 23787 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:24.060312 23787 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:24.061141 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:24.061936 19580 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:24.063733 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:24.064371 19580 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:19:24.065486 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:24.066133 19583 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:24.071525 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:24.072382 19580 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:24.028903 23737 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:24.082593 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:24.086103 19582 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:24.089128 23669 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:24.096446 23737 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:24.099566 19583 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:24.103734 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:24.103932 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:24.105103 19583 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:19:24.104506 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:24.106125 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:24.111330 19585 raft_consensus.cc:1275] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:19:24.138502 23764 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:24.150497 19585 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:19:24.150943 19585 pending_rounds.cc:85] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 5
I20260709 13:19:24.151155 19585 pending_rounds.cc:107] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:19:24.151420 19585 raft_consensus.cc:2889] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:24.156857 19398 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.710s	user 0.002s	sys 0.001s
I20260709 13:19:24.203536 23709 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.204092 23709 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:24.206249 23709 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:24.207023 23711 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.207623 23711 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:24.294130 19578 raft_consensus.cc:1275] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:24.298274 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:24.298986 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:24.299839 19580 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:24.298947 19578 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
W20260709 13:19:24.307781 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 562149us
I20260709 13:19:24.309166 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:24.309963 19587 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:24.426862 19579 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:19:24.424572 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.440380 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:24.449223 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.459952 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:24.460047 19504 raft_consensus.cc:1217] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[10.6-15.9]   Dedup: 14.8->[15.9-15.9]
I20260709 13:19:24.460953 19579 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:24.461314 19504 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: [10.6-15.9]
I20260709 13:19:24.465665 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:24.466375 19507 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:24.470713 19579 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 14.
I20260709 13:19:24.476747 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:24.433856 19583 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:24.484107 19587 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:24.487679 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:24.497087 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:24.495616 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:24.507514 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:24.513255 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:24.528625 19579 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:24.585474 19578 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
W20260709 13:19:24.580289 23823 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:19:24.661019 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:24.663269 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 150146us
I20260709 13:19:24.664347 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:24.666870 23830 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:24.668304 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:24.669123 19579 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:19:24.669169 19581 raft_consensus.cc:2410] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:24.669639 19579 pending_rounds.cc:85] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 8
I20260709 13:19:24.669952 19579 pending_rounds.cc:107] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:19:24.670241 19579 raft_consensus.cc:2889] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:24.670516 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:24.670329 23830 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:24.680701 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2816) took 1103 ms. Trace:
I20260709 13:19:24.681238 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:24.682073 19584 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:24.681245 19506 rpcz_store.cc:276] 0709 13:19:23.576889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.699881 (+122992us) service_pool.cc:224] Handling call
0709 13:19:23.700185 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.700366 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:23.724820 (+ 24454us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.680347 (+955527us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:24.680396 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:24.680443 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.680508 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.680634 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":954068,"prepare.queue_time_us":144721,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"thread_start_us":17539,"threads_started":1}
I20260709 13:19:24.683413 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:24.684051 19506 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:19:24.684998 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:24.686086 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:24.686933 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:24.687971 19578 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:24.689585 19584 raft_consensus.cc:2410] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:24.690119 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:24.693426 19579 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:24.685982 23825 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:24.694944 23831 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:24.690680 19580 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:24.695052 23825 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:24.695837 23831 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:24.696146 23830 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:24.696242 23831 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:24.696817 23830 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:24.697269 23825 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:24.682091 23827 log.cc:927] Time spent T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:19:24.696813 23831 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:24.703337 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:24.711371 23825 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:24.712036 23825 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.712482 23825 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:24.698549 23830 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:24.718194 23830 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:24.718776 23830 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:24.739003 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 68565.2us
I20260709 13:19:24.752700 19506 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:24.753886 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:24.754649 19506 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:24.758527 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:24.759629 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:24.760669 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:24.761338 19506 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:24.334968 23798 consensus_queue.cc:1059] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.428s
I20260709 13:19:24.763073 23832 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.766076 23831 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:24.763510 23631 consensus_queue.cc:1059] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:19:24.766438 23832 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:24.766974 23830 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:24.768399 23831 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:24.768553 23832 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:24.769124 23830 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:24.770174 23825 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:24.762339 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:24.772529 19506 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:24.783042 19506 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:19:24.783959 19506 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:19:24.784543 19506 raft_consensus.cc:606] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:24.784888 19506 raft_consensus.cc:614] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:24.786118 23825 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:24.802903 23825 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:24.803699 23825 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:24.807647 23825 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:24.809975 23825 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.810532 23825 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:24.813673 23825 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:24.842006 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2805) took 1474 ms. Trace:
I20260709 13:19:24.842504 19511 rpcz_store.cc:276] 0709 13:19:23.367106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.367526 (+   420us) service_pool.cc:224] Handling call
0709 13:19:23.386697 (+ 19171us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:23.401235 (+ 14538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.401266 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:23.418767 (+ 17501us) log.cc:844] Serialized 52 byte log entry
0709 13:19:24.825157 (+1406390us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b1800375ee0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa0d1 00007f6c31715a0f
0709 13:19:24.841503 (+ 16346us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:24.841550 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.841652 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:24.841701 (+    49us) raft_consensus.cc:1685] finished
0709 13:19:24.841714 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.841935 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7287,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":5263,"spinlock_wait_cycles":52590336,"thread_start_us":16128,"threads_started":1,"wal-append.queue_time_us":1420027}
I20260709 13:19:24.311147 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:24.848122 19652 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:24.858441 19652 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:24.866613 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2807) took 1498 ms. Trace:
I20260709 13:19:24.867621 19508 rpcz_store.cc:276] 0709 13:19:23.367837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.607527 (+239690us) service_pool.cc:224] Handling call
0709 13:19:23.607870 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:24.344579 (+736709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:24.344623 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:24.345250 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 13:19:24.501951 (+156701us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:24.502001 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.866100 (+364099us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b54002201d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:24.866166 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:24.866240 (+    74us) raft_consensus.cc:1685] finished
0709 13:19:24.866255 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.866537 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":719952,"raft.queue_time_us":1058245,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"spinlock_wait_cycles":37425920,"thread_start_us":63284,"threads_started":1,"wal-append.queue_time_us":105317}
I20260709 13:19:24.868988 23711 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:24.974291 19511 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:25.010628 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:25.014523 19508 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:19:25.014982 19508 pending_rounds.cc:85] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 7
I20260709 13:19:25.015354 19508 pending_rounds.cc:107] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:19:25.015583 19508 raft_consensus.cc:2889] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:25.016731 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:25.017884 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:25.018875 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:25.019376 19508 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:25.028148 19508 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:25.029752 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:25.029994 23720 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:25.030507 23720 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.031350 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:25.032541 23720 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:25.032708 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:25.033088 23720 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:25.028192 23712 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.035422 23712 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:25.036173 19508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:19:25.036760 19508 raft_consensus.cc:606] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:25.033540 23720 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.037593 23712 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:25.042302 23720 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:25.043126 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:25.039624 19508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:19:25.044785 19508 raft_consensus.cc:606] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:25.045142 19508 raft_consensus.cc:614] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:25.042469 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.051492 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:25.052959 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:25.054085 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:25.055097 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:25.056039 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:25.051505 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:25.058687 19653 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 5.
W20260709 13:19:25.106984 23778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.009s	sys 0.017s
W20260709 13:19:25.107491 23778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.010s	sys 0.018s
I20260709 13:19:25.107939 23833 consensus_queue.cc:1059] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:25.108887 23833 consensus_queue.cc:1243] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:25.124044 19660 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:25.156750 23638 raft_consensus.cc:3055] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:25.157258 23638 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:25.158118 23638 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.159423 23638 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:25.179065 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:25.198872 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:25.199841 19654 raft_consensus.cc:2393] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 8: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:25.201256 19509 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:25.202103 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2800) took 1850 ms. Trace:
I20260709 13:19:25.202483 19509 rpcz_store.cc:276] 0709 13:19:23.351578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.191562 (+1839984us) service_pool.cc:224] Handling call
0709 13:19:25.191942 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:25.201798 (+  9856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.202038 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:25.204030 19625 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.129:38645 timed out after 1.607s (SENT) [suppressed 1 similar messages]
I20260709 13:19:25.205953 19657 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:25.208999 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:25.219663 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.222450 23798 raft_consensus.cc:3055] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:25.222909 23798 raft_consensus.cc:740] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:25.223618 23798 consensus_queue.cc:260] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.224426 23798 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:25.233457 19505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.005s	sys 0.038s
W20260709 13:19:25.233956 19505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.006s	sys 0.038s
I20260709 13:19:25.234848 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2808) took 1810 ms. Trace:
I20260709 13:19:25.235255 19505 rpcz_store.cc:276] 0709 13:19:23.424701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.635721 (+211020us) service_pool.cc:224] Handling call
0709 13:19:23.636143 (+   422us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:24.211542 (+575399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:24.211587 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:24.434184 (+222597us) log.cc:844] Serialized 52 byte log entry
0709 13:19:25.234386 (+800202us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:25.234440 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.234520 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:25.234575 (+    55us) raft_consensus.cc:1685] finished
0709 13:19:25.234587 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:25.234775 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":574852,"raft.queue_time_us":1045963,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":799740,"threads_started":1,"wal-append.queue_time_us":234587}
I20260709 13:19:25.237859 19506 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: [13.6-13.6]
W20260709 13:19:25.276135 19507 consensus_meta.cc:287] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.809s	user 0.012s	sys 0.000s
I20260709 13:19:25.334885 19507 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:25.300351 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:25.297012 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:25.341951 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:25.342682 19659 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:25.341552 19398 maintenance_manager.cc:643] P 5aff2c187289436a846acba13255b21f: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 9.500s	user 0.184s	sys 0.066s Metrics: {"bytes_written":30289,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":231054,"dirs.run_cpu_time_us":434,"dirs.run_wall_time_us":4105,"drs_written":1,"lbm_read_time_us":135452,"lbm_reads_10-100_ms":4,"lbm_write_time_us":207670,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":7,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":165710,"threads_started":1,"update_count":3}
I20260709 13:19:25.358131 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:25.359273 23774 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.359867 23800 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:25.360500 23800 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.362778 19399 maintenance_manager.cc:419] P 5aff2c187289436a846acba13255b21f: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7523 bytes on disk
I20260709 13:19:25.366596 23796 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:25.367210 23796 raft_consensus.cc:697] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:25.367333 19398 maintenance_manager.cc:643] P 5aff2c187289436a846acba13255b21f: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":341,"lbm_reads_lt_1ms":4}
I20260709 13:19:25.368153 23796 consensus_queue.cc:237] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.369767 23638 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:25.370360 23638 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.372645 23638 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:25.373205 23638 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:25.373755 23833 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.374244 23842 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.374311 23833 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.374897 23842 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:25.376533 23833 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:25.377120 23842 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:25.378825 19585 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:25.379762 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:25.359885 23774 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.382135 19551 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:25.383044 23731 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:25.383437 23731 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:25.383783 23731 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:25.384019 23774 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:25.362917 23800 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:25.386363 23638 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.402926 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2815) took 1828 ms. Trace:
I20260709 13:19:25.403450 19503 rpcz_store.cc:276] 0709 13:19:23.574694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.670771 (+ 96077us) service_pool.cc:224] Handling call
0709 13:19:23.671100 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.671325 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:23.708178 (+ 36853us) log.cc:844] Serialized 14 byte log entry
0709 13:19:25.402514 (+1694336us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:25.402580 (+    66us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:25.402638 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.402713 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:25.402856 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1693998,"prepare.queue_time_us":123530,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":46,"thread_start_us":36041,"threads_started":1}
W20260709 13:19:25.409901 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.411597 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2070) took 1846 ms. Trace:
I20260709 13:19:25.412034 19504 rpcz_store.cc:276] 0709 13:19:23.565085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.663637 (+ 98552us) service_pool.cc:224] Handling call
0709 13:19:24.459825 (+796188us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:19:24.461812 (+  1987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.411303 (+949491us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b54000fd550. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:25.411520 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1829979392}
I20260709 13:19:25.415613 23638 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:25.418658 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:25.420001 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:25.420213 23697 raft_consensus.cc:2764] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:25.420945 23697 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:25.421285 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:25.432299 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:25.433944 19584 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:25.436060 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2811) took 1997 ms. Trace:
I20260709 13:19:25.436151 23731 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:25.438069 23697 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:25.436571 19512 rpcz_store.cc:276] 0709 13:19:23.438739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.636380 (+197641us) service_pool.cc:224] Handling call
0709 13:19:23.641484 (+  5104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.641698 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:23.693838 (+ 52140us) log.cc:844] Serialized 14 byte log entry
0709 13:19:25.435692 (+1741854us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:25.435749 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:25.435806 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.435887 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:25.436003 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1741587,"prepare.queue_time_us":81828,"prepare.run_cpu_time_us":4005,"prepare.run_wall_time_us":50056,"thread_start_us":36987,"threads_started":1}
I20260709 13:19:25.439756 23787 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:19:25.442396 19627 connection.cc:256] RPC call timeout handler was delayed by -1.1450078520001625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 13:19:25.442934 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.444480 23712 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:25.445130 23712 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.447712 23712 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:25.448414 23712 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
W20260709 13:19:25.450186 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:25.451085 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.451947 19627 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:19:25.453557 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:25.456418 19581 raft_consensus.cc:1275] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:25.455195 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:25.460701 19585 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:25.448992 23712 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:25.467145 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:25.468771 20666 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:25.469547 23709 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.470012 23692 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.470288 23709 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.470721 23692 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.472550 23709 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:25.473090 23709 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:25.474509 23669 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:25.473989 23709 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:25.475035 23669 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.475623 23309 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.476141 23309 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.495064 19512 raft_consensus.cc:1275] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:25.519927 19505 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:25.484895 19478 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:25.520489 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 56908.9us
I20260709 13:19:25.523257 19478 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:25.495545 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:25.504753 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:25.486760 19608 debug-util.cc:398] Leaking SignalData structure 0x7b08001f6060 after lost signal to thread 18417
I20260709 13:19:25.463917 23715 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:19:25.477473 19625 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:25.529179 19608 debug-util.cc:398] Leaking SignalData structure 0x7b08000ed300 after lost signal to thread 19444
I20260709 13:19:25.532946 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:25.533360 19608 debug-util.cc:398] Leaking SignalData structure 0x7b08000e0ee0 after lost signal to thread 19536
W20260709 13:19:25.533681 19608 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0f40 after lost signal to thread 19537
W20260709 13:19:25.534612 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 57212.9us
W20260709 13:19:25.534931 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 102354us
I20260709 13:19:25.467587 23457 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.536471 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:25.539669 19625 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:25.540006 19508 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:19:25.477396 23709 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:25.481371 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:25.497819 23165 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.498413 23547 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:25.473351 23692 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:25.543099 19627 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:25.529752 23571 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:25.498476 23752 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.551031 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:25.469725 23708 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:25.495797 23512 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:25.537341 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:25.488456 23669 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:25.479033 23712 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:25.478240 23309 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:25.466089 23691 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:19:25.539346 23354 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:25.534085 23737 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:25.544895 23457 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.585986 23737 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.586323 23846 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:25.587528 23457 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:25.539423 23786 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:19:25.588721 23737 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:25.498201 23760 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:25.532661 23715 consensus_queue.cc:1243] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:25.570039 23708 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.589834 23787 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.493891 23641 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:25.590013 23708 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:25.590452 23641 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.592830 23641 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:25.539371 23660 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.575964 23712 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:25.593921 23660 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.594525 23712 raft_consensus.cc:697] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:25.551093 23709 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:25.596165 23709 raft_consensus.cc:697] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:25.596367 23660 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:25.595750 23712 consensus_queue.cc:237] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.573335 23512 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.597318 23709 consensus_queue.cc:237] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.601137 23512 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:25.477820 23738 consensus_queue.cc:1059] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:19:25.550644 23165 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:25.602571 19506 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:25.593484 23760 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:25.603593 23165 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:25.607825 23760 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:25.553150 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:25.568346 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.617048 19504 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 12.
W20260709 13:19:25.543565 19608 debug-util.cc:398] Leaking SignalData structure 0x7b0800155a00 after lost signal to thread 19611
W20260709 13:19:25.617733 19608 debug-util.cc:398] Leaking SignalData structure 0x7b0800157fa0 after lost signal to thread 19612
W20260709 13:19:25.619029 19608 debug-util.cc:398] Leaking SignalData structure 0x7b08002418e0 after lost signal to thread 19685
W20260709 13:19:25.621362 19608 debug-util.cc:398] Leaking SignalData structure 0x7b08000b1ee0 after lost signal to thread 20690
W20260709 13:19:25.621690 19608 debug-util.cc:398] Leaking SignalData structure 0x7b08001d5440 after lost signal to thread 20691
W20260709 13:19:25.622033 19608 debug-util.cc:398] Leaking SignalData structure 0x7b08002ce8a0 after lost signal to thread 23311
W20260709 13:19:25.622474 19608 debug-util.cc:398] Leaking SignalData structure 0x7b080031df80 after lost signal to thread 23584
W20260709 13:19:25.623435 19608 debug-util.cc:398] Leaking SignalData structure 0x7b08002ae420 after lost signal to thread 23788
W20260709 13:19:25.623729 19608 debug-util.cc:398] Leaking SignalData structure 0x7b08003183a0 after lost signal to thread 23790
I20260709 13:19:25.573804 19652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:25.532558 23572 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:19:25.629516 19608 debug-util.cc:398] Leaking SignalData structure 0x7b08002efaa0 after lost signal to thread 23810
I20260709 13:19:25.629480 19652 raft_consensus.cc:606] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:25.630295 19652 raft_consensus.cc:614] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:25.574975 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 143104us
I20260709 13:19:25.576843 23354 raft_consensus.cc:697] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:25.571637 23752 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.570231 23500 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:25.555029 23547 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.587075 23846 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.651930 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:25.654265 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:25.588961 23457 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.528383 23433 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:25.590399 23787 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.602597 23738 raft_consensus.cc:3055] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:25.561372 19508 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 14.
I20260709 13:19:25.552054 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:25.628703 19584 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:25.569721 19478 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:25.687866 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 135915us
I20260709 13:19:25.581650 19659 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:25.641852 19476 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:25.639156 19408 catalog_manager.cc:5697] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 7 to 10, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 10 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:19:25.642608 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 100592us
W20260709 13:19:25.645212 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 97140.8us
I20260709 13:19:25.624014 23769 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:25.691236 19408 catalog_manager.cc:5697] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 9 to 11, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 11 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:25.648293 19406 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48852 (request call id 174) took 19385 ms (client timeout 15000 ms). Trace:
W20260709 13:19:25.693519 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 123904us
I20260709 13:19:25.694689 19478 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:25.694989 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 53205.2us
I20260709 13:19:25.650857 23848 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:25.634281 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:25.695858 19476 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:25.697883 19627 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:25.698026 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 63885.9us
I20260709 13:19:25.699123 20619 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:25.699792 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.637578 23638 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:25.699050 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:25.701399 19408 catalog_manager.cc:5697] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 6 to 11, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 11 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.703236 19478 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:25.641233 23798 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:25.703778 19408 catalog_manager.cc:5697] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 11 to 13, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 13 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:19:25.706943 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:25.707899 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:25.624236 23697 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:25.659622 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.644675 23165 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:25.644645 23641 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:25.710026 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:25.705302 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:25.712430 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:25.710546 19408 catalog_manager.cc:5697] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 8 to 12, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 12 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:25.715276 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:25.714848 19408 catalog_manager.cc:5697] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 6 to 9, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 9 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
W20260709 13:19:25.717495 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.695887 23467 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:25.700683 23737 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.764855 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:25.725705 23165 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.761286 19408 catalog_manager.cc:5697] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 10 to 11, leader changed from 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 11 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.777201 19659 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:25.652163 23760 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:19:25.697155 23764 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:25.769673 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:25.769675 19658 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 12.
I20260709 13:19:25.705062 23571 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:25.651345 23500 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.710390 23847 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:25.693078 19406 rpcz_store.cc:269] 0709 13:19:06.262956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.263145 (+   189us) service_pool.cc:224] Handling call
0709 13:19:25.648185 (+19385040us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:22.351660 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:22.467807 (+116147us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:22.480264 (+ 12457us) write_op.cc:435] Acquired schema lock
0709 13:19:22.486846 (+  6582us) tablet.cc:662] Decoding operations
0709 13:19:22.789416 (+302570us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:22.789509 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:22.789553 (+    44us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:19:22.791911 (+  2358us) tablet.cc:701] Row locks acquired
0709 13:19:22.791943 (+    32us) write_op.cc:260] PREPARE: finished
0709 13:19:22.792164 (+   221us) write_op.cc:270] Start()
0709 13:19:22.792313 (+   149us) write_op.cc:276] Timestamp: P: 1783603162792095 usec, L: 0
0709 13:19:22.792359 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:19:22.846290 (+ 53931us) log.cc:844] Serialized 9146 byte log entry
0709 13:19:23.666817 (+820527us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b18002cf3e0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:19:23.892088 (+225271us) op_driver.cc:464] REPLICATION: finished
0709 13:19:23.956377 (+ 64289us) write_op.cc:301] APPLY: starting
0709 13:19:23.957517 (+  1140us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:23.960056 (+  2539us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:23.960083 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:24.015036 (+ 54953us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:24.026375 (+ 11339us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=23,key_file_lookups=23,delta_file_lookups=23,mrs_lookups=46
0709 13:19:24.026454 (+    79us) write_op.cc:312] APPLY: finished
0709 13:19:24.027111 (+   657us) log.cc:844] Serialized 295 byte log entry
0709 13:19:24.027342 (+   231us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:24.027613 (+   271us) write_op.cc:454] Released schema lock
0709 13:19:24.027689 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:24.028189 (+   500us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:24.028225 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5576,"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":47052,"apply.run_cpu_time_us":26934,"apply.run_wall_time_us":78845,"cfile_cache_hit":44,"cfile_cache_hit_bytes":45958,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6216,"cfile_init":2,"lbm_read_time_us":1181,"lbm_reads_lt_1ms":12,"num_ops":23,"prepare.queue_time_us":282826,"prepare.run_cpu_time_us":45425,"prepare.run_wall_time_us":742502,"raft.queue_time_us":180557,"raft.run_cpu_time_us":4655,"raft.run_wall_time_us":68435,"replication_time_us":1071519,"spinlock_wait_cycles":3496320,"thread_start_us":535277,"threads_started":4,"wal-append.queue_time_us":260469,"wal-append.run_cpu_time_us":35331,"wal-append.run_wall_time_us":1502577}]]}
I20260709 13:19:25.708686 23767 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:25.713210 23719 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:25.723371 23433 raft_consensus.cc:2764] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:19:25.686420 23738 raft_consensus.cc:740] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:25.793678 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:25.762378 23774 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:19:25.815217 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 109981us
I20260709 13:19:25.714203 23833 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:25.723598 23697 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:25.767509 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 61356.4us
I20260709 13:19:25.709232 23800 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:25.710951 23777 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:25.768783 23796 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:25.777958 19408 catalog_manager.cc:5697] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
W20260709 13:19:25.812320 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 97138.8us
I20260709 13:19:25.713306 23842 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:25.819998 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:25.713406 23638 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.816730 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:25.784775 23764 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:25.812844 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 115042us
I20260709 13:19:25.715415 23848 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:25.842813 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:25.685773 23354 consensus_queue.cc:237] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.762014 23641 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:25.815428 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 91571.5us
I20260709 13:19:25.708556 23457 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.706550 23769 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.821126 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:25.725946 23798 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.783420 23737 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.846588 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:25.852945 19478 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:25.853912 19478 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:25.797698 23467 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:25.804138 23572 raft_consensus.cc:3055] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:25.820894 19408 catalog_manager.cc:5697] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 10 to 13, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 13 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:25.809262 23719 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:25.867636 19408 catalog_manager.cc:5697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:25.846931 23764 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:25.869096 19408 catalog_manager.cc:5697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 9 to 11, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 11 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.873181 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:25.873965 19658 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:25.818219 23845 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:25.874223 19408 catalog_manager.cc:5697] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 8 to 10, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 10 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:25.861950 23572 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:25.879004 23572 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:25.882405 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 60725.3us
I20260709 13:19:25.857055 23760 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:25.883913 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:25.885097 23467 raft_consensus.cc:697] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:25.886576 23467 consensus_queue.cc:237] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.887408 23641 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:25.849857 23731 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Requested vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:25.888368 23731 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:25.888837 23731 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:25.889807 23669 consensus_queue.cc:1059] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:25.891816 23860 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:25.892769 23858 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:25.893602 23731 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:25.894500 23547 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:25.864012 23660 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:25.895242 23660 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:25.895644 23660 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:25.897095 19533 debug-util.cc:398] Leaking SignalData structure 0x7b08000caa40 after lost signal to thread 18414
W20260709 13:19:25.897665 19533 debug-util.cc:398] Leaking SignalData structure 0x7b0800138960 after lost signal to thread 18417
W20260709 13:19:25.898672 19533 debug-util.cc:398] Leaking SignalData structure 0x7b0800138b60 after lost signal to thread 19444
W20260709 13:19:25.899550 19533 debug-util.cc:398] Leaking SignalData structure 0x7b080025efa0 after lost signal to thread 19503
W20260709 13:19:25.899912 19533 debug-util.cc:398] Leaking SignalData structure 0x7b080036f440 after lost signal to thread 19510
I20260709 13:19:25.897032 23691 raft_consensus.cc:3055] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:19:25.900208 19533 debug-util.cc:398] Leaking SignalData structure 0x7b080039b340 after lost signal to thread 19512
W20260709 13:19:25.903353 19533 debug-util.cc:398] Leaking SignalData structure 0x7b08000f4960 after lost signal to thread 19536
W20260709 13:19:25.903769 19533 debug-util.cc:398] Leaking SignalData structure 0x7b08003abee0 after lost signal to thread 19537
W20260709 13:19:25.905066 19533 debug-util.cc:398] Leaking SignalData structure 0x7b08002e0740 after lost signal to thread 19611
I20260709 13:19:25.876055 19408 catalog_manager.cc:5697] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:25.819562 23767 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:25.847194 23777 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:25.905480 19533 debug-util.cc:398] Leaking SignalData structure 0x7b080004a240 after lost signal to thread 19612
I20260709 13:19:25.807672 23847 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:25.922472 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:25.856870 23842 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:25.884356 23760 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:19:25.914230 19533 debug-util.cc:398] Leaking SignalData structure 0x7b080036a560 after lost signal to thread 19626
I20260709 13:19:25.860297 23709 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:25.916613 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:25.821913 23852 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 13:19:25.919314 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:25.920013 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:25.945955 19508 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
W20260709 13:19:25.937237 19533 debug-util.cc:398] Leaking SignalData structure 0x7b0800167d00 after lost signal to thread 19685
I20260709 13:19:25.863701 23719 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:25.927126 19408 catalog_manager.cc:5697] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
W20260709 13:19:25.948232 19533 debug-util.cc:398] Leaking SignalData structure 0x7b08002c20e0 after lost signal to thread 20690
W20260709 13:19:25.948529 19533 debug-util.cc:398] Leaking SignalData structure 0x7b080022cb00 after lost signal to thread 20691
W20260709 13:19:25.949244 19533 debug-util.cc:398] Leaking SignalData structure 0x7b080038a1a0 after lost signal to thread 23712
W20260709 13:19:25.949798 19533 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4e20 after lost signal to thread 23715
I20260709 13:19:25.931094 19661 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:25.868055 23433 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:25.917336 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:25.954564 19653 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:25.955515 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:25.955787 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:25.956118 19653 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:25.957010 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:25.901427 23845 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.900642 23848 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:25.949293 19658 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:25.950120 19504 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:25.948563 19408 catalog_manager.cc:5697] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 7 to 9, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 9 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:25.930387 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:25.957600 19653 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:25.964838 19506 raft_consensus.cc:2410] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:19:25.967216 19408 catalog_manager.cc:5697] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:19:25.965796 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:25.968698 19658 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:25.969578 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:25.928776 23572 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:25.952190 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:25.978952 19508 raft_consensus.cc:2410] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:19:25.949155 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:25.902818 23691 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:19:25.974960 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 119547us
I20260709 13:19:25.962743 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:25.932086 23777 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:25.952075 19533 debug-util.cc:398] Leaking SignalData structure 0x7b080038c860 after lost signal to thread 23719
W20260709 13:19:26.001427 19533 debug-util.cc:398] Leaking SignalData structure 0x7b0800168cc0 after lost signal to thread 23720
I20260709 13:19:25.965461 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:25.977986 19408 catalog_manager.cc:5697] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 9 to 13, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 13 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:26.002561 19408 catalog_manager.cc:5697] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 7 to 10, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 10 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:26.004493 19478 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:26.005883 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
W20260709 13:19:26.006286 19533 debug-util.cc:398] Leaking SignalData structure 0x7b08003741c0 after lost signal to thread 23764
W20260709 13:19:26.006613 19533 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6f60 after lost signal to thread 23767
W20260709 13:19:26.006925 19533 debug-util.cc:398] Leaking SignalData structure 0x7b0800377dc0 after lost signal to thread 23777
I20260709 13:19:26.004387 19408 catalog_manager.cc:5697] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 5 to 6, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 6 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:26.016037 19408 catalog_manager.cc:5697] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 9 to 13, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 13 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:26.018863 19408 catalog_manager.cc:5697] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 6 to 9, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 9 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:26.021092 19408 catalog_manager.cc:5697] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
W20260709 13:19:26.021927 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 163468us
I20260709 13:19:26.031080 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:25.961664 23845 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:26.022226 19408 catalog_manager.cc:5697] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:25.957017 23846 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:26.040172 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:25.985808 23842 raft_consensus.cc:697] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 14 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:19:25.979961 23709 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:26.003263 23862 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:25.999899 23787 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.038596 19408 catalog_manager.cc:5697] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 12 to 13, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 13 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:26.019681 23731 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.057952 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.059476 19584 raft_consensus.cc:1240] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:26.019683 23858 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.061156 19658 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:26.062819 19408 catalog_manager.cc:5697] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 10 to 11, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 11 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:25.903425 23738 consensus_queue.cc:260] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.041826 23857 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:26.073098 23872 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:26.073352 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:26.073483 19661 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:19:26.054838 23796 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:26.044437 23800 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:26.081902 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.030261 23641 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:19:26.066471 19408 catalog_manager.cc:5697] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 7 to 11, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 11 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:26.046028 23833 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:26.056879 23861 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:26.074154 23571 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:26.074638 23787 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:26.074434 23720 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:26.068251 23165 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.079650 23500 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.074157 23691 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.080174 23856 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:19:26.075449 23858 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.063134 23767 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.102510 23796 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.103627 19408 catalog_manager.cc:5697] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 8 to 11, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 11 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:26.115211 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.173513 19408 catalog_manager.cc:5697] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 12 to 15, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 15 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:26.122005 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 71207.7us
I20260709 13:19:26.141952 23777 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.087956 23774 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:26.067569 23731 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.121713 23697 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.127548 23798 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.118785 23738 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:26.177999 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.065883 23862 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:26.155544 23843 log.cc:927] Time spent T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 13:19:26.176105 19627 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:26.114820 23847 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:26.121044 23863 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:26.182171 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 324545us
I20260709 13:19:26.183837 23719 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.150027 23720 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:26.218452 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.176676 23737 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.221031 23862 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.223968 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.105134 23864 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 13:19:26.152855 23852 consensus_queue.cc:1059] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:19:26.104176 23800 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:26.232355 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 56340.3us
I20260709 13:19:26.173866 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:19:26.244195 23853 log.cc:927] Time spent T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 13:19:26.255435 23862 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.258790 23862 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.260742 23731 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.260944 23862 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.261322 23731 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:26.261848 23731 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.263824 23731 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.264298 23731 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:26.231868 23697 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:26.265225 23697 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.221064 23878 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:26.265799 23855 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:26.266464 23855 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:26.266307 23878 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:26.267033 23855 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:26.267305 23697 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.267920 23697 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:26.268651 20666 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:19:26.269164 23878 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:26.127950 23833 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:26.271606 23833 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:26.239573 19653 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:26.230324 23851 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:26.272908 23851 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:19:26.274183 23851 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:26.234167 23798 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.275954 23660 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.276360 23798 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:26.279433 23865 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:19:26.280913 23660 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.281803 23719 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:26.282851 23870 log.cc:927] Time spent T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
W20260709 13:19:26.284718 23844 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.425s	user 0.002s	sys 0.000s
I20260709 13:19:26.236874 23720 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:26.113943 23709 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.090025 23872 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.229736 23774 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.240343 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.212642 23691 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:26.268373 23697 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.179139 23457 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:26.235422 19661 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:26.292526 19625 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:26.171136 23787 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:26.319285 19660 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:26.133780 23861 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:26.322429 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.261452 23862 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:26.320442 19476 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.000s	sys 0.015s
W20260709 13:19:26.329769 19476 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.001s	sys 0.015s
W20260709 13:19:26.330181 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 611321us
I20260709 13:19:26.336591 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:26.337853 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 45429.2us
I20260709 13:19:26.338788 19625 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:26.337863 19627 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:26.343685 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:26.342394 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 267319us
I20260709 13:19:26.351089 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.173275 23842 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:26.352828 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:19:26.339751 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 162698us
I20260709 13:19:26.361244 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.361996 19585 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:26.363023 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.364459 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.365099 19583 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:26.366943 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.367712 19583 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:26.369015 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.369659 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.370069 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.370682 19585 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:26.372699 19585 pending_rounds.cc:85] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 5
I20260709 13:19:26.373034 19585 pending_rounds.cc:107] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 13.6
I20260709 13:19:26.373263 19585 raft_consensus.cc:2889] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:26.373988 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.374193 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.375102 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.375387 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:26.376752 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2068) took 2793 ms. Trace:
I20260709 13:19:26.363683 19581 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:26.370297 19586 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:26.376256 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:26.381002 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.381500 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.381949 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.382406 19586 raft_consensus.cc:2393] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:26.382603 19581 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:26.383139 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.384122 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:26.386538 19476 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:26.382767 23712 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:26.389858 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.390570 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.391234 19504 raft_consensus.cc:2368] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11.
I20260709 13:19:26.377190 19510 rpcz_store.cc:276] 0709 13:19:23.564493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.656126 (+ 91633us) service_pool.cc:224] Handling call
0709 13:19:23.657190 (+  1064us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:25.403596 (+1746406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.403624 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:25.404320 (+   696us) log.cc:844] Serialized 52 byte log entry
0709 13:19:25.701130 (+296810us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:25.701180 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.701275 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.357690 (+656415us) raft_consensus.cc:1685] finished
0709 13:19:26.357715 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.357876 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1721371,"raft.queue_time_us":1797957,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":100,"thread_start_us":296393,"threads_started":1,"wal-append.queue_time_us":389620}
I20260709 13:19:26.236968 23863 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.398953 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:26.394460 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.395447 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.359113 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:26.399936 19587 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:26.400719 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:26.401981 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:26.394840 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:26.358596 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 352766us
I20260709 13:19:26.403414 19511 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:26.321777 23467 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:19:26.396932 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.414557 19505 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:26.352867 23879 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:26.396577 19476 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:26.385145 23428 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:26.378453 23856 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:26.414740 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:26.415985 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:26.412349 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.410591 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.413818 19506 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:26.416239 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:26.410041 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.406563 19627 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:26.430640 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.390061 23712 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.426321 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.416721 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.430936 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:26.422535 19476 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:26.432170 19578 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:26.391299 23883 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:26.441958 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.443317 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.444415 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.445009 19578 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:26.432854 19580 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:26.402501 23641 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:26.438223 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.410588 23798 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.446547 19625 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:26.431679 19586 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:26.337688 23862 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.409720 23833 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:26.447327 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:26.466488 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 44065.3us
I20260709 13:19:26.471721 19476 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:26.438659 19583 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:26.468393 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:26.439428 19505 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:26.425824 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:19:26.474964 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 68485.7us
W20260709 13:19:26.445787 23866 log.cc:927] Time spent T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:19:26.481175 19627 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:26.420064 23737 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:19:26.448395 23712 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:26.485780 19586 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:26.489225 19476 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:26.504217 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.431241 23889 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:26.438043 23433 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:26.480365 23572 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:26.492215 23711 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:26.492678 19580 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
W20260709 13:19:26.497996 23708 consensus_meta.cc:287] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.907s	user 0.009s	sys 0.006s
I20260709 13:19:26.487929 23309 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:26.485915 23547 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:26.500177 23862 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:26.510344 23764 consensus_meta.cc:287] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.604s	user 0.013s	sys 0.000s
I20260709 13:19:26.500808 23881 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:26.536855 23881 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.537247 23881 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:26.469521 23719 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:26.431838 23879 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.457002 23857 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:26.506642 19625 leader_election.cc:400] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11.
W20260709 13:19:26.568032 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 61516.5us
I20260709 13:19:26.568809 19625 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:26.528770 23858 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.474467 23660 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:26.573608 23660 raft_consensus.cc:697] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:26.574663 23660 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.462765 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:26.512161 19478 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:26.515946 19627 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:26.516604 23786 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:26.509861 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 102822us
I20260709 13:19:26.523497 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:26.578574 23737 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:26.578647 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 66557.4us
I20260709 13:19:26.579003 19586 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:26.579632 19478 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:26.580657 23752 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.581285 23752 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:26.480638 23878 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:26.487054 23846 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:26.437691 23885 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:26.530391 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.490437 23777 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.486164 23833 raft_consensus.cc:697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:26.528322 23798 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:26.535233 23764 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.530733 23891 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:26.536332 23862 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.498047 23863 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.458885 23883 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.537073 23720 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.546659 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.547736 23861 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.583201 23786 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.549336 23512 raft_consensus.cc:3055] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:26.522593 23433 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.406008 23884 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:19:26.531637 23547 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:26.570797 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 86663.6us
I20260709 13:19:26.588982 19578 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:26.695088 19580 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
W20260709 13:19:26.584157 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 68276.6us
I20260709 13:19:26.589020 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:26.696584 19627 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:26.698125 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:26.675172 23769 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.695917 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:26.650620 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:26.584244 19478 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:26.600178 19586 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:26.594980 23859 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:19:26.569309 23697 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.655381 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:26.582381 23738 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:26.531277 23572 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.656805 19579 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:19:26.582151 23846 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:26.548264 23787 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:26.655458 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.664860 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.592166 23309 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:26.660315 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 155732us
I20260709 13:19:26.532681 23708 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:26.566919 23719 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.704335 23861 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:26.632614 23891 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.667764 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:26.692808 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:26.668291 23872 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.693282 23720 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:26.693773 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.766728 19585 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:26.702558 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:26.548270 23800 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.701670 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:26.572199 23857 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:26.706380 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 124767us
I20260709 13:19:26.659991 23862 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.773427 19478 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:26.690862 23433 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:26.701200 23547 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:26.780519 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 78939.7us
I20260709 13:19:26.780747 23764 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.781368 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:26.781669 23500 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:26.782312 23500 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:26.782612 19551 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:26.783465 23697 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:26.783202 23500 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.783874 23697 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.784247 23697 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:26.784288 23881 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.672921 23786 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:26.786630 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.786867 23881 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.788172 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.729872 19583 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:26.790480 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.790572 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.787628 23881 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:26.791258 23881 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:26.791394 19505 raft_consensus.cc:2393] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:26.791677 23881 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:26.704799 23715 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:26.791914 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:26.792270 23715 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.734411 19627 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:26.798489 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 64304.3us
I20260709 13:19:26.799039 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.672053 23512 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:26.721702 23738 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.743032 23719 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.743858 23572 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.819926 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.727046 23875 raft_consensus.cc:3055] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:26.745469 23708 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:26.745921 23861 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:26.725802 23833 consensus_queue.cc:237] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.737514 23309 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:26.774952 23638 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.747179 19655 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:26.729285 23846 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:26.750566 23879 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.817034 23880 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:26.837210 23880 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.837651 23880 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:26.838919 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.631820 23798 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.841095 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.843135 23798 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.720057 23860 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:26.754947 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:26.845259 23860 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:26.732808 19581 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:26.792546 19585 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:26.793740 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.852516 19508 raft_consensus.cc:2393] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:26.795529 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.796182 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.796171 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.796980 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.801764 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.802606 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:26.853833 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:26.854802 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 52291.7us
I20260709 13:19:26.855042 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.855706 19652 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:26.804381 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.856376 19510 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:26.803574 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.857704 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.806479 23512 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:26.858891 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.859038 23512 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:26.859694 19510 raft_consensus.cc:2410] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:19:26.860781 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.804486 23715 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:26.862323 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.863423 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.863679 23786 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.864495 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.800863 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:26.808326 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.807932 23796 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.865538 23457 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:26.865706 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 64896.3us
I20260709 13:19:26.866137 23457 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.803714 23800 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:26.803869 23855 consensus_meta.cc:287] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.536s	user 0.003s	sys 0.009s
I20260709 13:19:26.869982 23855 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.872392 23855 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:26.875458 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:26.865576 19654 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:26.876152 23571 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:26.813912 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.876586 23571 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:26.876888 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.810266 23857 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.811087 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:26.810110 23845 consensus_meta.cc:287] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.759s	user 0.012s	sys 0.000s
I20260709 13:19:26.878050 19503 raft_consensus.cc:2393] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:26.878196 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.877965 23845 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:26.879101 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.879370 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.879760 19503 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:19:26.880254 23845 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.812783 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.880537 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.881155 19503 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:26.812465 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.816674 23851 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:26.882042 19512 raft_consensus.cc:2393] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:26.882858 20666 raft_consensus.cc:2393] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:19:26.883426 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.884488 19584 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:26.819774 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.885942 19504 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:26.741590 23669 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:26.821282 23875 raft_consensus.cc:740] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:19:26.823257 23861 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:26.827064 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.918045 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:26.828493 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:26.831480 20618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.820716 23738 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:26.834631 23883 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.830137 23309 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:26.836144 23547 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.717240 23165 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:19:26.845671 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 90904.5us
I20260709 13:19:26.932415 19476 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:26.845785 23863 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:26.774096 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.847170 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:26.933987 19579 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:26.934455 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:26.936741 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.937328 19582 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:26.938160 23786 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:26.849145 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:26.848064 23691 consensus_meta.cc:287] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.001s
I20260709 13:19:26.852305 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.795300 19658 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:26.943536 19581 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:26.943297 19625 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:26.944283 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.945353 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.855242 23860 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.866590 23457 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:26.809909 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.877069 23571 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:26.758782 23891 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:26.881543 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.951548 19579 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:26.885362 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.880486 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.952782 19584 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:26.879019 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:26.953958 19510 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:26.954365 19580 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:26.889127 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.890199 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.890699 19585 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:26.853874 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:26.955986 19508 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:26.955904 19625 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:26.901306 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:26.956163 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:26.901566 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59942 (request call id 256) took 1192 ms. Trace:
I20260709 13:19:26.904803 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 2235) took 1035 ms. Trace:
I20260709 13:19:26.907502 19478 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:26.914661 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:26.957688 19655 rpcz_store.cc:276] 0709 13:19:25.709150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.709703 (+   553us) service_pool.cc:224] Handling call
0709 13:19:26.901256 (+1191553us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400122ad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:26.901478 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2381125888}
I20260709 13:19:26.927037 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:26.926904 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.899560 23669 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:26.929325 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 100901us
I20260709 13:19:26.847200 19578 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:26.899587 23872 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:26.946828 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
W20260709 13:19:26.964838 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57440.4us
I20260709 13:19:26.950759 19583 raft_consensus.cc:2393] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:26.950793 19503 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:26.877254 19507 raft_consensus.cc:2410] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:19:26.966223 19478 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:26.957870 19659 rpcz_store.cc:276] 0709 13:19:25.869690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.869978 (+   288us) service_pool.cc:224] Handling call
0709 13:19:26.903025 (+1033047us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b5400102554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:26.904717 (+  1692us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2005993216}
I20260709 13:19:26.959208 19587 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:19:26.881551 23862 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:26.960752 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 46245.2us
I20260709 13:19:26.971122 19627 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:26.932662 23796 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:26.973922 19585 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:26.974423 19510 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:26.977450 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:26.962615 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:26.978132 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.917351 23712 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:26.962721 20618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.960049 23572 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:27.000537 23433 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.002920 23433 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.005653 19509 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:26.950122 23165 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:26.942392 23863 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:26.950479 23760 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:26.985422 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:26.985898 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:26.987557 19478 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:27.019333 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:26.979388 23796 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:26.990624 23547 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:26.993961 23833 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:27.020413 19478 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:26.981343 19660 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:27.007366 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:27.007627 19511 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:27.009944 19508 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:19:27.016638 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.963398 23856 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:26.964686 23669 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:27.048128 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:27.023018 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:27.049316 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:27.049785 19656 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:27.024160 19506 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:26.964484 23691 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:27.025018 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:27.033574 23719 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:26.975584 23857 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:27.034487 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:27.063277 19478 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:27.038821 19476 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:26.980593 23660 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:27.040328 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:27.040514 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 59219.3us
I20260709 13:19:27.067282 23767 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:27.040730 19657 raft_consensus.cc:2393] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 13: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:27.067695 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:27.068295 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:26.942234 23697 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:26.982462 23874 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:26.982059 23864 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:27.020900 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:27.034000 23847 consensus_queue.cc:1059] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:19:27.052768 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:27.053956 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:27.111971 19656 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:27.059036 19585 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:19:27.021652 23500 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:27.114771 23500 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:27.115242 23500 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.035210 23796 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.069507 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:27.022647 23863 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:27.035466 23572 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:27.131127 19656 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:27.070336 23712 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:27.035722 23800 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:27.079777 19627 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:26.973852 23872 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.081841 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:27.215868 20666 raft_consensus.cc:2393] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 13: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:19:27.082578 23859 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:27.083323 23165 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.057508 23860 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:27.022459 23309 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:27.090480 23917 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:19:27.060314 23719 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:27.078013 23660 raft_consensus.cc:697] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:27.035583 23709 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:19:27.094535 23777 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:27.095139 23571 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.097604 19584 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:19:27.102183 23697 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.107903 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:27.108829 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 65901.8us
I20260709 13:19:27.109673 19580 raft_consensus.cc:1240] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:27.023497 23848 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:19:27.124285 19509 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:19:27.072422 19478 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:19:27.252703 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 180350us
I20260709 13:19:27.077584 23715 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.129156 23572 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:27.080821 23764 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:27.062695 23547 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.210171 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:27.071242 23857 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:27.211156 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 131484us
I20260709 13:19:27.022790 23875 consensus_queue.cc:260] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:27.238677 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:27.114782 23847 raft_consensus.cc:3055] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:27.214529 23712 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:27.289665 19657 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:19:27.106302 23845 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.111s
I20260709 13:19:27.249336 19655 raft_consensus.cc:1240] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:27.217186 23769 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.251645 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:27.253578 19478 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:27.256467 19580 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:27.241297 23719 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:27.315661 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 62192.1us
I20260709 13:19:27.316577 19478 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:27.273159 19503 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:27.234023 23457 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:27.226086 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 150209us
I20260709 13:19:27.323562 19476 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:27.257494 23433 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:27.241493 23880 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.262351 23572 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:27.261682 23862 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:27.246910 23777 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:27.293426 23857 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:27.327129 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 75539us
I20260709 13:19:27.257285 23691 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:19:27.335366 19551 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:27.337081 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:27.241070 23846 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.330133 19655 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:27.248478 23906 consensus_queue.cc:1059] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:19:27.363277 19653 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:27.330964 23833 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:27.325485 23433 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:27.350715 23918 log.cc:927] Time spent T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:19:27.297336 23847 raft_consensus.cc:740] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:27.332347 23767 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:27.325037 19476 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:27.293397 23708 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:19:27.293505 23547 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.296973 23660 consensus_queue.cc:237] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.298058 23895 consensus_queue.cc:1059] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:19:27.324985 23752 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:27.383713 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 46696us
I20260709 13:19:27.332855 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:27.349526 23571 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.323570 23769 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.365238 23872 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:27.376230 23512 consensus_meta.cc:287] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.000s
I20260709 13:19:27.390079 23883 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:27.377215 23884 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:27.349725 23309 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:27.387005 23692 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:27.386739 23433 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:27.288609 23764 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:27.376941 23921 log.cc:927] Time spent T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:19:27.331585 23760 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:27.396727 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 71755.9us
I20260709 13:19:27.419304 23571 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:27.168126 23891 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:27.381129 23697 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:27.406857 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:19:27.459376 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 52611.8us
I20260709 13:19:27.460203 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:27.458052 23847 consensus_queue.cc:260] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:27.380508 23881 consensus_meta.cc:287] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.588s	user 0.003s	sys 0.005s
I20260709 13:19:27.461942 23881 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.464265 23881 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.465263 23881 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:27.461328 23847 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:27.465811 23872 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:27.466347 23872 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:27.466812 23872 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:27.467407 23769 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.421840 23883 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:27.468109 23883 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:27.352010 23861 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.470242 19587 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:27.471342 19510 raft_consensus.cc:2393] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:27.471789 23861 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.472493 19582 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:27.454654 23764 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:27.386034 23833 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:27.473202 23833 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:27.473423 23891 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:27.367131 23457 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:27.364383 23880 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:27.461426 19551 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:27.396077 23845 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.438562 19659 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:27.475838 23845 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:27.476421 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:27.442658 19584 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:27.429188 23884 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:27.478106 23845 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:27.478317 23884 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:27.479018 23889 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:27.479898 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:27.480041 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:27.480974 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:27.416141 23752 raft_consensus.cc:697] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:27.481281 23669 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.482374 23752 consensus_queue.cc:237] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.483186 23846 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:27.483533 19658 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:27.483228 23881 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:27.478049 23547 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.484443 23881 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.443986 23692 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:27.448578 23796 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.380594 23500 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.487231 23796 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.389535 23572 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.488217 19508 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:27.489220 23500 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.489650 19583 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:27.456643 19476 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:27.337518 23777 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.422843 23708 consensus_queue.cc:1243] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:19:27.398780 23906 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:27.442257 23738 consensus_meta.cc:287] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260709 13:19:27.493675 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:27.495975 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:27.481519 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:27.503454 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:27.513109 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:27.511023 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:27.350409 23715 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:27.458712 23571 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:27.525202 23571 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:27.525592 23874 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:27.528083 19654 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:27.528939 19652 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:27.504684 23547 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:27.506578 23738 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.540302 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:27.543388 19658 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:27.554456 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:27.555861 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:27.557008 19653 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:27.561117 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:27.562564 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:27.563006 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:27.565263 19583 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:27.569248 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:27.489686 23760 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.576575 19653 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:27.577929 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2223) took 1160 ms. Trace:
I20260709 13:19:27.578715 19582 rpcz_store.cc:276] 0709 13:19:26.417314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.937968 (+520654us) service_pool.cc:224] Handling call
0709 13:19:26.938255 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.472889 (+534634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.577576 (+104687us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b54003bf954. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:27.577846 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1228245760}
I20260709 13:19:27.579449 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:27.583463 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:27.591326 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:27.591568 19585 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:27.600471 19652 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:19:27.600557 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:27.601017 19652 pending_rounds.cc:85] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 8
I20260709 13:19:27.601397 19652 pending_rounds.cc:107] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:19:27.601681 19652 raft_consensus.cc:2889] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:27.603972 19582 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:27.604240 19584 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:27.606581 19661 raft_consensus.cc:2368] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13.
I20260709 13:19:27.515446 23669 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:27.607434 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 318977us
I20260709 13:19:27.607805 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:27.615123 23857 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.617093 23711 raft_consensus.cc:3055] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:27.586040 23841 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.558091 23800 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.606510 23697 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:27.618427 23572 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.620244 23738 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:27.576810 23692 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:27.621276 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:27.508494 23891 consensus_queue.cc:1059] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:19:27.520438 23906 consensus_queue.cc:1059] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:19:27.622551 19654 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:27.603191 23769 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:27.576050 23796 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.625963 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:27.625355 23863 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:27.629175 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 338622us
I20260709 13:19:27.630106 19653 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:27.678401 19653 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:27.575373 23889 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:27.633874 19582 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:27.653913 23711 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:27.645147 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 53940.7us
I20260709 13:19:27.652722 19509 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:27.654541 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:27.631807 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:27.665571 19512 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:27.627568 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:27.670051 19508 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:27.676820 19504 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:27.657401 23638 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:27.665126 23697 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:27.653306 23767 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.684388 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:27.699975 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:27.695632 23572 raft_consensus.cc:3055] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:27.702000 23572 raft_consensus.cc:740] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:27.702798 23572 consensus_queue.cc:260] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.704005 23572 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:27.684536 19585 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
W20260709 13:19:27.686834 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 284196us
I20260709 13:19:27.706955 19506 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:27.688769 19659 raft_consensus.cc:2393] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:27.692476 19625 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:27.686146 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 353401us
I20260709 13:19:27.669986 23800 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.676455 23719 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.705924 23638 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.698833 23697 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:27.698522 23165 raft_consensus.cc:3055] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:27.717293 19478 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:27.666921 23841 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:27.680837 23796 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.744218 19478 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:27.698946 23845 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:19:27.757725 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:27.708276 23767 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:27.763479 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 71091.1us
W20260709 13:19:27.765576 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 48567us
I20260709 13:19:27.716877 23165 raft_consensus.cc:740] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:27.772022 23512 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:27.761345 23752 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:27.773696 23906 consensus_queue.cc:1059] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:27.774438 23738 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:27.776201 23891 consensus_queue.cc:1059] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:27.778729 23719 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.780875 23767 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.717324 23638 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:27.770051 23850 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:27.782949 23800 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.790755 19627 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:27.757570 23500 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:27.754321 23884 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.795671 23752 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:27.838335 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 67828.8us
W20260709 13:19:27.826954 19578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.028s	sys 0.034s
W20260709 13:19:27.843037 19578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.029s	sys 0.035s
I20260709 13:19:27.798533 23786 raft_consensus.cc:3055] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:27.716776 23711 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.785193 23895 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:19:27.852715 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:27.860441 19504 raft_consensus.cc:2410] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:19:27.798785 23777 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.841585 23760 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.798301 23457 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:19:27.844486 23752 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:27.844977 23800 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:27.844229 23786 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:27.838577 23512 consensus_queue.cc:1059] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:19:27.847340 23547 raft_consensus.cc:697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:27.893532 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2224) took 1476 ms. Trace:
I20260709 13:19:27.841725 23692 consensus_queue.cc:1059] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:19:27.861409 23500 raft_consensus.cc:697] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:27.869876 23857 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.867307 23711 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:27.863761 23433 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.963567 23433 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.964176 23433 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:27.964618 23433 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.941588 23638 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:27.967304 23638 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:27.967818 23638 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.973517 23764 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.947235 23777 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.947369 23547 consensus_queue.cc:237] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.974843 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2657) took 1080 ms. Trace:
I20260709 13:19:27.975239 19586 rpcz_store.cc:276] 0709 13:19:26.894049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.433196 (+539147us) service_pool.cc:224] Handling call
0709 13:19:27.433558 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.435805 (+  2247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.435830 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:27.442719 (+  6889us) log.cc:844] Serialized 26 byte log entry
0709 13:19:27.886035 (+443316us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:27.886093 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.886197 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.974548 (+ 88351us) raft_consensus.cc:1685] finished
0709 13:19:27.974577 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.974761 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":7157,"thread_start_us":442888,"threads_started":1,"wal-append.queue_time_us":529761}
I20260709 13:19:27.976572 23796 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.976933 19511 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:27.868988 23165 consensus_queue.cc:260] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.926373 23767 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:27.958781 23786 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:27.960963 23512 consensus_queue.cc:1059] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:27.930330 19581 rpcz_store.cc:276] 0709 13:19:26.417564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.944178 (+526614us) service_pool.cc:224] Handling call
0709 13:19:26.944462 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.944667 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:27.290589 (+345922us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.717404 (+426815us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.893125 (+175721us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:27.893193 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:27.893246 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.893319 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.893460 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3470,"prepare.queue_time_us":9346,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"thread_start_us":939835,"threads_started":3,"wal-append.queue_time_us":577491}
I20260709 13:19:27.978009 23638 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:27.989835 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 221171us
I20260709 13:19:27.992022 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:27.935631 23863 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:27.979314 23767 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:27.984392 23760 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:28.005816 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 321502us
I20260709 13:19:28.009044 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:28.011462 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:28.016010 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:27.999605 23165 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:28.023383 19551 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:28.000349 23786 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:28.024962 23841 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:28.031963 23500 consensus_queue.cc:237] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.026175 23638 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:28.027175 23796 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:28.024201 23954 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:28.024850 23760 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:28.008672 23883 consensus_meta.cc:287] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.001s
I20260709 13:19:28.043092 23845 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:19:28.071051 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 280424us
I20260709 13:19:28.071062 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:28.072821 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 229787us
I20260709 13:19:28.075213 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:28.076740 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:28.077077 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:28.024343 23863 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:28.078826 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:28.089926 19507 raft_consensus.cc:2410] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:19:28.088368 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.080756 19659 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:28.084914 23939 raft_consensus.cc:3055] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:28.085279 19657 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:19:28.085541 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 212850us
W20260709 13:19:28.044909 23571 consensus_meta.cc:287] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.000s
I20260709 13:19:28.086458 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.111624 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.055186 19653 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.092911 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.113421 19586 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:28.113413 19653 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:28.094413 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.115017 19583 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:28.094712 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.118551 19581 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:28.062420 23860 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:28.133565 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:28.134887 19654 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:28.136202 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:28.137243 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:28.047418 23889 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:28.098476 19585 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:19:28.143052 19585 pending_rounds.cc:85] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 4
I20260709 13:19:28.143325 19585 pending_rounds.cc:107] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:19:28.143610 19585 raft_consensus.cc:2889] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:28.049058 23796 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:28.145408 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:28.147984 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:28.156181 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.120788 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.084978 23954 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.042351 23433 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.063910 23760 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:28.042598 23764 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.140033 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.072250 23669 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.083747 23855 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:28.070530 23883 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.157267 19585 raft_consensus.cc:2393] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:28.138461 19581 raft_consensus.cc:2393] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 6: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:28.160087 19653 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:19:28.157245 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:28.041564 23697 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.105798 23939 raft_consensus.cc:740] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:28.170217 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:28.243275 19507 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:28.123543 23884 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.157203 19582 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:28.174059 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 2269) took 1187 ms. Trace:
I20260709 13:19:28.164273 23800 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.248253 19652 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:28.153766 23889 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:28.133445 23860 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:28.088225 23847 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:19:28.078018 23767 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.092191 23769 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:19:28.242271 19504 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:28.245067 19503 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:19:28.251432 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 259496us
I20260709 13:19:28.119282 23863 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.174695 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.138351 23857 consensus_queue.cc:1059] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:19:28.137874 23571 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:28.169013 23941 log.cc:927] Time spent T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:19:28.246671 19656 rpcz_store.cc:276] 0709 13:19:26.986612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.204669 (+218057us) service_pool.cc:224] Handling call
0709 13:19:27.204975 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.205177 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:27.430181 (+225004us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.787349 (+357168us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.839692 (+ 52343us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.063495 (+223803us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b1800307f60. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e63b2a6 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e5e7c0a 00007f6c37d27219
0709 13:19:28.065523 (+  2028us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b1800307f60. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e5e7c0a 00007f6c37d27219 00007f6c3562e58f 00007f6c2e66d571 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd
0709 13:19:28.173678 (+108155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:28.173736 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:28.173792 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.173866 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.173997 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":408226,"prepare.queue_time_us":164649,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":391025,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":78315,"spinlock_wait_cycles":68633856,"thread_start_us":506689,"threads_started":2,"wal-append.queue_time_us":507426}
W20260709 13:19:28.256989 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 180001us
I20260709 13:19:28.297521 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:28.172397 23881 consensus_meta.cc:287] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.004s
W20260709 13:19:28.177368 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.070742 23752 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:28.246809 23950 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:19:28.260510 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:28.264432 19583 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:28.166988 19586 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:28.309499 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:28.267278 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.261469 23955 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:28.250890 23800 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.164088 23719 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:19:28.274765 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:28.255947 23862 consensus_meta.cc:287] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.918s	user 0.012s	sys 0.001s
I20260709 13:19:28.281422 19507 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:28.270664 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
W20260709 13:19:28.283070 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 107407us
I20260709 13:19:28.289093 19582 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:28.291093 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.243347 23669 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.304448 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:28.269603 23833 consensus_meta.cc:287] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.796s	user 0.015s	sys 0.004s
W20260709 13:19:28.251926 23712 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:19:28.310681 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.365489 19583 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:19:28.366303 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 61966.5us
I20260709 13:19:28.366601 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.367471 19583 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:28.367396 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:28.310281 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.309464 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2659) took 1332 ms. Trace:
I20260709 13:19:28.306126 23847 consensus_queue.cc:1243] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 17.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:28.360348 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2241) took 1885 ms. Trace:
I20260709 13:19:28.307145 23767 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:28.171072 23954 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:28.327841 19503 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:28.379108 19503 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:28.268483 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.380381 19503 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:28.353371 20666 raft_consensus.cc:2393] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:19:28.355142 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:28.356312 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:28.357584 19511 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:28.358196 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.361285 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.370236 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.370297 19578 rpcz_store.cc:276] 0709 13:19:26.475321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.962127 (+486806us) service_pool.cc:224] Handling call
0709 13:19:26.962448 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.244161 (+281713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.244193 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:27.244622 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:19:27.843698 (+599076us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:27.843742 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.324124 (+480382us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400247054. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:28.324191 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.324277 (+    86us) raft_consensus.cc:1685] finished
0709 13:19:28.324297 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.360266 (+ 35969us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647354240,"thread_start_us":598757,"threads_started":1,"wal-append.queue_time_us":725118}
I20260709 13:19:28.383747 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.384083 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:28.369342 19579 rpcz_store.cc:276] 0709 13:19:26.976952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.604619 (+627667us) service_pool.cc:224] Handling call
0709 13:19:27.604905 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.606182 (+  1277us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:27.653264 (+ 47082us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.846079 (+192815us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.057485 (+211406us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b180045a180. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66a455 00007f6c31752060 00007f6c31764716 00007f6c31775287 00007f6c31775208
0709 13:19:28.309059 (+251574us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:28.309119 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:28.309181 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.309260 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.309399 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47714,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":3197,"raft.queue_time_us":242211,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":70,"spinlock_wait_cycles":12698496,"thread_start_us":443700,"threads_started":2,"wal-append.queue_time_us":320685}
I20260709 13:19:28.376058 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:28.387573 19507 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:28.387718 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.388420 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:28.392493 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:28.393255 19584 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 8.
I20260709 13:19:28.396454 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:28.397002 19584 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:28.398479 19584 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:19:28.397264 19579 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:28.401789 19586 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:28.404386 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:28.405022 23697 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:28.405602 23958 log.cc:927] Time spent T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 13:19:28.407485 23872 consensus_meta.cc:287] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.940s	user 0.010s	sys 0.006s
I20260709 13:19:28.407941 23872 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.410110 19585 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:28.411473 19585 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:28.413805 19587 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:28.414551 23571 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.415513 23752 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.405051 20662 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:28.416415 23939 consensus_queue.cc:260] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.322937 23860 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.418756 23860 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:28.418685 23872 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.423151 23800 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.378515 23833 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.310056 23956 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:28.322237 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:19:28.433060 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 57111.3us
I20260709 13:19:28.435410 19661 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:28.436832 19581 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 14.
W20260709 13:19:28.436110 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 81641.4us
W20260709 13:19:28.436491 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 80305.7us
I20260709 13:19:28.443790 19583 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:28.395113 23433 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:28.308133 23881 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.374997 23862 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:28.380326 23638 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:28.389200 23955 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:28.454671 19586 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:19:28.455394 19551 leader_election.cc:400] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13.
W20260709 13:19:28.432113 23941 log.cc:927] Time spent T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:19:28.407853 23883 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.476400 19551 leader_election.cc:403] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:28.458459 23571 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:28.451972 23963 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:28.482568 19585 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:28.468425 23433 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:28.465754 23872 consensus_queue.cc:1059] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:19:28.472594 23939 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:28.466156 23800 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 13:19:28.482975 23547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.001s
I20260709 13:19:28.484493 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:28.484201 23963 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:28.497730 23880 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:28.500747 23547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.008s	sys 0.002s
I20260709 13:19:28.489143 23715 consensus_queue.cc:1059] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:19:28.502821 23963 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:28.509788 23880 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:28.515909 23970 log.cc:927] Time spent T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 13:19:28.515930 23968 log.cc:927] Time spent T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:19:28.517091 23881 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.519048 23954 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:28.525432 23963 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.531847 23963 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:28.565950 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 124202us
I20260709 13:19:28.474541 19512 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:28.578830 23500 consensus_queue.cc:1059] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:19:28.582194 23571 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:28.583674 23571 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.587322 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.588581 23572 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:28.590409 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.590742 23547 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:28.504982 23433 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.596027 23669 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:28.488834 19625 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:28.599002 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 110134us
I20260709 13:19:28.606683 23571 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.602062 23669 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:28.622774 23669 raft_consensus.cc:697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:28.602248 23500 raft_consensus.cc:3055] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:28.626621 23500 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:28.628492 23500 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.630751 23500 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:28.603734 23433 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:28.604089 23715 raft_consensus.cc:3055] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:19:28.580979 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 125600us
I20260709 13:19:28.634092 23715 raft_consensus.cc:740] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:28.635447 19582 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:28.635773 23715 consensus_queue.cc:260] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.637921 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:28.638955 19509 raft_consensus.cc:2368] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12.
I20260709 13:19:28.607064 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:28.527390 23880 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:28.523703 23889 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.643002 23857 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:28.608450 19476 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:28.618747 19583 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:28.621042 19579 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:28.603091 23572 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.609367 23712 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:19:28.624697 23669 consensus_queue.cc:237] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.614466 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:28.647475 23881 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13.
W20260709 13:19:28.654033 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 45877.9us
I20260709 13:19:28.660472 20659 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:28.663323 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:28.665798 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:28.663532 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:28.669844 19507 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:28.669993 23572 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.670567 23857 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:28.671118 23857 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.671522 23857 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:28.678624 23975 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:28.679482 23975 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:28.681597 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:28.681228 23975 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.682610 19655 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:28.683791 23975 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:28.684082 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:28.688465 20619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.689740 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:28.690816 19653 raft_consensus.cc:2368] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12.
I20260709 13:19:28.692133 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:28.651403 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:28.707798 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 77420us
I20260709 13:19:28.716599 20619 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:28.719841 23974 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:28.725970 23976 consensus_queue.cc:1059] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:28.727866 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:28.728953 19657 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:28.728991 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:28.729835 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:28.730082 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:28.730837 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:28.731408 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:28.732962 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:28.730436 19657 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:28.733844 19657 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:28.708889 23572 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:28.736343 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2664) took 1655 ms. Trace:
I20260709 13:19:28.736207 23572 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:28.737401 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:28.737888 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.737808 23571 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:28.738656 23571 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.739099 23572 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.736824 19587 rpcz_store.cc:276] 0709 13:19:27.080545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.633304 (+552759us) service_pool.cc:224] Handling call
0709 13:19:27.667401 (+ 34097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.414266 (+746865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.735829 (+321563us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b5400267d54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:28.736159 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1716185984}
I20260709 13:19:28.743613 23884 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:19:28.734987 19657 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.750962 23767 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.751914 23697 raft_consensus.cc:3055] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:28.752470 23697 raft_consensus.cc:740] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:28.754473 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:28.756855 23889 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.757867 19652 raft_consensus.cc:1275] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:19:28.758034 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:28.758638 19661 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:28.759459 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:28.761739 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.764880 19511 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:28.765853 19508 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:28.766052 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:28.766518 23976 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.766968 19511 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:28.767356 19508 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:28.767103 23976 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.768513 19511 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:19:28.751667 23767 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.758312 19652 pending_rounds.cc:85] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 7
I20260709 13:19:28.773310 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:28.773814 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:28.776185 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:28.777988 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:28.778213 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:28.779284 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 69759.9us
I20260709 13:19:28.771517 23767 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.741483 23571 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.771026 19660 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:28.784349 19657 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:28.783468 19652 pending_rounds.cc:107] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:19:28.786562 19652 raft_consensus.cc:2889] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:28.787968 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:28.788753 19512 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 13.
I20260709 13:19:28.789945 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:28.791793 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:28.779564 23697 consensus_queue.cc:260] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.795068 23697 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:28.769644 23708 consensus_queue.cc:1059] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:19:28.798434 23708 raft_consensus.cc:3055] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:28.798641 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:28.798928 23708 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:28.800109 23708 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.801281 19509 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:28.793773 23833 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.803453 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:28.805079 19512 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:28.818674 23848 raft_consensus.cc:3055] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:28.819175 23848 raft_consensus.cc:740] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:28.820369 23848 consensus_queue.cc:260] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.808841 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:28.822439 19657 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
I20260709 13:19:28.813093 23861 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:28.798458 19478 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:28.824172 23660 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:28.824700 19478 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:28.825712 23660 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:28.827610 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:28.828011 19657 pending_rounds.cc:85] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 7
I20260709 13:19:28.828388 19657 pending_rounds.cc:107] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 13:19:28.828641 19657 raft_consensus.cc:2889] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:28.831048 23709 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:19:28.832774 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:28.769588 23976 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:28.813090 23708 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:28.809129 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:28.835990 19659 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:28.847399 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:28.829461 23309 raft_consensus.cc:3055] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:28.793339 23875 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:28.856918 19511 raft_consensus.cc:2393] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:28.855209 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:28.860155 19512 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:28.849321 23975 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.864400 23975 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:28.865559 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 99012us
I20260709 13:19:28.852469 23309 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:28.875157 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:28.874361 19476 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:28.877701 19476 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:28.879557 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.879678 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:28.880825 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2648) took 1943 ms. Trace:
I20260709 13:19:28.881522 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:28.882457 19503 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 14: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:28.881704 23433 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:28.883373 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:28.883688 23433 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:28.884151 19503 raft_consensus.cc:2393] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 10: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:28.884500 23433 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:28.881212 19580 rpcz_store.cc:276] 0709 13:19:26.891980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.303320 (+411340us) service_pool.cc:224] Handling call
0709 13:19:27.303636 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.325348 (+ 21712us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:27.340072 (+ 14724us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.432094 (+ 92022us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b1800459fa0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa23a 00007f6c31764a2a
0709 13:19:28.071343 (+639249us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.137930 (+ 66587us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.141720 (+  3790us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:28.529171 (+387451us) spinlock_profiling.cc:243] Waited 9.5 ms on lock 0x7b1800459fa0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d522 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:19:28.790584 (+261413us) spinlock_profiling.cc:243] Waited 9.77 ms on lock 0x7b1800459fa0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d522 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:19:28.808290 (+ 17706us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b2c0002d418. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:19:28.808890 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 13:19:28.809085 (+   195us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:28.809387 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.809564 (+   177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.809733 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.834880 (+ 25147us) raft_consensus.cc:1685] finished
0709 13:19:28.834908 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.835073 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112267,"prepare.queue_time_us":44512,"prepare.run_cpu_time_us":223,"prepare.run_wall_time_us":9601,"raft.queue_time_us":351289,"raft.run_cpu_time_us":701,"raft.run_wall_time_us":57990,"spinlock_wait_cycles":365205120,"thread_start_us":638685,"threads_started":2,"wal-append.queue_time_us":556481}
I20260709 13:19:28.887564 19654 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:28.881393 19476 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:28.888746 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:28.889554 19654 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:28.891115 23572 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:28.893487 23848 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:28.895694 19476 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:28.896860 23948 raft_consensus.cc:3055] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:28.897292 23948 raft_consensus.cc:740] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:28.898439 23948 consensus_queue.cc:260] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.899732 23948 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:28.899834 23965 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.454s	user 0.000s	sys 0.002s
I20260709 13:19:28.900797 23764 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:28.901366 23764 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.901512 20631 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:19:28.901835 23764 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:28.902354 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45068us
I20260709 13:19:28.902596 23841 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:28.903069 23841 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.903434 23841 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:28.904314 23309 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.905575 23309 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:28.908589 23863 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.910732 23697 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:28.911115 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:28.911585 23697 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.912917 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:28.861202 23660 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:28.914188 23697 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.914790 19553 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:19:28.915705 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:28.916532 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:28.917371 19510 raft_consensus.cc:2393] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:28.917781 23715 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:28.917582 23857 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:28.920003 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 46023.6us
I20260709 13:19:28.920287 23857 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.922645 19504 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:28.917551 23841 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:28.859328 23976 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:28.926587 23976 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.927812 19476 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:28.928871 23976 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:28.929970 23959 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:28.931458 19625 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:28.931756 23975 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:28.929322 23764 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.934000 23841 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:28.934893 23692 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:28.935142 23874 consensus_queue.cc:1059] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:28.936196 23691 consensus_queue.cc:1059] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:28.967365 23691 consensus_queue.cc:1243] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:28.940161 19508 raft_consensus.cc:2368] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13.
W20260709 13:19:28.944005 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.969288 23692 raft_consensus.cc:697] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:19:28.970374 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 142918us
I20260709 13:19:28.971346 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:28.972098 23959 consensus_queue.cc:1059] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:28.920660 19627 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:28.964627 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:28.973198 19580 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:28.966481 23874 raft_consensus.cc:3055] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:28.971452 23692 consensus_queue.cc:237] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:28.973968 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:28.955698 19653 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
W20260709 13:19:28.974356 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 106046us
I20260709 13:19:28.959246 23889 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.979234 23959 raft_consensus.cc:3055] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:19:28.981251 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 60857.2us
I20260709 13:19:28.983469 23764 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:28.983268 19478 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:28.988373 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 54923.1us
I20260709 13:19:29.023994 23857 consensus_queue.cc:1048] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:29.025707 23572 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:29.036396 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60692 (request call id 214) took 1185 ms. Trace:
I20260709 13:19:29.029558 19658 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:29.040422 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2131) took 1436 ms. Trace:
I20260709 13:19:29.051569 19625 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:28.975909 23697 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:29.055598 19659 raft_consensus.cc:3055] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:29.036216 23939 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:28.984473 23833 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:28.994982 23669 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:28.976464 23874 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:29.056068 19659 raft_consensus.cc:740] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:19:29.036515 23987 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:19:28.995285 23959 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:29.040046 23860 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.048300 19505 rpcz_store.cc:276] 0709 13:19:27.539880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.540899 (+  1019us) service_pool.cc:224] Handling call
0709 13:19:27.541340 (+   441us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:27.866732 (+325392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.866787 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:27.926613 (+ 59826us) log.cc:844] Serialized 52 byte log entry
0709 13:19:28.165829 (+239216us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:28.165892 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.165965 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.898946 (+732981us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:28.947344 (+ 48398us) raft_consensus.cc:1685] finished
0709 13:19:28.947367 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.975720 (+ 28353us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79683,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":10219392,"thread_start_us":540313,"threads_started":2,"wal-append.queue_time_us":413074}
W20260709 13:19:29.062922 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 43758.6us
I20260709 13:19:29.044499 19506 rpcz_store.cc:276] 0709 13:19:27.850710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.850911 (+   201us) service_pool.cc:224] Handling call
0709 13:19:27.857763 (+  6852us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.858193 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.858236 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:28.690126 (+831890us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b2c00000c88. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:19:28.690853 (+   727us) log.cc:844] Serialized 26 byte log entry
0709 13:19:28.783255 (+ 92402us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:28.783290 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.823621 (+ 40331us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:29.035723 (+212102us) raft_consensus.cc:1685] finished
0709 13:19:29.035762 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:29.036135 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27428,"raft.queue_time_us":34971,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":9322,"spinlock_wait_cycles":7820544,"thread_start_us":91203,"threads_started":1,"wal-append.queue_time_us":327679}
I20260709 13:19:29.035391 23872 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.072027 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:29.074018 19580 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 15.
I20260709 13:19:29.066717 23712 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:29.064313 23857 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:29.036442 23889 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:29.063382 23572 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 13:19:29.093560 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 180877us
I20260709 13:19:29.076238 23669 raft_consensus.cc:697] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:29.080440 23861 raft_consensus.cc:2764] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:19:29.084194 19659 consensus_queue.cc:260] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.078018 23715 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:29.090720 23433 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:29.098165 23433 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.098726 23433 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:29.101704 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:29.102336 19505 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:19:29.086139 23660 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:29.109095 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.109000 19659 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:29.074560 23860 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.115952 19654 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
W20260709 13:19:29.118569 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.121150 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:29.102708 23715 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:29.126201 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:29.107406 23660 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:29.096956 23976 consensus_queue.cc:1059] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:19:29.148501 20631 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:19:29.086355 23709 consensus_queue.cc:1059] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:19:29.145754 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:29.151279 19653 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:29.151932 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 168828us
I20260709 13:19:29.146922 23433 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.150102 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:29.125392 23715 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:29.161866 23845 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:29.162609 23845 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 15 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:19:29.163589 23845 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:29.165704 23697 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:29.166390 23697 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.114302 23712 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.147145 23660 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:29.116915 23857 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.174811 23433 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:29.178764 23697 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:29.182641 23862 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:29.183789 23959 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.185263 23959 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:29.185818 23933 raft_consensus.cc:3055] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:29.186245 23933 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:29.187212 23933 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.185163 19659 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:19:29.195369 19659 pending_rounds.cc:85] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 7
I20260709 13:19:29.191923 23895 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.188638 23933 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:29.198092 23895 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:29.198577 23889 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:29.197355 19659 pending_rounds.cc:107] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:19:29.199218 23889 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:29.199399 20662 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 6.
I20260709 13:19:29.199820 23889 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.200748 23669 consensus_queue.cc:237] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.199998 19659 raft_consensus.cc:2889] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:29.190382 19627 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:29.205094 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.194208 23712 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:29.213277 19505 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 15.
I20260709 13:19:29.110270 23872 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.142802 23874 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:29.215631 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 107418us
I20260709 13:19:29.204349 19476 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:29.220753 19657 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:29.231628 23857 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:29.236114 23872 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:29.226778 23691 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:19:29.239324 23889 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:29.197507 23860 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:29.242110 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 67597.6us
I20260709 13:19:29.244576 23433 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:29.217751 23862 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:29.229375 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:19:29.253393 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.255393 19653 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:29.258797 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:29.261524 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 86426.2us
I20260709 13:19:29.263480 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:29.263867 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:29.264057 19653 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:29.256728 23857 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:29.266304 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 76090.2us
I20260709 13:19:29.251336 23712 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:29.285218 23433 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.290148 19657 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:29.283042 23874 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:29.304013 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 46950.3us
I20260709 13:19:29.304148 19476 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:29.290329 23889 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:29.310098 23433 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.313688 23863 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:29.315668 23863 raft_consensus.cc:697] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:29.316744 23863 consensus_queue.cc:237] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.302537 23857 raft_consensus.cc:697] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:29.328588 23857 consensus_queue.cc:237] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.339073 19653 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
W20260709 13:19:29.353416 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 100606us
I20260709 13:19:29.309269 23976 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:19:29.367074 23433 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:29.314180 23939 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:19:29.372087 23715 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.380406 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:29.387907 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.388537 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:29.391557 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:29.398902 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.408697 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:29.412070 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:29.410817 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.412709 19627 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:29.411895 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:29.294210 23862 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:29.427023 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:29.413393 19503 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:29.424834 19587 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 6.
I20260709 13:19:29.428349 19476 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:29.414242 23660 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.431012 23906 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:29.431092 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:29.431555 23906 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:19:29.431721 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 66753.9us
I20260709 13:19:29.431979 23906 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:29.432679 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:29.433039 19506 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:29.433255 23572 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:29.433781 19654 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:29.433959 19504 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:29.431893 23660 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:29.439039 23932 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:29.439190 23895 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:29.439599 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:29.436072 23848 consensus_meta.cc:287] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.004s
I20260709 13:19:29.361080 23860 consensus_queue.cc:1059] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:19:29.444412 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:29.446882 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:29.450675 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.449721 19508 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:29.373603 23846 raft_consensus.cc:3055] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:29.441550 23669 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:29.456043 19660 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 5.
I20260709 13:19:29.460412 19627 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:29.459347 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.450824 23932 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:29.452947 23861 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:29.474364 20631 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
W20260709 13:19:29.498183 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 65343.2us
I20260709 13:19:29.502534 19476 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:29.503831 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:29.505934 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 66382.5us
I20260709 13:19:29.506749 23764 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:29.507663 19478 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:29.457002 23846 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:29.508428 23764 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:29.516168 19625 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:29.517571 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 151414us
I20260709 13:19:29.515842 23975 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:29.520157 23764 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.511411 23309 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:29.514618 23875 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:29.540259 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:29.538065 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:29.524277 23764 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:29.533023 23572 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:29.550122 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 95362.6us
I20260709 13:19:29.534775 23692 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:29.535214 23939 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:29.556288 23457 consensus_queue.cc:1059] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:19:29.557462 23457 raft_consensus.cc:3055] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:29.557889 23457 raft_consensus.cc:740] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:29.558188 23309 raft_consensus.cc:697] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:29.558768 23457 consensus_queue.cc:260] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.559350 23309 consensus_queue.cc:237] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.560158 23457 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:29.561831 23889 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:29.546968 23932 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.565126 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:29.566332 23889 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:29.567129 23862 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:29.568076 23715 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:29.516185 23863 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:19:29.568611 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:29.570114 23862 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:29.570555 23862 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:29.571004 23862 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:29.552385 23692 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.571602 23692 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:29.572136 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.542274 23875 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.573798 23875 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:29.574684 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:29.573918 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:29.577111 23889 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:19:29.589829 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.606993 23572 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.610085 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:29.611171 23975 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:29.611806 23975 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:29.612862 23975 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.622367 23863 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:29.622201 23889 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:29.623543 23708 raft_consensus.cc:3055] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:29.623955 23708 raft_consensus.cc:740] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:19:29.625366 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 132062us
I20260709 13:19:29.642820 23846 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.644236 23846 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:29.615648 23976 consensus_queue.cc:1059] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:19:29.649549 23906 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.704720 23906 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:29.653579 23764 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:29.683228 23998 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.189s	user 0.003s	sys 0.000s
I20260709 13:19:29.689075 19587 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:29.690663 23715 raft_consensus.cc:3055] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:29.713778 23715 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:29.714879 23715 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.716611 23715 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:29.691045 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:29.718973 19510 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:29.718317 19410 catalog_manager.cc:5697] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:19:29.656055 23708 consensus_queue.cc:260] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.721380 23708 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:29.662297 19508 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:19:29.682725 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 162773us
I20260709 13:19:29.725790 23889 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:29.726976 23889 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:29.727451 23889 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:29.728547 23889 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.674256 23862 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.736379 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:29.736884 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:29.737214 19586 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:29.740186 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:29.740839 19583 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:29.738842 19585 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:19:29.724468 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 88908.7us
W20260709 13:19:29.756675 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.782717 19580 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:29.782953 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:29.784334 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:29.785156 19656 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:29.786324 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:29.788833 19586 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:29.795349 19583 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:29.806008 19587 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:29.763981 23872 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:29.810667 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:29.810853 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:29.811254 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:29.813318 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:29.818862 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:29.829296 19583 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:29.743012 23861 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:29.831264 19586 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:19:29.834097 23889 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:29.835616 23692 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.840773 23692 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:29.758873 23845 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:19:29.831876 19586 pending_rounds.cc:85] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 7
I20260709 13:19:29.855247 19586 pending_rounds.cc:107] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:19:29.855621 19586 raft_consensus.cc:2889] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:29.856954 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.859179 19578 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:29.877159 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 90668.8us
W20260709 13:19:29.882907 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.884119 19656 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:29.854668 23861 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.884586 23872 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.883628 19581 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
W20260709 13:19:29.888024 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.903581 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:29.911232 19657 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:29.912274 19551 leader_election.cc:400] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12.
I20260709 13:19:29.912647 19551 leader_election.cc:403] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:19:29.913112 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:29.913704 19508 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:29.921197 19504 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:29.923094 19510 raft_consensus.cc:1275] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:19:29.902782 24018 log.cc:927] Time spent T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:19:29.854995 23875 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:29.888121 23692 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:29.887293 23974 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:19:29.940733 23692 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:29.941761 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:29.965088 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:29.981068 19578 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:29.949698 19584 raft_consensus.cc:1275] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:29.954422 23872 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:29.915093 23862 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:29.967526 23709 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:29.999828 23709 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:30.000270 23709 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.916287 23906 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.000846 23906 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.003265 23906 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:29.915292 23948 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.944618 23861 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.004179 23948 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.004587 23861 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12.
I20260709 13:19:30.005924 23572 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:19:30.009045 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.011662 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 73208us
I20260709 13:19:30.012063 23572 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:30.012461 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:30.017767 24006 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.018437 24006 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.019253 23692 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:30.020479 24016 log.cc:927] Time spent T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:30.020965 24006 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.021888 24021 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:30.022157 24015 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:19:30.022584 24021 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.025163 24021 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.027263 23875 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 7 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.018028 23572 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:30.029390 23572 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.029455 23764 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.029937 23572 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:30.033262 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.989688 19508 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
W20260709 13:19:29.989854 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 54008us
I20260709 13:19:30.036686 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:30.037328 19587 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:29.992964 19580 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
W20260709 13:19:29.994177 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 116060us
I20260709 13:19:29.998123 19583 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:30.037981 19478 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:30.038373 19551 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:30.044026 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 70903.3us
I20260709 13:19:30.044265 19476 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:30.046664 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.972219 23976 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.053897 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:30.061985 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:30.063341 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:30.068025 19478 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:30.069538 19578 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:30.064155 19510 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:30.069984 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:30.059188 24021 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:30.080742 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:30.059747 24006 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:29.998797 23457 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
W20260709 13:19:30.085600 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 93997.6us
I20260709 13:19:30.067516 23933 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.094892 19505 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:30.088176 19625 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:30.074499 23764 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:30.099315 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:30.084240 23863 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:30.067116 23874 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:19:30.114151 19578 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:19:30.103308 23309 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:30.095256 24006 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:30.076253 23976 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:30.101257 23764 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:30.107079 23863 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:30.127583 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:30.129096 23959 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.128742 24006 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.131310 23976 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:30.131991 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:30.132696 24025 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:30.098869 23933 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.140427 23309 raft_consensus.cc:697] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:30.148263 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:30.152007 19587 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 7.
I20260709 13:19:30.164500 19579 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:30.112332 23872 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:30.163705 19585 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:30.153052 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:30.164626 19583 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:30.165897 19478 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:30.167140 19578 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:30.150843 23764 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:30.154870 23863 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:30.177480 19478 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:30.165503 20631 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:19:30.186785 19580 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:30.188706 24029 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:30.161659 24025 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.161952 24026 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:30.166730 23872 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:30.189378 24029 raft_consensus.cc:697] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 7 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:19:30.199462 23906 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.205035 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:30.204883 23433 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:30.206386 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:30.203111 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 101506us
I20260709 13:19:30.209750 23433 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:30.190961 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:30.211437 19478 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:30.214803 19625 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:30.215378 19578 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:30.215678 23692 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:30.202428 23857 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:30.196022 24025 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:30.216441 23433 consensus_queue.cc:1048] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:30.143553 19656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:30.174322 23959 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.207571 23872 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:30.231884 20659 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:30.233778 24030 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.234021 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:30.234368 24030 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.235246 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:30.236392 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:30.236294 23309 consensus_queue.cc:237] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.237582 19551 leader_election.cc:400] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13.
I20260709 13:19:30.239946 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:30.216115 23692 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:30.241122 23692 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:30.219398 23857 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:30.242298 23857 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:30.242815 24028 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:30.226792 23975 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:30.221882 19656 raft_consensus.cc:606] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:30.227664 23933 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:30.175932 23572 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:30.230064 24009 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:30.231374 23959 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.231113 23752 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:19:30.236585 24030 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.240507 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:30.226164 19508 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:19:30.280809 19508 pending_rounds.cc:85] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 6
I20260709 13:19:30.281061 19508 pending_rounds.cc:107] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:19:30.281142 19580 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:30.281334 19508 raft_consensus.cc:2889] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:30.246701 19627 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:30.226082 24027 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:30.225775 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:30.237936 19551 leader_election.cc:403] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:19:30.243287 24028 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.221306 23939 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:30.285910 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:30.292338 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 54913.8us
W20260709 13:19:30.296705 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 50107.8us
I20260709 13:19:30.297191 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:30.298039 19512 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:19:30.298434 19512 pending_rounds.cc:85] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 7
I20260709 13:19:30.298650 19512 pending_rounds.cc:107] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:19:30.298890 19512 raft_consensus.cc:2889] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:30.211513 23906 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.299281 19505 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:30.299922 19627 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:30.303402 19511 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:30.311507 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:30.311698 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:30.207485 24026 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.313547 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:30.316118 19583 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:30.316942 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:30.256563 24009 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:30.277844 23862 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:30.319027 19660 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:30.318928 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:30.318456 19653 raft_consensus.cc:1217] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 11.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 13:19:30.320207 19653 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:30.317036 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:30.320925 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:30.323298 19627 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:30.324644 19583 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 15: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:30.324721 19625 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:30.327486 19509 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:19:30.328914 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:30.329879 19654 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
W20260709 13:19:30.331498 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.303164 24030 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13.
I20260709 13:19:30.299741 23939 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:30.294523 24028 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:30.351042 19627 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:30.334522 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:30.257822 23709 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:30.331750 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:30.315622 23976 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:30.348976 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:30.341997 19505 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 14: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:30.382745 19658 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:30.331585 23874 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:30.385950 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:30.386037 19627 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:30.378087 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:30.378448 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 159682us
I20260709 13:19:30.388144 19478 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:30.313864 24033 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:30.321545 24009 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:30.383427 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:30.390946 19509 raft_consensus.cc:2393] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:19:30.392576 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.394023 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:30.318739 23846 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:19:30.395979 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:30.401944 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:30.352471 23939 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:30.351119 23848 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:30.407848 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:30.399566 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:30.312892 24029 consensus_queue.cc:237] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:30.402819 19478 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:30.398324 19583 raft_consensus.cc:2368] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7.
I20260709 13:19:30.404397 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:30.330998 23862 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.403942 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:30.382578 23709 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:30.302903 24027 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.389530 23889 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:30.432600 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:30.391834 23975 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:30.389429 24033 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.380848 23861 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.435307 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:30.446265 19504 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:30.407482 23848 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.403927 24006 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:30.441082 19583 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:30.443661 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.443969 19658 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 7.
I20260709 13:19:30.407358 23959 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:30.405709 24030 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:30.454581 23861 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:30.457712 19460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 45692.1us
I20260709 13:19:30.458143 23720 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:30.408948 24008 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 13:19:30.459973 24036 log.cc:927] Time spent T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:19:30.460650 24037 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:19:30.461840 23572 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:30.464425 24025 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.471825 19659 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:30.446985 24041 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:30.478080 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:30.477298 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:30.485272 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:30.492749 24014 log.cc:927] Time spent T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.653s	user 0.001s	sys 0.004s
I20260709 13:19:30.481938 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:30.500705 23906 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.501245 19580 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:30.505194 23948 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:30.459152 24038 log.cc:927] Time spent T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:30.452804 23848 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:30.447131 24033 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:30.482004 23959 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.526835 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:30.490880 24030 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.530020 19585 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:30.449923 23889 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.457454 23872 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.532389 24041 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.520308 23861 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.476365 23863 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.552472 23948 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.530735 19587 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:30.590787 19587 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:30.571856 23959 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:30.577203 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 174477us
I20260709 13:19:30.577822 19580 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:30.578516 19585 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:30.573695 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:30.580755 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.552176 23572 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:30.549479 23906 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:30.607125 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.548403 24006 raft_consensus.cc:697] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:30.592609 19587 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:30.574689 19582 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:30.605247 19586 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:30.584697 24041 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:30.613693 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:30.613427 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:30.615056 19551 leader_election.cc:400] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12.
I20260709 13:19:30.616564 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:30.617010 19656 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:30.617200 19583 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:30.624044 19581 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:30.627195 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:30.609498 23861 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.631202 19585 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:30.623764 19587 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:30.633378 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:30.633641 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:30.630169 19582 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:30.640502 19580 raft_consensus.cc:1275] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:30.594590 23692 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.599184 23948 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.614256 24026 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.642671 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:30.612617 23906 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.644493 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
W20260709 13:19:30.645085 24043 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:19:30.649045 24034 log.cc:927] Time spent T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.265s	user 0.001s	sys 0.001s
I20260709 13:19:30.650136 23872 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.656716 19656 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:30.679289 19627 leader_election.cc:400] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7.
I20260709 13:19:30.681668 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:30.681264 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:30.685528 19655 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:30.683732 19585 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:30.685441 19627 leader_election.cc:403] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:19:30.688971 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:30.682989 19587 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:30.689008 19661 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:30.690634 19659 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:30.693881 19653 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:30.695386 19581 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:19:30.696341 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 53727.1us
I20260709 13:19:30.697038 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:30.685425 20659 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:30.707929 19661 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:30.642030 23861 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.710999 19661 raft_consensus.cc:606] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:30.725535 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:30.729388 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:30.687819 24028 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.747645 24051 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 6. Current term is 7.
W20260709 13:19:30.747789 24040 log.cc:927] Time spent T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:19:30.747925 24025 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.751998 24056 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.752528 24056 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:30.754402 24049 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:19:30.758265 24048 log.cc:927] Time spent T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:19:30.760983 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:30.762359 24026 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:19:30.763173 24052 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:19:30.764802 24026 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.765304 24026 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.712560 24060 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:30.768683 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:30.709856 23933 consensus_queue.cc:1059] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:19:30.769584 19654 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:30.733269 24027 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.746587 23846 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:30.748574 23715 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:19:30.781826 23846 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:30.792384 23846 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:30.793151 23874 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.800479 23874 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.802670 23874 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:30.802847 24055 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:30.803718 23874 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:30.804427 23846 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.805760 23572 raft_consensus.cc:697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:30.806888 23572 consensus_queue.cc:237] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.807982 19627 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:30.809875 23708 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:30.810837 23309 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:30.811666 23708 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:30.812242 23309 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:30.812482 23692 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:30.806881 23846 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:30.818063 23857 consensus_meta.cc:287] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.575s	user 0.001s	sys 0.009s
I20260709 13:19:30.818550 23857 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.793795 23975 raft_consensus.cc:993] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:19:30.820554 23975 raft_consensus.cc:1081] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:19:30.820716 19478 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:30.821712 23862 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.825985 24058 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:30.827153 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:30.827888 19587 raft_consensus.cc:2393] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:30.798321 23715 raft_consensus.cc:3055] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:30.799132 23933 raft_consensus.cc:3055] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:30.792125 24051 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:30.830335 19655 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:30.831836 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:19:30.833968 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 136985us
I20260709 13:19:30.840866 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:30.841202 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:30.841919 19587 raft_consensus.cc:2393] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:30.773672 23932 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:19:30.783267 23889 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.728590 24006 consensus_queue.cc:237] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.850667 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:30.855882 19587 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 15: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:30.851532 19656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:30.856472 19656 raft_consensus.cc:606] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:30.856815 19656 raft_consensus.cc:614] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:30.852348 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:30.825512 24008 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:30.789378 23863 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.857542 19654 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:30.847085 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:30.861258 19579 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:19:30.840555 23860 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.833369 23715 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:30.864934 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:30.869360 19503 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:30.836740 23933 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:30.875396 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:30.855029 23948 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.862655 24008 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.889317 24057 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.889707 23715 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.889983 24057 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.891284 24005 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.891806 24005 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.892233 24057 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.864354 23720 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:19:30.864770 23457 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.871821 23709 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.873987 23860 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.889345 24008 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:30.873123 24068 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:30.901911 19508 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:30.833748 24041 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.921314 19584 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:30.945775 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:30.952399 19656 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:30.921461 23669 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.957324 19653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:30.957957 19653 raft_consensus.cc:606] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:30.957751 23669 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:30.945099 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 86025.6us
I20260709 13:19:30.863292 24009 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.948458 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:30.902791 23948 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:30.924577 24005 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:30.900437 23752 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:19:30.904783 24059 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.964841 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:30.904866 23457 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.972272 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:30.904959 23709 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:30.972872 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 141119us
I20260709 13:19:30.976438 19478 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:30.981873 19507 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:30.961040 23948 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:31.000993 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 52650.1us
I20260709 13:19:31.001008 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:19:31.005582 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.982997 23764 consensus_meta.cc:287] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.793s	user 0.013s	sys 0.000s
I20260709 13:19:31.010071 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:30.979454 23720 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:30.978628 24026 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.002447 23948 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:31.021051 24075 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:31.026886 24077 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.005293 24068 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:31.028036 24009 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.008127 24005 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:31.028714 23720 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:31.030218 23860 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:31.031914 24069 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:19:31.012171 23572 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:19:31.028219 23709 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:31.037206 24077 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:30.977965 24059 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.038208 24068 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:31.040256 20659 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:31.045272 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:31.046351 24066 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:19:31.053157 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:31.036614 24075 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:31.054250 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 44272.4us
I20260709 13:19:31.054900 23669 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:31.064405 19579 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:31.080042 19585 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:31.058256 24026 raft_consensus.cc:2764] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:19:31.078780 19581 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:31.078235 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:31.016165 23764 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.082639 19582 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:31.088792 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:31.074371 24072 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:19:31.074994 24071 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:19:31.073379 23939 consensus_meta.cc:287] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.658s	user 0.007s	sys 0.003s
I20260709 13:19:31.097349 19551 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.071061 24041 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.078704 24005 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:31.110606 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:31.110855 19510 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:31.074712 23457 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:31.115377 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:31.111879 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.102280 19476 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.124469 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:31.081475 24075 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:31.122172 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:31.098230 23862 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:31.128806 19503 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:31.132822 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:31.135015 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:31.109948 23889 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:31.136942 19580 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:31.138022 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:31.138567 19551 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.138690 19580 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:31.140013 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:31.147027 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:31.147687 19659 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:31.148324 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.149567 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.154291 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:31.158721 19503 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:31.158551 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:31.145424 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.159226 19585 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:31.128535 23709 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.127364 23860 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.160718 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.168212 19503 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:31.070092 23720 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.167325 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:31.166044 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.129573 24026 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:31.130010 23862 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:31.165769 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.169938 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.171082 19659 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:31.152906 24060 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:31.173184 23764 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.174515 23861 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.174851 23857 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.179620 24061 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:31.170539 23709 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.182811 24076 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:31.111258 23939 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:31.167244 23848 consensus_meta.cc:287] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.002s
I20260709 13:19:31.198751 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:31.203490 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.109977 24080 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:19:31.184168 23860 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.209643 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:31.210078 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.210750 24062 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.213786 24054 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:31.214455 24047 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:31.214960 23948 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.208202 23889 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:31.216404 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.226982 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:31.227428 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.228120 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:31.255800 19660 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:31.204464 23862 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:31.232861 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 154539us
I20260709 13:19:31.237963 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.227939 23848 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.232481 24021 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:31.239017 19652 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:31.238946 24070 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:31.239322 24080 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:31.239934 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.267735 19659 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:31.243549 24077 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.244010 19583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60800
I20260709 13:19:31.245046 19504 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:31.257236 19661 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:31.270418 19583 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:31.270833 19583 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:31.259385 23433 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.207383 24026 raft_consensus.cc:697] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:31.271395 23433 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.272989 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.273705 19503 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:31.273012 23860 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:31.275029 23709 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:31.275323 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.217738 24068 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.234058 24005 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:31.282141 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.233888 24047 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:31.278609 23861 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:31.287398 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.288249 19503 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:31.271013 23691 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.289894 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.267282 24080 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:31.322962 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.324970 23433 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:31.320941 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.326988 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.330283 19652 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:31.331415 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.226550 24061 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.248313 24075 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.288856 24047 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:31.235610 24062 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.340971 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.343575 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.349943 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.350636 19511 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:31.372208 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.329977 23861 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:31.328246 24027 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:31.373936 19505 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:31.374311 19580 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:31.294262 24025 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:31.334674 24021 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:31.284996 23889 consensus_queue.cc:1059] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:19:31.271171 24070 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.378887 24021 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:31.415001 19583 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.411021 23720 consensus_queue.cc:1059] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:19:31.420095 23874 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:31.422526 23874 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:31.423031 23874 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:31.424220 23874 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.417544 23720 raft_consensus.cc:3055] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:31.427158 23720 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:31.433719 24070 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.338258 23691 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.440783 23715 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:31.441295 24008 consensus_meta.cc:287] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.517s	user 0.002s	sys 0.008s
I20260709 13:19:31.351944 24026 consensus_queue.cc:237] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.397455 23848 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:31.431520 19478 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:31.436843 24062 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.406538 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:31.428373 23720 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.455005 19660 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:31.481431 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.482151 19512 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:31.447105 24021 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:31.483844 19659 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:31.485731 24061 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.450824 23861 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:31.486481 23861 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.488327 23948 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.489022 19585 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:31.490358 23691 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:31.493070 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59942 (request call id 280) took 1456 ms. Trace:
I20260709 13:19:31.457130 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:31.499783 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 68338us
I20260709 13:19:31.499751 19583 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.500730 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.498445 19652 raft_consensus.cc:1275] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:31.466599 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:31.506510 24055 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:31.498867 19658 rpcz_store.cc:276] 0709 13:19:30.036567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.038306 (+  1739us) service_pool.cc:224] Handling call
0709 13:19:31.492777 (+1454471us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54000ad554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:31.492951 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735726848}
I20260709 13:19:31.500774 19478 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:31.505179 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:31.460925 24033 consensus_meta.cc:287] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.869s	user 0.013s	sys 0.000s
I20260709 13:19:31.454810 23874 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:31.515292 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:31.521562 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.522636 19511 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.523624 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:31.526564 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:31.513195 23959 consensus_meta.cc:287] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.907s	user 0.004s	sys 0.009s
W20260709 13:19:31.517315 24099 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:19:31.533869 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:31.540035 23433 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:31.540566 23433 raft_consensus.cc:697] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:31.537385 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 118337us
I20260709 13:19:31.507046 24055 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:31.520471 24094 log.cc:927] Time spent T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:19:31.544646 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:31.545903 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:31.547135 19503 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:31.547547 19578 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:19:31.429656 24080 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.524689 24062 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:31.541337 23720 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:31.551775 23433 consensus_queue.cc:237] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.550207 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:31.517189 24056 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:31.461207 24008 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.563938 19506 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:19:31.550532 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:31.546617 19625 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:31.564885 23309 raft_consensus.cc:993] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:19:31.552987 24062 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.565546 24075 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.546845 24055 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:31.574200 23309 raft_consensus.cc:1081] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:19:31.539829 23959 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.567484 23861 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.575851 19508 raft_consensus.cc:2368] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16.
I20260709 13:19:31.575999 24106 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:31.571234 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:31.497557 24047 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.568280 24008 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.573839 24062 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:31.579286 24101 log.cc:927] Time spent T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:31.576507 24106 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.580186 24106 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.573609 20659 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:31.576618 23862 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.570111 19511 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:31.584096 19625 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:31.586355 19553 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:19:31.596318 19585 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:31.597123 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.599442 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.600378 19625 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:31.601504 24035 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:31.601907 19625 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:31.601944 24035 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.602597 24035 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:31.606004 23975 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:31.606480 23975 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.606814 23975 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:31.611738 24035 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.614297 24035 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:31.615003 23975 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:31.617079 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.617249 23975 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:31.543977 23848 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:31.521555 24033 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:31.619892 23709 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.623080 23709 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.576507 23959 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.620060 24047 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.625247 23861 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:31.620445 23708 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:31.625416 24061 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.625571 24008 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:31.625465 24026 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:31.597518 23691 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:19:31.636914 23861 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.625221 23848 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.638767 23708 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.656410 19512 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:19:31.655226 23861 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:31.654181 24026 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.671445 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2692) took 1515 ms. Trace:
I20260709 13:19:31.672048 19586 rpcz_store.cc:276] 0709 13:19:30.156367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.469073 (+312706us) service_pool.cc:224] Handling call
0709 13:19:30.469396 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.610104 (+140708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.671087 (+1060983us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54002fd854. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:31.671358 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305596288}
I20260709 13:19:31.683425 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:31.684060 19506 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:31.684249 23862 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.688004 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.689213 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:31.654959 24008 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:31.693095 24008 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:31.694352 24030 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.641865 24061 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.660770 23708 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:31.702562 24033 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:31.705312 23848 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:31.713563 19503 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:31.669270 24026 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.716048 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.697419 24061 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.721413 19586 raft_consensus.cc:1275] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:31.708655 23709 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:31.725770 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:31.728152 19505 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 14: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:31.729157 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.731045 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.741989 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.741779 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.742929 19512 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:31.741722 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:31.745218 19505 raft_consensus.cc:2393] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:31.746353 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.747834 19510 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:31.752954 19506 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:31.761068 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:31.760285 24062 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.780381 19511 raft_consensus.cc:2368] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14.
I20260709 13:19:31.780812 24028 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.781082 24062 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.788722 24106 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.794027 19476 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:31.802980 19476 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.806234 19476 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.808494 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.809978 19476 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.806805 24061 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:31.809831 24008 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:31.811116 24075 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:31.815788 23660 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:31.805900 23959 raft_consensus.cc:2764] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:19:31.806977 24028 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:31.826892 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.829595 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:31.833557 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.841202 24055 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.843298 24026 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:31.844012 24026 raft_consensus.cc:697] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:31.843420 24055 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.850284 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.847124 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.848030 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.849160 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:31.852880 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.853868 23862 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:31.853955 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:31.854223 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:31.854359 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.854948 19658 raft_consensus.cc:2393] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:31.855597 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.855643 19658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:31.856770 24070 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:31.857887 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:31.828749 24028 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.858520 19654 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:31.858881 19654 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:31.857960 19658 raft_consensus.cc:606] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:31.860114 24028 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.860417 23708 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.854048 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.866264 24064 raft_consensus.cc:3055] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:31.866735 24064 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:31.866750 19660 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:31.867734 24064 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.868945 24064 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:31.856405 19657 raft_consensus.cc:2368] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14.
I20260709 13:19:31.844914 24026 consensus_queue.cc:237] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.814908 24021 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.845026 24075 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:19:31.874882 24030 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:31.886032 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2960) took 1018 ms. Trace:
I20260709 13:19:31.886545 19507 rpcz_store.cc:276] 0709 13:19:30.867997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.875601 (+  7604us) service_pool.cc:224] Handling call
0709 13:19:30.896836 (+ 21235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.000517 (+103681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.885776 (+885259us) spinlock_profiling.cc:243] Waited 81.6 ms on lock 0x7b54000fda54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:31.885973 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187636608}
I20260709 13:19:31.887166 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.888314 19657 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:31.889457 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:31.889578 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:31.890420 19657 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:31.890614 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:31.891274 19660 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:31.892171 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.893761 19578 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:31.885314 24021 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:31.902746 23933 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.904327 23933 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:31.907425 19476 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:31.910243 19580 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:31.911700 19661 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:31.919432 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.920032 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2725) took 1096 ms. Trace:
I20260709 13:19:31.918915 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:31.920104 19653 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:31.921766 19586 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:19:31.922749 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.923758 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:31.926146 19660 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:31.925379 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:31.927047 19585 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:31.926436 19583 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:31.929230 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:31.929862 19661 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:31.931160 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:31.931946 19660 raft_consensus.cc:2393] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:31.925763 19653 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:31.932547 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.933140 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:31.934896 24021 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:31.935326 19653 raft_consensus.cc:2393] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:31.937896 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:31.939019 19476 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:31.886555 24106 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:31.942391 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:31.920744 19587 rpcz_store.cc:276] 0709 13:19:30.823369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.878982 (+ 55613us) service_pool.cc:224] Handling call
0709 13:19:30.879309 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:30.887827 (+  8518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.887877 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:30.904355 (+ 16478us) log.cc:844] Serialized 52 byte log entry
0709 13:19:31.690065 (+785710us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b18003f9a60. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa0d1 00007f6c31715a0f
0709 13:19:31.772560 (+ 82495us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:31.909993 (+137433us) log.cc:844] Serialized 14 byte log entry
0709 13:19:31.910258 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.910339 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.910381 (+    42us) raft_consensus.cc:1685] finished
0709 13:19:31.919727 (+  9346us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.919951 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39325,"prepare.queue_time_us":54528,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":416,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":23498,"spinlock_wait_cycles":4800256,"thread_start_us":171712,"threads_started":2,"wal-append.queue_time_us":914365}
I20260709 13:19:31.949934 19657 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:31.950351 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:31.950973 19587 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:31.946300 19551 leader_election.cc:400] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14.
I20260709 13:19:31.952054 19551 leader_election.cc:403] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:31.953346 19660 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:31.952978 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.923987 24085 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:31.958194 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:31.935779 23861 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:31.968103 19585 raft_consensus.cc:2393] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 17: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:31.967185 19476 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:31.953989 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:31.958021 24085 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:31.974340 24085 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:31.975221 23660 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:31.954656 23872 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:31.982383 19587 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:31.983456 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:31.975768 23660 raft_consensus.cc:697] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:31.984858 23660 consensus_queue.cc:237] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.987066 23861 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:31.987906 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:31.988489 19585 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:31.990041 24026 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:31.990584 24026 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:31.991498 24026 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:31.980302 19478 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:31.993988 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.994653 19655 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:31.970068 19657 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:31.978482 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 2964) took 1022 ms. Trace:
I20260709 13:19:31.965528 19661 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:31.957782 23764 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:31.955322 24075 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:31.995573 19508 rpcz_store.cc:276] 0709 13:19:30.955666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.959389 (+  3723us) service_pool.cc:224] Handling call
0709 13:19:31.978307 (+1018918us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b540012fa54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:31.978429 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385719680}
I20260709 13:19:31.957779 24030 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:19:31.994674 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:31.996905 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:31.967736 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:31.957901 24059 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:32.000188 19655 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:31.997423 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:32.003007 19478 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:31.994573 24005 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:32.007830 23872 raft_consensus.cc:697] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:32.024209 23872 consensus_queue.cc:237] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.008806 23861 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:32.027722 23861 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.000962 24075 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.029978 24075 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:32.011982 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:32.031293 19503 raft_consensus.cc:2393] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:32.017910 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:32.019465 23764 raft_consensus.cc:697] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:32.033109 23764 consensus_queue.cc:237] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.020440 24006 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:32.036535 24006 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.036953 24006 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:32.039908 19660 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:32.042984 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:31.997786 24029 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:19:32.044040 19511 raft_consensus.cc:2393] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:32.044214 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:32.043412 19508 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:32.007609 19587 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:19:32.059461 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:32.064739 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:32.065480 19586 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:32.068169 19585 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:32.104077 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:32.104115 23948 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:32.105337 23948 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.105821 23948 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:32.107453 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:32.064530 24025 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:19:32.110491 24070 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:32.110882 24070 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:32.111726 24070 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.112320 23708 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:32.112965 24070 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:32.029989 23861 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:32.122833 19478 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
W20260709 13:19:32.125155 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 49858.8us
I20260709 13:19:32.125174 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:32.126767 19586 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:32.127421 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:32.127980 19478 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:32.109201 24006 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.130079 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:32.130935 23433 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:32.131422 23433 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:32.131124 19478 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:32.127113 24059 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:32.127204 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:32.140098 23433 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.132797 24062 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:32.128062 24076 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:32.165120 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2326) took 1151 ms. Trace:
I20260709 13:19:32.127758 24085 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.143255 24077 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.158093 20659 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:32.175405 19585 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:32.176898 19586 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:32.161149 24008 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:32.156742 24062 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.211735 23861 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:32.223301 23861 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.238752 24085 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:32.205471 24122 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:19:32.260380 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:32.269368 23939 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:32.271991 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:32.273185 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:32.203102 24062 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:32.269482 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.284570 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.285456 19625 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:32.163532 24076 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.287590 19625 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:32.177004 24077 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.237079 24075 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:32.313407 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.329530 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:32.330427 19512 raft_consensus.cc:2393] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:32.322768 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:32.298216 23669 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:32.342082 19510 raft_consensus.cc:2393] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:32.343982 19625 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:32.352468 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:32.353384 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:32.353962 19511 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:32.354636 19661 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:32.362936 19625 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:32.356001 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:32.298929 24051 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:19:32.343808 24030 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14.
I20260709 13:19:32.358501 24106 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:32.392827 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:32.390556 23660 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:32.403189 20662 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:32.403380 23660 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.364020 23669 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:32.357467 23874 consensus_queue.cc:1059] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:19:32.358984 23861 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:32.402545 24077 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:32.399850 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:32.374778 23976 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:32.376957 23708 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:32.387993 24006 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:32.420713 19660 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:32.425263 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2732) took 1453 ms. Trace:
I20260709 13:19:32.427709 19580 rpcz_store.cc:276] 0709 13:19:30.972124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.379712 (+407588us) service_pool.cc:224] Handling call
0709 13:19:31.379941 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.916708 (+536767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.424950 (+508242us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54003d04d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:32.425174 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1219138944}
I20260709 13:19:32.429364 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:32.433964 19580 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:19:32.437829 19587 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:32.391537 19511 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:32.444881 19506 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:32.405524 23660 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:32.446477 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 81028.4us
I20260709 13:19:32.449940 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:32.415710 23976 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.454159 19653 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:19:32.459210 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 63151.2us
I20260709 13:19:32.460008 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:32.460569 19627 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:32.458038 23976 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:32.458791 23906 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:32.459015 24006 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:32.478350 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:32.480438 19582 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
W20260709 13:19:32.481791 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.484318 20662 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:32.474016 24129 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.487576 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:32.487906 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:32.488385 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:32.488958 19579 raft_consensus.cc:2393] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:32.491050 19586 raft_consensus.cc:2393] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 11: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:32.491860 19580 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:19:32.493595 24080 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:32.494833 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 2958) took 1627 ms. Trace:
I20260709 13:19:32.495232 19504 rpcz_store.cc:276] 0709 13:19:30.867478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.867601 (+   123us) service_pool.cc:224] Handling call
0709 13:19:30.867892 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.270467 (+402575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.494574 (+1224107us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b54002a1f54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:32.494768 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":866878720}
W20260709 13:19:32.498471 24120 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.374s	user 0.003s	sys 0.000s
I20260709 13:19:32.504963 19507 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:32.508967 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 377906us
I20260709 13:19:32.522436 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:32.482417 24076 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:32.487716 24075 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:32.531792 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:32.533111 24136 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:32.533716 24076 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:32.534273 24076 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.536470 24076 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:32.538559 19478 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:32.539292 23906 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:32.511565 24051 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:19:32.540985 24051 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:32.541349 24051 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:32.541718 24051 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:32.549863 24077 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:32.550922 23906 raft_consensus.cc:697] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:32.555109 23976 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.550180 20659 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:32.533113 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:32.558379 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:32.485184 24006 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.479630 23669 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.570802 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:32.575081 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:32.510341 24129 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.577929 19653 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:32.578593 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:32.579268 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:32.581310 19578 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:32.582754 19553 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:19:32.583329 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:32.587318 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:32.588490 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:32.591187 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:32.592536 23872 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:19:32.593358 24132 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:19:32.593905 24030 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:32.598990 19579 raft_consensus.cc:2393] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 17: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:32.577818 24025 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:32.595162 24006 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:32.595871 23906 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.577119 24064 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:32.605849 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.581120 23861 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:32.549463 24051 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.596990 24026 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:32.597579 24080 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:32.612447 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:32.613063 19579 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 12: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:19:32.618377 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 170732us
W20260709 13:19:32.610708 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 150221us
I20260709 13:19:32.581167 23708 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:32.621752 19625 leader_election.cc:400] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16.
I20260709 13:19:32.622151 19625 leader_election.cc:403] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:19:32.622520 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:32.617818 23948 consensus_meta.cc:287] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.000s
I20260709 13:19:32.621305 23861 raft_consensus.cc:697] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:19:32.634243 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 45829.2us
I20260709 13:19:32.635979 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:32.630123 23872 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:32.609495 24092 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:19:32.638195 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:32.635643 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:32.642148 23861 consensus_queue.cc:237] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.644033 24062 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.645159 19503 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:19:32.646021 24030 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:32.657644 24134 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:19:32.659003 19551 leader_election.cc:400] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14.
I20260709 13:19:32.659891 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:32.652844 24030 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:32.662945 23976 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:32.665261 24062 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:32.665961 24080 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:19:32.689908 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 82138.8us
W20260709 13:19:32.756374 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 81493us
I20260709 13:19:32.638379 24141 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16.
I20260709 13:19:32.631574 23948 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.767449 19509 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:32.771121 19656 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:19:32.780572 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 128711us
I20260709 13:19:32.782269 19627 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:32.677448 24030 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 13:19:32.765681 23708 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.764647 24080 consensus_queue.cc:1059] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:19:32.841701 19509 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:32.843390 24025 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:19:32.845173 24064 raft_consensus.cc:3055] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:32.845826 24064 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:32.847137 24064 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.849046 24064 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:32.863530 19580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60800
I20260709 13:19:32.864140 19580 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:32.864502 19580 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:32.797957 24143 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:19:32.855518 24070 consensus_meta.cc:287] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.742s	user 0.007s	sys 0.007s
I20260709 13:19:32.890600 19585 raft_consensus.cc:2410] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:19:32.842106 24051 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:32.841868 24142 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:32.853377 24080 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.889494 19580 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.856209 24026 consensus_queue.cc:1059] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:19:32.895867 24070 raft_consensus.cc:3055] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:32.896386 24070 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:32.897197 24080 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.897341 24070 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.899091 24070 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:32.167047 19584 rpcz_store.cc:276] 0709 13:19:31.013702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.621069 (+607367us) service_pool.cc:224] Handling call
0709 13:19:31.631812 (+ 10743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.632096 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:31.640603 (+  8507us) log.cc:844] Serialized 14 byte log entry
0709 13:19:32.023817 (+383214us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b1800368080. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa23a 00007f6c31764a2a
0709 13:19:32.164770 (+140953us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:32.164822 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:32.164874 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.164937 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.165064 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5326,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":937,"raft.queue_time_us":2159,"spinlock_wait_cycles":24901376,"thread_start_us":140689,"threads_started":1}
I20260709 13:19:32.900665 19584 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:32.799826 23872 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:32.907505 19579 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:32.889906 24143 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.909878 19579 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:32.910789 19584 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:19:32.910305 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 235875us
I20260709 13:19:32.919368 24080 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:32.916173 19625 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:32.922358 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:32.890731 24149 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:32.924572 19580 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:32.926512 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:32.927393 19504 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:32.932132 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:32.932798 19506 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:32.907747 24051 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.934603 19510 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:32.891799 23669 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:19:32.940503 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:32.942390 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:32.942694 19506 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:32.948359 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:32.948957 19661 raft_consensus.cc:3055] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:32.949244 19661 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:32.927475 24149 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.907928 24142 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.996393 24143 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:32.998592 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:32.998634 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 2367) took 1732 ms. Trace:
I20260709 13:19:33.002300 24151 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:32.999742 19659 rpcz_store.cc:276] 0709 13:19:31.266374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.268549 (+  2175us) service_pool.cc:224] Handling call
0709 13:19:32.998422 (+1729873us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54002c79d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:32.998560 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477923200}
I20260709 13:19:32.954015 24149 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.946480 24051 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:32.989022 23948 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:33.022421 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 225955us
I20260709 13:19:33.020659 24150 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.035254 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:33.039126 24138 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:33.036060 24152 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.037503 24150 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:33.059118 24126 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.803s	user 0.003s	sys 0.000s
I20260709 13:19:33.059850 24150 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:33.060896 24148 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:19:33.066310 24106 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.066915 24106 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:33.075434 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:33.076406 19506 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:33.086890 19504 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
W20260709 13:19:33.092846 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.095817 19580 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:33.048424 24152 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.084429 24150 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:33.138685 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 57253.9us
W20260709 13:19:33.167622 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 139893us
W20260709 13:19:33.147904 24153 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:19:33.174094 19584 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:33.178993 24161 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:33.168630 19625 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:33.145387 24080 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:33.150314 24142 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:33.185843 19627 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:33.150292 24152 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:33.202826 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 2350) took 1232 ms. Trace:
I20260709 13:19:33.219738 19587 rpcz_store.cc:276] 0709 13:19:31.970899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.107185 (+136286us) service_pool.cc:224] Handling call
0709 13:19:33.202632 (+1095447us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b5400247f54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:33.202734 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":688475904}
I20260709 13:19:33.204918 19661 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.150790 24150 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.221377 24152 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:33.223618 24150 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:33.221487 19661 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:33.227231 19654 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.228343 19654 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.213933 24080 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.235410 24080 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:33.235466 19661 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:33.171674 24139 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:19:33.236279 24129 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:33.236477 24139 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:33.236832 24139 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:33.237756 24139 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.239298 24139 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:33.214888 24051 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:33.242395 19654 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
W20260709 13:19:33.244685 23874 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:19:33.248037 24135 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:33.248534 24135 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:33.249259 24028 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.249945 24028 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.250425 23906 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:33.251051 24137 raft_consensus.cc:3055] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:33.251508 24137 raft_consensus.cc:740] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:33.252399 23708 raft_consensus.cc:3055] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:33.252982 24161 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:33.253600 24161 raft_consensus.cc:697] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:33.251083 23906 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.254871 24161 consensus_queue.cc:237] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.256440 23906 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:33.252959 24028 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:33.252959 23708 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:33.245937 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2219) took 1398 ms. Trace:
I20260709 13:19:33.249439 24135 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.258443 24149 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.184980 19625 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:33.252566 24137 consensus_queue.cc:260] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.267472 19654 rpcz_store.cc:276] 0709 13:19:31.846977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.847104 (+   127us) service_pool.cc:224] Handling call
0709 13:19:33.226755 (+1379651us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b4c00035440. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2fa26a20 00007f6c2fa37a29 00007f6c2f9fd644 00007f6c2fa24f2d 00007f6c2fa24b93 00007f6c3175518b 00007f6c31755cb5 00007f6c31750f30 00007f6c317527de 00007f6c3175e27c 00007f6c3671fb17
0709 13:19:33.245858 (+ 19103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34111744}
W20260709 13:19:33.278285 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 93433.2us
I20260709 13:19:33.279521 19476 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:33.281308 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:33.282089 19512 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:33.283085 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:33.283753 19509 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:33.271009 24106 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.284905 19503 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:33.286322 24106 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:33.286399 23708 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.287264 23906 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:33.288074 23708 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:33.288627 19476 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:33.271502 24129 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:19:33.291302 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2335) took 1378 ms. Trace:
I20260709 13:19:33.291798 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:33.291988 24167 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:33.292686 24167 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.293081 24167 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:33.291697 19578 rpcz_store.cc:276] 0709 13:19:31.912709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.912855 (+   146us) service_pool.cc:224] Handling call
0709 13:19:31.913108 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.581716 (+668608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.291089 (+709373us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54001fc054. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:33.291253 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1534141184}
I20260709 13:19:33.294011 19508 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:33.296370 19625 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:33.267095 24151 raft_consensus.cc:697] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:33.305226 19625 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:33.314352 19580 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:33.317152 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:33.320139 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:33.320791 19578 raft_consensus.cc:2410] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:19:33.320960 19579 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:33.329873 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:33.329943 19578 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:33.330636 19583 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:33.332346 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:33.298602 23709 consensus_queue.cc:1059] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:19:33.336030 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:33.336598 19661 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.337373 24129 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:33.338855 24005 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:33.340638 19476 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:33.342933 24062 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.343093 23906 raft_consensus.cc:2764] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:19:33.343483 24062 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.343148 19580 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:33.315981 24135 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:33.346715 24151 consensus_queue.cc:237] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:33.333196 24136 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:33.350106 24136 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.350514 24136 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:33.352914 24149 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:33.353644 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.355181 19654 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:33.324457 24028 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:33.356526 24028 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.324910 24106 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:33.358129 24106 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.358486 24106 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.331792 24061 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:33.363557 24061 raft_consensus.cc:697] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:33.365290 19581 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:33.336627 23709 raft_consensus.cc:3055] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:33.368993 19661 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:33.375160 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:33.381280 19654 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:33.383226 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:33.369261 19625 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:33.370178 23709 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:33.386920 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:33.409039 19655 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:33.415782 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 230025us
I20260709 13:19:33.394403 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:33.398797 19652 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:33.400394 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:33.401507 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:33.386656 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:33.423281 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:33.423898 19656 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:33.424214 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:33.403066 19657 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:33.403832 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:33.425765 19657 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:19:33.426010 19660 raft_consensus.cc:2410] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:19:33.390450 19579 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:33.432399 19655 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
W20260709 13:19:33.432765 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 63586us
I20260709 13:19:33.433871 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:33.413251 24143 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.440892 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:33.441522 19659 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:33.442014 19656 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:33.411441 24026 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.384464 24062 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:33.439023 19583 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:19:33.398209 20659 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:33.418690 23906 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.450719 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:33.451406 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:33.458770 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.459517 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.465314 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:33.467741 19652 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:33.444928 24135 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:33.470011 19627 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:33.471405 19627 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:33.364655 24061 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:33.471518 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 138208us
I20260709 13:19:33.443948 23863 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:19:33.469353 23933 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:33.471948 24135 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.392297 23709 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.499078 23709 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:33.503211 23863 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:33.446987 24143 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.450026 24026 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.472600 24149 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:33.495847 24167 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:33.507629 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.471004 24165 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:33.481359 24164 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:33.466074 23906 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:33.507445 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 70695.9us
I20260709 13:19:33.519095 19587 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:19:33.541121 19476 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:33.395998 19405 catalog_manager.cc:5697] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 11 to 15, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 15 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:33.521476 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:33.546736 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:33.547575 19583 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:19:33.524724 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:33.551783 19581 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:33.526172 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:33.509661 24135 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.508912 24062 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:33.539858 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 59066us
I20260709 13:19:33.558439 19478 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:33.559226 19476 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:33.511650 24028 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:33.552984 19578 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:33.555133 19627 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:33.556335 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:33.568164 19586 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:33.573172 19503 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:33.562139 19654 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 17: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:33.575448 19583 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:33.577298 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:33.577911 19586 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.578133 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:33.578821 19584 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:33.579860 24173 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:33.575804 24161 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.581460 24161 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.583662 24161 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:33.586197 19586 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:33.587141 24167 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:33.588068 24165 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:33.588109 24028 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.588884 24028 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.581542 24173 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:19:33.591454 24028 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:33.597594 24181 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:33.598213 24181 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:33.598603 24181 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:33.600232 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:33.602001 19652 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:33.603374 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:33.604079 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:33.604410 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:33.605443 19506 raft_consensus.cc:2393] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:33.605679 19510 raft_consensus.cc:3055] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:33.606055 19510 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:33.606788 19510 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:33.608130 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:33.608565 19510 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:33.608866 19511 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:33.609051 24077 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:33.606812 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:33.609560 24077 raft_consensus.cc:697] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:33.610072 19512 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 15: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:33.610356 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:33.610553 24077 consensus_queue.cc:237] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.604089 19652 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:33.612952 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:33.621268 19510 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:19:33.623435 19510 pending_rounds.cc:85] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 10
I20260709 13:19:33.623557 24005 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:33.624995 19510 pending_rounds.cc:107] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:19:33.626022 19510 raft_consensus.cc:2889] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:33.629199 19410 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 51) took 13492 ms (client timeout 15000 ms). Trace:
I20260709 13:19:33.629608 24136 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.630867 19658 raft_consensus.cc:2368] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13.
W20260709 13:19:33.630187 19410 rpcz_store.cc:269] 0709 13:19:20.136730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.149506 (+ 12776us) service_pool.cc:224] Handling call
0709 13:19:33.629081 (+13479575us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:30.160959 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:30.228581 (+ 67622us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:30.228641 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:19:30.228680 (+    39us) tablet.cc:662] Decoding operations
0709 13:19:30.229140 (+   460us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:30.229217 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:30.229251 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:19:30.229560 (+   309us) tablet.cc:701] Row locks acquired
0709 13:19:30.229646 (+    86us) write_op.cc:260] PREPARE: finished
0709 13:19:30.229846 (+   200us) write_op.cc:270] Start()
0709 13:19:30.230018 (+   172us) write_op.cc:276] Timestamp: P: 1783603170229757 usec, L: 0
0709 13:19:30.230043 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:19:30.230842 (+   799us) log.cc:844] Serialized 538 byte log entry
0709 13:19:30.576633 (+345791us) op_driver.cc:464] REPLICATION: finished
0709 13:19:30.821334 (+244701us) write_op.cc:301] APPLY: starting
0709 13:19:30.821445 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:30.822690 (+  1245us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:30.822827 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:30.823492 (+   665us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:30.823663 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:19:30.823704 (+    41us) write_op.cc:312] APPLY: finished
0709 13:19:30.823908 (+   204us) log.cc:844] Serialized 24 byte log entry
0709 13:19:30.824095 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:30.824180 (+    85us) write_op.cc:454] Released schema lock
0709 13:19:30.824218 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:30.824670 (+   452us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:30.824699 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":223,"mutex_wait_us":2114306,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":201465,"apply.run_cpu_time_us":3304,"apply.run_wall_time_us":3305,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"num_ops":1,"prepare.queue_time_us":300464,"prepare.run_cpu_time_us":3830,"prepare.run_wall_time_us":110661,"replication_time_us":313474,"thread_start_us":187962,"threads_started":2}]]}
I20260709 13:19:33.647749 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:33.651039 24028 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:33.651858 24028 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.654758 24028 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:33.656666 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.670526 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:33.671443 19578 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:33.675508 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:33.676477 19587 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:19:33.677026 19587 pending_rounds.cc:85] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 8
I20260709 13:19:33.677268 19587 pending_rounds.cc:107] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:19:33.677517 19587 raft_consensus.cc:2889] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:33.678398 19578 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:33.604543 24143 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:33.608747 24026 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:33.686511 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.689939 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:33.632283 20659 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:33.624753 19405 catalog_manager.cc:5697] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:33.699697 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 140572us
I20260709 13:19:33.700577 19405 catalog_manager.cc:5697] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:33.690619 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.624743 24005 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:33.702461 24005 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.704756 24005 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:33.697289 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 137442us
I20260709 13:19:33.571066 24062 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.692642 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:33.706327 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:33.684458 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:33.707036 19583 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:33.704402 19405 catalog_manager.cc:5697] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:33.688561 24030 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.725853 19627 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:33.722886 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:33.728431 19509 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:33.731369 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:33.739135 19578 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:33.741165 19627 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:33.728188 24178 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.738482 23872 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:33.751289 19583 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:19:33.723228 24143 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:33.712777 24070 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:19:33.754725 24167 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:33.776647 24167 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.777086 24167 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:33.778204 24176 log.cc:927] Time spent T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:19:33.778600 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:33.779206 19506 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:33.779424 19507 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:33.778136 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:33.781435 19511 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:33.782002 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:33.775061 19661 raft_consensus.cc:2410] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:19:33.739823 24161 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:33.787310 19627 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:33.744607 24178 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.790124 19405 catalog_manager.cc:5697] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 9 to 14, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 14 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:33.733896 24030 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.795073 19408 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48840 (request call id 167) took 11157 ms. Trace:
I20260709 13:19:33.772101 23906 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:33.755254 24106 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.798044 24106 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:33.798537 24062 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:33.799477 19660 raft_consensus.cc:2368] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14.
I20260709 13:19:33.753289 23872 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.792805 19405 catalog_manager.cc:5697] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:33.816251 19511 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:33.763994 23692 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:19:33.819334 23709 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:33.810560 23872 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.795431 24030 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:33.822047 24030 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:33.795471 19408 rpcz_store.cc:276] 0709 13:19:22.625496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.651476 (+ 25980us) service_pool.cc:224] Handling call
0709 13:19:23.518127 (+866651us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54002ec7d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c4090 00007f6c31762f3a 00007f6c375191cc 00007f6c3761737e 00007f6c35ad82a4 00007f6c35ad8232 00007f6c35ad8161 00007f6c35ad80dc 00007f6c35ad7392 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:33.763703 (+10245576us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:26.656778 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:26.765632 (+108854us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:26.765677 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:19:26.765699 (+    22us) tablet.cc:662] Decoding operations
0709 13:19:26.792088 (+ 26389us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:26.792144 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:26.792175 (+    31us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:19:26.824990 (+ 32815us) tablet.cc:701] Row locks acquired
0709 13:19:26.825012 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:19:26.825185 (+   173us) write_op.cc:270] Start()
0709 13:19:26.825329 (+   144us) write_op.cc:276] Timestamp: P: 1783603166825131 usec, L: 0
0709 13:19:26.825352 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:19:26.837772 (+ 12420us) log.cc:844] Serialized 11205 byte log entry
0709 13:19:27.939406 (+1101634us) op_driver.cc:464] REPLICATION: finished
0709 13:19:28.310592 (+371186us) write_op.cc:301] APPLY: starting
0709 13:19:28.315750 (+  5158us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:28.528510 (+212760us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:28.531204 (+  2694us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:29.269799 (+738595us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:29.385969 (+116170us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=56,mrs_lookups=0
0709 13:19:29.386081 (+   112us) write_op.cc:312] APPLY: finished
0709 13:19:29.387039 (+   958us) log.cc:844] Serialized 243 byte log entry
0709 13:19:29.506205 (+119166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:29.506595 (+   390us) write_op.cc:454] Released schema lock
0709 13:19:29.506684 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:29.507332 (+   648us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:29.507359 (+    27us) write_op.cc:454] Released schema lock
0709 13:19:30.820445 (+1313086us) spinlock_profiling.cc:243] Waited 7.1 ms on lock 0x7b54002ec7d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175732a 00007f6c316dcf14 00007f6c316dcec3 00007f6c316dce38 00007f6c316dcdf3 00007f6c316dc0dc 00007f6c31705e16 00007f6c316edcbb 00007f6c316d839d 00007f6c316dbd75
Metrics: {"mutex_wait_us":761171,"reported_tablets":58,"spinlock_wait_cycles":577768192,"child_traces":[["op",{"apply.queue_time_us":335785,"apply.run_cpu_time_us":45704,"apply.run_wall_time_us":1212387,"cfile_cache_hit":114,"cfile_cache_hit_bytes":121111,"num_ops":28,"prepare.queue_time_us":191391,"prepare.run_cpu_time_us":32371,"prepare.run_wall_time_us":368456,"raft.queue_time_us":723777,"raft.run_cpu_time_us":60941,"raft.run_wall_time_us":503341,"replication_time_us":1113828,"spinlock_wait_cycles":16325888,"thread_start_us":864811,"threads_started":6,"wal-append.queue_time_us":548359,"wal-append.run_cpu_time_us":45296,"wal-append.run_wall_time_us":3892036}]]}
W20260709 13:19:33.824092 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 113670us
W20260709 13:19:33.831434 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 124666us
I20260709 13:19:33.832346 19476 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
W20260709 13:19:33.838292 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 51081.5us
I20260709 13:19:33.839293 19627 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:33.840307 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:33.840970 19510 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.842697 19506 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:33.845733 24077 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:33.847002 23669 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:33.847574 23669 raft_consensus.cc:697] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:33.848619 24137 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:33.848461 23669 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.852568 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:33.853164 19578 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.855809 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:33.856686 19583 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:33.814806 24178 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:33.806452 24135 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.822438 24030 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:33.865412 19625 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:33.806249 24080 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:19:33.830684 24136 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:33.874029 19583 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:33.879412 19510 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:33.870461 19511 raft_consensus.cc:1275] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:33.884179 19578 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:33.830056 24161 raft_consensus.cc:697] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:33.874759 24077 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:33.932497 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 90557.2us
W20260709 13:19:33.933169 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 44559.2us
I20260709 13:19:33.937438 19476 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:33.935488 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:33.936196 19653 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:19:33.942348 24182 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:19:33.943503 20662 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:33.945277 24181 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.946446 19578 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:33.947171 24136 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:33.947710 24136 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:33.948529 24136 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.950766 24181 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:33.950783 24106 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:33.952083 24106 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.885207 24143 raft_consensus.cc:697] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:33.958634 24143 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.845463 23692 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:33.960229 23874 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:33.960675 23692 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:33.884922 24030 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:33.962745 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:33.954280 24106 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:33.968935 23874 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:19:33.970244 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 238966us
I20260709 13:19:33.971284 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:33.890727 24150 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:33.886610 24028 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:33.972074 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:33.972468 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:33.984360 19478 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:33.984879 24077 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.985783 24075 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:33.988124 24075 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:33.974318 24026 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:33.989923 19476 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:33.985321 19478 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:33.973382 24197 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:34.000375 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:33.977347 24181 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:34.009191 23862 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:34.009991 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:33.979730 24150 raft_consensus.cc:697] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:33.975031 23906 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:19:34.020597 24188 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:34.021250 24188 raft_consensus.cc:697] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:34.022125 24188 consensus_queue.cc:237] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.011579 24161 consensus_queue.cc:237] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.990710 24075 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:33.994503 24193 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:34.026392 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:34.025544 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:33.999673 24064 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:19:33.978894 24028 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.011006 24186 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:33.988140 24167 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:33.996766 24195 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:19:33.973875 23692 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.043385 24197 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:34.045956 24186 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:34.027865 24026 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:34.067230 24167 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:34.028018 24135 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:34.051002 24194 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:19:34.053442 24150 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.026078 24187 consensus_queue.cc:1059] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 13:19:34.061571 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 76290.4us
I20260709 13:19:34.031980 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:34.066787 24197 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:34.071061 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:34.018736 24062 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.090938 19579 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [8.5-9.6]
I20260709 13:19:34.063097 24154 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:34.098487 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:34.092803 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 60931.6us
I20260709 13:19:34.068713 24186 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:34.062903 24106 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:34.068785 24139 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.011013 24005 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:19:34.101042 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:34.110203 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:34.117821 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:34.117712 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:34.099530 24026 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:34.106880 24168 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.154006 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:34.105794 24062 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.127427 24026 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:34.133985 24064 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:34.177982 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 121238us
I20260709 13:19:34.115621 24106 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.181298 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:34.146661 24195 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:34.107396 24154 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.187152 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:34.188560 24194 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.188903 19655 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: [13.8-15.9]
I20260709 13:19:34.119735 24139 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.194463 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:34.194844 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:34.316107 19657 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:34.320441 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:34.344587 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 158674us
I20260709 13:19:34.344983 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:34.115185 24075 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.187002 24026 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:34.346294 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:34.387159 19658 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:34.346956 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:34.366955 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 179860us
W20260709 13:19:34.368705 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 251100us
W20260709 13:19:34.389946 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 188929us
I20260709 13:19:34.390758 19476 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:34.380123 19657 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:34.406401 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:34.407485 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:34.408221 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:34.408891 19655 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:34.151870 24168 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:34.394198 24201 log.cc:927] Time spent T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.297s	user 0.003s	sys 0.007s
I20260709 13:19:34.345930 24005 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:34.440244 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 70049.7us
I20260709 13:19:34.456067 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:34.456022 19655 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:19:34.463282 24217 consensus_queue.cc:1059] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 13:19:34.467504 24202 log.cc:927] Time spent T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.354s	user 0.000s	sys 0.001s
I20260709 13:19:34.398101 24135 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.476504 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:34.106786 19405 catalog_manager.cc:5697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 11 to 12, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 12 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:34.326893 24194 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.472174 24181 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:34.400564 24187 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:19:34.498610 24215 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:34.521850 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 130574us
W20260709 13:19:34.587755 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 197138us
W20260709 13:19:34.497336 24200 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.403s	user 0.001s	sys 0.000s
W20260709 13:19:34.591204 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 136070us
I20260709 13:19:34.499064 24188 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:34.474613 24005 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.345914 24197 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.498014 24028 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:34.509922 24205 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.400s	user 0.000s	sys 0.001s
I20260709 13:19:34.491650 24135 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:34.607420 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 130971us
I20260709 13:19:34.585215 24215 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.594461 24188 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.614063 24106 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:34.507711 24221 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 13:19:34.603065 24028 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.615726 24194 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:34.609737 24136 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.016s	sys 0.044s
W20260709 13:19:34.629338 23872 consensus_meta.cc:287] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.808s	user 0.011s	sys 0.000s
I20260709 13:19:34.593132 24214 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:19:34.616405 24188 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:34.646770 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 52581.9us
W20260709 13:19:34.645531 24136 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.017s	sys 0.045s
I20260709 13:19:34.638862 24062 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:34.645371 24181 raft_consensus.cc:697] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:34.695688 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 70490.6us
I20260709 13:19:34.689805 24194 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.661253 24154 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:34.652268 24028 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.739091 23906 consensus_queue.cc:1059] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:34.722065 24168 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:34.742455 24135 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:34.742821 24230 log.cc:927] Time spent T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:19:34.744046 24212 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:19:34.688549 24139 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:34.745256 24030 consensus_meta.cc:287] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.771s	user 0.010s	sys 0.003s
W20260709 13:19:34.767571 24231 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:19:34.752614 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:34.654258 23872 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.742877 24233 consensus_queue.cc:1059] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:19:34.766902 24030 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.708423 24229 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:34.765193 24137 consensus_meta.cc:287] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.916s	user 0.013s	sys 0.000s
I20260709 13:19:34.774435 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:34.802022 19660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2239) took 1202 ms (client timeout 1569 ms). Trace:
I20260709 13:19:34.745745 24194 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.732728 24062 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:34.798738 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 124945us
I20260709 13:19:34.799247 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:34.843170 19654 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:34.843645 19476 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:34.844478 24062 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.802933 19578 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:19:34.802476 19660 rpcz_store.cc:269] 0709 13:19:33.599815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.599974 (+   159us) service_pool.cc:224] Handling call
0709 13:19:34.798301 (+1198327us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400021554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:34.801963 (+  3662us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456427776}
I20260709 13:19:34.845273 19476 leader_election.cc:400] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13.
I20260709 13:19:34.867761 19476 leader_election.cc:403] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:34.802711 19509 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 17: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:34.846029 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:34.848592 19508 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:34.849978 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:34.846540 24214 raft_consensus.cc:3055] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:34.745311 19405 catalog_manager.cc:5697] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 12 to 16, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 16 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:34.873477 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:34.874544 19508 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:34.856688 24028 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:34.858980 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:34.859846 19579 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:34.860086 19512 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:19:34.860329 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 169791us
I20260709 13:19:34.862304 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:34.863262 19580 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:34.863468 19582 raft_consensus.cc:1275] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:34.871220 19503 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:34.877806 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:34.879000 19625 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:34.882304 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:34.775063 24139 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:19:34.774874 24135 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:19:34.885336 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:34.887818 24245 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.890251 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:34.890910 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:34.873731 24214 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:34.880198 23939 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:34.878664 24215 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:34.883708 24224 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13.
I20260709 13:19:34.884198 24005 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:34.902683 24215 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:34.903801 23872 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:34.906546 24178 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:34.907306 24026 consensus_meta.cc:287] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.001s
I20260709 13:19:34.907537 24214 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:34.908880 24227 log.cc:927] Time spent T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:19:34.908993 24214 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:34.886937 23692 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:34.846968 24229 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.896708 24245 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.912122 24229 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:34.900950 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:34.881335 24221 consensus_queue.cc:1059] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:19:34.907754 24026 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.922403 19511 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:34.918025 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:34.919040 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:34.917848 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:34.937747 19661 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:34.937976 19659 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:34.920387 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:34.939124 19476 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:34.941087 19660 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:34.942771 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:34.918299 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:34.846655 24181 consensus_queue.cc:237] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.969252 19655 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:34.888726 24137 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:19:34.974181 19551 leader_election.cc:400] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14.
I20260709 13:19:34.974587 19551 leader_election.cc:403] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:34.975873 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:34.919157 24218 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260709 13:19:34.913549 24245 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:34.919028 24194 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:34.966867 23872 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:34.935460 24168 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.934697 24028 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:34.918056 23692 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.919620 24221 raft_consensus.cc:3055] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:34.980008 19585 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:34.944698 24136 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:34.984848 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:34.971683 24224 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:34.969674 24106 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:34.991168 24247 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:34.982908 23669 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:35.003185 23692 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.003917 24221 raft_consensus.cc:740] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:35.006415 19659 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:35.009136 24135 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:35.009317 24255 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:35.004554 24136 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.022655 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:35.022904 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.028419 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:34.985114 24140 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:34.991221 23872 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.081950 23872 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:34.984926 24240 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:35.089998 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2384) took 1007 ms. Trace:
I20260709 13:19:35.090580 19584 rpcz_store.cc:276] 0709 13:19:34.082261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.084630 (+  2369us) service_pool.cc:224] Handling call
0709 13:19:34.085052 (+   422us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:34.085539 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.085576 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:34.090267 (+  4691us) log.cc:844] Serialized 52 byte log entry
0709 13:19:34.184636 (+ 94369us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:34.184696 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.184800 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.089706 (+904906us) raft_consensus.cc:1685] finished
0709 13:19:35.089735 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.089921 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1931,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":8323,"thread_start_us":68269,"threads_started":1,"wal-append.queue_time_us":384119}
I20260709 13:19:34.984997 24188 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:34.997068 24150 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:34.986536 24238 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14.
I20260709 13:19:35.028621 24247 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.106106 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:35.080878 24140 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:35.097406 19653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2242) took 1495 ms (client timeout 1690 ms). Trace:
I20260709 13:19:34.914978 19405 catalog_manager.cc:5697] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 11 to 15, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 15 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:35.098379 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:35.099480 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 86419.4us
I20260709 13:19:35.102942 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:34.996507 24168 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.108445 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.109992 19659 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:35.110327 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:35.026618 24160 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:35.114537 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:35.112461 19653 rpcz_store.cc:269] 0709 13:19:33.601819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.610106 (+  8287us) service_pool.cc:224] Handling call
0709 13:19:35.097187 (+1487081us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54003f3254. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:35.097341 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":747489152}
I20260709 13:19:35.030965 24106 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.129448 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:35.116325 24241 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:19:35.105842 24247 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:35.068977 24224 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.075382 23669 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.076969 24135 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:35.144631 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:35.156632 19507 raft_consensus.cc:2368] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16.
I20260709 13:19:35.128949 24030 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:35.160300 19551 leader_election.cc:400] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16.
I20260709 13:19:35.077430 24255 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.164122 19551 leader_election.cc:403] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:19:35.111696 24150 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:35.168097 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 51297us
I20260709 13:19:35.140375 24062 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:35.182210 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:35.128954 24160 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.186909 19659 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:35.196945 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:35.175464 24214 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:35.175254 24249 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.123170 24221 consensus_queue.cc:260] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.186062 24026 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:35.257017 19653 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:35.257081 19659 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:35.260975 24259 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:35.261248 24106 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:35.238478 23933 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.247577 24262 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:35.261737 24259 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:35.275694 24136 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:35.275579 24262 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:35.276973 24188 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:35.277429 24186 consensus_meta.cc:287] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 1.162s	user 0.004s	sys 0.009s
I20260709 13:19:35.278100 24224 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:35.278519 24258 log.cc:927] Time spent T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:19:35.279342 23933 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.263957 24221 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:35.289736 19551 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.131:33295 timed out after 1.690s (SENT) [suppressed 4 similar messages]
I20260709 13:19:35.273586 24261 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:35.291790 23692 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:35.246928 24249 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.294291 24140 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:35.334560 24150 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:35.245250 19405 catalog_manager.cc:5697] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 13 to 14, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 14 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:35.345009 24160 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:35.347999 24233 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.348464 24249 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:35.290287 24186 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.319211 24168 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:35.348547 24233 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.360006 23669 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:35.360623 23669 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.361061 23669 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.361389 24233 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:35.363847 24262 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:35.366125 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:35.367208 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:35.368609 19657 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:35.369392 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:35.370117 19657 raft_consensus.cc:2410] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:19:35.311161 24261 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:35.374989 24168 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:35.375804 24261 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:35.375641 24168 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:35.376331 24261 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:35.378434 24168 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:35.379981 19405 catalog_manager.cc:5697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 6 to 12, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 12 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:35.382308 19505 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:35.383741 24186 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:35.386722 23933 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:35.387530 23872 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.388149 24259 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:35.378574 24093 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:35.403311 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:35.407073 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:35.345026 24247 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.408103 19657 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:35.402341 19505 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:35.410524 24247 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:35.413703 19657 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:35.415405 19476 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:35.416812 19476 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:35.363093 23669 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:35.420712 19656 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:35.376797 24261 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.426246 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:35.427381 19476 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:35.428246 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:35.428468 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:35.429433 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:35.390666 23872 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:35.443054 19509 raft_consensus.cc:3055] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:35.443627 19509 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:35.444579 19509 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.445858 24251 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:35.446396 24251 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.446832 24251 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:35.447300 24203 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 1.253s	user 0.002s	sys 0.000s
I20260709 13:19:35.440732 19476 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:35.451749 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.451817 19509 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:35.454648 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.422706 24186 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:35.457592 19506 raft_consensus.cc:3055] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:35.458053 19506 raft_consensus.cc:740] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:35.459479 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.413947 24093 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:35.465750 23872 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:35.466507 23872 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.440155 24207 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:35.469707 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 180013us
I20260709 13:19:35.458875 19506 consensus_queue.cc:260] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.479175 24243 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
W20260709 13:19:35.492214 19585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 2386) took 1409 ms (client timeout 1845 ms). Trace:
I20260709 13:19:35.492905 24214 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16.
I20260709 13:19:35.454056 24178 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:35.452733 24255 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:35.460600 24224 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 13:19:35.492751 19585 rpcz_store.cc:269] 0709 13:19:34.082907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.086139 (+  3232us) service_pool.cc:224] Handling call
0709 13:19:35.492007 (+1405868us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b54002279d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:35.492147 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2025333120}
I20260709 13:19:35.497241 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:35.648505 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.495719 24178 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:35.670341 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.423333 19405 catalog_manager.cc:5697] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:35.733954 24178 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:35.740345 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:35.741168 19653 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:35.709906 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.742261 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:35.742996 19653 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:35.743573 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.744844 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.745886 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.742090 24275 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:35.746649 19657 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:35.696203 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.748625 24026 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:35.748365 24093 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:35.752800 19653 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:35.771824 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:35.772997 19653 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:35.811623 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.700932 24143 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:19:35.813658 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 60454.2us
W20260709 13:19:35.812014 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 62406.9us
I20260709 13:19:35.712406 24214 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:35.701997 24255 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:35.821051 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.678969 24233 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:35.829847 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:35.830816 19656 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:35.833721 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.835813 19507 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:35.839708 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.821022 24186 raft_consensus.cc:697] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:35.838197 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.870862 19625 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:35.867813 19657 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:19:35.873183 19657 pending_rounds.cc:85] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 9
I20260709 13:19:35.873445 19657 pending_rounds.cc:107] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:19:35.873716 19657 raft_consensus.cc:2889] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:35.878300 19625 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:35.879642 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.882858 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.884639 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.885887 24168 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:35.857710 24233 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.892359 24233 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:35.892936 24233 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.825387 24143 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.893723 24270 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:35.880360 19510 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:35.902799 19656 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:35.907063 19509 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:19:35.908092 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.840353 24268 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.911794 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:35.867329 19405 catalog_manager.cc:5697] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 7 to 14, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 14 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:35.913573 23872 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:35.916010 19510 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:35.869889 24261 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:35.954895 19507 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:35.956984 19507 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:35.822113 24275 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:35.821022 24026 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:35.954142 24221 consensus_meta.cc:287] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.661s	user 0.018s	sys 0.002s
I20260709 13:19:35.973870 24026 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:35.926131 24268 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.976514 24268 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:35.893399 24233 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.978396 19508 raft_consensus.cc:2410] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:19:35.962980 19509 pending_rounds.cc:85] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 9
I20260709 13:19:35.979842 19509 pending_rounds.cc:107] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:19:35.980188 19509 raft_consensus.cc:2889] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:35.968607 24143 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:35.968988 19507 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:35.843523 24214 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.908622 24270 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.970276 23872 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:35.971776 24275 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:35.965934 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 145776us
I20260709 13:19:35.982719 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:35.843051 24255 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.015548 19510 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:35.983608 24070 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:35.986968 24026 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:35.985529 23862 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:36.039780 23862 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:36.038690 24214 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:35.989574 24270 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.996007 24143 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:35.989528 23872 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:36.071273 24234 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 1.433s	user 0.006s	sys 0.000s
I20260709 13:19:36.066097 24214 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:36.041874 24070 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.014796 24186 consensus_queue.cc:237] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:35.973407 19405 catalog_manager.cc:5697] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 9 to 10, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 10 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:36.114400 23862 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:36.115242 23862 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:36.115847 23862 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:36.119074 24235 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 1.316s	user 0.003s	sys 0.008s
I20260709 13:19:36.121383 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2393) took 1972 ms. Trace:
I20260709 13:19:36.121809 19580 rpcz_store.cc:276] 0709 13:19:34.148696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.148847 (+   151us) service_pool.cc:224] Handling call
0709 13:19:34.149156 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.878588 (+729432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.121106 (+1242518us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b5400268254. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:36.121314 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1641722112}
I20260709 13:19:36.122656 23872 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:36.123167 19652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 2251) took 1713 ms. Trace:
W20260709 13:19:36.124001 24278 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 13:19:36.125211 19578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2785) took 2099 ms (client timeout 1666 ms). Trace:
W20260709 13:19:36.131196 24251 consensus_meta.cc:287] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.000s
I20260709 13:19:36.131654 24251 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.069578 24026 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.074848 24143 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:36.137735 19578 rpcz_store.cc:269] 0709 13:19:34.025900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.026045 (+   145us) service_pool.cc:224] Handling call
0709 13:19:36.124962 (+2098917us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b54003d04d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:36.125096 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1777096960}
I20260709 13:19:36.140470 19625 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:36.104813 24282 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:36.085347 24214 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.123553 19652 rpcz_store.cc:276] 0709 13:19:34.409973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.456891 (+ 46918us) service_pool.cc:224] Handling call
0709 13:19:34.457179 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.457495 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.457524 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:34.457968 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:19:34.605719 (+147751us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:34.605780 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.605878 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.118433 (+1512555us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:36.122843 (+  4410us) raft_consensus.cc:1685] finished
0709 13:19:36.122865 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.123082 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9453,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":89,"spinlock_wait_cycles":90002688,"thread_start_us":99074,"threads_started":1,"wal-append.queue_time_us":217338}
I20260709 13:19:36.151013 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:36.178032 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:36.178934 19659 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
W20260709 13:19:36.191402 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 294307us
I20260709 13:19:36.289796 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:36.176952 24257 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:36.291038 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:36.142086 23872 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:36.146303 24197 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:36.295008 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.314567 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:36.312536 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:36.316861 19652 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:36.322449 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:36.180573 24150 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 13:19:36.330260 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:36.331194 19652 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:36.181936 23709 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.129s
W20260709 13:19:36.312728 24234 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.132s	user 0.009s	sys 0.000s
I20260709 13:19:36.176419 24282 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:36.297916 23669 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:19:36.303105 24257 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.312256 24283 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:36.318198 24164 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:36.355748 24283 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.355870 24164 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.303978 24261 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:19:36.362537 24255 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:36.359941 24257 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:36.466014 24070 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:36.466643 24070 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:36.467104 24070 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.469133 24070 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:36.331418 19405 catalog_manager.cc:5697] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:36.470422 24270 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:36.472160 24251 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:36.326490 24197 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.475432 24197 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:36.475967 24197 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:36.476177 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:36.476511 24197 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:36.476967 19510 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 14.
I20260709 13:19:36.318121 23872 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.444160 24296 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:36.478643 24296 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.479331 23872 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:36.479900 23872 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.448508 24143 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:36.449090 24282 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:19:36.449793 24288 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:19:36.351604 23862 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:36.501298 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:36.501581 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:36.502494 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:36.480353 23872 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:36.481117 24178 consensus_meta.cc:287] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.743s	user 0.012s	sys 0.000s
I20260709 13:19:36.515389 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:36.516988 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:36.512444 24143 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:36.519680 24143 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.522692 24296 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:36.525795 24283 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:36.472410 19405 catalog_manager.cc:5697] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 15 to 16, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 16 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:36.481770 24070 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:36.530601 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:36.532200 24282 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.532398 24197 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:36.532743 23872 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:36.532815 24282 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.527931 24178 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.513465 24293 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:36.510865 24261 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:19:36.535516 24305 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:36.535892 24296 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:36.542398 23872 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:36.546407 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:36.550278 24305 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.553470 24305 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:36.555109 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.555881 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:36.537355 24070 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.540591 24293 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.720237 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2397) took 2559 ms. Trace:
I20260709 13:19:36.702989 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:36.875909 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 377961us
I20260709 13:19:36.920854 19510 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:19:36.700217 19507 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:36.560868 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:36.925367 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:36.920279 19581 rpcz_store.cc:276] 0709 13:19:34.161070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.347500 (+186430us) service_pool.cc:224] Handling call
0709 13:19:34.347893 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:34.376231 (+ 28338us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:34.405396 (+ 29165us) log.cc:844] Serialized 14 byte log entry
0709 13:19:34.868664 (+463268us) log.cc:844] Serialized 14 byte log entry
0709 13:19:34.874604 (+  5940us) log.cc:844] Serialized 14 byte log entry
0709 13:19:34.874795 (+   191us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:35.910509 (+1035714us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:36.476560 (+566051us) spinlock_profiling.cc:243] Waited 77.8 ms on lock 0x7b2c0002d418. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:19:36.477128 (+   568us) log.cc:844] Serialized 52 byte log entry
0709 13:19:36.477303 (+   175us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:36.500228 (+ 22925us) log.cc:844] Serialized 14 byte log entry
0709 13:19:36.511138 (+ 10910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.511273 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.719897 (+208624us) raft_consensus.cc:1685] finished
0709 13:19:36.719927 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.720132 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37552,"prepare.queue_time_us":96583,"prepare.run_cpu_time_us":164,"prepare.run_wall_time_us":3175,"raft.queue_time_us":128166,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":48199,"spinlock_wait_cycles":251312000,"thread_start_us":401850,"threads_started":3,"wal-append.queue_time_us":152325}
I20260709 13:19:36.990918 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:36.976342 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 51048.7us
I20260709 13:19:36.976843 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:37.014940 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:37.015892 19652 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
W20260709 13:19:36.990854 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.721155 24204 log.cc:927] Time spent T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 2.352s	user 0.000s	sys 0.003s
W20260709 13:19:37.022218 19511 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 2212) took 2147 ms (client timeout 1662 ms). Trace:
W20260709 13:19:36.718128 24294 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
W20260709 13:19:37.030057 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 98913.2us
I20260709 13:19:36.829879 24282 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:36.587390 24186 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.699487 24277 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:36.557307 24178 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:37.035910 19505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 3027) took 2186 ms (client timeout 1666 ms). Trace:
I20260709 13:19:37.041770 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:37.036350 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:37.024816 19511 rpcz_store.cc:269] 0709 13:19:34.862362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.872039 (+  9677us) service_pool.cc:224] Handling call
0709 13:19:37.009480 (+2137441us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b54002a1f54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:37.009699 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75853696}
I20260709 13:19:36.721802 24143 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.013885 24303 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:19:37.041074 19654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 2428) took 2842 ms (client timeout 3274 ms). Trace:
W20260709 13:19:37.042181 19505 rpcz_store.cc:269] 0709 13:19:34.849569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.859463 (+  9894us) service_pool.cc:224] Handling call
0709 13:19:37.035655 (+2176192us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54002071d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:37.035815 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148562304}
I20260709 13:19:37.020912 24229 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:37.013480 24305 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.114671 24305 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.115401 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2214) took 2234 ms. Trace:
I20260709 13:19:37.115753 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:37.116761 24305 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:36.723997 24222 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:37.115953 19503 rpcz_store.cc:276] 0709 13:19:34.880978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.881712 (+   734us) service_pool.cc:224] Handling call
0709 13:19:34.882036 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.971111 (+ 89075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.971178 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:36.548180 (+1577002us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b2c00000c88. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:19:36.548704 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:19:36.999350 (+450646us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:36.999410 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.012279 (+ 12869us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:37.115015 (+102736us) raft_consensus.cc:1685] finished
0709 13:19:37.115040 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:37.115304 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20509,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":13163264,"thread_start_us":535696,"threads_started":2,"wal-append.queue_time_us":488919}
I20260709 13:19:37.116953 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:37.119237 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:37.120004 19652 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:36.551102 24296 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.175495 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:37.024499 24197 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:37.021139 24306 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:36.714264 24257 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.565984 23872 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:37.107311 19654 rpcz_store.cc:269] 0709 13:19:34.194028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.194176 (+   148us) service_pool.cc:224] Handling call
0709 13:19:37.036679 (+2842503us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b54000adf54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:37.036805 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1212814592}
I20260709 13:19:37.091181 24129 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:37.113312 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:37.113900 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.117724 24222 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:36.703059 24221 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:37.138233 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:37.220618 19510 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:37.043644 24173 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.059847 23669 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:37.185576 20619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.038s	sys 0.083s
W20260709 13:19:37.225008 20619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.039s	sys 0.083s
I20260709 13:19:37.188962 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:37.203043 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:37.204488 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 193352us
I20260709 13:19:37.226824 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:37.228746 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.228926 19585 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:37.229357 19581 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:37.229933 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.230508 19587 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:37.230593 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:37.225414 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 675680us
I20260709 13:19:37.231353 19581 raft_consensus.cc:2410] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:19:37.232484 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.232825 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:37.051867 24317 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:37.211941 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:37.217938 19477 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.001s	sys 0.023s
I20260709 13:19:37.233546 19581 raft_consensus.cc:2410] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:19:37.234714 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.234848 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:37.184854 24282 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.232182 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:37.238372 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.253242 19586 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:37.253758 19503 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 14: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:19:37.253796 19477 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.001s	sys 0.023s
I20260709 13:19:37.254321 19582 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:37.254613 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:37.255052 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.255334 19505 raft_consensus.cc:2393] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:37.052798 24277 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.258347 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:37.044023 24186 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.212705 24306 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:37.218698 24310 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.270393 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:37.225325 24195 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:37.204962 24197 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.136767 24303 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:37.290534 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 277948us
I20260709 13:19:37.294790 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:37.304232 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.316757 19585 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:37.317235 19654 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:37.305590 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.318924 19582 raft_consensus.cc:2410] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:19:37.307021 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.308292 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.319818 19586 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:37.320053 19587 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:37.321746 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.322224 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.323205 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.323576 19581 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:37.324240 19587 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 15: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:37.308521 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.325227 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.326735 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.327970 24152 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.328611 24152 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.231676 24221 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.234819 23669 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.325295 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.261839 24282 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.340831 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.235859 24129 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:37.297641 23862 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:37.344626 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:37.349843 19652 raft_consensus.cc:2410] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:19:37.336649 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.351223 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:37.301344 24319 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.352995 19586 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:37.352432 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:37.259722 24317 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.386554 19584 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:37.235679 24173 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.388447 24319 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.400522 19511 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:37.345978 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:37.401865 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 168231us
I20260709 13:19:37.401706 19581 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:37.420823 19505 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:37.277484 24310 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.424547 19510 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:37.422194 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.430253 19586 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:37.401526 24318 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.401651 24320 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:37.333093 24195 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.404455 24070 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.425947 19581 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
W20260709 13:19:37.426509 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 74192.6us
I20260709 13:19:37.444669 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.425503 24106 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:37.386719 23862 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.446100 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:37.438613 24332 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:19:37.450410 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 47571.8us
I20260709 13:19:37.459369 24319 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.459543 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2399) took 3296 ms. Trace:
I20260709 13:19:37.439945 24321 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:37.457233 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:37.460727 19583 rpcz_store.cc:276] 0709 13:19:34.163567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.470295 (+306728us) service_pool.cc:224] Handling call
0709 13:19:34.470596 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.470921 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.470951 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:36.919860 (+2448909us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b2c0002d418. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:19:36.920339 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:19:37.288582 (+368243us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:37.288643 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.288749 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:37.459228 (+170479us) raft_consensus.cc:1685] finished
0709 13:19:37.459252 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:37.459476 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":306,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":12785,"spinlock_wait_cycles":7248640,"thread_start_us":247457,"threads_started":1,"wal-append.queue_time_us":405562}
W20260709 13:19:37.466915 20619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.427953 24323 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:37.472395 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.473580 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.459471 23872 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.438741 24331 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:37.481467 19583 raft_consensus.cc:2410] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:37.436058 24239 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:37.461810 24070 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:37.462699 24257 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:37.472087 24321 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.403586 24306 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.486887 24319 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:37.442224 24318 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.482518 24331 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:37.505656 23669 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:37.495265 24186 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.500833 24070 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.446412 24320 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.509918 24331 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:37.519037 24321 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:37.522533 24324 log.cc:927] Time spent T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:19:37.534225 24173 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.534953 24334 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.535362 24206 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:37.509500 24319 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:37.544086 24303 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.461552 24106 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:37.504366 24277 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:37.550839 19508 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 3031) took 2455 ms (client timeout 1783 ms). Trace:
I20260709 13:19:37.548995 24282 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:37.575340 19508 rpcz_store.cc:269] 0709 13:19:35.095131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.096115 (+   984us) service_pool.cc:224] Handling call
0709 13:19:37.550632 (+2454517us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b540003d4d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:37.550769 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1973201664}
I20260709 13:19:37.576397 24310 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.576587 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:37.537876 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:37.577950 19656 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:37.578464 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2277) took 1073 ms. Trace:
I20260709 13:19:37.546123 24217 raft_consensus.cc:3055] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:37.556125 24233 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.557245 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:37.584998 19504 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:37.561558 19657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59942 (request call id 297) took 2189 ms. Trace:
I20260709 13:19:37.585820 19657 rpcz_store.cc:276] 0709 13:19:35.372191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.874643 (+502452us) service_pool.cc:224] Handling call
0709 13:19:35.909318 (+ 34675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.909540 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:36.181348 (+271808us) log.cc:844] Serialized 14 byte log entry
0709 13:19:37.561016 (+1379668us) spinlock_profiling.cc:243] Waited 63.3 ms on lock 0x7b180034fc60. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c313024bc 00007f6c2e65048b 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa23a
0709 13:19:37.561223 (+   207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:37.561273 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:37.561317 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.561379 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:37.561499 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":440822,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":5229,"raft.queue_time_us":7082,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":145517824,"thread_start_us":426304,"threads_started":2,"wal-append.queue_time_us":280557,"wal-append.run_cpu_time_us":1004,"wal-append.run_wall_time_us":1003776}
I20260709 13:19:37.569242 19581 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:37.548440 24070 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:37.496748 24239 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.566834 24129 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:37.578877 19656 rpcz_store.cc:276] 0709 13:19:36.504721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.514347 (+  9626us) service_pool.cc:224] Handling call
0709 13:19:37.537648 (+1023301us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b58000e1c98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:19:37.578410 (+ 40762us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15753472}
I20260709 13:19:37.601948 24164 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:37.484130 24323 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.570539 24319 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:37.581228 24217 raft_consensus.cc:740] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:37.567610 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:37.594094 24318 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.550314 24221 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.600653 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:37.579973 24135 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:37.552289 24206 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:37.608997 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 134947us
I20260709 13:19:37.568033 24317 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.638280 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:37.557520 24334 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.613369 24026 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.645979 24320 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.655829 19510 raft_consensus.cc:2410] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:37.616329 24331 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:37.661276 19551 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:37.668992 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:37.668082 19478 connection.cc:256] RPC call timeout handler was delayed by -1.8261105389999557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 13:19:37.674319 19478 connection.cc:256] RPC call timeout handler was delayed by -1.1972338359998957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
W20260709 13:19:37.678484 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.652431 24217 consensus_queue.cc:260] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.664044 24026 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:37.665442 24317 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:19:37.695981 20629 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.666369 23863 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:37.703900 24317 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:37.704385 23863 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.706353 23863 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.702068 24217 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:37.706918 24206 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.696578 24026 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:37.708019 24026 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:37.668474 23872 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:37.710278 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:37.711333 19586 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:37.680574 24282 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:37.731540 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 46195.2us
I20260709 13:19:37.750178 24152 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:37.758970 20631 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:37.760987 24229 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:37.761258 24323 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.761515 24229 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:37.762060 24275 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:37.764842 24317 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:37.742133 24282 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:37.805193 24282 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:37.805361 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.809811 24323 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.828651 19506 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:37.834954 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 56937.7us
I20260709 13:19:37.813385 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.836333 19583 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:19:37.812055 19587 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:37.837519 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.838411 19583 raft_consensus.cc:2410] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:19:37.838241 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.840131 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.842549 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.727280 24339 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:37.844098 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.844586 19551 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:37.845788 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 77051.4us
I20260709 13:19:37.746723 24334 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.847857 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:37.844390 24197 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.898151 24106 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:37.900342 19583 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:37.856691 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:19:37.852762 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:37.903352 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 58837.9us
I20260709 13:19:37.903486 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:37.903581 19506 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:19:37.904923 19506 pending_rounds.cc:85] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 5
I20260709 13:19:37.905288 19506 pending_rounds.cc:107] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:19:37.905727 19506 raft_consensus.cc:2889] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:37.906458 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:37.906766 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3044) took 2464 ms. Trace:
I20260709 13:19:37.907452 19506 rpcz_store.cc:276] 0709 13:19:35.442717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.449598 (+  6881us) service_pool.cc:224] Handling call
0709 13:19:35.457461 (+  7863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:37.828378 (+2370917us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b58000548d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316b60aa 00007f6c31738447 00007f6c31750fe7 00007f6c317527de 00007f6c3175cb49 00007f6c3175d416 00007f6c31759d8f 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4
0709 13:19:37.906386 (+ 78008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.906687 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4848009600}
W20260709 13:19:37.843972 19405 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.006s	user 0.019s	sys 0.008s
W20260709 13:19:37.910719 24192 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:19:37.925159 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:37.890710 24243 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:37.847627 24005 consensus_queue.cc:1059] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:19:37.914111 24331 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.900959 24195 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.892227 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:37.937652 20659 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:37.918301 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:37.939214 19507 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:37.810216 24239 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:37.923692 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:37.909188 24306 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:37.922097 19405 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.024s	sys 0.014s
I20260709 13:19:37.810375 24323 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.927496 23872 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:19:37.957818 24282 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.904822 24319 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.926811 24243 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.927794 24335 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.922401 24106 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.965149 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3032) took 2869 ms. Trace:
I20260709 13:19:37.969785 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 2235) took 1264 ms. Trace:
I20260709 13:19:38.022405 19511 rpcz_store.cc:276] 0709 13:19:36.705741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.107536 (+401795us) service_pool.cc:224] Handling call
0709 13:19:37.969524 (+861988us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54002080d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:37.969684 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401308544}
I20260709 13:19:37.975427 24026 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.991312 19507 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 15.
W20260709 13:19:37.993309 19625 connection.cc:256] RPC call timeout handler was delayed by -1.2748457440000038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
W20260709 13:19:37.994275 20619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.025769 24106 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:37.920465 24197 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:38.001708 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 78079.2us
I20260709 13:19:38.006984 24306 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
W20260709 13:19:38.010416 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 163919us
I20260709 13:19:37.922900 24339 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:38.021422 19512 rpcz_store.cc:276] 0709 13:19:35.095429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.096459 (+  1030us) service_pool.cc:224] Handling call
0709 13:19:35.096712 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.167458 (+ 70746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.167479 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:35.167508 (+    29us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:35.167533 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.964911 (+2797378us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b5400208ad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:37.964962 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:37.965092 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161436544}
I20260709 13:19:38.025295 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:19:38.132344 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 107172us
I20260709 13:19:38.132553 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:37.995170 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:38.133167 19512 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:38.134146 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:38.026913 24026 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:38.027643 24293 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:38.001443 24260 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:38.031620 19587 raft_consensus.cc:2393] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 12: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:38.032775 24319 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:38.033934 24222 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:38.011826 24239 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:38.036365 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:38.038187 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:38.038022 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:38.078136 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:38.080094 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:38.036741 19625 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:38.020605 24335 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:38.140193 19507 raft_consensus.cc:2376] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14. Re-sending same reply.
I20260709 13:19:38.143603 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:38.142632 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:38.148218 19580 raft_consensus.cc:2368] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14.
I20260709 13:19:38.078884 24306 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:38.149858 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:38.128029 24338 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.148941 19512 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:38.143093 19511 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:19:38.152806 19627 leader_election.cc:336] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.573s (SENT)
I20260709 13:19:38.048861 24197 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:38.037024 24070 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:38.128566 24229 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:38.153791 19580 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [8.5-9.6]
W20260709 13:19:38.812086 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 614303us
W20260709 13:19:38.153905 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:38.815712 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.272332 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:38.189299 24272 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.713989 24339 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:38.817816 24272 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:38.818249 24338 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:38.820528 24272 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:38.894773 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:38.811650 20629 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.817191 24323 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:38.896888 24249 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:38.386139 24160 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:38.188985 24312 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:38.822057 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:38.824276 19655 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:38.812619 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2408) took 1146 ms. Trace:
W20260709 13:19:38.900260 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 747455us
I20260709 13:19:38.900067 19580 rpcz_store.cc:276] 0709 13:19:37.665928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.153009 (+487081us) service_pool.cc:224] Handling call
0709 13:19:38.153522 (+   513us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:38.812250 (+658728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.812552 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:38.813352 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.901115 19660 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:38.901515 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:38.478152 20619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:38.902335 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.825359 19511 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:19:38.821210 24338 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:38.180912 24137 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:38.825412 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:38.907661 19653 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:38.895288 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 78544.6us
I20260709 13:19:38.394675 23708 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.827402 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:38.870800 24306 consensus_meta.cc:287] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.681s	user 0.013s	sys 0.000s
I20260709 13:19:38.839352 24106 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:38.329285 24161 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.881433 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60692 (request call id 256) took 1213 ms. Trace:
I20260709 13:19:38.928174 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2409) took 1254 ms. Trace:
I20260709 13:19:38.958379 19508 rpcz_store.cc:276] 0709 13:19:37.668190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.668315 (+   125us) service_pool.cc:224] Handling call
0709 13:19:37.985708 (+317393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:37.985987 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.986034 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:37.986097 (+    63us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:37.986149 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.986232 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.881195 (+894963us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54002080d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:38.881351 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675475200}
I20260709 13:19:38.958979 19580 rpcz_store.cc:276] 0709 13:19:37.673596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.927136 (+1253540us) service_pool.cc:224] Handling call
0709 13:19:38.927450 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:38.927706 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:38.927745 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:38.927805 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:38.927855 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.927931 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.928099 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:38.892891 19657 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:38.826733 19581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2825) took 1404 ms (client timeout 1511 ms). Trace:
W20260709 13:19:38.960606 19581 rpcz_store.cc:269] 0709 13:19:37.424101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.444314 (+ 20213us) service_pool.cc:224] Handling call
0709 13:19:38.826541 (+1382227us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54002274d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:38.826667 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283036544}
W20260709 13:19:38.832959 19584 consensus_meta.cc:287] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.682s	user 0.011s	sys 0.011s
I20260709 13:19:38.961508 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:38.961715 19584 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:38.962200 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 2419) took 1042 ms. Trace:
I20260709 13:19:38.962598 19584 rpcz_store.cc:276] 0709 13:19:37.920132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.149606 (+229474us) service_pool.cc:224] Handling call
0709 13:19:38.962141 (+812535us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:38.154163 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 117511us
I20260709 13:19:38.892990 23862 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:38.378523 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:38.965054 19580 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:38.887748 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:38.189270 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 2250) took 3782 ms. Trace:
I20260709 13:19:38.889091 24282 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:38.965617 19582 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:19:38.897329 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:38.970757 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2818) took 1660 ms. Trace:
W20260709 13:19:38.970949 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 73693.9us
I20260709 13:19:38.879897 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:38.387365 24271 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:38.132159 24261 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:38.904795 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:38.139672 24239 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:38.912642 19578 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
W20260709 13:19:38.984019 19578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2823) took 1590 ms (client timeout 1744 ms). Trace:
W20260709 13:19:38.984581 19578 rpcz_store.cc:269] 0709 13:19:37.394561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.275896 (+881335us) service_pool.cc:224] Handling call
0709 13:19:38.983944 (+708048us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:38.862475 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:38.927383 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:38.189793 24214 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:38.892107 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3064) took 3006 ms. Trace:
I20260709 13:19:38.967892 19653 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:38.881114 24296 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:38.969481 19584 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:19:38.990623 19584 pending_rounds.cc:85] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 7
I20260709 13:19:38.990927 19584 pending_rounds.cc:107] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:19:38.991235 19584 raft_consensus.cc:2889] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:38.992084 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2414) took 1134 ms. Trace:
I20260709 13:19:38.992514 19584 rpcz_store.cc:276] 0709 13:19:37.857240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.968797 (+1111557us) service_pool.cc:224] Handling call
0709 13:19:38.969146 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:38.991783 (+ 22637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.992018 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:38.971854 19659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2276) took 2467 ms (client timeout 2544 ms). Trace:
W20260709 13:19:38.993793 19659 rpcz_store.cc:269] 0709 13:19:36.504464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.518451 (+ 13987us) service_pool.cc:224] Handling call
0709 13:19:38.879712 (+2361261us) spinlock_profiling.cc:243] Waited 7.99 ms on lock 0x7b58000e1c98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:19:38.971799 (+ 92087us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18372864}
I20260709 13:19:38.973217 19581 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:19:38.966060 19658 rpcz_store.cc:276] 0709 13:19:34.406954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.410994 (+  4040us) service_pool.cc:224] Handling call
0709 13:19:34.471744 (+ 60750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.626572 (+154828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.626625 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:34.627286 (+   661us) log.cc:844] Serialized 26 byte log entry
0709 13:19:34.805561 (+178275us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:34.953157 (+147596us) log.cc:844] Serialized 14 byte log entry
0709 13:19:34.982072 (+ 28915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.085204 (+103132us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b180018f340. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:19:38.188860 (+3103656us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54000e79d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:38.188937 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.188990 (+    53us) raft_consensus.cc:1685] finished
0709 13:19:38.189001 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.189164 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18825,"prepare.queue_time_us":83964,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":39679,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":37660,"spinlock_wait_cycles":336674816,"thread_start_us":147134,"threads_started":1,"wal-append.queue_time_us":246973,"wal-append.run_cpu_time_us":12109,"wal-append.run_wall_time_us":1397424}
I20260709 13:19:38.912108 24272 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:38.971087 19582 rpcz_store.cc:276] 0709 13:19:37.310520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.887385 (+1576865us) service_pool.cc:224] Handling call
0709 13:19:38.970697 (+ 83312us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:38.144392 24260 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:38.893013 24070 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:38.903694 24197 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:38.884653 24243 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:38.980497 19655 raft_consensus.cc:2368] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14.
I20260709 13:19:38.982587 19580 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:38.956775 24327 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:19:38.986821 24239 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:38.997987 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2418) took 1078 ms. Trace:
I20260709 13:19:38.987218 19509 rpcz_store.cc:276] 0709 13:19:35.885324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.986252 (+100928us) service_pool.cc:224] Handling call
0709 13:19:35.988379 (+  2127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:37.663255 (+1674876us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:37.696468 (+ 33213us) log.cc:844] Serialized 14 byte log entry
0709 13:19:37.876308 (+179840us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:37.876364 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:37.876412 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.891875 (+1015463us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b54001ef0d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:38.891923 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.892048 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41,"prepare.queue_time_us":181859,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":16004,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":7560,"spinlock_wait_cycles":3851401600,"thread_start_us":206442,"threads_started":2,"wal-append.queue_time_us":214540,"wal-append.run_cpu_time_us":1015,"wal-append.run_wall_time_us":1017843}
I20260709 13:19:38.964289 24312 raft_consensus.cc:697] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 15 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:19:39.000840 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2413) took 1150 ms. Trace:
I20260709 13:19:39.003943 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:39.012861 19581 rpcz_store.cc:276] 0709 13:19:37.850361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.972400 (+1122039us) service_pool.cc:224] Handling call
0709 13:19:38.972792 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:38.995950 (+ 23158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.000775 (+  4825us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:39.014693 19581 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:19:39.004892 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2417) took 1085 ms. Trace:
I20260709 13:19:39.006249 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:39.016528 19655 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:39.016290 19578 rpcz_store.cc:276] 0709 13:19:37.919422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.985518 (+1066096us) service_pool.cc:224] Handling call
0709 13:19:39.004398 (+ 18880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.004577 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.004600 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.004652 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:39.004689 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.004739 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.004839 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:39.007395 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2416) took 1088 ms. Trace:
W20260709 13:19:39.002235 24268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.014s	sys 0.065s
I20260709 13:19:39.008817 19657 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:38.930873 23708 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:38.980182 24285 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:38.911809 24160 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:39.004428 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:39.019387 24268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.014s	sys 0.066s
I20260709 13:19:38.958583 24306 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:38.969605 24161 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:38.906898 24249 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:39.019487 19658 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:39.010710 19584 rpcz_store.cc:276] 0709 13:19:37.919786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.993389 (+1073603us) service_pool.cc:224] Handling call
0709 13:19:38.997351 (+  3962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:38.997560 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:38.997595 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:38.997683 (+    88us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:38.997728 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.997797 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.997920 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:39.031810 19660 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:39.033228 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2425) took 1106 ms. Trace:
I20260709 13:19:39.020486 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2421) took 1094 ms. Trace:
I20260709 13:19:39.033583 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:38.978134 24106 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:19:39.033819 19581 rpcz_store.cc:276] 0709 13:19:37.925626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.013916 (+1088290us) service_pool.cc:224] Handling call
0709 13:19:39.014289 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.015080 (+   791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.020412 (+  5332us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:39.033573 19584 rpcz_store.cc:276] 0709 13:19:37.926872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.032474 (+1105602us) service_pool.cc:224] Handling call
0709 13:19:39.032761 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.032928 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.032950 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.032988 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:39.033023 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.033077 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.033176 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:39.021987 24285 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:39.037446 19584 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:39.038102 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2427) took 1093 ms. Trace:
I20260709 13:19:38.979876 24271 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:39.040571 24271 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:39.038537 19584 rpcz_store.cc:276] 0709 13:19:37.944559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.036932 (+1092373us) service_pool.cc:224] Handling call
0709 13:19:39.037223 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.037867 (+   644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.038055 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:38.988626 24261 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:39.041975 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.038409 19578 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:39.042824 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2422) took 1116 ms. Trace:
I20260709 13:19:39.043115 24261 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:39.043133 19578 rpcz_store.cc:276] 0709 13:19:37.925984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.029787 (+1103803us) service_pool.cc:224] Handling call
0709 13:19:39.038236 (+  8449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.042602 (+  4366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.042773 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:39.044399 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.044965 19578 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:39.017903 19580 rpcz_store.cc:276] 0709 13:19:37.919032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.974015 (+1054983us) service_pool.cc:224] Handling call
0709 13:19:38.974369 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.006676 (+ 32307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.007324 (+   648us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:39.046264 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.047574 19580 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:39.048492 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.050185 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.050832 19580 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:39.051692 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.053710 19580 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:39.046941 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.049134 19584 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:39.035578 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2426) took 1108 ms. Trace:
I20260709 13:19:39.060590 19580 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:19:39.174814 19580 pending_rounds.cc:85] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 8
I20260709 13:19:39.175414 19580 pending_rounds.cc:107] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:19:39.175957 19580 raft_consensus.cc:2889] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:39.177065 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 415) took 1214 ms. Trace:
I20260709 13:19:39.170449 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3069) took 1182 ms. Trace:
I20260709 13:19:39.177829 19584 rpcz_store.cc:276] 0709 13:19:37.962742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.057538 (+1094796us) service_pool.cc:224] Handling call
0709 13:19:39.175453 (+117915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.176123 (+   670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.176185 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.176289 (+   104us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:39.176374 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.176483 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.176675 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:39.053435 19655 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:39.064960 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:39.059360 19581 rpcz_store.cc:276] 0709 13:19:37.927153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.034759 (+1107606us) service_pool.cc:224] Handling call
0709 13:19:39.035080 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.035253 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.035288 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.035333 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:39.035367 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.035422 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.035530 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:39.183032 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.184345 19658 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
W20260709 13:19:39.173408 19506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.006s	sys 0.034s
W20260709 13:19:39.186421 19506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.006s	sys 0.034s
I20260709 13:19:39.188263 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3074) took 1198 ms. Trace:
W20260709 13:19:39.173600 19505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.017s	sys 0.061s
W20260709 13:19:39.190109 19505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.017s	sys 0.061s
W20260709 13:19:39.191599 19510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 2241) took 2100 ms (client timeout 2437 ms). Trace:
W20260709 13:19:39.192261 19510 rpcz_store.cc:269] 0709 13:19:37.090802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.567334 (+476532us) service_pool.cc:224] Handling call
0709 13:19:39.190861 (+1623527us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b54000ecc54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:39.191314 (+   453us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48203008}
I20260709 13:19:39.178248 19504 rpcz_store.cc:276] 0709 13:19:37.987673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.987829 (+   156us) service_pool.cc:224] Handling call
0709 13:19:37.988170 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:38.001049 (+ 12879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:38.001079 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:38.011658 (+ 10579us) log.cc:844] Serialized 26 byte log entry
0709 13:19:38.811888 (+800230us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:38.811925 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.812001 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:39.169561 (+357560us) raft_consensus.cc:1685] finished
0709 13:19:39.169665 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.170090 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16941,"raft.queue_time_us":20580,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4420,"thread_start_us":75707,"threads_started":1,"wal-append.queue_time_us":1013888}
I20260709 13:19:39.194844 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2833) took 1551 ms. Trace:
I20260709 13:19:39.195493 19587 rpcz_store.cc:276] 0709 13:19:37.642983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.838016 (+195033us) service_pool.cc:224] Handling call
0709 13:19:39.194184 (+1356168us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400106654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:39.194554 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442396416}
I20260709 13:19:39.200367 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2829) took 1710 ms. Trace:
I20260709 13:19:39.202517 23708 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:39.201085 19586 rpcz_store.cc:276] 0709 13:19:37.489307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.845792 (+356485us) service_pool.cc:224] Handling call
0709 13:19:37.846200 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:37.868369 (+ 22169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.868414 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:37.899493 (+ 31079us) log.cc:844] Serialized 26 byte log entry
0709 13:19:38.051792 (+152299us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:38.130512 (+ 78720us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.198576 (+1068064us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b18000c1120. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e5e7c0a 00007f6c37d27219 00007f6c2e66fa40 00007f6c2e66a4e4 00007f6c2e66a455 00007f6c31752060 00007f6c31764716 00007f6c31775287 00007f6c31775208
0709 13:19:39.199269 (+   693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.199452 (+   183us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:39.199584 (+   132us) raft_consensus.cc:1685] finished
0709 13:19:39.199767 (+   183us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.200095 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20339,"prepare.queue_time_us":78488,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":21081,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":8766,"spinlock_wait_cycles":54785280,"thread_start_us":151929,"threads_started":1,"wal-append.queue_time_us":775054}
W20260709 13:19:39.203619 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 1.1653e+06us
I20260709 13:19:39.093097 24160 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:39.080160 24197 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:39.078099 24229 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:39.103017 24249 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:39.094030 24260 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:39.056821 24285 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:39.258808 19583 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:39.172389 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3075) took 1182 ms. Trace:
I20260709 13:19:39.092150 24306 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:39.072299 24312 consensus_queue.cc:237] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:39.262115 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 298049us
I20260709 13:19:39.126976 24335 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:39.138648 24347 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.715s	user 0.002s	sys 0.010s
I20260709 13:19:39.266511 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:39.182673 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.268527 19578 raft_consensus.cc:2410] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 18 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:19:39.271198 19578 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:39.272056 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.260699 19507 rpcz_store.cc:276] 0709 13:19:38.003136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.152217 (+149081us) service_pool.cc:224] Handling call
0709 13:19:38.166507 (+ 14290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:38.181519 (+ 15012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:38.181569 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:38.813109 (+631540us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.033222 (+220113us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:39.033322 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.033493 (+   171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:39.114424 (+ 80931us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b4800270258. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c36683aa1 00007f6c3667ab37 00007f6c3667a9ca 00007f6c3677226f 00007f6c36771f37 00007f6c3678655c 00007f6c36786508 00007f6c36786488 00007f6c36786443 00007f6c367856ec 00007f6c356afa96
0709 13:19:39.171469 (+ 57045us) raft_consensus.cc:1685] finished
0709 13:19:39.171543 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.172130 (+   587us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13861,"raft.queue_time_us":21868,"raft.run_cpu_time_us":18563,"raft.run_wall_time_us":925750,"spinlock_wait_cycles":6108928,"thread_start_us":219835,"threads_started":1,"wal-append.queue_time_us":298824}
I20260709 13:19:39.184347 19581 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:39.319207 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.320360 19581 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:39.194881 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:39.237823 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.188700 19506 rpcz_store.cc:276] 0709 13:19:37.989370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.148022 (+158652us) service_pool.cc:224] Handling call
0709 13:19:38.148323 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:38.151001 (+  2678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:38.151119 (+   118us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:38.151864 (+   745us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.187455 (+1035591us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:39.187589 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.187782 (+   193us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:39.187878 (+    96us) raft_consensus.cc:1685] finished
0709 13:19:39.187896 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.188156 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36354,"raft.queue_time_us":2214,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":35119,"thread_start_us":879658,"threads_started":1,"wal-append.queue_time_us":878535}
I20260709 13:19:39.251814 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:39.260803 24197 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:39.222318 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.278569 24161 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:39.288494 20662 consensus_queue.cc:237] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:39.292522 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:39.297008 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.298345 24217 raft_consensus.cc:3055] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:39.300132 19625 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:39.303014 20631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.304651 24320 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:39.301359 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2803) took 2064 ms. Trace:
I20260709 13:19:39.306740 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3070) took 1318 ms. Trace:
I20260709 13:19:39.273532 19584 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:39.308117 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:39.305210 23862 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:19:39.310297 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 44154.9us
I20260709 13:19:39.311218 24240 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:39.312481 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2407) took 1657 ms. Trace:
W20260709 13:19:39.314160 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 411141us
I20260709 13:19:39.275494 19580 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:39.301329 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:39.332401 19583 rpcz_store.cc:276] 0709 13:19:37.655438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.911594 (+256156us) service_pool.cc:224] Handling call
0709 13:19:37.911910 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.259378 (+1347468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.312137 (+ 52759us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400226fd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:39.312411 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3096314752}
I20260709 13:19:39.326152 24217 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:39.348048 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 446881us
I20260709 13:19:39.348663 24335 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:39.349938 19655 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:39.359731 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:39.360942 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 95935.3us
I20260709 13:19:39.363180 19625 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:39.364609 19625 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:39.365127 24160 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:39.358534 19582 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:19:39.328370 19505 rpcz_store.cc:276] 0709 13:19:37.988048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.993724 (+  5676us) service_pool.cc:224] Handling call
0709 13:19:38.008059 (+ 14335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:38.022820 (+ 14761us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:38.088436 (+ 65616us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.191208 (+1102772us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:39.192538 (+  1330us) log.cc:844] Serialized 52 byte log entry
0709 13:19:39.192827 (+   289us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:39.192903 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.193036 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:39.306408 (+113372us) raft_consensus.cc:1685] finished
0709 13:19:39.306425 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.306646 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3661,"prepare.queue_time_us":85345,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":4302,"raft.queue_time_us":52012,"raft.run_cpu_time_us":560,"raft.run_wall_time_us":30618,"thread_start_us":963380,"threads_started":1,"wal-append.queue_time_us":967906}
I20260709 13:19:39.368667 19657 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:39.359704 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:39.367386 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:39.371632 24320 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:39.377374 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:39.378337 19656 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:39.379228 24335 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:39.382146 19658 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:39.383468 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:39.384846 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:39.387168 19627 leader_election.cc:336] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.666s (SENT)
I20260709 13:19:39.387517 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:39.388537 19657 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:39.389879 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:39.390002 24161 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:39.390638 19657 raft_consensus.cc:2376] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15. Re-sending same reply.
I20260709 13:19:39.391889 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:39.392366 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.392767 23862 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:39.394008 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.393924 24160 raft_consensus.cc:697] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:39.395961 24160 consensus_queue.cc:237] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:39.398248 24320 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:39.398904 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3077) took 1394 ms. Trace:
I20260709 13:19:39.399703 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:39.399361 24161 raft_consensus.cc:697] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:39.399340 19503 rpcz_store.cc:276] 0709 13:19:38.004219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.817513 (+813294us) service_pool.cc:224] Handling call
0709 13:19:39.240898 (+423385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.318313 (+ 77415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.318351 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.318426 (+    75us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:39.318500 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.318602 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.398565 (+ 79963us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54000ecc50. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:39.398725 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":892046720}
W20260709 13:19:39.402611 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 46643.6us
I20260709 13:19:39.401070 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:39.402124 24161 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:39.414943 24296 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:19:39.393465 23862 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:39.414781 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:39.419466 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:39.422463 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:39.424983 19661 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:19:39.426017 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.426846 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:39.433593 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:39.437220 19660 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:19:39.377041 24217 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:39.473594 24217 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:39.467761 20619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:39.472347 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 107983us
I20260709 13:19:39.328032 19579 rpcz_store.cc:276] 0709 13:19:37.236588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.236722 (+   134us) service_pool.cc:224] Handling call
0709 13:19:37.237025 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:37.237265 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:37.402574 (+165309us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.189553 (+1786979us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b18002177e0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c313024bc 00007f6c2e65048b 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa23a
0709 13:19:39.300420 (+110867us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.300514 (+    94us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:39.300636 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.300752 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.301023 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71275,"prepare.queue_time_us":201897,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":64840,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":165,"spinlock_wait_cycles":10769280,"thread_start_us":230796,"threads_started":2,"wal-append.queue_time_us":319187,"wal-append.run_cpu_time_us":1225,"wal-append.run_wall_time_us":1035358}
I20260709 13:19:39.480106 24137 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:39.484314 19655 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
W20260709 13:19:39.485222 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.494035 24335 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:39.478193 19660 pending_rounds.cc:85] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 8
I20260709 13:19:39.502728 19660 pending_rounds.cc:107] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:19:39.503103 19660 raft_consensus.cc:2889] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:39.484500 19661 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:39.539330 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2820) took 2107 ms. Trace:
I20260709 13:19:39.539853 19585 rpcz_store.cc:276] 0709 13:19:37.311006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.879173 (+1568167us) service_pool.cc:224] Handling call
0709 13:19:38.879594 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:38.879876 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:39.182476 (+302600us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.334178 (+151702us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.341014 (+  6836us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:39.350745 (+  9731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.356072 (+  5327us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.418530 (+ 62458us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41225,"prepare.queue_time_us":251936,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":5950,"raft.run_cpu_time_us":401,"raft.run_wall_time_us":20800,"thread_start_us":367807,"threads_started":2,"wal-append.queue_time_us":152604}
I20260709 13:19:39.543522 20659 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 15 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:39.543381 24268 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:19:39.548239 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 129186us
I20260709 13:19:39.525602 24320 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:39.586728 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:39.577371 19627 leader_election.cc:336] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.510s (SENT)
I20260709 13:19:39.589686 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:39.597740 24239 consensus_meta.cc:287] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.016s
I20260709 13:19:39.598356 24239 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:39.600754 24239 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:39.602681 24268 raft_consensus.cc:3055] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:39.603194 24268 raft_consensus.cc:740] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:19:39.604317 19627 leader_election.cc:336] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.650s (SENT)
I20260709 13:19:39.604419 24268 consensus_queue.cc:260] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:39.610368 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.612804 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:39.613404 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.614768 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.615608 19586 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:39.616175 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.616571 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:39.616809 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:39.616933 19579 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:39.617516 19585 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 10.
I20260709 13:19:39.618673 19584 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:39.569834 24335 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:39.622011 24335 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:39.630390 20659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59442 (request call id 174) took 1497 ms. Trace:
I20260709 13:19:39.633435 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:39.635735 19660 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:39.637982 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:39.639084 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:39.641010 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:39.630889 20659 rpcz_store.cc:276] 0709 13:19:38.133129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.143937 (+ 10808us) service_pool.cc:224] Handling call
0709 13:19:38.188752 (+ 44815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.574549 (+1385797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.629974 (+ 55425us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54006cc5d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:39.630286 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3094036864}
I20260709 13:19:39.644122 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:39.648051 19581 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:39.649804 24320 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:39.650657 24073 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:39.655025 19656 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:39.604914 19627 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:39.659024 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 99469.1us
I20260709 13:19:39.625367 24335 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:39.657253 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:39.667917 19583 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:39.586247 23862 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:39.672827 23862 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:39.676680 19584 raft_consensus.cc:1240] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:39.677377 24268 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:39.685461 24328 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.690760 24197 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:39.686165 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:39.694397 24285 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:39.702831 24312 consensus_queue.cc:1059] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:19:39.688504 24217 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:39.693610 24197 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:39.691498 24328 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:39.714565 24152 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:39.724685 24328 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:39.717694 24197 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:39.729796 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 92434.1us
W20260709 13:19:39.729995 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 125746us
I20260709 13:19:39.730849 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:39.731958 23862 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:39.732529 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:39.732793 24217 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:39.730870 19627 leader_election.cc:336] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.668s (SENT)
I20260709 13:19:39.734409 19627 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:39.740592 24160 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:39.754191 24029 raft_consensus.cc:3055] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:39.754706 24029 raft_consensus.cc:740] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:19:39.760480 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:39.763801 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:39.744625 23862 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:39.771720 24285 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:39.777173 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:39.777992 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:39.778196 19510 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:39.778898 19507 raft_consensus.cc:2393] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 12: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:39.777364 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:39.783349 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:39.784392 19503 raft_consensus.cc:2393] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 15: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:39.786460 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:39.787854 19507 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
W20260709 13:19:39.788513 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57711.9us
W20260709 13:19:39.789345 19627 leader_election.cc:336] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.674s (SENT)
I20260709 13:19:39.773293 19410 catalog_manager.cc:5697] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:39.792061 19410 catalog_manager.cc:5697] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:39.789803 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:39.742022 24217 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:39.801090 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:39.805258 20662 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:39.808146 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:39.803221 24285 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:19:39.818095 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:39.825469 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:39.832134 19410 catalog_manager.cc:5697] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:39.837165 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:39.838455 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:39.796372 24029 consensus_queue.cc:260] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:39.840443 24029 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:39.841723 23862 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:39.851567 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:39.852099 24249 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:39.853507 20631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:39.854473 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 43906.5us
I20260709 13:19:39.813171 24137 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:39.874522 19507 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:39.858188 23862 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:39.858615 24217 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:39.885265 19661 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 15.
I20260709 13:19:39.893256 19625 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:39.895861 19625 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:39.899163 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 109882us
W20260709 13:19:39.900799 19627 leader_election.cc:336] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.933s (SENT)
I20260709 13:19:39.876470 24320 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:39.901974 24320 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.902474 24320 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:39.903493 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 65181.6us
I20260709 13:19:39.904757 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:39.907953 24106 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:39.908198 24265 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:39.908438 24106 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:39.908702 24265 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.908941 24106 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:39.909111 24265 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:39.918767 24106 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:39.901273 19627 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:39.926987 20662 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:39.897197 19625 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:39.925426 24268 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:39.884733 24217 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:39.921692 24106 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:39.925938 24239 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:39.954998 24296 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:19:39.956781 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 59718.6us
I20260709 13:19:39.936833 24217 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:39.964236 19625 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:39.972302 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:39.973522 24197 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:39.967629 24268 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:39.981328 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 80603us
I20260709 13:19:39.980758 24249 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:40.000372 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:40.002170 24073 raft_consensus.cc:2955] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 4 to 8, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:19:39.984458 24249 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:40.006059 24249 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:40.007018 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.024528 23862 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:40.043340 23862 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:40.043661 24265 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:40.044327 23862 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:40.045931 23862 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:40.046173 24265 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:40.020840 24106 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:40.025077 19578 raft_consensus.cc:2955] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 4 to 8, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:19:40.049882 24106 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.027531 24197 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:40.057595 24106 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:40.071165 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:40.072880 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:40.073980 19654 raft_consensus.cc:2368] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15.
W20260709 13:19:40.077261 19627 leader_election.cc:336] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.147s (SENT)
I20260709 13:19:40.077968 19627 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:40.079376 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 82212.2us
W20260709 13:19:40.082631 19627 leader_election.cc:336] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.511s (SENT)
I20260709 13:19:40.083195 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:40.089001 20619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.085448 19510 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:19:40.092180 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:40.096412 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 150992us
I20260709 13:19:40.114845 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:40.112787 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 260193us
I20260709 13:19:40.116703 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.116860 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.117702 19659 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:40.118402 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.119050 19655 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:40.116947 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:40.123517 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.125702 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.127769 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:40.129503 19510 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:40.129031 19653 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:40.134140 19656 raft_consensus.cc:2376] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16. Re-sending same reply.
I20260709 13:19:40.150378 19661 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:40.105062 24320 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:40.154155 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:40.159631 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:40.163627 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.124723 24268 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:19:40.129935 24029 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:19:40.177615 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 95074.4us
I20260709 13:19:40.152655 24073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:45924 (request call id 0) took 4759 ms. Trace:
I20260709 13:19:40.181033 24237 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:19:40.176512 24388 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:40.189886 19506 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:40.191322 19510 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:40.192842 19625 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:40.193846 24272 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:40.205080 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.191951 24388 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:40.225425 24388 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:40.225453 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 48893.9us
I20260709 13:19:40.223196 19653 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 15.
I20260709 13:19:40.231309 24268 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:19:40.231602 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 102905us
I20260709 13:19:40.237586 19655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:40.237478 24358 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:40.239516 19655 raft_consensus.cc:606] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:40.239773 24358 raft_consensus.cc:697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:40.239944 19655 raft_consensus.cc:614] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:40.240847 24358 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:40.181792 24073 rpcz_store.cc:276] 0709 13:19:35.391642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.391839 (+   197us) service_pool.cc:224] Handling call
0709 13:19:36.554896 (+1163057us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b1800362880. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3179573d 00007f6c31760f3f 00007f6c317606b3 00007f6c317589fa 00007f6c367204c9 00007f6c2fc9cc54 00007f6c2fc9cbe2 00007f6c2fc9cb11 00007f6c2fc9ca8c 00007f6c2fc9bd42
0709 13:19:37.555548 (+1000652us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b58002180d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316b60aa 00007f6c31738447 00007f6c3175570a 00007f6c3175676a 00007f6c3175591b 00007f6c3176103c 00007f6c317606b3 00007f6c317589fa 00007f6c367204c9 00007f6c2fc9cc54
0709 13:19:39.285524 (+1729976us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b58007730d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316b60aa 00007f6c31738447 00007f6c3175570a 00007f6c3175676a 00007f6c3175591b 00007f6c3176103c 00007f6c317606b3 00007f6c317589fa 00007f6c367204c9 00007f6c2fc9cc54
0709 13:19:39.366491 (+ 80967us) log.cc:844] Serialized 508 byte log entry
0709 13:19:39.621491 (+255000us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5400599fa0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316d3142 00007f6c316b3eaa 00007f6c316bad53 00007f6c316bacd9 00007f6c316bac69 00007f6c316bac31 00007f6c316b9dfd 000000000038f354 000000000038f199 00007f6c2e66d475
0709 13:19:40.150717 (+529226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26529,"raft.run_cpu_time_us":3803,"raft.run_wall_time_us":109867,"spinlock_wait_cycles":6004872192,"thread_start_us":137370,"threads_started":1,"wal-append.queue_time_us":206344}
I20260709 13:19:40.228535 24385 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:40.255565 19476 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:40.265149 19655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:40.265435 24268 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:19:40.276883 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 43909.7us
I20260709 13:19:40.279112 19397 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 46d39387ed0c44978cdb2b736f9c1ccf with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:19:40.284494 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 50337.7us
I20260709 13:19:40.284675 24229 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:40.285166 24229 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:40.285585 24229 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.286298 19476 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:40.293206 19478 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.695s (SENT) [suppressed 69 similar messages]
I20260709 13:19:40.293839 24229 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:40.296828 24229 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:40.302392 24389 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:40.303155 24389 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:40.304147 24389 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:40.316839 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:40.292286 24388 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:40.315739 19653 raft_consensus.cc:2955] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 4 to 8, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:19:40.322078 24320 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:40.320788 24239 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:40.322579 20659 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:40.324262 24136 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:40.324525 24217 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:40.326037 19507 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 15: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:40.328950 19655 raft_consensus.cc:606] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:40.334800 24385 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:40.335997 24272 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:40.336701 24161 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:19:40.337918 24391 log.cc:927] Time spent T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:19:40.328137 24106 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:40.344065 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:40.344803 24217 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:40.346261 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.350214 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:40.352545 24106 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:40.359092 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:40.360008 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.361184 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.363442 19656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db4589d6497c49308384eacc43241a32"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:40.363991 19656 raft_consensus.cc:606] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:40.336261 19627 leader_election.cc:336] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.744s (SENT)
I20260709 13:19:40.365029 19627 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:40.369228 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:40.370860 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:40.371590 19655 raft_consensus.cc:2368] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16.
I20260709 13:19:40.390933 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:40.391021 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:40.404587 19655 raft_consensus.cc:2376] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15. Re-sending same reply.
I20260709 13:19:40.409852 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:40.410120 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 73900.6us
I20260709 13:19:40.410633 19509 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:40.410930 19627 leader_election.cc:336] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.752s (SENT)
I20260709 13:19:40.411405 19627 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:40.413151 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:40.413736 19476 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:40.416527 19410 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 52) took 6618 ms. Trace:
I20260709 13:19:40.416980 19410 rpcz_store.cc:276] 0709 13:19:33.798022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.798236 (+   214us) service_pool.cc:224] Handling call
0709 13:19:40.416409 (+6618173us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:40.107008 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:40.107864 (+   856us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:40.107935 (+    71us) write_op.cc:435] Acquired schema lock
0709 13:19:40.107980 (+    45us) tablet.cc:662] Decoding operations
0709 13:19:40.108749 (+   769us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:40.108855 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:40.108886 (+    31us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:19:40.109364 (+   478us) tablet.cc:701] Row locks acquired
0709 13:19:40.109416 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:19:40.109597 (+   181us) write_op.cc:270] Start()
0709 13:19:40.109798 (+   201us) write_op.cc:276] Timestamp: P: 1783603180109525 usec, L: 0
0709 13:19:40.109826 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:19:40.110649 (+   823us) log.cc:844] Serialized 1374 byte log entry
0709 13:19:40.198045 (+ 87396us) op_driver.cc:464] REPLICATION: finished
0709 13:19:40.198731 (+   686us) write_op.cc:301] APPLY: starting
0709 13:19:40.198865 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:40.201221 (+  2356us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:40.201367 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:40.262376 (+ 61009us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:40.262592 (+   216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:19:40.262647 (+    55us) write_op.cc:312] APPLY: finished
0709 13:19:40.310416 (+ 47769us) log.cc:844] Serialized 40 byte log entry
0709 13:19:40.315191 (+  4775us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:40.319710 (+  4519us) write_op.cc:454] Released schema lock
0709 13:19:40.321027 (+  1317us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:40.341749 (+ 20722us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:40.341780 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":46954,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":391,"apply.run_cpu_time_us":7236,"apply.run_wall_time_us":130402,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12534,"num_ops":3,"prepare.queue_time_us":71825,"prepare.run_cpu_time_us":4005,"prepare.run_wall_time_us":4003,"replication_time_us":87981,"thread_start_us":72647,"threads_started":1}]]}
I20260709 13:19:40.420599 19407 catalog_manager.cc:5697] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 11 to 15, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 15 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:40.423274 20659 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:40.424284 19407 catalog_manager.cc:5697] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.394693 24106 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:40.426290 19407 catalog_manager.cc:5697] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 8 to 9, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 9 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:40.429199 19407 catalog_manager.cc:5697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.430821 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:40.435118 24249 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:40.435685 24249 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.436103 24249 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.437328 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:40.438138 19505 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:19:40.431780 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:40.440271 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.441730 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.441531 24335 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:40.443197 20629 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.441578 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.446753 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.447093 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.447988 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.441996 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.448930 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.449712 19657 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:40.450199 19659 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:40.448961 24217 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:19:40.452652 24217 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:40.446668 19407 catalog_manager.cc:5697] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 9 to 13, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 13 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:40.443140 19661 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:40.461309 19656 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:40.462536 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:40.463825 20631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.477696 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:40.480321 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:40.404049 24388 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:40.484185 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:40.488895 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.491688 19660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:40.492497 19660 raft_consensus.cc:606] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:40.492903 19660 raft_consensus.cc:614] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:40.494336 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.491429 24161 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:40.468568 19509 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:40.509675 19625 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:40.516319 19660 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:40.488394 24335 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:19:40.520084 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
W20260709 13:19:40.529526 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 70265.4us
W20260709 13:19:40.530006 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 119113us
W20260709 13:19:40.524601 19553 connection.cc:256] RPC call timeout handler was delayed by -1.6078394030000709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260709 13:19:40.538722 19660 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:19:40.539996 24388 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.540531 24388 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:40.542472 24388 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:40.545470 20662 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 8.
I20260709 13:19:40.535283 24160 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:40.550355 24160 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:40.551513 24160 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:40.535133 24328 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:19:40.554868 19476 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:40.554942 24396 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:40.555426 19653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:40.555984 19653 raft_consensus.cc:606] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:40.559816 19553 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:40.561729 19627 leader_election.cc:336] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.803s (SENT)
I20260709 13:19:40.564280 24388 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:40.564721 19627 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:40.570494 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.571173 24249 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:40.576120 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.584089 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:40.586077 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.586866 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:40.577467 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.595094 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:40.595386 19659 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:19:40.597539 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.598922 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:40.597258 19553 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:19:40.597296 19508 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:40.598770 24388 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:40.609651 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.609895 24388 raft_consensus.cc:3055] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:40.610320 24388 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:40.611191 24388 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:40.611647 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.611931 24385 raft_consensus.cc:993] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:19:40.612474 24388 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:40.612534 24385 raft_consensus.cc:1081] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Signalling peer d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:19:40.605805 24239 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:40.597440 19657 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:40.600919 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 154341us
I20260709 13:19:40.613562 24239 raft_consensus.cc:697] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:40.614816 24239 consensus_queue.cc:237] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:40.610332 19585 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:40.619300 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.620133 19585 raft_consensus.cc:2393] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:40.622020 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.602144 19510 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:40.605803 24358 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:40.606168 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:40.606747 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 48064.8us
I20260709 13:19:40.606943 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.607649 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.608327 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:40.623827 19584 raft_consensus.cc:2410] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:19:40.608963 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.612409 19586 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:40.605880 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.597656 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:40.630499 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.632895 19578 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:40.634461 19655 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.638044 19581 raft_consensus.cc:2393] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 12: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:40.638844 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.639711 19657 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:40.599285 24249 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:40.646327 19627 leader_election.cc:336] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.923s (SENT)
I20260709 13:19:40.646358 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.646979 19627 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:40.648401 19627 leader_election.cc:336] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.924s (SENT)
I20260709 13:19:40.648898 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:40.642645 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.632817 19582 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:40.650435 19660 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:40.596907 24229 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:40.655587 19578 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:40.671191 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.672008 19582 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:40.673961 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:40.676608 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:40.684110 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.684712 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.663502 24136 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:40.667968 24358 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:40.689821 19582 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 15: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:40.692576 19506 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db4589d6497c49308384eacc43241a32"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:50822
I20260709 13:19:40.693475 19506 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:40.693961 19506 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:40.700034 19655 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:40.692641 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.703158 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:40.704182 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:40.707257 19627 leader_election.cc:336] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.955s (SENT)
I20260709 13:19:40.707991 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:40.720778 24358 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:40.721159 19627 leader_election.cc:336] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.017s (SENT)
I20260709 13:19:40.722419 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.721925 19627 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:40.727128 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.728785 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:40.729434 19660 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:40.740091 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:40.740456 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:40.741468 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:40.742353 24268 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:40.742674 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:40.742938 24268 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:40.743885 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:40.745069 24268 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:40.746966 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.747198 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:40.747856 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.748258 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.748462 19581 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:19:40.749169 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.713760 24229 raft_consensus.cc:697] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:40.749716 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.750252 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.750648 19581 raft_consensus.cc:2410] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:19:40.750537 24229 consensus_queue.cc:237] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:40.751433 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.749758 19587 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:40.752260 19583 raft_consensus.cc:2410] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:19:40.753237 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.753854 19582 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:40.756199 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:40.756791 19551 connection.cc:256] RPC call timeout handler was delayed by -1.5586409759998787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2544s for a response
I20260709 13:19:40.758741 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.759846 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.766148 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.766912 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:40.767887 24239 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:40.768267 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.768882 19578 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:40.769223 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:40.770056 24239 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:40.771178 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.773403 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.773931 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.774255 19587 raft_consensus.cc:2410] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:40.779466 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:40.780224 19659 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:40.781716 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:40.782280 19580 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:40.784281 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.785447 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.785795 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.786041 19586 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:40.786439 19657 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:40.787375 19586 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:40.789866 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.790364 19657 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:40.790889 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:40.790484 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.792850 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.794272 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:40.794803 19655 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:40.796279 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:40.798306 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:40.799484 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 78409.4us
I20260709 13:19:40.802856 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:40.806584 24272 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:40.806779 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:40.808292 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:40.809845 19627 leader_election.cc:336] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.057s (SENT)
W20260709 13:19:40.811363 19627 leader_election.cc:336] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.074s (SENT)
I20260709 13:19:40.811825 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:40.813060 24161 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:40.814394 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:40.816576 19659 raft_consensus.cc:2410] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:19:40.817203 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:40.834326 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.819235 19580 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:40.819684 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:40.836006 19510 raft_consensus.cc:2368] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13.
I20260709 13:19:40.756151 19660 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:40.821271 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:40.822363 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:40.790447 19585 raft_consensus.cc:3055] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:40.833434 19506 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:40.838295 19585 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:40.824079 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:40.818806 19503 raft_consensus.cc:1217] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 12.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 13:19:40.839570 19503 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:19:40.841482 19583 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:40.842559 19504 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:40.843184 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:40.844247 19478 leader_election.cc:336] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.615s (SENT)
I20260709 13:19:40.844686 19478 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:40.845898 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.846702 19578 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:40.848083 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:40.848295 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:40.848621 20631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.849736 19654 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:40.851388 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.851706 19506 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:40.850591 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:40.853817 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.854027 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.855068 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:40.855937 19580 raft_consensus.cc:2410] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:19:40.856346 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.854748 19587 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:40.858158 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.859223 19584 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 15: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:40.855466 19579 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:40.861510 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:40.861510 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:40.860981 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 47825.8us
I20260709 13:19:40.864135 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.862430 19587 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
W20260709 13:19:40.865774 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 232345us
I20260709 13:19:40.872747 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:40.873963 19580 raft_consensus.cc:2368] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14.
I20260709 13:19:40.875119 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.876053 19579 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:40.858238 24389 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:40.867352 19585 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:40.878266 19627 leader_election.cc:336] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.105s (SENT)
W20260709 13:19:40.881592 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 112477us
I20260709 13:19:40.881932 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.884056 19509 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:40.888885 19551 leader_election.cc:400] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16.
I20260709 13:19:40.889766 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.890089 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.890502 19584 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:40.893294 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.894008 19583 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:40.894933 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:40.895455 19583 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.890084 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:40.900660 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.901873 24320 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:40.902036 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:40.902429 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:40.903306 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:40.905258 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:40.904105 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:40.906533 19653 raft_consensus.cc:2955] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 5 to 13, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:19:40.908349 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:40.910158 24239 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:40.911371 19585 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:40.916934 19581 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:40.915131 19583 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:40.918604 19580 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:40.919601 19476 leader_election.cc:400] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15.
I20260709 13:19:40.920001 19476 leader_election.cc:403] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:19:40.926826 24029 raft_consensus.cc:2955] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 5 to 13, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:19:40.921463 19579 raft_consensus.cc:2376] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16. Re-sending same reply.
W20260709 13:19:40.931046 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 62266.7us
I20260709 13:19:40.939534 19585 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:19:40.940155 19585 pending_rounds.cc:85] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 7
W20260709 13:19:40.939656 24414 log.cc:927] Time spent T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:40.940894 19585 pending_rounds.cc:107] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:19:40.941341 19585 raft_consensus.cc:2889] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:40.942432 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 64200.7us
I20260709 13:19:40.950075 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:40.953608 19584 raft_consensus.cc:2368] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15.
I20260709 13:19:40.935063 24249 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15.
I20260709 13:19:40.967974 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:40.968900 24335 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:40.969923 24406 consensus_queue.cc:1059] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:40.970897 24411 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:40.971045 24406 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:19:40.972487 24416 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:19:40.974346 19476 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:40.975198 24335 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:40.975548 19476 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:40.975579 24335 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.976198 24335 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:40.976802 19476 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:40.977727 24328 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:40.978200 24328 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:40.970005 24217 consensus_queue.cc:1059] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:19:40.979377 24217 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:40.979068 24328 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:40.979972 24408 raft_consensus.cc:3055] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:40.980067 24412 raft_consensus.cc:3055] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:40.980464 24408 raft_consensus.cc:740] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:40.980553 24412 raft_consensus.cc:740] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:40.981470 24412 consensus_queue.cc:260] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:40.982595 24412 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:40.984053 19627 leader_election.cc:336] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.105s (SENT)
I20260709 13:19:40.984527 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:40.985132 24411 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:40.985585 24411 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:40.985718 19627 leader_election.cc:336] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.145s (SENT)
I20260709 13:19:40.986157 19627 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:40.987622 19627 leader_election.cc:336] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.225s (SENT)
I20260709 13:19:40.987808 24136 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:40.987941 19511 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:19:40.988586 24136 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:40.991726 19407 catalog_manager.cc:5697] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 8 to 9, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 9 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
W20260709 13:19:40.989493 19405 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48852 (request call id 175) took 15412 ms (client timeout 15000 ms). Trace:
I20260709 13:19:40.988029 19627 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:40.996956 20629 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:41.006693 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.009121 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:41.009958 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:41.011811 19654 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:41.018033 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:41.018498 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.018733 19655 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:41.023775 19660 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:41.045331 19656 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:41.000046 19405 rpcz_store.cc:269] 0709 13:19:25.577038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.577305 (+   267us) service_pool.cc:224] Handling call
0709 13:19:40.989268 (+15411963us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:37.776454 (+     0us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c2e6500ac 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66a455 00007f6c3518f16c
0709 13:19:38.136777 (+360323us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:38.756422 (+619645us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:38.804267 (+ 47845us) write_op.cc:435] Acquired schema lock
0709 13:19:38.804297 (+    30us) tablet.cc:662] Decoding operations
0709 13:19:38.806170 (+  1873us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:38.806281 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:38.806325 (+    44us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:19:38.807923 (+  1598us) tablet.cc:701] Row locks acquired
0709 13:19:38.807949 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:19:38.808144 (+   195us) write_op.cc:270] Start()
0709 13:19:38.808406 (+   262us) write_op.cc:276] Timestamp: P: 1783603178808080 usec, L: 0
0709 13:19:38.808442 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:19:38.809332 (+   890us) log.cc:844] Serialized 6409 byte log entry
0709 13:19:39.140225 (+330893us) op_driver.cc:464] REPLICATION: finished
0709 13:19:39.252348 (+112123us) write_op.cc:301] APPLY: starting
0709 13:19:39.252540 (+   192us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:39.450410 (+197870us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:39.450597 (+   187us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:39.729198 (+278601us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:39.742138 (+ 12940us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:19:39.743847 (+  1709us) write_op.cc:312] APPLY: finished
0709 13:19:39.761005 (+ 17158us) log.cc:844] Serialized 147 byte log entry
0709 13:19:39.763389 (+  2384us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:39.763813 (+   424us) write_op.cc:454] Released schema lock
0709 13:19:39.763894 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:39.764566 (+   672us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:39.764609 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":229224,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":111554,"apply.run_cpu_time_us":33189,"apply.run_wall_time_us":512307,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70975,"num_ops":16,"prepare.queue_time_us":1178932,"prepare.run_cpu_time_us":28929,"prepare.run_wall_time_us":1067669,"raft.queue_time_us":57537,"raft.run_cpu_time_us":10358,"raft.run_wall_time_us":190566,"replication_time_us":331572,"spinlock_wait_cycles":10834816,"thread_start_us":1546934,"threads_started":5,"wal-append.queue_time_us":223234}]]}
I20260709 13:19:40.986443 24411 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.054735 24411 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:41.024739 24136 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:41.058902 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 156566us
I20260709 13:19:41.059794 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:41.061163 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:41.008469 24320 raft_consensus.cc:697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:41.062960 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:41.065248 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:41.066133 19654 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 15: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:41.067368 24239 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.067889 24388 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:41.068434 24388 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.068849 24388 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:41.068009 24239 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:41.071661 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 84058.5us
I20260709 13:19:41.077214 19656 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:41.023211 24406 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:19:40.981331 24408 consensus_queue.cc:260] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:41.087610 19627 leader_election.cc:336] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.241s (SENT)
I20260709 13:19:41.092090 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:41.100560 19655 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:41.069886 24335 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.033057 24265 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:19:41.069805 24423 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:41.063139 24320 consensus_queue.cc:237] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.110010 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:41.116140 19655 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:41.127175 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.126995 24422 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:41.160560 24422 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.160954 24413 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:19:41.161701 19653 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:41.162582 24229 consensus_queue.cc:1059] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:41.119153 24161 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:41.185732 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 98180.8us
W20260709 13:19:41.204531 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.206467 20662 consensus_queue.cc:237] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:41.208642 24420 log.cc:927] Time spent T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:19:41.220008 19397 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6eb38e2ac9064d3286fe2f20aeb2381c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:19:41.223122 24335 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:41.161000 24422 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:41.248358 24239 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:41.249375 24239 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:41.259222 24388 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.259992 19655 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:41.268353 24388 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:41.272406 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 133725us
I20260709 13:19:41.280822 24389 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:41.281348 24389 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:41.282043 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:41.276559 24423 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:41.282332 24389 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.270112 24388 raft_consensus.cc:3055] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:41.284013 24389 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:41.284255 24388 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:41.291851 24408 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:41.297686 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:41.298310 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 234731us
I20260709 13:19:41.298346 19660 raft_consensus.cc:3055] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:41.298890 19660 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:41.305907 19660 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.311556 19660 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:41.334174 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.315922 19478 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:41.347188 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:41.363564 19660 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
W20260709 13:19:41.375772 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.382853 24217 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.384464 24217 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.387246 24217 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:41.394306 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 78479.9us
I20260709 13:19:41.396101 19478 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:41.397063 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.397395 24217 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:41.398356 19509 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:19:41.401583 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:41.406996 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.371781 24423 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:41.408330 24434 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:41.408188 24423 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.408891 24434 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:41.411216 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.414736 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:41.397509 19506 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:41.415496 19655 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:41.410550 24423 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:41.416076 19659 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:41.411672 24406 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:41.416491 24422 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.446820 24422 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:41.371974 24388 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.418823 19511 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:41.422823 24433 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.448480 24388 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:41.448398 24433 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:41.450474 24433 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:41.422962 19512 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:41.410996 24434 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:41.454506 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 58506.4us
I20260709 13:19:41.455384 19478 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:19:41.456406 24433 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:41.456843 24433 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:41.457285 24433 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:41.466372 19627 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:41.469308 24268 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:41.469889 24440 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:41.413425 19476 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:41.472934 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 59562.4us
I20260709 13:19:41.475493 19476 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:41.476351 24249 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:41.476884 24249 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.477301 24249 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:41.440793 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:41.439491 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 104953us
I20260709 13:19:41.443359 24439 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:41.493798 24406 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:41.494529 24406 raft_consensus.cc:697] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:41.495491 24406 consensus_queue.cc:237] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:41.500824 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45546.2us
I20260709 13:19:41.502009 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:19:41.503208 24217 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:41.506191 19476 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:41.508332 24412 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:41.521411 19476 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:41.529906 24412 raft_consensus.cc:697] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:41.531212 24412 consensus_queue.cc:237] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.532455 24433 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:41.534329 19478 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:41.535241 24328 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:41.535622 24328 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:41.535953 24429 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:41.535982 24328 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:41.536522 24429 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:41.537050 24429 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:41.537220 24433 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:41.552253 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:41.521373 24439 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:41.544286 24411 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:19:41.563971 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.560375 19655 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:41.563877 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:41.567138 19586 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:19:41.585155 19582 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:41.585330 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:41.563030 24423 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:41.586611 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:41.592206 19580 raft_consensus.cc:2393] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 15: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:19:41.598150 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 131897us
I20260709 13:19:41.596165 19476 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:41.614171 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:41.563359 24029 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:19:41.563184 24396 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:19:41.618053 24439 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.616256 24422 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:41.620592 24422 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:41.621055 24422 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:41.622026 24435 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:41.622613 24435 raft_consensus.cc:697] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:41.623541 24435 consensus_queue.cc:237] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.610092 24423 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:41.627568 24423 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.627810 24249 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.630193 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:41.631150 19584 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:41.632572 19584 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:19:41.633857 19478 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:41.575847 24411 raft_consensus.cc:697] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:41.635733 19478 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:41.635986 24411 consensus_queue.cc:237] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.637800 24408 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:41.638226 24408 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:41.638566 24408 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:41.641733 19584 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:41.637431 19478 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:41.655364 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:41.657711 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.674961 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:41.653947 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:41.650853 19627 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:41.679090 19659 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:41.687448 24328 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:41.688513 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:41.709900 19652 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:19:41.715487 24446 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:19:41.718677 24249 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:41.719507 24249 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:41.720120 24249 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:41.721585 24413 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:41.722434 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:41.724888 19478 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:41.725636 24413 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:41.729336 24413 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:41.729805 24413 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:41.727054 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 85828.3us
I20260709 13:19:41.732410 20662 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:41.733208 19627 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:41.734754 19627 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:41.736454 19627 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:41.743917 19627 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:41.765764 19478 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:41.766398 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 170344us
I20260709 13:19:41.741585 24106 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:41.742519 24152 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:41.763640 24160 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:41.763963 24433 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:41.765599 24239 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:41.781323 19478 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:41.783978 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.785965 19476 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:41.789264 24452 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:41.789894 24452 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:41.790271 24452 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:41.793181 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.789342 24335 raft_consensus.cc:3055] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:41.797962 24335 raft_consensus.cc:740] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:41.800228 24441 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.165s	user 0.002s	sys 0.000s
I20260709 13:19:41.804719 24239 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:41.805284 24239 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:41.809301 24443 log.cc:927] Time spent T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:19:41.812736 24408 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.813333 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:41.743686 24429 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.813932 19652 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:41.815389 24429 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:41.772542 24106 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:41.816090 24106 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:41.821713 19627 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:41.776957 24406 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:41.847465 19478 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:41.765116 24422 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:41.851227 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.771235 24388 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 13:19:41.855481 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 70411us
I20260709 13:19:41.787238 24328 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:41.858526 19652 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:41.861141 24389 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:41.863381 24444 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.231s	user 0.000s	sys 0.002s
I20260709 13:19:41.866575 19478 leader_election.cc:400] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14.
I20260709 13:19:41.866937 19478 leader_election.cc:403] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:19:41.867198 24335 consensus_queue.cc:260] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.867831 19478 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:41.868122 24217 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:41.870049 24217 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.848587 24406 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:41.872552 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 171152us
W20260709 13:19:41.874336 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 316365us
I20260709 13:19:41.900501 19507 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:41.906586 24161 consensus_queue.cc:1059] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:41.907708 24161 raft_consensus.cc:3055] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:41.908075 24161 raft_consensus.cc:740] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:41.909030 24161 consensus_queue.cc:260] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:41.910786 24161 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:41.912220 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:41.927738 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 68031.7us
I20260709 13:19:41.871083 24160 raft_consensus.cc:2764] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:19:41.871693 24217 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:41.931159 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 55923.5us
I20260709 13:19:41.946557 19652 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:41.876250 24406 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:41.963217 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:41.997769 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 212900us
W20260709 13:19:42.003803 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 136057us
I20260709 13:19:41.928970 24268 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:42.011116 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:42.023114 19478 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:42.061357 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 55989.6us
I20260709 13:19:42.001225 24335 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:42.064977 19478 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:42.011849 19512 raft_consensus.cc:2955] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 5 to 13, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:19:42.079690 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 67695.4us
I20260709 13:19:42.081044 19476 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:42.029928 24433 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Leader election lost for term 13. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14.
W20260709 13:19:42.084857 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 69023.2us
I20260709 13:19:42.083669 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:42.069921 24388 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:42.096704 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 168181us
I20260709 13:19:42.106745 19478 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:42.022903 24452 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.123733 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:42.067938 24435 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:19:42.100124 24388 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:42.128293 24388 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:42.151544 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 70612us
W20260709 13:19:42.152393 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:42.175788 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:42.155321 24450 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
W20260709 13:19:42.207914 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 84252.4us
I20260709 13:19:42.253286 19627 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:42.152133 24408 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:42.165472 24453 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.129433 24152 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:42.128680 24448 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:42.250422 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 126795us
W20260709 13:19:42.251159 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.118297 24412 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:42.117825 24328 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:19:42.251596 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 87658.6us
I20260709 13:19:42.255051 19627 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:42.263463 24449 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
W20260709 13:19:42.291311 24457 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 13:19:42.249483 19478 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:42.270341 24385 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:42.145076 24413 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.277143 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:42.174611 24280 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 13:19:42.310775 19507 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:42.313681 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:42.320111 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.322009 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:42.323482 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:42.324075 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:42.324460 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:42.327150 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 72168.2us
I20260709 13:19:42.328210 19661 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:42.334724 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:42.335664 19654 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:42.301406 24389 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:42.274700 24448 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:42.183715 24471 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:42.283231 24412 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:42.355036 19511 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:42.303256 24328 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:42.364743 19656 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:42.358525 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:42.357895 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:42.366691 19652 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 15: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:42.361514 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:42.363369 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:42.371680 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:42.373308 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 123910us
I20260709 13:19:42.375175 19478 leader_election.cc:400] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15.
I20260709 13:19:42.279277 24106 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.330579 24423 raft_consensus.cc:2764] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:19:42.336047 24433 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:42.282284 24453 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.364336 24412 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:42.404742 24472 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:19:42.421705 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:42.405864 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:42.409722 24460 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:42.363077 24385 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:42.360057 24448 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:42.353996 24436 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:42.405224 24454 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:42.378665 24328 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:42.393460 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:42.357501 24265 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
W20260709 13:19:42.438624 24465 log.cc:927] Time spent T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:19:42.362768 24358 consensus_queue.cc:1059] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:19:42.448859 19508 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:19:42.451681 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 108481us
I20260709 13:19:42.427131 24136 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:42.462190 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 98907.9us
I20260709 13:19:42.461395 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:42.486929 24161 consensus_meta.cc:287] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.576s	user 0.015s	sys 0.010s
I20260709 13:19:42.488773 19627 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:42.462992 19653 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:19:42.490569 24460 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.498301 24460 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.500417 24460 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:42.501466 19661 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:42.502305 24455 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:42.463743 24239 consensus_meta.cc:287] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.658s	user 0.005s	sys 0.006s
I20260709 13:19:42.509491 24455 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.510040 24413 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:42.511795 24455 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:42.513130 24455 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:19:42.522398 24468 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:19:42.526415 20662 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:19:42.526688 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:42.527408 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:42.527621 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:42.530439 24452 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:42.533304 19505 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:42.516913 24455 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.459815 24454 raft_consensus.cc:697] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:42.537649 24439 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:42.538451 24454 consensus_queue.cc:237] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.538478 24439 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.541661 24439 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:42.543673 24439 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:42.558462 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:42.559882 19661 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:42.562661 19654 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:19:42.563413 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 76210.6us
W20260709 13:19:42.570640 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 109399us
I20260709 13:19:42.571643 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:42.572633 24423 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:42.573470 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:42.573923 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 85228.2us
I20260709 13:19:42.582787 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:42.583770 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:42.591250 24484 log.cc:927] Time spent T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:19:42.598817 24453 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:42.600421 24106 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:42.565225 24239 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.605881 24482 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.604110 24152 consensus_queue.cc:1059] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:19:42.602178 24452 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:42.606527 24482 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.607239 24239 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:42.566596 24439 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.608047 19627 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:42.608177 24439 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.609009 24482 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:42.611819 19478 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:42.615819 24477 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:42.617673 24451 raft_consensus.cc:3055] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:42.618158 24451 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:42.457381 24436 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:42.618261 24433 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:42.618568 24152 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:42.574266 24385 consensus_queue.cc:1059] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:19:42.626873 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.604305 24453 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:42.633423 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:42.625329 24217 consensus_meta.cc:287] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.002s
I20260709 13:19:42.623972 23708 raft_consensus.cc:3055] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:42.619072 24451 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.637959 24485 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:42.584292 24489 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:19:42.638257 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:42.640308 24436 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:42.674167 19506 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:42.643308 24328 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.644506 24453 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:42.648011 19587 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 13:19:42.681479 24406 consensus_meta.cc:287] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.659s	user 0.008s	sys 0.001s
I20260709 13:19:42.653980 19580 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:42.655687 19578 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:19:42.659209 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 86145.9us
I20260709 13:19:42.660728 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:42.699167 19581 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:42.664093 24439 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:42.664713 24491 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:42.667661 24463 log.cc:927] Time spent T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.586s	user 0.002s	sys 0.005s
I20260709 13:19:42.668162 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:42.705158 19579 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:19:42.705307 19582 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:19:42.697536 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 88325.7us
I20260709 13:19:42.707628 24499 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:42.708209 24499 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.671572 24136 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:42.658763 24217 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.674903 19585 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:19:42.678346 24451 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:42.653223 24448 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.678891 24265 raft_consensus.cc:993] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:19:42.665526 24335 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.647163 24229 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:42.658429 23708 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:42.735500 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:42.682452 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:42.659229 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:42.650326 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 85640.1us
I20260709 13:19:42.737120 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:42.702755 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:42.703388 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:42.738273 19578 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:42.712980 19579 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:42.740861 19579 raft_consensus.cc:3055] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:42.741334 19579 raft_consensus.cc:740] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:42.742172 19510 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:42.714696 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:42.690009 24429 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:42.726208 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:42.703294 24471 raft_consensus.cc:697] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:42.742942 19587 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:42.739617 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:42.751032 19580 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:42.745419 19504 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:42.753384 19581 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:42.744153 24265 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:42.754693 19582 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:19:42.758526 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 55941.8us
I20260709 13:19:42.778496 19587 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:42.776541 19584 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:42.731879 24335 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.780953 24503 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.764740 24492 raft_consensus.cc:3055] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:42.754765 24471 consensus_queue.cc:237] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.782011 24492 raft_consensus.cc:740] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:42.781760 24503 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:42.782755 24217 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:42.766875 24487 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:42.758162 24265 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.784001 24503 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:42.785288 24265 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:42.702570 24406 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.785521 24328 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:42.785694 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:42.786072 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:42.761828 24477 consensus_queue.cc:1059] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:19:42.788815 19587 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:19:42.797283 19587 pending_rounds.cc:85] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 7
I20260709 13:19:42.797601 19587 pending_rounds.cc:107] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:19:42.798030 19587 raft_consensus.cc:2889] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:42.793206 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.779847 19578 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:42.799104 19585 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:42.774704 19579 consensus_queue.cc:260] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.741515 24455 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:42.806357 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:42.811275 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:42.813398 19579 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.767586 24422 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:42.769032 24499 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:42.753788 24505 raft_consensus.cc:1081] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:19:42.855646 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:42.856513 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
W20260709 13:19:42.857178 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 71190.3us
I20260709 13:19:42.858270 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:42.861145 24488 raft_consensus.cc:3055] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:42.861389 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:42.861577 24488 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:42.862597 24388 consensus_meta.cc:287] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.692s	user 0.010s	sys 0.015s
I20260709 13:19:42.863382 24388 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.813571 24435 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:19:42.866437 24496 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:42.844750 24487 raft_consensus.cc:2764] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:19:42.869902 24487 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:42.862418 24488 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.871403 24488 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:42.871685 24435 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:42.869419 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:42.875018 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:42.876273 24422 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:42.875346 24388 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:42.844691 24136 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:42.877189 19478 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:42.878129 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:42.878208 24136 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.879367 24491 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:42.879873 24491 raft_consensus.cc:697] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:42.880818 24136 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:42.880764 24491 consensus_queue.cc:237] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.886253 19504 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:42.844695 24328 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:19:42.859398 24265 consensus_queue.cc:1059] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:19:42.880470 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:42.891341 24487 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:42.892238 24487 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:42.893813 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.766428 24461 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:19:42.899763 24268 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
W20260709 13:19:42.904997 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.900085 19510 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:42.899981 24493 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:42.900565 24272 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:42.901221 24152 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:42.908768 19659 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:42.907132 19579 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:42.901434 24422 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:42.902299 24448 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:42.899855 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:42.902262 24335 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:42.902539 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:42.902810 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:42.817513 24453 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:42.908373 19660 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:42.899811 24487 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:19:42.800271 24489 consensus_queue.cc:1059] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:19:42.910379 19655 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:42.910097 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:42.811918 24411 consensus_queue.cc:1059] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 13:19:42.915319 19586 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.916851 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:42.922484 19658 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:42.917335 19579 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:42.770996 23708 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.927407 19655 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:42.928601 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:42.929492 19580 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:42.929054 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:42.929872 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:42.927335 24453 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:42.934230 24503 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:42.934784 24503 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.936942 24503 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:42.930850 24406 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:42.937988 19587 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:42.939355 19587 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:42.931448 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:42.782943 24492 consensus_queue.cc:260] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.941383 19587 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:42.942713 19587 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:42.943125 19587 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:42.944887 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:42.945770 19655 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:42.946722 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:42.947448 19655 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:42.947501 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:42.948351 19660 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:42.951032 19660 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:42.956221 19579 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
W20260709 13:19:42.931535 24412 consensus_meta.cc:287] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.008s
I20260709 13:19:42.968443 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:42.969238 19511 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:42.933209 24488 raft_consensus.cc:3055] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:42.911185 24268 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:43.003976 24488 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:43.005759 24268 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:43.005234 24488 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.956342 19587 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.006942 19587 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:43.004025 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:42.910607 24493 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:42.979314 24509 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.076s	user 0.002s	sys 0.000s
I20260709 13:19:43.024052 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:42.983075 24505 raft_consensus.cc:3055] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:42.912228 24152 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:42.955993 24136 consensus_queue.cc:1059] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:19:42.988481 23708 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:42.993721 24469 log.cc:927] Time spent T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:42.994727 19504 raft_consensus.cc:2955] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index 4 to 8, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:19:42.967202 24453 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:42.955430 24265 consensus_queue.cc:1059] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:19:43.001979 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:43.047262 19653 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:43.020164 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 53360.2us
I20260709 13:19:43.006953 24488 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:43.027307 19660 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:43.036355 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:43.054239 19654 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:43.038720 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:43.040861 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:43.042832 19587 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:19:43.056193 19587 pending_rounds.cc:85] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 7
I20260709 13:19:43.056499 19587 pending_rounds.cc:107] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:19:43.056777 19587 raft_consensus.cc:2889] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:43.060812 19653 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:43.034278 24505 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:43.067397 19660 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:42.974612 24412 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.068544 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:43.080775 19476 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:43.086326 24388 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:43.088776 24493 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:43.089373 24217 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:43.068665 24136 raft_consensus.cc:3055] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:43.098021 24136 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:43.099254 24136 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.101146 24136 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:43.111228 24161 raft_consensus.cc:3055] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:43.111855 24161 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:43.114413 24503 raft_consensus.cc:3055] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:43.114951 24503 raft_consensus.cc:740] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:19:43.115639 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 47217.4us
I20260709 13:19:43.115955 24503 consensus_queue.cc:260] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.116427 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:43.117183 24503 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:43.118043 24388 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:43.118855 24507 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:19:43.127856 19510 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: []
W20260709 13:19:43.128690 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 178954us
I20260709 13:19:43.131337 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:43.133332 19625 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:43.133776 24516 log.cc:927] Time spent T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:19:43.134186 24518 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:43.134651 24518 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:43.134990 24518 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:43.136147 24152 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:43.117553 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:43.137059 24388 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:43.140494 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 59835.1us
I20260709 13:19:43.140973 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:43.150663 19476 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:43.159068 19476 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:43.112870 24161 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:43.210891 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 46683.9us
I20260709 13:19:43.211928 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:43.150638 24406 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:43.206161 24496 consensus_queue.cc:1059] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:19:43.164186 24448 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.076s
W20260709 13:19:43.222187 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 148258us
I20260709 13:19:43.250550 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:43.254506 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.290305 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.244756 19551 leader_election.cc:400] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13.
W20260709 13:19:43.293016 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 48485.7us
W20260709 13:19:43.296371 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 45900.4us
I20260709 13:19:43.299815 19586 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:43.300520 19578 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:43.164315 24217 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:43.302595 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:43.239144 24508 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:19:43.305521 19476 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:43.249523 24388 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:43.167428 24411 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:43.159687 24335 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.143s
I20260709 13:19:43.164057 24328 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.143s
I20260709 13:19:43.317799 24422 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:43.306092 24408 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:43.311024 24217 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.319485 24161 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:43.343076 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:43.315109 24495 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:43.312693 24496 consensus_queue.cc:1059] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:19:43.350997 24388 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:43.335078 24412 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:43.316049 24411 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.364955 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:43.163492 24505 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.318262 24491 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:19:43.346823 24408 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.349578 24217 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:43.376029 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:43.373991 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:43.367619 24268 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.384395 24268 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.386649 24268 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:43.391130 19583 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:43.348625 24455 consensus_queue.cc:1059] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:19:43.375029 24408 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:43.392124 19587 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:43.414793 19587 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:43.410538 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:43.372334 24388 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:43.370179 24411 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:43.413014 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:43.419313 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:43.419924 19585 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:43.420076 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:43.420674 19581 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:43.432541 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:43.433925 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:43.434379 19584 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:43.434473 19583 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:43.439760 24328 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:43.440122 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:43.445115 24478 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:43.445289 24388 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:43.445603 24478 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:19:43.409353 24495 raft_consensus.cc:697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:43.446015 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:19:43.447111 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 71174.7us
I20260709 13:19:43.456718 19585 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
W20260709 13:19:43.457903 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.426707 24476 raft_consensus.cc:2955] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 13 LEADER]: Committing config change with OpId 13.8: config changed from index 4 to 8, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:19:43.418612 24505 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:43.450533 24448 consensus_queue.cc:1059] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:19:43.468354 24422 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:19:43.472873 24328 raft_consensus.cc:3055] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:43.473244 24328 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:43.473682 19582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60800
I20260709 13:19:43.474915 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:43.464118 19583 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
W20260709 13:19:43.473263 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.476357 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.476919 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.465823 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.478152 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:43.480082 19583 raft_consensus.cc:2393] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:43.481873 19581 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:43.482964 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:43.474315 19582 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:43.487975 19582 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:43.488092 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 169730us
I20260709 13:19:43.450392 24433 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:43.505016 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:43.505935 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:43.506407 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:43.506466 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:43.494975 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:43.495853 19627 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:43.498829 19658 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:43.446688 24495 consensus_queue.cc:237] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.503579 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:43.504045 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:43.446583 24478 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:43.521042 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:43.447902 24412 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:19:43.507246 19583 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:43.501420 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:43.522513 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:43.450171 24496 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:19:43.450675 24474 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:19:43.449468 24411 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.538352 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:43.539526 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:43.542266 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:43.542505 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:43.543258 19656 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:43.503047 24388 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.502655 24272 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:43.531723 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:43.532398 19659 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:43.544903 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 49142us
I20260709 13:19:43.541669 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:43.549414 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:43.531613 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:43.551126 19654 raft_consensus.cc:2393] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:43.551705 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:43.554844 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:43.550879 24265 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:43.575282 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:43.578804 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:43.579980 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:43.589582 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:43.591468 19656 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:43.580683 24478 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:43.494640 24406 consensus_queue.cc:1059] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:19:43.504168 24422 consensus_queue.cc:1059] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:19:43.613194 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:43.586943 19582 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.599066 19581 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:43.587718 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:43.599637 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 51403.8us
I20260709 13:19:43.600348 19505 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:19:43.602020 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:43.606701 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 75174.9us
I20260709 13:19:43.622659 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:43.586540 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:43.594655 24453 raft_consensus.cc:3055] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:19:43.609023 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 137754us
I20260709 13:19:43.537779 24487 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:43.621379 19507 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:43.603087 19578 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:43.629367 19582 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:43.631942 19478 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:43.637059 19581 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:43.606192 24265 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:43.634842 24499 consensus_queue.cc:1059] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:19:43.534488 24328 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.654362 24265 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.655510 24328 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:43.634534 24529 consensus_queue.cc:1059] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:19:43.619377 24455 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:43.650105 24406 consensus_queue.cc:1059] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:43.639022 24518 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.658350 19627 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:43.660288 19478 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:43.671518 24412 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:43.674201 24406 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:43.674606 24406 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:43.675485 24477 raft_consensus.cc:3055] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:43.675987 24477 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:43.676831 24499 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:43.608469 24388 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.689203 19478 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:43.678207 24411 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:43.630740 24453 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:43.679787 24518 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:43.690732 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 63779.6us
I20260709 13:19:43.692772 24160 raft_consensus.cc:3055] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:43.695777 24528 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:19:43.707363 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 49109.5us
I20260709 13:19:43.700773 19478 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:43.708635 19627 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:43.719520 24217 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.722046 19508 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:43.722952 24408 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.680941 24161 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:19:43.726442 19510 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:43.638100 24136 consensus_queue.cc:1059] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:19:43.680794 24474 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:19:43.752591 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 44074.8us
I20260709 13:19:43.754868 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:43.729442 24537 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:43.757351 24518 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:43.757561 24229 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:19:43.696703 24488 consensus_meta.cc:287] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.634s	user 0.011s	sys 0.000s
I20260709 13:19:43.727540 24408 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:43.759382 19627 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:43.764081 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:43.715055 24106 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:43.707474 24160 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:43.767831 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:43.772214 19579 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:43.750521 24528 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:43.675490 24406 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:43.790796 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 56955.9us
I20260709 13:19:43.791579 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:43.769232 24489 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:43.773797 24217 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:43.805940 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:43.810890 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:43.777493 24106 raft_consensus.cc:697] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:43.778043 24537 raft_consensus.cc:697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:43.779038 24229 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:43.676921 24477 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.832803 19627 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:43.836166 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:43.843474 24452 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:43.844573 24452 consensus_queue.cc:1059] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:43.855517 24412 raft_consensus.cc:3055] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:43.856236 24412 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:43.858412 24537 consensus_queue.cc:237] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.859699 24528 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.862872 24106 consensus_queue.cc:237] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.805651 24489 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.808657 24358 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:43.813753 24161 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:43.842245 24493 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:43.867722 24492 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:43.868110 24493 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:43.868536 24493 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:43.801290 24272 consensus_queue.cc:1059] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
W20260709 13:19:43.877234 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 344247us
W20260709 13:19:43.925272 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 303743us
I20260709 13:19:43.913981 19504 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:43.837809 24136 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:43.963913 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:43.969271 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 338493us
I20260709 13:19:43.969532 19657 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:43.964612 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:43.970554 19659 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:43.966954 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:43.971485 19656 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:43.833945 24451 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:43.839073 24474 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:43.970036 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:43.973186 19625 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:43.787379 24453 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:43.881795 24496 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.985888 24217 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.996079 24503 raft_consensus.cc:3055] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:43.857300 24412 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:44.032122 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 62164.1us
I20260709 13:19:43.999882 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:44.004613 24488 raft_consensus.cc:476] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Not starting pre-election -- already a leader
I20260709 13:19:44.005523 24429 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:44.019263 19661 raft_consensus.cc:2955] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index 4 to 8, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:19:44.008157 19656 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:44.034502 19578 raft_consensus.cc:2393] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:19:44.035023 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 61919.4us
I20260709 13:19:43.938275 24433 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:44.048250 19659 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:43.870070 24539 consensus_queue.cc:1059] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.200s
I20260709 13:19:44.061909 19657 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:44.019445 24503 raft_consensus.cc:740] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:44.035511 24217 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.046993 24229 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:44.092505 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 76853.3us
W20260709 13:19:44.109072 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.046303 24422 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:43.993661 24451 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.060312 24272 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:44.054339 24388 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:44.077306 24541 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.259s	user 0.000s	sys 0.004s
W20260709 13:19:44.076829 24535 log.cc:927] Time spent T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
W20260709 13:19:44.077968 24538 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:19:44.069113 24542 log.cc:927] Time spent T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:19:44.011508 24474 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.031123 24496 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.046597 24152 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:19:44.113533 24412 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:44.164343 24358 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.068392 24551 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 13:19:44.162608 24471 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.067981 24546 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 13:19:44.160056 24461 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:44.188957 24476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:45924 (request call id 2) took 3114 ms. Trace:
I20260709 13:19:44.161700 24272 raft_consensus.cc:697] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:44.078459 24433 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:44.195217 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 161759us
I20260709 13:19:44.213331 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:44.206180 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.181073 24545 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:44.169950 24328 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:19:44.247663 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:44.232823 24545 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:44.217417 24152 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.190469 24358 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:44.273857 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 66476.5us
I20260709 13:19:44.190415 24503 consensus_queue.cc:260] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.253521 24455 raft_consensus.cc:3055] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:44.197597 24471 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.267401 23708 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.289346 19476 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:44.216217 24461 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:44.300722 24217 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:44.282481 24455 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:44.282641 24152 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:44.306540 24540 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.216s	user 0.005s	sys 0.000s
I20260709 13:19:44.306947 24573 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.307092 24461 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:44.296749 24493 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.309577 24562 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:44.310734 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:44.335902 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 88426.3us
I20260709 13:19:44.363067 19660 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 8.
I20260709 13:19:44.363148 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:44.364576 20619 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:44.369679 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:44.371187 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:44.367309 24492 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.335153 24545 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:44.293759 23708 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:44.379168 24563 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:19:44.379058 24497 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:19:44.392902 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 104684us
I20260709 13:19:44.402704 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:44.407939 19476 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:44.405874 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:44.293337 24272 consensus_queue.cc:237] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:44.462448 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 54596.5us
I20260709 13:19:44.392596 24568 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:44.463039 24491 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:44.364243 24573 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:44.472437 24573 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:44.401539 24536 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:44.396906 24474 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:44.460428 24482 raft_consensus.cc:3055] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:19:44.509343 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 103555us
I20260709 13:19:44.511005 19551 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:44.547386 19551 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:44.404467 24496 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:44.549374 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2905) took 1083 ms. Trace:
I20260709 13:19:44.549834 19585 rpcz_store.cc:276] 0709 13:19:43.465604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.465944 (+   340us) service_pool.cc:224] Handling call
0709 13:19:43.466296 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:43.468759 (+  2463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.468789 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:43.504023 (+ 35234us) log.cc:844] Serialized 26 byte log entry
0709 13:19:43.825868 (+321845us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:43.825924 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.826017 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.268728 (+442711us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:44.500582 (+231854us) raft_consensus.cc:1685] finished
0709 13:19:44.500613 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.549304 (+ 48691us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2440,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":3863424,"thread_start_us":291909,"threads_started":1,"wal-append.queue_time_us":546090}
I20260709 13:19:44.405274 24579 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.465407 24429 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:44.394414 24492 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.204819 24476 rpcz_store.cc:276] 0709 13:19:41.058043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.058210 (+   167us) service_pool.cc:224] Handling call
0709 13:19:41.198570 (+140360us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b54004e19a0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316d7520 00007f6c31760b42 00007f6c3175f800 00007f6c317589fa 00007f6c367204c9 00007f6c2fc9cc54 00007f6c2fc9cbe2 00007f6c2fc9cb11 00007f6c2fc9ca8c 00007f6c2fc9bd42
0709 13:19:41.210241 (+ 11671us) log.cc:844] Serialized 508 byte log entry
0709 13:19:42.522767 (+1312526us) spinlock_profiling.cc:243] Waited 63.1 ms on lock 0x7b54004e19a0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316cfdbe 00007f6c316da930 00007f6c316da8d8 00007f6c316da858 00007f6c316da813 00007f6c316d9a9c 00007f6c375c5626 00007f6c375bfdd8 00007f6c317167cb 00007f6c317192c0
0709 13:19:44.172487 (+1649720us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23322,"raft.queue_time_us":28188,"raft.run_cpu_time_us":840,"raft.run_wall_time_us":15283,"spinlock_wait_cycles":247027968,"thread_start_us":466563,"threads_started":1,"wal-append.queue_time_us":661420,"wal-append.run_cpu_time_us":4520,"wal-append.run_wall_time_us":1649591}
I20260709 13:19:44.462018 24497 raft_consensus.cc:697] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:44.588626 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:44.549721 24568 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:44.508365 24482 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:44.559774 24491 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:44.401289 24455 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:44.648798 19503 consensus_meta.cc:287] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.000s
I20260709 13:19:44.663753 19503 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
W20260709 13:19:44.673597 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 126303us
I20260709 13:19:44.636330 24429 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:44.700413 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:44.700971 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:44.702204 24574 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:44.702335 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:44.722111 19659 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:44.564837 24579 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.702888 24561 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:44.702775 24578 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.155s
I20260709 13:19:44.703837 24590 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:44.704299 24587 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:19:44.703759 24491 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.698242 24358 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:44.705433 24568 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:44.705024 24570 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:44.706203 24493 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:44.706405 24586 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:44.708876 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2540) took 1215 ms. Trace:
I20260709 13:19:44.713078 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:44.713689 19656 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:44.711908 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:44.705090 24564 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:44.758582 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:44.741199 24534 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:44.737546 24471 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:44.748951 24590 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.776824 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2346) took 1235 ms. Trace:
I20260709 13:19:44.777184 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2531) took 1382 ms. Trace:
I20260709 13:19:44.778359 19658 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:44.779175 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2548) took 1037 ms. Trace:
I20260709 13:19:44.810818 19654 rpcz_store.cc:276] 0709 13:19:43.541127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.578069 (+ 36942us) service_pool.cc:224] Handling call
0709 13:19:44.776582 (+1198513us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54003f3c54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:44.776742 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957674752}
I20260709 13:19:44.812261 19586 rpcz_store.cc:276] 0709 13:19:43.394838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.395822 (+   984us) service_pool.cc:224] Handling call
0709 13:19:43.396109 (+   287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:43.396497 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:43.467772 (+ 71275us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.007857 (+540085us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b18003f6700. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa23a 00007f6c31764a2a
0709 13:19:44.164950 (+157093us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:44.184030 (+ 19080us) log.cc:844] Serialized 52 byte log entry
0709 13:19:44.184443 (+   413us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:44.247582 (+ 63139us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.273982 (+ 26400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.274086 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.776978 (+502892us) raft_consensus.cc:1685] finished
0709 13:19:44.777000 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.777129 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66413,"prepare.queue_time_us":239895,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":89,"raft.queue_time_us":246127,"raft.run_cpu_time_us":559,"raft.run_wall_time_us":58779,"spinlock_wait_cycles":6415232,"thread_start_us":242158,"threads_started":3,"wal-append.queue_time_us":1216944}
I20260709 13:19:44.795037 20619 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:44.796322 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:44.822288 19659 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:44.769424 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:44.823064 19512 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:44.815424 19584 rpcz_store.cc:276] 0709 13:19:43.741711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.010083 (+268372us) service_pool.cc:224] Handling call
0709 13:19:44.010420 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:44.010755 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:44.010785 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:44.011274 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:19:44.193143 (+181869us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:44.193184 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.193249 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.778911 (+585662us) raft_consensus.cc:1685] finished
0709 13:19:44.778940 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.779117 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23230,"spinlock_wait_cycles":16038144,"thread_start_us":125475,"threads_started":1,"wal-append.queue_time_us":355381}
W20260709 13:19:44.769833 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 58054.5us
I20260709 13:19:44.825232 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:44.826804 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:44.739794 24482 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.742106 24561 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.767447 19581 rpcz_store.cc:276] 0709 13:19:43.493302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.641755 (+148453us) service_pool.cc:224] Handling call
0709 13:19:43.642143 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:43.845536 (+203393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.845571 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:43.846069 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:19:44.188463 (+342394us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:44.188498 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.188567 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.708627 (+520060us) raft_consensus.cc:1685] finished
0709 13:19:44.708652 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.708811 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14763,"raft.queue_time_us":45629,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":17207,"thread_start_us":530078,"threads_started":2,"wal-append.queue_time_us":860747}
W20260709 13:19:44.781090 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.777405 19653 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:44.829398 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:44.808049 24406 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:44.739158 24497 consensus_queue.cc:237] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.806512 19476 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:44.871114 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 64680.7us
I20260709 13:19:44.871482 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:44.872896 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.787873 24385 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:44.823957 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2549) took 1081 ms. Trace:
I20260709 13:19:44.771705 24586 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.780543 24492 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:44.856503 24482 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:44.823437 24545 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:44.773331 24534 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:44.771835 24152 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:44.786294 23708 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:44.839977 24570 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:44.776350 24160 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.798676 24358 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:44.784171 24493 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.782579 24429 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.769424 24568 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:44.839524 24578 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:44.803877 24408 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.021s	sys 0.118s
I20260709 13:19:44.773366 24572 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:44.783784 24595 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:44.897902 24534 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:44.766745 19580 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.006s	sys 0.012s
W20260709 13:19:44.926661 19580 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.006s	sys 0.012s
I20260709 13:19:44.881974 19512 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
W20260709 13:19:44.883702 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.876107 19578 rpcz_store.cc:276] 0709 13:19:43.742441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.061935 (+319494us) service_pool.cc:224] Handling call
0709 13:19:44.062370 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.062635 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:44.341081 (+278446us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.765538 (+424457us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:44.765597 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:44.765677 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.823782 (+ 58105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.823904 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1660,"prepare.queue_time_us":229193,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2450,"raft.queue_time_us":13182,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":649444,"threads_started":2,"wal-append.queue_time_us":476238}
I20260709 13:19:44.777213 24590 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:44.886134 24412 consensus_meta.cc:287] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.699s	user 0.012s	sys 0.002s
I20260709 13:19:44.875957 24385 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:44.950804 24385 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.952198 24385 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:44.886509 24229 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:44.914026 24544 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 13:19:44.915107 24160 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:44.912176 24358 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.875247 24471 consensus_queue.cc:1059] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:19:44.919448 24572 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:44.953907 24229 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.916301 24493 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.960350 24570 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:44.962493 24579 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:44.987630 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.968571 24572 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:44.971089 24229 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:44.966606 24578 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:44.925876 24568 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:44.943274 24595 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:44.992203 24561 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:45.009305 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 137911us
I20260709 13:19:44.996191 24600 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.015828 24568 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:45.023106 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:45.023869 20659 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:19:45.025290 19553 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:19:45.013312 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:45.013383 24578 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:45.023118 24595 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.036242 24471 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.031131 24600 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.052273 24600 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.052850 24471 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.044428 24578 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.055250 24471 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.055959 24578 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.046379 24595 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:45.056563 24578 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:45.056865 24595 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:45.057490 24595 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:45.057770 24578 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:45.046142 24586 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:45.072433 24555 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 1.005s	user 0.006s	sys 0.002s
I20260709 13:19:45.080720 24586 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:45.081218 24586 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:45.082422 24358 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:45.082073 24586 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:45.091445 24548 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.879s	user 0.001s	sys 0.008s
I20260709 13:19:45.092344 24572 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.094084 24617 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.094147 24489 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:45.102092 24617 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.102968 24229 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.104470 24617 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.105147 24229 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.107080 24572 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.113873 24493 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:45.113754 24534 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:45.117218 24534 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.119103 24595 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:45.120286 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:45.123003 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2919) took 1271 ms. Trace:
I20260709 13:19:45.122393 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:45.123363 19580 rpcz_store.cc:276] 0709 13:19:43.851575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.208855 (+357280us) service_pool.cc:224] Handling call
0709 13:19:44.209171 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:44.209478 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:44.927103 (+717625us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.003902 (+ 76799us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:45.004639 (+   737us) log.cc:844] Serialized 26 byte log entry
0709 13:19:45.004811 (+   172us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:45.005051 (+   240us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.122744 (+117693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.122796 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.122824 (+    28us) raft_consensus.cc:1685] finished
0709 13:19:45.122832 (+     8us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.122948 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39802,"prepare.queue_time_us":172645,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":81,"raft.queue_time_us":102064,"spinlock_wait_cycles":65295232,"thread_start_us":840204,"threads_started":3,"wal-append.queue_time_us":100166}
W20260709 13:19:45.126046 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 83860.1us
I20260709 13:19:45.128485 24623 consensus_queue.cc:1059] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:45.129437 24499 raft_consensus.cc:3055] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:45.129819 24499 raft_consensus.cc:740] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:19:45.129916 19503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 2304) took 1592 ms (client timeout 1991 ms). Trace:
I20260709 13:19:45.130613 24499 consensus_queue.cc:260] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:45.130329 19503 rpcz_store.cc:269] 0709 13:19:43.537490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.538034 (+   544us) service_pool.cc:224] Handling call
0709 13:19:45.129761 (+1591727us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54001ef5d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:45.129863 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1323606912}
I20260709 13:19:45.134979 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:45.136204 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:45.126006 24474 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:45.138942 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.140013 19503 raft_consensus.cc:2393] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:45.141898 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.142553 19503 raft_consensus.cc:2393] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:45.144285 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.144369 24572 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:45.144858 24572 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.146624 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.146800 24572 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.147202 19503 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 9.
I20260709 13:19:45.147487 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.148078 19581 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 9.
I20260709 13:19:45.149017 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.151249 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:45.153267 24594 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:45.153501 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.154203 19580 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:45.155781 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:45.156229 24451 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:45.156463 19503 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:19:45.157505 24594 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:45.157936 24594 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:45.158262 24575 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:45.158854 24575 raft_consensus.cc:697] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:45.159411 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:45.159701 24575 consensus_queue.cc:237] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.160322 24572 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:45.160701 24572 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:45.161032 24572 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:45.136643 24549 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:45.162354 24549 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:45.163154 24549 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.166517 24595 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:45.136153 24536 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:19:45.169077 24536 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:45.169458 24536 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:45.169859 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:45.170583 19503 raft_consensus.cc:2393] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:45.170285 24536 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.171447 24536 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.148967 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.172781 19584 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:45.158361 24594 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:45.173754 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.176319 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.176563 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.179123 19586 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:45.179738 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:45.183272 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:45.184429 24531 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.184866 19584 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:45.184928 24531 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.191496 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.192624 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.195024 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:45.196355 24556 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.994s	user 0.002s	sys 0.008s
I20260709 13:19:45.197180 19508 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:45.197847 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.198127 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:45.198452 19507 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:45.198604 19508 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:45.198897 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2543) took 1460 ms. Trace:
I20260709 13:19:45.199357 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.199985 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.200130 19504 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:45.137902 24474 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.200956 24474 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:45.209916 19504 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:45.200587 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.215663 19587 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:45.199227 19579 rpcz_store.cc:276] 0709 13:19:43.738100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.773017 (+ 34917us) service_pool.cc:224] Handling call
0709 13:19:43.774347 (+  1330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:43.779571 (+  5224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.779699 (+   128us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:43.780401 (+   702us) log.cc:844] Serialized 26 byte log entry
0709 13:19:44.065354 (+284953us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:44.065919 (+   565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.066066 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.192010 (+1125944us) spinlock_profiling.cc:243] Waited 74.4 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:45.198641 (+  6631us) raft_consensus.cc:1685] finished
0709 13:19:45.198662 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.198842 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26242,"raft.queue_time_us":159661,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":23884,"spinlock_wait_cycles":171216768,"thread_start_us":230199,"threads_started":1,"wal-append.queue_time_us":355329}
I20260709 13:19:45.203816 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:45.216872 19586 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:45.202718 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.217782 19503 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:45.219951 24458 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.229969 24539 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:45.230643 24539 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.232911 24539 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.203413 24531 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:45.234030 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.202913 19581 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:45.237322 19581 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:45.243049 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.249694 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 2605) took 1283 ms. Trace:
I20260709 13:19:45.250135 19658 rpcz_store.cc:276] 0709 13:19:43.966046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.966515 (+   469us) service_pool.cc:224] Handling call
0709 13:19:44.778179 (+811664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.814638 (+ 36459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.249407 (+434769us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54003f3c50. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:45.249530 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866041728}
I20260709 13:19:45.252111 19397 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d05498e224814b9b8f31e3f965ab2583 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 13:19:45.255100 20666 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:19:45.257381 19553 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:45.204475 24217 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.260073 19478 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:45.260869 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.255926 24408 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:45.265157 19579 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:45.264074 24624 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:45.259443 24388 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.271476 24388 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.269994 24624 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:45.266873 24217 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.275760 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.280187 19586 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:45.274583 24408 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.203675 24572 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.220504 24458 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:45.282562 24531 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:45.274847 24624 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:45.320634 24575 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:19:45.321799 24566 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 1.019s	user 0.001s	sys 0.012s
I20260709 13:19:45.321465 24575 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.330885 24572 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.332837 24551 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.333911 24551 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.335728 24453 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:45.336151 24551 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.336710 24408 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.312089 24531 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:45.337423 24531 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:45.317159 24474 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.323879 24575 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.344092 24594 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.352010 24217 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.361985 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.325433 24388 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.366328 19587 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:45.366863 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.367200 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.367403 19581 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:45.367972 19583 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:45.368435 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:45.368772 19478 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:45.369416 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.370759 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.368899 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.371655 24492 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:45.372246 24492 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.372555 24136 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:45.373051 24136 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.373569 24594 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.377552 19625 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:45.382272 19478 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:45.383255 19508 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:45.383565 19478 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:45.383822 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.384454 19661 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:45.385391 24408 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:45.385767 24106 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.386436 24408 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:45.386251 24106 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.386821 24408 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.386956 24539 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:45.388304 24106 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:45.388837 24106 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:45.389115 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.385046 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:45.387236 24408 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:45.391727 19655 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:45.392482 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:45.392992 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.393031 19660 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:45.393726 19661 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:45.394783 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.395360 19656 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:45.375954 19584 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:45.380995 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:45.370993 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.398324 19580 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:45.401999 19587 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:45.371755 19583 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
W20260709 13:19:45.403469 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.397872 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.404145 19587 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
W20260709 13:19:45.369990 24567 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 1.056s	user 0.000s	sys 0.009s
I20260709 13:19:45.376384 24412 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:19:45.405862 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.406199 24458 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:45.406605 19584 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:45.407377 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:45.407229 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:45.403942 24623 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:45.407904 20666 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:45.408496 24582 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:45.380724 24272 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:45.410115 24577 raft_consensus.cc:3055] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:45.409735 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.409735 24582 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.414775 19659 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:19:45.415432 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.415903 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.410835 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:45.416855 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.385776 24217 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:45.422212 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:45.421792 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.422530 19580 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:45.380791 24474 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.459967 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:45.460281 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 82791.4us
I20260709 13:19:45.461331 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.422506 24582 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:45.377592 24152 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:19:45.410183 24272 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.426772 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.437844 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.421962 24328 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.426543 24217 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.439339 24477 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.458525 24489 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:45.426438 24577 raft_consensus.cc:740] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:45.379552 24561 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.444633 24586 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:45.445657 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:45.445910 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.446319 24499 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.447279 24613 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.375157 24136 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:45.389285 24106 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.452437 24455 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:45.473932 24493 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:19:45.455853 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 46731.2us
I20260709 13:19:45.456727 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.374434 24492 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:45.419242 19581 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:45.461494 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.472415 24358 consensus_queue.cc:1059] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:19:45.463131 19625 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:45.464864 19580 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 15: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:45.469223 24539 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:45.470081 24161 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:45.474551 19660 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:45.554744 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.555979 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:45.557093 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.460307 24433 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:45.428812 19583 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:45.475049 24217 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:45.473569 24495 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:19:45.476042 24328 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.480942 24408 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.503619 19584 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:45.472079 24574 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.528712 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:45.529219 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:45.569808 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.532697 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.570464 19653 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
W20260709 13:19:45.571697 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 108646us
I20260709 13:19:45.571959 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.572682 19653 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:45.573108 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:45.574558 24607 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:45.575860 24328 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.535913 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.576179 24408 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.577535 19656 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:19:45.512056 24453 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:45.584200 19656 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:45.543637 24616 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.504349 24489 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.537351 24229 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:45.537117 24493 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.551227 24272 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:45.527393 23708 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:45.463842 24385 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.565659 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:45.597174 19581 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:45.575134 24607 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:45.579375 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 50775.7us
I20260709 13:19:45.597342 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.598785 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:45.581022 19653 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:19:45.529547 24561 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.462229 19661 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:45.553452 24578 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.538499 24539 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:45.554137 24161 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.562342 24433 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.568032 24136 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.532115 24613 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.610026 19655 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:19:45.584033 24623 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:45.603776 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:45.586283 24577 consensus_queue.cc:260] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.612421 19652 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:19:45.614598 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:45.588387 24453 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.607949 24624 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:45.607658 24161 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:45.607849 24433 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:45.605422 24272 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:45.622704 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:45.630960 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:45.633817 24388 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:45.634289 24388 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.634634 24388 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:45.637202 24592 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:45.637738 24592 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.637887 24575 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:45.638123 24592 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:45.638296 24575 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.633205 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:45.597838 24229 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.641399 19581 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:45.618877 24594 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:45.601748 23708 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:45.644052 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:45.601738 24385 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.626989 24536 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:45.607479 24578 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.627516 24577 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:45.638732 24575 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:45.611222 24136 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.677305 20665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59430 (request call id 158) took 1489 ms. Trace:
I20260709 13:19:45.592240 24616 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.683645 20665 rpcz_store.cc:276] 0709 13:19:44.187961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.188171 (+   210us) service_pool.cc:224] Handling call
0709 13:19:44.195221 (+  7050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.286285 (+ 91064us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:44.376609 (+ 90324us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.498828 (+122219us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.499221 (+   393us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:44.499272 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:44.499322 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.510719 (+1011397us) spinlock_profiling.cc:243] Waited 9.53 ms on lock 0x7b1800408460. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e63b2a6 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419
0709 13:19:45.677093 (+166374us) spinlock_profiling.cc:243] Waited 90.8 ms on lock 0x7b5400018454. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:45.677138 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.677250 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125,"prepare.queue_time_us":529912,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":16574,"raft.queue_time_us":3794,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":44771,"spinlock_wait_cycles":230799872,"thread_start_us":176548,"threads_started":2,"wal-append.queue_time_us":390354}
I20260709 13:19:45.692045 24328 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:45.692747 24328 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.695863 24328 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.680991 19659 raft_consensus.cc:3055] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:45.643395 24546 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:45.682096 19581 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:19:45.698058 19659 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:45.698076 19581 pending_rounds.cc:85] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 8
I20260709 13:19:45.700124 19581 pending_rounds.cc:107] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:19:45.700376 19581 raft_consensus.cc:2889] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:45.701105 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.701743 19505 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:45.702522 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.703446 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.706223 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.707281 19660 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:45.665489 24551 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:45.709838 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.706439 24429 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.711187 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.711627 24429 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.711694 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.713806 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.719797 19506 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:45.718367 24592 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.720485 24429 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.722980 19504 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:45.725844 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.646870 24272 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.726483 19503 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:45.730662 19579 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:19:45.731055 19579 pending_rounds.cc:85] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 8
I20260709 13:19:45.731289 19579 pending_rounds.cc:107] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:19:45.731535 19579 raft_consensus.cc:2889] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:45.600452 24574 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.731333 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:45.738111 24558 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 1.506s	user 0.009s	sys 0.004s
I20260709 13:19:45.738282 24607 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.701638 24328 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:45.726881 19659 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.704380 24572 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:45.739780 19580 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:45.668825 24531 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.744194 19659 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:45.724334 24551 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:45.751945 19578 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:45.753732 24453 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.732829 24422 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:45.646093 24539 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.785033 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.762898 24489 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:45.764858 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.764750 23708 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:45.743201 24106 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:45.770413 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:45.771047 19510 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:45.806332 19587 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:45.809005 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.809593 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.772424 24385 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:45.773851 24229 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.776288 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:45.762204 24493 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:45.834720 19659 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:19:45.835819 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:45.836583 19656 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:45.787395 19580 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:45.791126 19478 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:45.840624 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:45.841069 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 61185.5us
I20260709 13:19:45.841782 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.846752 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.839506 19625 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:45.848970 19506 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:45.850092 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.812677 19476 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:45.814095 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:45.851238 19653 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:45.814354 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.815044 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.852221 19658 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:45.815356 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:45.753103 24551 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.852859 19507 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:45.821058 19654 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:45.825757 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.826666 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.827332 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.827809 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:45.830720 19585 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:19:45.825306 19652 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:45.832476 20665 raft_consensus.cc:1240] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:45.855379 19585 pending_rounds.cc:85] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 9
I20260709 13:19:45.852284 19661 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:45.843320 19478 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:45.855861 19585 pending_rounds.cc:107] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:19:45.856269 19585 raft_consensus.cc:2889] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:45.857199 19580 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 17: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:45.861271 19655 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 17: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:45.749653 24328 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.752518 24572 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.884389 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:45.884909 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 72317.6us
I20260709 13:19:45.871168 19587 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:45.871639 19503 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 12: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:45.851313 24474 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:45.886844 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.887498 19654 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:45.888367 24497 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:45.889020 24489 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.889185 19655 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:45.821646 24335 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:19:45.873728 24455 consensus_queue.cc:1059] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:45.808845 24549 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:45.894447 19659 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:45.874424 24217 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.815791 24586 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.810526 24581 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:45.879931 19656 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:45.871194 24161 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.880978 24613 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:45.879768 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2544) took 2141 ms. Trace:
I20260709 13:19:45.855604 19625 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:45.882376 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.911543 19586 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 17: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:45.883608 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.911940 20619 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:45.890120 24536 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.813570 24471 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.864233 19478 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:45.893982 24474 raft_consensus.cc:697] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:45.891580 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:45.861471 24358 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:19:45.831544 24561 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:45.806566 24422 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.903478 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:45.913457 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:45.884356 19507 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
W20260709 13:19:45.916009 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 60473.2us
I20260709 13:19:45.887527 24412 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:19:45.892449 24553 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:45.920217 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.921217 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57052.1us
I20260709 13:19:45.890838 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.908599 19582 rpcz_store.cc:276] 0709 13:19:43.738758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.773453 (+ 34695us) service_pool.cc:224] Handling call
0709 13:19:43.775891 (+  2438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:43.781184 (+  5293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.781219 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:43.782233 (+  1014us) log.cc:844] Serialized 26 byte log entry
0709 13:19:44.095196 (+312963us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:44.234284 (+139088us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.108829 (+874545us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b1800371ce0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:19:45.152053 (+ 43224us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b1800371ce0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c313024bc 00007f6c2e65048b 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66a455 00007f6c31752060 00007f6c31764716 00007f6c31775287
0709 13:19:45.152173 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.152242 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.668596 (+516354us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:45.879474 (+210878us) raft_consensus.cc:1685] finished
0709 13:19:45.879501 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.879674 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24308,"prepare.queue_time_us":206281,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":21355,"raft.queue_time_us":350880,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":203,"spinlock_wait_cycles":60477952,"thread_start_us":359982,"threads_started":3,"wal-append.queue_time_us":375901}
I20260709 13:19:45.889564 24489 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.906983 24493 raft_consensus.cc:2764] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:19:45.932996 19476 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:45.933552 24458 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:45.958048 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:45.962743 19476 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:45.929297 24477 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:45.935199 24422 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.935683 19579 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:45.936178 24632 raft_consensus.cc:2764] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:19:45.928134 24613 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:45.938288 24272 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:45.944711 19627 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:45.945874 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:45.982105 19587 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 10: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:45.948196 19653 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:45.916615 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:45.982963 19627 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:45.949571 19580 raft_consensus.cc:2393] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:45.916085 24534 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:45.934154 24136 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:45.962277 24458 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.995253 24458 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:45.958703 24553 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.998112 24572 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.998812 24477 raft_consensus.cc:697] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:45.999702 24553 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:46.000712 24106 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:46.000111 24477 consensus_queue.cc:237] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.001132 24106 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.001578 24106 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:45.901899 24586 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.956632 24328 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:45.971061 24489 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:45.972895 24575 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.974967 24161 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:45.902405 24549 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.906642 24581 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:45.986768 19625 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:45.966059 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.980533 24613 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.927991 24471 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.988066 19627 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:45.967403 24435 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:45.928188 24536 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:45.989085 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:45.989593 24217 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:46.018523 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 55852.5us
I20260709 13:19:46.019438 19625 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:45.985066 23708 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:46.026687 19587 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:46.016938 24613 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:46.017710 24435 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.022080 24161 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:46.025327 24577 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:46.024783 24489 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:46.048516 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:46.049021 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:46.050894 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:46.051457 19586 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:45.964533 24474 consensus_queue.cc:237] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.053090 19511 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:46.031601 24136 consensus_queue.cc:1059] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:19:46.057206 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:46.057395 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:46.039078 24435 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.036936 24385 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:46.058185 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:46.070607 24536 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:46.070784 24549 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:46.081346 24388 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.082952 24586 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:46.084331 24581 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:46.072134 24575 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:46.033922 24272 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:19:46.077530 24529 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:46.086091 24529 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.086464 24529 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:46.087556 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:46.088169 19581 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:46.088812 24551 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.040490 24412 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:19:46.092741 24613 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.079411 24136 raft_consensus.cc:3055] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:46.094595 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:46.084553 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:46.061662 24229 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:19:46.044113 24489 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:46.043983 24577 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:46.078918 24433 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:46.075261 19478 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:46.093779 24152 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.118654 24152 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.121227 24152 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:46.121716 24412 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:46.112493 24136 raft_consensus.cc:740] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:46.122305 24412 raft_consensus.cc:697] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:46.122784 24136 consensus_queue.cc:260] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.123168 24412 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.124186 24136 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.125069 24551 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:46.044050 23708 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:19:46.072870 24385 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.098826 19586 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:46.141144 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:46.149331 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:46.149682 19625 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:46.116590 24489 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:46.117213 24577 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:46.159493 24482 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:19:46.150560 24385 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.161471 24152 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:46.161968 24152 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:46.162351 24152 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:46.142622 24582 consensus_meta.cc:287] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.001s
I20260709 13:19:46.084599 24388 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:46.173269 24613 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:46.183699 19625 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:46.186369 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:46.187688 19581 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:46.117810 24106 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.192833 23708 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:46.197746 24152 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.209830 24458 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.210433 23708 raft_consensus.cc:697] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:46.211202 19506 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:46.211407 23708 consensus_queue.cc:237] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.212103 24152 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:46.212569 24471 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:46.216832 24503 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.218803 24529 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.219302 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2566) took 1041 ms. Trace:
I20260709 13:19:46.220237 19506 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:46.221097 24529 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:46.221517 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:46.222302 19511 raft_consensus.cc:2368] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18.
I20260709 13:19:46.222343 24578 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:46.223351 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:46.224192 24458 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:46.228243 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 199492us
I20260709 13:19:46.187081 24582 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.231431 24574 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:46.232445 19508 raft_consensus.cc:2368] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17.
I20260709 13:19:46.234829 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:46.219758 19585 rpcz_store.cc:276] 0709 13:19:45.177596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.177745 (+   149us) service_pool.cc:224] Handling call
0709 13:19:45.178021 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.856699 (+678678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.219015 (+362316us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b5400268254. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:46.219232 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1500325120}
I20260709 13:19:46.242887 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:46.243779 19585 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:46.245683 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:46.254765 19625 leader_election.cc:400] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18.
I20260709 13:19:46.259572 19625 leader_election.cc:403] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:19:46.257226 19627 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:46.260581 19585 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.279049 24435 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.254578 24152 consensus_queue.cc:1059] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:19:46.262989 24577 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.269287 24613 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:46.283201 19627 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:46.283686 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:46.294291 19581 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:46.261996 24582 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:46.258878 24518 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:46.300158 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 2558) took 1157 ms. Trace:
I20260709 13:19:46.300549 19578 rpcz_store.cc:276] 0709 13:19:45.142535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.173449 (+ 30914us) service_pool.cc:224] Handling call
0709 13:19:46.300000 (+1126551us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b5400227ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:46.300092 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1317969280}
I20260709 13:19:46.303352 19585 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:46.303673 19583 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:46.304777 19585 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:19:46.286748 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 50323.5us
I20260709 13:19:46.290309 24161 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:46.306113 19585 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:46.309008 19512 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:46.291047 24452 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:19:46.312922 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3213) took 1121 ms. Trace:
I20260709 13:19:46.316598 19510 rpcz_store.cc:276] 0709 13:19:45.191667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.193413 (+  1746us) service_pool.cc:224] Handling call
0709 13:19:45.196440 (+  3027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.806322 (+609882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.312719 (+506397us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b5400402c54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:46.312870 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320714624}
I20260709 13:19:46.310014 19627 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:46.478278 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.310369 24613 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:46.538561 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 228621us
I20260709 13:19:46.540354 19627 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:46.547832 24435 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:46.548384 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:46.551080 24106 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:46.552802 24106 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:46.556643 24471 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.556939 24577 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:46.557252 24471 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.559827 24471 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:46.567010 24499 raft_consensus.cc:3055] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:46.567525 24499 raft_consensus.cc:740] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:46.568393 24499 consensus_queue.cc:260] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:46.541249 24561 raft_consensus.cc:2764] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:19:46.597329 19512 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:46.306744 24518 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.613001 24385 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.615680 24385 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:46.570739 24505 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:46.617869 24489 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.620560 24489 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:46.631165 24518 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:46.569592 24499 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.640938 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2366) took 1161 ms. Trace:
I20260709 13:19:46.641492 19660 rpcz_store.cc:276] 0709 13:19:45.479186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.556856 (+ 77670us) service_pool.cc:224] Handling call
0709 13:19:46.640716 (+1083860us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400021554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:46.640863 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344021248}
I20260709 13:19:46.660495 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:46.661379 19506 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.661893 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:46.663945 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:46.664670 19511 raft_consensus.cc:2368] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14.
I20260709 13:19:46.665414 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:46.674741 19625 leader_election.cc:400] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14.
I20260709 13:19:46.675074 19625 leader_election.cc:403] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:19:46.693593 19506 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:46.679772 24106 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:46.670414 24518 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:19:46.690274 24493 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.722959 24616 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:46.726150 19478 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.432s (SENT) [suppressed 3 similar messages]
I20260709 13:19:46.729115 24616 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.729720 24616 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.731755 24616 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:46.743438 24539 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:46.748073 24531 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:46.755390 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:46.756096 19652 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:19:46.756474 19504 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:46.756702 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:46.757488 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:46.762256 19505 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:46.765889 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:46.774705 19509 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:46.775439 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:46.775993 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:46.776432 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:46.777068 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:46.777601 19653 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:46.777518 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:46.777907 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:46.778471 19655 raft_consensus.cc:2368] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14.
I20260709 13:19:46.778968 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:46.779124 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:46.779680 19654 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:46.781705 19656 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:46.781450 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:46.783871 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 235578us
I20260709 13:19:46.784595 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:46.786254 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:46.786993 19661 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:46.789770 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:46.790089 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:46.790722 19654 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:46.786691 19625 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:46.792387 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:46.795210 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:46.797456 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:46.798763 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:46.803303 19510 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:46.804762 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:46.806700 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:46.807843 19659 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:46.808947 19658 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 15: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:46.809862 19653 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:19:46.808152 19627 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:46.815979 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:46.797497 24654 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:19:46.826711 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:46.829213 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:46.829922 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:46.830544 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:46.831316 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:46.830538 19510 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
W20260709 13:19:46.832584 24161 consensus_meta.cc:287] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.002s
I20260709 13:19:46.831988 19504 raft_consensus.cc:2368] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14.
I20260709 13:19:46.832998 24161 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18.
I20260709 13:19:46.834087 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:46.832746 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:46.836149 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:46.836872 19504 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:46.809252 24272 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:46.805119 24574 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:46.804965 24578 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:46.850755 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:46.851540 19503 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:19:46.840420 24136 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:46.801795 24616 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.845592 24574 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:46.884510 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 158390us
I20260709 13:19:46.848414 24578 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:46.849931 24272 raft_consensus.cc:697] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:46.855525 24136 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.857316 24499 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:46.842864 24518 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:46.892750 19509 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:46.885489 24574 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:46.875850 24461 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:19:46.898867 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 100172us
I20260709 13:19:46.906303 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:46.889537 24578 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:46.895035 24136 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:46.859297 24616 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.893764 24499 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:46.933848 19503 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:19:46.904975 24452 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:46.905306 24503 consensus_meta.cc:287] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.688s	user 0.009s	sys 0.004s
I20260709 13:19:46.919453 24493 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14.
I20260709 13:19:46.950670 19657 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:46.950948 24663 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:46.950966 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2945) took 1146 ms. Trace:
I20260709 13:19:46.915926 24161 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:46.952641 19583 rpcz_store.cc:276] 0709 13:19:45.804093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.304414 (+500321us) service_pool.cc:224] Handling call
0709 13:19:46.304634 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:46.304825 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:46.727869 (+423044us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.950652 (+222783us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:46.950702 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:46.950751 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.950809 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.950914 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":423198,"prepare.queue_time_us":422874,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"thread_start_us":221856,"threads_started":2,"wal-append.queue_time_us":216171}
I20260709 13:19:46.944682 24499 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:46.951298 24579 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:46.963277 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 57036us
I20260709 13:19:46.964140 19551 leader_election.cc:400] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14.
I20260709 13:19:46.964669 24503 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:46.965355 24503 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:46.968066 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 907251us
I20260709 13:19:46.968218 24503 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:46.968441 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:46.975123 24630 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:46.976986 24412 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:46.951774 24489 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:46.918383 24461 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:46.938319 24656 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:19:46.989153 19476 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:46.946674 24452 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.983072 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 3225) took 1282 ms. Trace:
I20260709 13:19:46.995690 19508 rpcz_store.cc:276] 0709 13:19:45.699981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.700355 (+   374us) service_pool.cc:224] Handling call
0709 13:19:46.982533 (+1282178us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b5400207bd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:46.982692 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1216856832}
I20260709 13:19:46.984867 24461 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:46.998196 19625 leader_election.cc:400] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17.
I20260709 13:19:46.998626 19625 leader_election.cc:403] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:46.999332 19476 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:46.964433 19551 leader_election.cc:403] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:19:46.992525 24661 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:46.957119 24161 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.994115 24616 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:46.993021 24592 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:47.003772 24662 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:47.008376 19659 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:46.972563 24579 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:46.996918 24497 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:46.954936 24272 consensus_queue.cc:237] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.018488 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:47.020991 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:47.021673 19656 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.957763 24663 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:47.016726 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:47.004240 24661 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.004017 24531 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:47.031724 24663 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:46.989214 24489 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:47.037324 24489 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:47.029443 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:47.039971 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:47.040860 20665 raft_consensus.cc:2393] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 9: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:19:47.042016 24161 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:47.030416 24659 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:19:47.032092 24661 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:47.009757 24561 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:19:47.048849 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:47.049276 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:47.052354 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:47.056864 24579 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:47.065798 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:47.067540 19656 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:47.067926 19652 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:47.071709 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:47.072880 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2585) took 1655 ms. Trace:
I20260709 13:19:47.050419 24616 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.051914 24335 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.092598 24335 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.094808 24335 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:47.080808 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:47.087440 24616 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:47.091938 19505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 3231) took 1383 ms (client timeout 1520 ms). Trace:
W20260709 13:19:47.092121 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:47.098403 19505 rpcz_store.cc:269] 0709 13:19:45.708528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.709591 (+  1063us) service_pool.cc:224] Handling call
0709 13:19:47.091761 (+1382170us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400403154. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:47.091874 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2418858240}
I20260709 13:19:47.104084 19661 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:19:47.060297 24665 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:47.084828 19584 rpcz_store.cc:276] 0709 13:19:45.419927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.565510 (+145583us) service_pool.cc:224] Handling call
0709 13:19:45.588603 (+ 23093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.648560 (+ 59957us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:45.702343 (+ 53783us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.844629 (+142286us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.146096 (+301467us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b18001e0d00. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e5e7c0a 00007f6c37d27219 00007f6c3562e58f 00007f6c2e66d571 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd
0709 13:19:46.716699 (+570603us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b18001e0d00. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e5e7c0a 00007f6c37d27219 00007f6c2e66fa40 00007f6c2e66a4e4 00007f6c2e66a455 00007f6c351523c7 00007f6c317649a7 00007f6c317740bf 00007f6c31774038
0709 13:19:46.716913 (+   214us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.727388 (+ 10475us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:46.727445 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:46.727492 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.072643 (+345151us) spinlock_profiling.cc:243] Waited 59.7 ms on lock 0x7b5400269154. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:47.072690 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.072822 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":997313,"prepare.queue_time_us":1430179,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":109,"raft.queue_time_us":53076,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":19982,"spinlock_wait_cycles":149332608,"thread_start_us":60152,"threads_started":2,"wal-append.queue_time_us":123562}
I20260709 13:19:47.107555 19627 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:47.114503 24452 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:47.123113 20665 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:47.123067 19478 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:47.125245 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:47.126049 19661 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:47.127353 19627 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:47.128461 19478 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:47.134539 19478 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:47.135996 19478 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:47.136723 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:47.139896 19627 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:47.075773 24663 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:19:47.139348 24579 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:47.150295 24661 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.151297 24553 consensus_queue.cc:1059] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:47.151816 24662 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14.
I20260709 13:19:47.151923 24616 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:47.153134 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:47.114493 24589 raft_consensus.cc:3055] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:47.167665 19627 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:47.123602 24665 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.130739 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:47.127049 24328 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.165823 24335 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:47.133069 24632 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:47.133298 24505 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:47.153553 24577 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:47.185876 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:47.152760 24495 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:47.126688 24482 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:19:47.193939 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:47.198329 19659 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:47.178691 24489 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:47.141389 24136 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.184733 24589 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:47.190683 24579 raft_consensus.cc:2764] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:19:47.190071 24616 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:19:47.235595 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 49826.2us
I20260709 13:19:47.237936 19652 raft_consensus.cc:2368] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16.
I20260709 13:19:47.238919 24663 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:47.236712 24656 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:47.241333 24433 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:47.184094 24574 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.236490 24411 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:47.244330 24661 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:47.224334 24335 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:47.245991 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:47.246724 19657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 2619) took 2453 ms. Trace:
I20260709 13:19:47.188841 24665 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:47.179711 24499 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.256168 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:47.226606 24632 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:47.265743 19660 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:47.231254 24577 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:47.224421 24578 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.283592 24578 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:47.284132 24578 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:47.273864 24411 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:47.284591 24578 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.261438 24663 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.286635 24411 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:47.287102 24663 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:47.287642 24663 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:47.288086 24663 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.270077 19659 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:47.278560 24661 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:47.290277 24661 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.291277 19659 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:47.291342 24136 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:47.292275 24661 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:47.261854 24616 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:47.271265 19655 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:47.293774 24616 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.275008 19656 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:19:47.229511 24328 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:47.298969 24499 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:47.300030 24589 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.301174 24589 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:47.302837 24664 log.cc:927] Time spent T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.338s	user 0.004s	sys 0.000s
I20260709 13:19:47.303375 24663 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:47.303599 24574 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:47.275074 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:47.273324 19657 rpcz_store.cc:276] 0709 13:19:44.793225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.795544 (+  2319us) service_pool.cc:224] Handling call
0709 13:19:44.795860 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:46.951122 (+2155262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.246455 (+295333us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b5400122fd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:47.246636 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4954818304}
I20260709 13:19:47.262850 24495 raft_consensus.cc:697] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:47.279785 24632 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:47.281548 24577 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:47.274492 24335 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:47.268348 24505 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:19:47.302764 24578 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:47.332238 24499 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:47.332885 24412 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:47.330821 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:47.337754 20665 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:47.326582 24574 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:47.329068 24161 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:47.343397 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:47.338495 24328 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:47.348896 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:47.351318 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:47.352073 19583 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:47.355378 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:47.357971 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:47.358633 19585 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:47.359740 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:47.360509 19586 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 17: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:47.361991 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:47.363328 24581 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:47.363970 24581 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.373863 19582 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:47.331440 24663 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:47.380275 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:47.348405 24161 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.399428 24161 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:47.399561 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:47.400317 19586 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 18: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:47.383718 19582 raft_consensus.cc:2393] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:47.385303 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:47.389849 24663 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.357141 24495 consensus_queue.cc:237] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.392766 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:47.393548 20665 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:47.350045 24578 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:47.397969 24491 raft_consensus.cc:3055] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:47.398445 19579 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:47.338968 24499 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.340904 24412 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:47.417423 24412 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:47.408135 19587 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 15: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:47.418627 24412 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.348670 24574 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:47.419117 24412 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.420907 24412 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:47.420920 24574 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:47.422505 24561 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17.
I20260709 13:19:47.418871 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:47.427435 24406 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:47.428040 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:47.428535 24579 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:47.429030 24561 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:47.429688 24561 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.429026 24579 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.432649 24577 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.435190 24579 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:47.436489 24632 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.428087 24406 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:47.439481 24561 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:47.421478 19581 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:47.469031 19661 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
W20260709 13:19:47.471040 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 405293us
I20260709 13:19:47.460646 19583 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:47.471702 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:47.463171 19585 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:47.479046 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:47.479760 19579 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:47.479261 24406 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:47.481751 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 236210us
I20260709 13:19:47.415067 24491 raft_consensus.cc:740] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:47.485034 19625 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:43.404301 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:47.473502 24579 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:47.490195 19410 catalog_manager.cc:5697] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 11 to 15, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 15 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.491765 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:47.494585 19579 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 9.
I20260709 13:19:47.495901 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:47.496156 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:47.496234 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.496897 19581 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:47.492619 24136 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:47.499176 24136 raft_consensus.cc:697] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:47.504295 19410 catalog_manager.cc:5697] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 4 to 8, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New cstate: current_term: 10 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.505311 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:47.506160 19508 raft_consensus.cc:1813] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Handling vote request from an unknown peer 2cfd02601ea44976833027665abc93bf
I20260709 13:19:47.506819 19508 raft_consensus.cc:2410] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:19:47.441592 24578 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.513496 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:47.516630 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:47.518927 19585 raft_consensus.cc:2393] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:47.520540 24136 consensus_queue.cc:237] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.522009 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:47.525566 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:47.526765 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:47.527405 19582 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:47.530274 24581 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:47.557718 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:47.559790 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:47.560984 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:47.561158 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:47.556320 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:47.558393 19579 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:47.568418 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:47.576490 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:47.579711 19508 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:47.585072 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:47.513363 24335 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.594651 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:47.595734 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:47.496542 24665 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.597944 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:47.604985 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:47.598809 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:47.599350 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:47.600008 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:47.600713 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:47.602070 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:47.602273 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:47.609455 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.611842 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:47.502439 24579 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:47.586062 24660 log.cc:927] Time spent T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.614s	user 0.000s	sys 0.003s
I20260709 13:19:47.629498 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:47.575047 24537 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:47.675894 19580 raft_consensus.cc:2393] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:47.676662 19505 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:47.681241 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:47.682857 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:47.594295 24673 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.586277 24676 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:47.687808 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:47.694723 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:47.621989 24632 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:47.584597 24616 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:19:47.613725 24574 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:47.614406 24677 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.703650 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:47.623461 24662 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:47.705099 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:47.710913 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:47.711313 19660 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:47.711696 19582 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:47.709473 19581 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:47.710512 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:47.712713 19579 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:47.562425 24491 consensus_queue.cc:260] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.609046 24675 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.094s
I20260709 13:19:47.716828 19476 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:47.719766 19508 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16. Ops: []
W20260709 13:19:47.740638 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 128915us
I20260709 13:19:47.623770 24661 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:19:47.758496 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:47.759449 19503 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:47.707975 24577 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:47.769224 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 52454us
I20260709 13:19:47.769788 24632 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:47.770792 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:47.822715 19586 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:47.772001 24684 log.cc:927] Time spent T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:19:47.772789 24672 log.cc:927] Time spent T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 13:19:47.777020 19579 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
W20260709 13:19:47.782354 24679 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:19:47.784184 24579 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:47.839538 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:47.841161 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:47.804603 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:47.808023 19407 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48826 (request call id 180) took 28584 ms (client timeout 15000 ms). Trace:
I20260709 13:19:47.847664 19653 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:47.809773 24335 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:47.812476 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:47.741964 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:47.833303 19476 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:47.760066 24491 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:47.834612 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:47.849377 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:47.850142 19579 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:47.790305 24678 log.cc:927] Time spent T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:19:47.854017 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:47.761731 24663 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:47.687808 24537 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:47.815917 24499 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:47.867239 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 125343us
I20260709 13:19:47.867605 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:47.868382 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:47.701318 24673 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.858011 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:47.858418 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:47.859330 19476 leader_election.cc:400] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16.
I20260709 13:19:47.878383 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:47.884135 19476 leader_election.cc:403] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:19:47.892095 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:47.894399 19655 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:47.714982 24677 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.900219 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:47.908164 19582 raft_consensus.cc:2368] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16.
W20260709 13:19:47.847961 19407 rpcz_store.cc:269] 0709 13:19:19.224116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.224489 (+   373us) service_pool.cc:224] Handling call
0709 13:19:47.807924 (+28583435us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:41.505314 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:41.505930 (+   616us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:41.505966 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:19:41.505986 (+    20us) tablet.cc:662] Decoding operations
0709 13:19:41.506757 (+   771us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:41.506840 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:41.506881 (+    41us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:19:41.507597 (+   716us) tablet.cc:701] Row locks acquired
0709 13:19:41.507623 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:19:41.507802 (+   179us) write_op.cc:270] Start()
0709 13:19:41.507943 (+   141us) write_op.cc:276] Timestamp: P: 1783603181507745 usec, L: 0
0709 13:19:41.507974 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:19:41.563271 (+ 55297us) log.cc:844] Serialized 2495 byte log entry
0709 13:19:41.807801 (+244530us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c2e6500ac 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b
0709 13:19:42.501852 (+694051us) op_driver.cc:464] REPLICATION: finished
0709 13:19:42.542629 (+ 40777us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c2e6500ac 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c35190ef0
0709 13:19:42.670773 (+128144us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b1800115de0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:19:42.670908 (+   135us) write_op.cc:301] APPLY: starting
0709 13:19:42.670986 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:42.759619 (+ 88633us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:42.759646 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:42.912011 (+152365us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:42.915090 (+  3079us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:19:42.915154 (+    64us) write_op.cc:312] APPLY: finished
0709 13:19:42.918519 (+  3365us) log.cc:844] Serialized 64 byte log entry
0709 13:19:42.918709 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:42.930311 (+ 11602us) write_op.cc:454] Released schema lock
0709 13:19:42.932189 (+  1878us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:42.936535 (+  4346us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:42.936571 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":497022,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":90091,"apply.run_cpu_time_us":10857,"apply.run_wall_time_us":265597,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29195,"num_ops":6,"prepare.queue_time_us":501390,"prepare.run_cpu_time_us":30818,"prepare.run_wall_time_us":507844,"raft.queue_time_us":115255,"raft.run_cpu_time_us":10610,"raft.run_wall_time_us":124490,"replication_time_us":993683,"spinlock_wait_cycles":114255744,"thread_start_us":850394,"threads_started":4,"wal-append.queue_time_us":776389,"wal-append.run_cpu_time_us":30427,"wal-append.run_wall_time_us":1705345}]]}
I20260709 13:19:47.901345 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:47.848471 24632 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:47.880436 19579 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:47.903170 19551 leader_election.cc:400] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14.
I20260709 13:19:47.827553 24656 consensus_queue.cc:1059] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:19:47.909775 24632 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.816051 24161 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:47.911434 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:47.912503 24499 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:47.913197 24161 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:47.881462 24539 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:47.893952 24693 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:47.919179 24578 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:47.919271 24665 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:47.919900 24578 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:47.920468 24578 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:47.829427 24685 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:19:47.923244 24553 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:47.915439 19653 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:47.916814 19652 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 15: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:47.892503 24661 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:47.914212 24616 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:47.926563 19578 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:47.926702 24616 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:47.927385 24616 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:47.882716 24674 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.933770 19582 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:47.951026 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:47.914812 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:47.898021 24497 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16.
I20260709 13:19:47.966675 24539 raft_consensus.cc:697] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:47.765443 24630 consensus_queue.cc:1175] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e19c80e9149b4b8d88ae13bde8e43864" responder_term: 15 status { last_received { term: 12 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: [14.8-14.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:47.971414 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:47.975034 19586 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:47.975221 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:47.977352 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 79112.1us
W20260709 13:19:47.975097 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 60373.6us
I20260709 13:19:47.979261 19476 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:47.964087 24661 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:47.989848 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:47.914971 24577 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:19:47.905687 24552 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:19:47.994807 19476 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:48.001097 24495 consensus_queue.cc:1059] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:48.010601 24495 raft_consensus.cc:3055] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:48.003629 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:47.981132 24676 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:48.009232 19476 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:48.014067 19654 raft_consensus.cc:2393] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:47.980265 24161 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.040479 24161 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.042758 24161 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:48.046121 24537 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:48.047683 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:48.048193 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:48.049353 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:48.052071 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:48.052682 19509 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:48.054314 19579 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:48.015331 19476 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:48.011050 24495 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:48.013792 24328 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:47.998553 24448 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:48.014014 24358 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.021497 24677 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:48.022635 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:48.023480 19653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:48.100910 19653 raft_consensus.cc:606] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:48.024948 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:48.026278 19582 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:48.026445 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:48.028023 24682 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.424s	user 0.000s	sys 0.002s
I20260709 13:19:48.028482 19585 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:48.029011 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:48.103526 19587 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:48.030097 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:48.104169 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:48.104686 19580 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:48.031586 24578 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:47.965026 24674 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:47.988435 24656 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.119236 24656 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.120949 24674 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:48.121868 24656 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:48.122124 24662 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:48.122575 24662 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:19:48.059365 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 44109.7us
I20260709 13:19:48.123052 24495 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.123530 24662 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:48.124648 24495 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:48.124899 24662 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:48.017799 24685 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:48.064668 19625 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:48.126513 24589 consensus_meta.cc:287] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.825s	user 0.016s	sys 0.004s
I20260709 13:19:47.998777 24497 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 13:19:48.099474 24448 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.127351 24448 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:48.129933 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:48.130626 19657 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:48.132843 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.132736 20619 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:48.134105 24700 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:48.067291 24692 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:19:48.068100 24539 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.114918 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:48.138204 19654 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:19:48.065421 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:48.085747 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:48.095252 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:48.098380 19503 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:48.010859 24673 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:48.077569 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:48.108433 19582 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:48.156173 19652 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:48.109033 19661 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:19:48.112370 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:48.157742 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:48.117296 24691 raft_consensus.cc:3055] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:48.117455 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:48.118363 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:48.134768 19476 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:48.161927 19582 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:48.141000 19507 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:48.139647 19581 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:48.158116 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:48.164182 19476 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:48.143218 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.166978 19476 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:48.168689 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:48.063745 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:48.170327 19586 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:48.170773 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:48.171164 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:48.171996 19587 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 9.
I20260709 13:19:48.173769 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:48.153041 19657 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:48.170792 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:19:48.175261 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:48.154449 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 89869.5us
I20260709 13:19:48.177414 19553 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:48.158133 19659 raft_consensus.cc:2393] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:48.070075 24581 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:48.067586 24406 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:48.159404 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:48.112704 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:48.197242 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:48.198817 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:48.204509 19579 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:48.110785 24328 raft_consensus.cc:697] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:48.202033 19553 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:48.212690 19580 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:48.215001 19582 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:48.101404 24161 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:19:48.218144 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:48.160619 24661 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.155707 24578 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:48.221058 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:48.195217 24335 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:48.225219 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:48.160830 24691 raft_consensus.cc:740] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:48.161513 24677 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.161501 24499 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.235502 19586 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 15: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:19:48.222538 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 64505.7us
I20260709 13:19:48.218883 24693 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:48.200210 24688 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:48.111584 24358 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.241240 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:48.268110 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:48.203330 24675 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:48.231083 24574 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:48.279249 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:48.279920 19586 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:48.247336 19654 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:19:48.215757 24665 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:48.282341 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:48.283955 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:48.205506 24581 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:48.246177 24335 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.173966 24673 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:48.261752 19627 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:48.309859 24161 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:48.243468 24661 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:48.335875 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 118766us
I20260709 13:19:48.278887 19652 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:48.248430 24578 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.299868 24136 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:48.304960 24358 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:48.297459 19478 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:48.308518 24335 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:48.310036 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 48497.7us
I20260709 13:19:48.349972 19627 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:48.228271 24685 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:48.311651 19658 raft_consensus.cc:2410] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:19:48.228423 24531 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:19:48.313311 19653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:48.314118 19661 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 8.
I20260709 13:19:48.257756 19579 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:48.274957 24497 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:48.327006 19582 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:48.361120 19627 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:48.327625 20631 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:19:48.278863 24688 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.372611 24688 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:48.231588 24272 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:48.306951 24581 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:48.376958 24578 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:48.377241 24561 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:48.348064 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 50687.9us
W20260709 13:19:48.378104 24705 log.cc:927] Time spent T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:19:48.378029 24592 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:48.378312 19478 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:48.341828 24136 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:48.379598 24136 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.380391 24482 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:48.380697 19478 leader_election.cc:400] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16.
I20260709 13:19:48.380915 24136 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:48.381513 24482 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:48.324915 24574 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:19:48.382256 24703 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:19:48.275940 24677 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.357867 19653 raft_consensus.cc:606] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:48.384423 19653 raft_consensus.cc:614] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:48.358726 19586 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:48.276585 24616 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.276247 24499 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:48.404606 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 43584.7us
I20260709 13:19:48.405452 19627 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:48.406601 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 188573us
I20260709 13:19:48.407610 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:48.409114 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:48.352836 24412 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:48.414633 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:48.426851 19627 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:48.429049 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:48.430778 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:48.398006 24520 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:48.434784 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:48.435333 19587 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:48.382266 24482 consensus_queue.cc:1243] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:48.438422 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:48.440081 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:19:48.414785 24579 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:48.335981 24328 consensus_queue.cc:237] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.415858 24578 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:48.415050 24574 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:48.469887 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:48.423784 24693 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:48.434307 24665 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:48.434271 24561 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.450788 24452 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:48.471261 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:48.436889 24520 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.435505 24589 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:48.426509 24685 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:19:48.355129 24691 consensus_queue.cc:260] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.479173 24561 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.480535 24717 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:48.482945 24718 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:19:48.484315 24698 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.362s	user 0.004s	sys 0.000s
I20260709 13:19:48.484582 24579 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:48.424827 24673 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:19:48.489660 19655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:48.571357 19655 raft_consensus.cc:606] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:48.571837 19655 raft_consensus.cc:614] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:48.491029 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:48.468876 24676 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:48.488101 24452 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:48.478016 24690 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:48.491910 24520 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.497364 24717 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:48.496342 24592 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:48.491794 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 67142.7us
W20260709 13:19:48.579582 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 100726us
W20260709 13:19:48.601773 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 245845us
W20260709 13:19:48.551676 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.507287 24589 raft_consensus.cc:697] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:48.504753 24718 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.615089 19476 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:48.572775 24691 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:48.614423 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:48.567263 24579 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:48.604142 24452 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:48.567873 24656 consensus_queue.cc:1175] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d56df3728fc04e37b2d29a3bcd91d167" responder_term: 15 status { last_received { term: 14 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:19:48.678180 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 60719.3us
W20260709 13:19:48.717914 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 99451.2us
I20260709 13:19:48.605167 24690 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:48.616724 24717 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:48.619808 24663 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:48.742827 19658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:48.743487 19658 raft_consensus.cc:606] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:48.618003 24592 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:48.655503 24579 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:48.618026 24718 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:48.656366 24704 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:48.735299 24716 log.cc:927] Time spent T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 13:19:48.730019 24692 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:48.612136 24693 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.117s
I20260709 13:19:48.664345 24661 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:48.754065 24673 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.754703 24673 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.686792 24676 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:48.755667 24676 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:48.755761 24335 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.756546 24676 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.747548 24724 consensus_queue.cc:1059] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:19:48.753882 24692 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:48.761793 24677 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:48.761893 24632 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:48.750844 24730 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:48.733922 24690 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:48.747032 24592 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:48.770345 24412 raft_consensus.cc:3055] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:48.770893 24412 raft_consensus.cc:740] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:48.771919 24412 consensus_queue.cc:260] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:48.785851 24713 log.cc:927] Time spent T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 13:19:48.752871 24630 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:19:48.785876 19658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:48.749969 24616 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:48.906234 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:48.906921 19505 raft_consensus.cc:1275] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:48.849874 24412 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:48.869050 24448 consensus_meta.cc:287] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.741s	user 0.008s	sys 0.003s
W20260709 13:19:48.909725 19654 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.003s	sys 0.003s
W20260709 13:19:48.918254 19654 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.004s	sys 0.004s
W20260709 13:19:48.853366 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:48.903584 24581 consensus_meta.cc:287] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.002s
W20260709 13:19:48.926513 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.926389 19505 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:48.927647 24491 consensus_meta.cc:287] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 1.070s	user 0.018s	sys 0.001s
I20260709 13:19:48.902294 24677 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:48.928850 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:48.913453 24272 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:48.964092 24272 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.789685 24531 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 13:19:48.937884 24448 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.986385 19510 raft_consensus.cc:1275] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:19:48.944345 24452 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.946795 24579 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.992873 24579 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:48.951378 24561 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:48.953805 24662 consensus_meta.cc:287] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.828s	user 0.010s	sys 0.006s
I20260709 13:19:48.966327 24581 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.993584 19509 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:19:48.995977 24581 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:48.996459 24452 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:48.932915 24688 consensus_meta.cc:287] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.000s
I20260709 13:19:48.953248 24520 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:48.997294 24688 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.999951 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:49.000093 24688 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:49.000216 24520 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:49.000591 19585 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:48.958801 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 44572.3us
I20260709 13:19:48.989638 24272 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:48.990957 24448 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:48.866907 24589 consensus_queue.cc:237] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.981858 24677 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.007126 24677 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:49.008275 19585 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 10.
I20260709 13:19:49.009708 20631 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:19:49.009502 24561 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:49.010697 24700 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:49.011305 24700 raft_consensus.cc:697] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 10 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:19:49.012243 24700 consensus_queue.cc:237] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:49.012849 24718 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:48.917378 24726 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:49.014385 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 295366us
I20260709 13:19:49.006965 24581 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:19:48.965459 24136 consensus_meta.cc:287] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.584s	user 0.014s	sys 0.000s
W20260709 13:19:48.937439 24495 consensus_meta.cc:287] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.812s	user 0.010s	sys 0.000s
W20260709 13:19:48.983942 24161 consensus_meta.cc:287] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.648s	user 0.006s	sys 0.005s
I20260709 13:19:48.962996 24335 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:49.019176 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 404794us
I20260709 13:19:49.021664 19658 raft_consensus.cc:606] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:49.023887 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 532947us
I20260709 13:19:49.035754 19627 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:49.035981 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:49.035171 19658 raft_consensus.cc:614] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:49.038148 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.048764 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:49.049831 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:49.027889 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 348132us
I20260709 13:19:49.053884 19660 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:49.056424 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:49.057135 19655 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:49.056833 19627 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:49.066108 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:49.072626 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:49.073668 19507 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:19:49.079620 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:49.083483 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:49.088227 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:49.094012 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:49.084442 19508 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 10.
I20260709 13:19:49.098477 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:49.103379 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:49.107669 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 50917us
I20260709 13:19:49.110469 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:49.111008 19627 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:49.111716 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:49.112459 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:49.114960 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:49.118096 19627 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:49.119176 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:49.119402 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:49.113276 19661 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:19:49.124315 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:49.125428 19653 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:49.126557 19627 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:49.034430 24161 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:49.127532 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:49.127743 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:49.034240 24495 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.117399 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:49.134124 19503 raft_consensus.cc:1813] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Handling vote request from an unknown peer 2cfd02601ea44976833027665abc93bf
I20260709 13:19:49.134986 19503 raft_consensus.cc:2410] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:19:49.117755 24661 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.137738 24661 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.140085 24661 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:49.117897 24662 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:49.132057 24616 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:49.144948 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:49.105773 24539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.015s	sys 0.029s
I20260709 13:19:49.152757 19504 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:49.157116 19660 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:49.159374 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:49.128255 24732 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:49.124850 24688 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:49.131980 24505 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:49.164597 24496 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:49.117084 24579 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:49.222918 24579 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.166471 19655 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:19:49.167389 19627 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:49.100569 24730 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:49.171700 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:49.227999 19661 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:19:49.229049 19657 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:49.020463 24726 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:49.149989 24539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.016s	sys 0.029s
I20260709 13:19:49.165287 24495 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.106051 24452 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:49.035132 24136 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
W20260709 13:19:49.191490 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 64127.3us
I20260709 13:19:49.252261 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:49.193368 24496 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:49.178303 19504 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.140996 24717 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.193048 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:49.225394 24579 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:49.330798 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 163516us
I20260709 13:19:49.332904 19504 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:49.182840 24561 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:49.185339 24688 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:19:49.382553 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 49605us
I20260709 13:19:49.141068 24662 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.196676 24161 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:49.384929 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:49.227113 24578 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:49.389394 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:49.390121 19580 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
W20260709 13:19:49.390313 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 222269us
I20260709 13:19:49.395780 19584 raft_consensus.cc:1275] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:19:49.402421 19627 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:49.149140 24690 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:49.405980 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:49.379079 24734 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.406337 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:49.410614 24520 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.391047 24452 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:49.388330 24688 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:49.413259 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:49.425961 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:49.449729 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 197566us
I20260709 13:19:49.452025 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:49.463382 19584 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:49.448743 24589 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:49.467319 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:49.467478 24589 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:49.468078 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 2988) took 1268 ms. Trace:
I20260709 13:19:49.468245 24589 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:49.468541 19587 rpcz_store.cc:276] 0709 13:19:48.200167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.224989 (+ 24822us) service_pool.cc:224] Handling call
0709 13:19:49.467909 (+1242920us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54002fc954. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:49.468016 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434547584}
I20260709 13:19:49.414671 24581 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:49.470453 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:49.472592 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:49.473517 19585 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:49.478080 19587 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 17: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:49.477298 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:49.432018 24452 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:19:49.487710 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 431878us
I20260709 13:19:49.427618 24677 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:49.430883 24520 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:49.479193 19584 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.476184 24531 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.475288 24505 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:19:49.516350 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 100827us
I20260709 13:19:49.515506 24750 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
W20260709 13:19:49.522177 24738 log.cc:927] Time spent T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:19:49.479939 24718 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:49.523456 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:49.478852 24728 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:49.524665 19587 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: []
W20260709 13:19:49.512676 24691 consensus_meta.cc:287] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.888s	user 0.004s	sys 0.007s
I20260709 13:19:49.425287 24734 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.528460 19627 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:49.509836 24452 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:49.419806 24496 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.513155 24677 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:49.530222 24136 raft_consensus.cc:993] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:19:49.530423 24272 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.530687 24505 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:49.535183 24750 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:49.535535 24578 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:49.536422 24691 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:49.537439 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:49.530107 24728 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.480692 24581 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.549247 19583 raft_consensus.cc:1275] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:49.551229 19652 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:49.555182 19584 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:19:49.540784 24718 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:49.523536 24531 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.545806 24677 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.588331 24726 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:49.589152 24736 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:19:49.589504 24690 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:49.590447 24497 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:49.591259 24497 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:49.591701 24531 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:49.549017 24161 raft_consensus.cc:1081] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:19:49.548821 24136 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.563233 24718 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.557296 24272 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.556737 24751 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:49.583865 24495 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:49.604027 24718 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:49.597673 24752 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:49.612512 24751 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.559559 24578 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.622221 24728 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:49.622516 24520 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:49.611364 24662 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:49.628381 24499 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:49.629662 24734 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:49.630396 24742 raft_consensus.cc:993] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:19:49.630937 24742 raft_consensus.cc:1081] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:19:49.631958 24619 raft_consensus.cc:3055] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:49.632359 24619 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:49.633029 24592 consensus_meta.cc:287] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.863s	user 0.008s	sys 0.002s
I20260709 13:19:49.618245 24752 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:49.633458 24592 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.649083 24673 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:49.654863 24692 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.637791 24752 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:49.656111 24692 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:49.633159 24619 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.703756 24718 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.706908 24718 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:49.710588 24764 log.cc:927] Time spent T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:19:49.732156 24752 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:49.770525 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 288607us
W20260709 13:19:49.771436 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.773772 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 269880us
I20260709 13:19:49.777699 19476 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:49.779247 19478 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:49.803526 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:49.605304 24136 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.805616 19584 raft_consensus.cc:2410] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:19:49.657275 24619 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:49.779505 19476 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:49.823756 24673 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:49.824205 24718 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.825048 24718 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:49.830082 24734 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:49.833814 24734 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.835225 24136 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:49.835696 24578 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:49.836894 24734 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:49.838939 24688 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.849185 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 2987) took 1649 ms. Trace:
I20260709 13:19:49.849797 24136 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:49.850965 24136 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:49.854266 24632 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:49.856695 24491 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:49.615226 24505 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.806910 24272 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:49.857406 24632 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:19:49.888259 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 74021.5us
I20260709 13:19:49.927881 24539 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:49.895207 24574 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:49.931064 24574 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:49.931778 24136 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:49.904232 24688 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:49.823845 24693 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.825085 24673 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.933758 24693 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.934916 24717 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:49.935724 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:49.849851 19586 rpcz_store.cc:276] 0709 13:19:48.199809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.298551 (+ 98742us) service_pool.cc:224] Handling call
0709 13:19:48.358563 (+ 60012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.385212 (+ 26649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.848663 (+1463451us) spinlock_profiling.cc:243] Waited 59.7 ms on lock 0x7b5400267d50. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:49.848965 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137228544}
I20260709 13:19:49.935724 24673 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:49.871627 24741 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:49.895814 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60692 (request call id 289) took 1551 ms. Trace:
I20260709 13:19:49.930258 24592 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:49.903662 24745 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.346s	user 0.008s	sys 0.005s
I20260709 13:19:49.941524 24335 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:49.857514 24491 raft_consensus.cc:697] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:49.870996 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 91695.8us
I20260709 13:19:49.943014 24752 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:49.916494 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48052 (request call id 26) took 1132 ms. Trace:
I20260709 13:19:49.886847 24677 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.939999 19512 rpcz_store.cc:276] 0709 13:19:48.344121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.344267 (+   146us) service_pool.cc:224] Handling call
0709 13:19:48.356047 (+ 11780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.408171 (+ 52124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:48.408198 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:48.408236 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:48.408264 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.895049 (+1486785us) spinlock_profiling.cc:243] Waited 51.9 ms on lock 0x7b54001b0b54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:49.895159 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.895475 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119376256}
I20260709 13:19:49.946357 19658 rpcz_store.cc:276] 0709 13:19:48.783459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.785656 (+  2197us) service_pool.cc:224] Handling call
0709 13:19:49.915940 (+1130284us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54000cc454. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c31754853 00007f6c3672260a 00007f6c2fca87d4 00007f6c2fca8762 00007f6c2fca8691 00007f6c2fca860c 00007f6c2fca78c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:49.916147 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":530369792}
W20260709 13:19:49.953636 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.962510 24491 consensus_queue.cc:237] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:49.939769 24574 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:49.859705 24663 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.990190 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:49.991403 20666 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:19:50.002255 19478 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:50.003643 24574 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:50.004459 24574 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:50.011525 24735 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:50.012238 24735 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:49.972514 24718 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:49.953387 24741 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:50.022715 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 49397.6us
I20260709 13:19:50.041765 19553 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:19:50.053731 24663 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.055112 24741 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.056512 24663 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:50.058799 24677 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:50.059252 24742 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:50.059792 24751 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:50.041234 24217 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:19:50.060207 24742 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.062052 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2354) took 1978 ms. Trace:
I20260709 13:19:50.028031 24693 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:50.062448 19509 rpcz_store.cc:276] 0709 13:19:48.083321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.083469 (+   148us) service_pool.cc:224] Handling call
0709 13:19:48.083889 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.994893 (+911004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.061485 (+1066592us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b54000249d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:50.061868 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091584256}
W20260709 13:19:50.065920 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 44994.7us
I20260709 13:19:50.082234 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:50.071671 24693 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:50.087261 24693 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.087868 24693 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:50.087990 24749 log.cc:927] Time spent T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.560s	user 0.006s	sys 0.005s
I20260709 13:19:50.089370 24726 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:50.116254 24726 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:50.119179 24726 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:50.095983 24750 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:50.119912 19504 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:50.120096 24750 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:50.122099 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.123067 24750 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:50.097229 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:50.097807 19551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.036s	sys 0.030s
I20260709 13:19:50.098397 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:50.100342 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 2711) took 1861 ms. Trace:
W20260709 13:19:50.102718 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:50.103173 24452 consensus_meta.cc:287] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.005s
I20260709 13:19:50.103830 24574 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:19:50.104853 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.106959 24742 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:50.108803 24552 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:50.111426 24581 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:50.113214 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:50.114276 24497 consensus_meta.cc:287] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.014s
I20260709 13:19:50.114745 19652 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:50.131861 19551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.037s	sys 0.030s
I20260709 13:19:50.137727 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:50.141726 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 689776us
I20260709 13:19:50.013499 24735 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.143136 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:50.132058 19478 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:50.163044 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:50.164182 19653 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:50.166102 24496 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:50.166563 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2635) took 2141 ms. Trace:
I20260709 13:19:50.166972 19578 rpcz_store.cc:276] 0709 13:19:48.025477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.026624 (+  1147us) service_pool.cc:224] Handling call
0709 13:19:48.026928 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.050669 (+ 23741us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:48.308778 (+258109us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b180030d840. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66a455 00007f6c351523c7 00007f6c317649a7 00007f6c317740bf 00007f6c31774038
0709 13:19:48.433473 (+124695us) log.cc:844] Serialized 14 byte log entry
0709 13:19:48.605870 (+172397us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:48.610123 (+  4253us) log.cc:844] Serialized 26 byte log entry
0709 13:19:48.610294 (+   171us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:48.616606 (+  6312us) log.cc:844] Serialized 14 byte log entry
0709 13:19:48.616860 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.616975 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:49.830883 (+1213908us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b180030d840. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e63b2a6 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1
0709 13:19:49.995001 (+164118us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b180030d840. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:19:50.166151 (+171150us) raft_consensus.cc:1685] finished
0709 13:19:50.166171 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.166357 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90876,"prepare.queue_time_us":265374,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":66383,"raft.run_cpu_time_us":628,"raft.run_wall_time_us":76472,"spinlock_wait_cycles":28502016,"thread_start_us":260198,"threads_started":2,"wal-append.queue_time_us":185914}
I20260709 13:19:50.173805 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.173969 19551 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:50.175073 19583 raft_consensus.cc:2368] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10.
I20260709 13:19:50.175278 24676 raft_consensus.cc:2764] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:19:50.176198 24589 consensus_meta.cc:287] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.677s	user 0.004s	sys 0.021s
I20260709 13:19:50.176250 24676 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:50.176859 24589 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.176504 24758 consensus_queue.cc:1059] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:19:50.179165 24758 raft_consensus.cc:3055] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:50.179411 24589 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:50.156883 24742 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:50.180059 19625 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:50.180886 24742 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.181773 24750 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.182112 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.182744 24751 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:50.183305 24742 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:50.183554 24732 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.183917 24742 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:50.184195 24732 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.184623 24742 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.185451 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:50.185881 19580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60800
I20260709 13:19:50.186138 24561 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:50.186849 24561 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.186355 19504 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:19:50.188160 24692 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:50.188732 24692 raft_consensus.cc:697] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:50.189477 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.179589 24758 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:50.192093 24758 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.193444 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 2722) took 1154 ms. Trace:
I20260709 13:19:50.185890 24730 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:50.194056 24758 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:50.194809 24730 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:50.160872 24574 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:50.183322 24751 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.197070 24574 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.182426 24750 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.154747 24497 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.198915 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:50.199265 24574 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:50.199510 19657 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:50.199795 19503 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:50.200634 19658 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:50.201222 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:50.201964 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:50.201803 24692 consensus_queue.cc:237] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.202517 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.203154 19586 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:50.180307 24589 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.133795 24552 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:50.202596 19582 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:19:50.207587 24619 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:50.212426 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:50.217231 24732 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:50.218024 24619 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:50.180009 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:50.223260 19580 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:50.223743 19580 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:50.199695 24497 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:50.150929 24452 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.227577 19504 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:19:50.228775 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:50.126513 19656 rpcz_store.cc:276] 0709 13:19:48.239117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.273691 (+ 34574us) service_pool.cc:224] Handling call
0709 13:19:48.663293 (+389602us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.729311 (+ 66018us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:48.752568 (+ 23257us) log.cc:844] Serialized 14 byte log entry
0709 13:19:49.434883 (+682315us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:49.910007 (+475124us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b2c0002b1b8. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:19:49.910974 (+   967us) log.cc:844] Serialized 26 byte log entry
0709 13:19:49.918043 (+  7069us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:49.918113 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.918254 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:49.918299 (+    45us) raft_consensus.cc:1685] finished
0709 13:19:49.918430 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.099948 (+181518us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b540039ab50. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:50.100071 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":163002,"prepare.queue_time_us":19573,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":211494,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":21301,"spinlock_wait_cycles":961332864,"thread_start_us":568582,"threads_started":2,"wal-append.queue_time_us":692511}
I20260709 13:19:50.231144 24589 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.233656 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.236268 24589 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:50.237013 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.238596 24561 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:50.239363 24217 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:50.240012 24217 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:50.243996 20619 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:50.238659 24552 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.245038 24520 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:50.245261 24552 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:50.245702 24674 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:50.245908 24452 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:50.246323 24674 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:50.247996 19410 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 53) took 9519 ms. Trace:
I20260709 13:19:50.248843 24674 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:50.249914 19660 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:50.241264 24217 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.251507 19507 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:19:50.254297 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 179746us
I20260709 13:19:50.256430 24630 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:50.258024 20666 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:50.258138 24619 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:50.261325 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:50.262066 19505 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:50.262295 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:50.263631 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:50.264897 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:50.228201 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:50.266028 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:50.267004 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:50.267441 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:50.268987 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.266136 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.193842 19654 rpcz_store.cc:276] 0709 13:19:49.038565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.038701 (+   136us) service_pool.cc:224] Handling call
0709 13:19:49.039073 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:49.039506 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:49.039547 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:49.100069 (+ 60522us) log.cc:844] Serialized 26 byte log entry
0709 13:19:49.395437 (+295368us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:49.395483 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.395561 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:50.086896 (+691335us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:50.189717 (+102821us) raft_consensus.cc:1685] finished
0709 13:19:50.189744 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.193240 (+  3496us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8428,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":9684,"spinlock_wait_cycles":62299904,"thread_start_us":211927,"threads_started":1,"wal-append.queue_time_us":335726}
I20260709 13:19:50.273168 19652 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:50.276547 19657 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:19:50.282781 19653 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:50.291000 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:50.294013 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:50.301846 19583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60800
I20260709 13:19:50.306500 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.308508 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:50.303260 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:50.316813 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:50.317047 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:50.319330 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:50.320129 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.321697 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:50.322547 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:50.322664 19578 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:50.323203 19582 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 16.
I20260709 13:19:50.324488 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:50.324697 20631 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:19:50.325233 19586 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:50.325866 24645 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:50.326287 24645 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:50.326668 24645 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:50.285250 24574 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.337481 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:50.340931 19505 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:19:50.342576 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:50.305292 24452 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:50.347308 19655 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:19:50.248363 19410 rpcz_store.cc:276] 0709 13:19:40.728417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.753754 (+ 25337us) service_pool.cc:224] Handling call
0709 13:19:50.247739 (+9493985us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:48.001607 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:48.002219 (+   612us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:48.002255 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:19:48.002271 (+    16us) tablet.cc:662] Decoding operations
0709 13:19:48.002653 (+   382us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:48.002720 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:48.002749 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:19:48.010205 (+  7456us) tablet.cc:701] Row locks acquired
0709 13:19:48.010229 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:19:48.010401 (+   172us) write_op.cc:270] Start()
0709 13:19:48.010533 (+   132us) write_op.cc:276] Timestamp: P: 1783603188010350 usec, L: 0
0709 13:19:48.010553 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:19:48.019287 (+  8734us) log.cc:844] Serialized 924 byte log entry
0709 13:19:48.727281 (+707994us) op_driver.cc:464] REPLICATION: finished
0709 13:19:49.441576 (+714295us) write_op.cc:301] APPLY: starting
0709 13:19:49.450270 (+  8694us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:49.645193 (+194923us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:49.646560 (+  1367us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:49.655191 (+  8631us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:49.655378 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:19:49.655423 (+    45us) write_op.cc:312] APPLY: finished
0709 13:19:49.655643 (+   220us) log.cc:844] Serialized 32 byte log entry
0709 13:19:49.860541 (+204898us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:49.860740 (+   199us) write_op.cc:454] Released schema lock
0709 13:19:49.860838 (+    98us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:49.861715 (+   877us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:49.861752 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4562897,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":663225,"apply.run_cpu_time_us":66085,"apply.run_wall_time_us":443341,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12483,"num_ops":2,"prepare.queue_time_us":398170,"prepare.run_cpu_time_us":38988,"prepare.run_wall_time_us":223300,"raft.queue_time_us":295496,"raft.run_cpu_time_us":87001,"raft.run_wall_time_us":580810,"replication_time_us":645412,"thread_start_us":1277259,"threads_started":5,"wal-append.queue_time_us":366715,"wal-append.run_cpu_time_us":20192,"wal-append.run_wall_time_us":1173573}]]}
I20260709 13:19:50.351451 19586 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
W20260709 13:19:50.354238 24767 log.cc:927] Time spent T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:50.355072 24734 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:50.355790 24734 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.356451 19657 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:19:50.357957 24734 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:50.360206 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.360805 19512 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
W20260709 13:19:50.361682 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.366276 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:50.368280 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.374577 19583 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:50.374686 19657 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:50.375089 19583 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:50.373747 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:50.378329 19580 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.384196 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.387488 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.388818 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.390021 19505 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:19:50.390143 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:50.390734 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.384398 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.391359 19510 raft_consensus.cc:1813] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Handling vote request from an unknown peer 2cfd02601ea44976833027665abc93bf
W20260709 13:19:50.391462 24771 log.cc:927] Time spent T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:19:50.391955 19510 raft_consensus.cc:2410] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:19:50.391510 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.361218 24645 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:50.392884 19509 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:19:50.392825 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:50.394098 19582 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:50.394321 24645 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:50.398020 19655 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:50.347080 24676 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.399828 24676 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.402143 24734 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:50.402849 24734 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.404882 24663 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.405007 24734 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:50.405524 24663 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.406325 19586 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:19:50.406205 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:50.407600 24663 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:50.407848 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:50.408427 19578 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:50.410470 19581 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:50.416335 19581 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:19:50.417836 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.418051 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:50.419658 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:50.419974 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 240230us
I20260709 13:19:50.420754 24663 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:50.427610 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:50.428654 19581 raft_consensus.cc:2368] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20.
I20260709 13:19:50.430168 19581 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:50.433259 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:50.434491 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:50.437788 19578 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:50.441184 19580 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:50.443306 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.444589 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:50.445369 20666 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 17: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:19:50.453313 19476 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:50.454541 24750 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:50.454773 24552 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:50.455168 24750 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.455300 24552 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.455785 24552 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:50.455704 24750 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.468252 24735 consensus_queue.cc:1059] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:50.469487 24497 raft_consensus.cc:3055] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:50.469915 24497 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:50.470885 24497 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.471539 24751 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:50.472275 24495 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:50.442721 24561 consensus_queue.cc:1059] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:50.480029 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.477111 19583 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.483546 24693 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:50.479017 24724 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:19:50.484673 24726 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.484808 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:50.487808 19498 tablet_service.cc:1558] Processing DeleteTablet for tablet 46d39387ed0c44978cdb2b736f9c1ccf with delete_type TABLET_DATA_TOMBSTONED (TS d56df3728fc04e37b2d29a3bcd91d167 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:50816
I20260709 13:19:50.492125 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:50.432082 24574 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.500756 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.500236 24742 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:50.502389 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.494741 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:50.503183 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.582927 19505 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:19:50.503583 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.522933 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.493515 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:50.496548 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:50.524848 24663 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:50.497414 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:50.587451 19511 raft_consensus.cc:2393] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 20: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:50.523912 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.502312 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.508338 24741 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.499955 24561 raft_consensus.cc:3055] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:19:50.524325 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 49314.6us
I20260709 13:19:50.498449 24676 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:50.599282 19579 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:50.516638 24406 consensus_queue.cc:1059] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:19:50.517657 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:50.506182 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:50.502760 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:50.547003 24751 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.524688 24452 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:19:50.523869 24730 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:50.550235 24497 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:50.539650 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 50194.8us
I20260709 13:19:50.555971 24732 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:19:50.524559 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 91414.8us
I20260709 13:19:50.590216 19582 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
W20260709 13:19:50.599363 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.601085 19586 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:19:50.601531 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.605512 19655 raft_consensus.cc:2368] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15.
I20260709 13:19:50.580837 24750 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:50.599517 24589 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:50.616550 19509 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:50.627465 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.627974 19587 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:50.630184 19585 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:50.630781 19512 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:50.631492 24520 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:50.615438 19583 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:50.642710 19583 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:50.600056 24561 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:50.644917 24561 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.646816 24561 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:50.651175 24676 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:50.651970 24676 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.653920 19627 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:50.629483 19587 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:50.633018 24505 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:19:50.582412 24552 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.664183 24539 consensus_queue.cc:1059] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:50.665760 24589 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.667994 24574 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:50.668161 24589 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:50.665696 24539 raft_consensus.cc:3055] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:50.676689 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:50.602028 24741 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.690680 19625 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:50.614039 24751 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.696595 24751 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:50.618203 24726 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.679478 24677 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.682575 24539 raft_consensus.cc:740] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:50.730557 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 114146us
I20260709 13:19:50.731727 19478 leader_election.cc:400] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20.
I20260709 13:19:50.732221 19478 leader_election.cc:403] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:50.713579 24750 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:19:50.733294 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 70543.2us
I20260709 13:19:50.738816 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:50.738214 19625 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:50.728152 24452 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:50.744539 24452 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:50.745096 24452 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:50.683447 24732 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.713223 24531 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:19:50.736285 24750 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:50.752889 24574 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:50.768524 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 90264.6us
I20260709 13:19:50.729959 24677 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:50.766963 19627 leader_election.cc:400] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10.
I20260709 13:19:50.784420 19627 leader_election.cc:403] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:19:50.778667 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 86301.4us
W20260709 13:19:50.768227 24758 consensus_meta.cc:287] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.004s
I20260709 13:19:50.789146 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:50.789734 24491 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:50.790313 24491 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:50.790601 19584 raft_consensus.cc:2410] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:19:50.790491 24645 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:50.789821 20666 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:50.799165 19627 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:50.772666 24589 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:50.803679 19625 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:50.777832 24693 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:50.780889 24496 raft_consensus.cc:3055] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:50.810456 24491 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.811038 24496 raft_consensus.cc:740] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:50.811807 24491 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:50.812297 24496 consensus_queue.cc:260] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.815552 24732 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:50.816460 24732 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:50.772017 24676 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:50.806174 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:50.777993 24750 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:50.808279 24730 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 9. Current term is 10.
I20260709 13:19:50.832226 24741 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:50.816949 24732 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.835515 20666 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:19:50.843645 19553 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:19:50.854494 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.837563 24505 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:50.862512 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:50.857703 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 64246.8us
I20260709 13:19:50.839382 24732 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:50.807677 24589 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:50.867421 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:50.874085 24740 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20.
W20260709 13:19:50.878680 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 389098us
W20260709 13:19:50.879791 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 77888.8us
I20260709 13:19:50.800453 24724 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:19:50.883734 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:50.855609 24574 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:50.855901 24552 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:50.867918 24505 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.881289 24589 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:50.908579 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:50.909896 24495 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:50.911816 24726 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:50.911722 24528 consensus_queue.cc:1059] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:50.899618 24505 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:50.886900 24676 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:50.818010 24539 consensus_queue.cc:260] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:50.898626 24693 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:50.898561 24574 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:50.880426 24730 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 13:19:50.952025 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 58800.6us
W20260709 13:19:50.964722 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 81107.3us
I20260709 13:19:50.972262 24726 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.972862 24726 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:50.977317 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 46706.2us
W20260709 13:19:50.977793 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 178761us
I20260709 13:19:50.993842 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:51.002004 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.002808 19586 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:50.977837 24799 tablet_replica.cc:333] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:19:51.002005 20666 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
W20260709 13:19:50.976475 24619 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.012s	sys 0.039s
I20260709 13:19:51.011554 19551 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:51.020313 19627 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:50.967309 24531 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:19:51.006278 24752 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:19:51.016866 24619 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.013s	sys 0.039s
I20260709 13:19:51.022320 19476 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:51.034405 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:51.036839 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:51.043370 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:51.048218 19587 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:51.028775 24752 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:50.997539 24452 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:51.026932 24539 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:51.068349 19551 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:51.070447 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51628.7us
I20260709 13:19:51.076273 19476 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:51.057343 24574 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:51.072669 24752 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.025872 24693 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:51.078440 19587 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
W20260709 13:19:51.078615 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 58383.6us
I20260709 13:19:51.037098 24734 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:51.086221 19587 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:19:51.014117 24724 consensus_queue.cc:1059] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:19:51.088649 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:51.091189 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.095187 19551 leader_election.cc:400] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15.
I20260709 13:19:51.095643 19551 leader_election.cc:403] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:19:51.052722 24788 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:51.053236 24742 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.090292 19587 pending_rounds.cc:85] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 10
I20260709 13:19:51.103147 19579 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:51.028314 24692 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:19:51.076529 24630 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:51.078804 24531 consensus_queue.cc:1243] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:19:51.086174 24663 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:51.106204 19587 pending_rounds.cc:107] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:19:51.126034 19587 raft_consensus.cc:2889] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:51.102428 24552 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:51.117067 24752 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:51.129647 24724 raft_consensus.cc:3055] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:51.129675 24693 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:51.146591 24798 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:51.139916 24804 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:51.148589 24676 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15.
W20260709 13:19:51.150035 24784 log.cc:927] Time spent T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:19:51.145750 24788 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:51.148617 24793 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:19:51.129951 24741 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:19:51.151955 24751 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.165386 24552 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.171365 24788 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:51.172587 24802 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:51.154109 24724 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:51.187747 19661 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
W20260709 13:19:51.176867 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.158529 24726 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:51.160961 24798 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:51.160856 24804 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:51.139676 24742 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.191334 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:51.193755 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:51.193958 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:51.192934 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:51.194399 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:51.204250 19511 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:51.196660 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:51.197975 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.197809 24552 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.198129 19409 catalog_manager.cc:5697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.200201 19508 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:51.203186 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:51.205116 19654 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:51.206413 19504 raft_consensus.cc:2410] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:19:51.207530 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:51.208163 19504 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:51.214044 19655 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:51.259781 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:51.260550 19512 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:51.215025 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:51.214433 19656 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:51.210948 24726 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:51.284902 19661 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:51.200640 24798 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:51.275346 19503 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:19:51.201654 24734 raft_consensus.cc:697] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:51.205763 24804 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:51.299834 19506 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:51.297152 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:51.298364 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:51.303580 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 179533us
I20260709 13:19:51.260304 24802 raft_consensus.cc:697] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:51.304744 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.305795 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:51.306495 19656 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:51.314774 20619 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.321079 19653 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:51.323374 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:51.210634 24751 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.324069 19507 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:19:51.332998 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:51.302428 24452 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:51.343657 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.345069 24742 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:51.346722 24742 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:51.347213 24742 raft_consensus.cc:697] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:51.347959 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.348169 24742 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:51.350098 24790 log.cc:927] Time spent T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 13:19:51.350353 24807 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:19:51.352257 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:51.352654 24808 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:51.353099 19509 raft_consensus.cc:2410] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:19:51.352720 24740 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:51.355594 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:51.358067 19654 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
W20260709 13:19:51.359141 24796 log.cc:927] Time spent T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.297s	user 0.002s	sys 0.000s
I20260709 13:19:51.338462 19655 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:51.321120 24813 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.326684 24758 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:51.397771 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:51.373320 19656 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:51.404098 19504 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:19:51.405103 19509 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16. Ops: []
W20260709 13:19:51.411729 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 115818us
I20260709 13:19:51.417502 24589 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.418462 24452 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:51.421257 24452 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.309140 24726 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.429776 19586 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:51.423708 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:51.432116 24810 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:19:51.436323 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:51.437233 19655 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:51.438163 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:51.438652 24789 log.cc:927] Time spent T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
I20260709 13:19:51.439467 24812 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:51.439579 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:51.440104 24781 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.403s	user 0.001s	sys 0.001s
I20260709 13:19:51.440392 19655 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:19:51.440204 24812 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.441485 24758 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.425644 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.442632 24812 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:51.443594 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.429284 24335 raft_consensus.cc:3055] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:51.444232 19582 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 12.
I20260709 13:19:51.444471 24335 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:51.445214 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.427260 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:51.438429 19478 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:51.443681 24758 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:51.453027 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:51.453537 24826 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:51.454114 24826 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.454463 24826 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:51.454835 19582 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:51.458688 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.460212 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:51.460836 19652 raft_consensus.cc:3055] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:51.461124 19652 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:51.461846 19652 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.462001 24734 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.462340 24826 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.464124 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.464558 24826 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:51.466461 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.466941 19652 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:51.468118 24750 consensus_meta.cc:287] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.620s	user 0.010s	sys 0.001s
I20260709 13:19:51.468544 24750 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.469767 19659 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:51.470264 24817 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.470820 24817 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.472991 24817 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:51.423640 24217 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.475538 24217 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.366173 24663 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:51.478363 24663 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:51.482523 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:51.483835 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:51.484927 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:51.486960 24751 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:51.445775 19578 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:51.448799 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:51.426693 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:51.367652 24730 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:51.370342 24780 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:51.450098 24802 consensus_queue.cc:237] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.453656 19654 raft_consensus.cc:3055] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:51.502892 19654 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:51.467059 19584 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:51.468843 24677 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:51.508664 19587 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:51.446496 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:51.445441 24335 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:51.447762 24812 consensus_queue.cc:1059] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:51.465430 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.490890 19661 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:51.493709 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:51.413148 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 89449.4us
I20260709 13:19:51.521162 19655 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:51.495085 19512 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:51.496825 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:51.522893 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:51.496903 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 182212us
I20260709 13:19:51.524021 19478 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:51.506973 19511 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:51.507097 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:51.513895 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.524395 19652 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
W20260709 13:19:51.496754 24793 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:19:51.399667 24788 consensus_queue.cc:1059] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.125s
I20260709 13:19:51.531709 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.531769 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:51.518034 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 229863us
I20260709 13:19:51.525547 19508 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:51.526157 19585 raft_consensus.cc:2393] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 18: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:51.509963 19656 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:19:51.490490 24217 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:51.535764 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:51.531085 19507 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:51.522990 19654 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.336632 24724 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.540928 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.541203 24788 raft_consensus.cc:3055] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:51.541585 19584 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:51.541790 24452 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:51.542424 19654 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:51.542781 19584 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:51.544713 24577 consensus_queue.cc:1059] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:51.545822 24619 consensus_queue.cc:1059] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:51.546660 24577 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:51.549999 24491 raft_consensus.cc:3055] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:51.550519 24491 raft_consensus.cc:740] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:51.551410 24491 consensus_queue.cc:260] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.552552 24491 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:51.552742 24496 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:51.553694 19580 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:51.554198 24552 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:51.556082 24726 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:51.406262 24813 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.520426 24676 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:51.565815 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.568478 19654 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:51.541623 24788 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:51.594813 24788 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.595443 24813 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:51.596207 24788 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:51.598255 24677 raft_consensus.cc:3055] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:51.598714 24677 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:51.599800 24677 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:51.591612 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 142911us
I20260709 13:19:51.609678 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:51.592289 19661 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:51.549504 24577 raft_consensus.cc:3055] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:51.623292 24577 raft_consensus.cc:740] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:51.624487 24577 consensus_queue.cc:260] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.538590 24497 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:19:51.571368 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.541218 24335 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:51.580186 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.539161 24826 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:51.634389 24826 raft_consensus.cc:697] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:51.635825 24826 consensus_queue.cc:237] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.642458 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:51.601366 24677 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:51.591866 24794 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.293s	user 0.003s	sys 0.000s
I20260709 13:19:51.593420 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:51.661336 19627 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:51.663717 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 56386.1us
I20260709 13:19:51.664717 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:51.669866 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:51.539639 24520 consensus_queue.cc:1059] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 13:19:51.674337 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.678998 20666 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 13:19:51.685961 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.677709 19585 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
W20260709 13:19:51.692838 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.646637 24735 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:19:51.674084 24574 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.705940 24574 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.708289 24574 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:51.688891 24676 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:51.686718 24732 consensus_meta.cc:287] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.781s	user 0.003s	sys 0.008s
I20260709 13:19:51.711056 24732 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.713807 19660 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:51.676123 24452 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:51.697676 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.701102 24831 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:51.723647 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 59010.4us
I20260709 13:19:51.729835 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:51.696285 24577 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:51.727160 24452 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:51.735890 24505 consensus_meta.cc:287] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.762s	user 0.003s	sys 0.009s
I20260709 13:19:51.736435 24505 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.737349 24452 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:51.737840 24732 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:51.738521 24750 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:51.739302 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.739892 19579 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:19:51.741519 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.742166 19584 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:51.744789 24619 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:51.746794 24574 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:51.749351 19627 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.750501 19627 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.751554 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.752736 19627 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.763114 19627 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.766152 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2685) took 1244 ms. Trace:
W20260709 13:19:51.727586 24752 consensus_meta.cc:287] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.587s	user 0.006s	sys 0.004s
I20260709 13:19:51.772400 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:51.766616 19583 rpcz_store.cc:276] 0709 13:19:50.522102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.653746 (+131644us) service_pool.cc:224] Handling call
0709 13:19:50.654186 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.654801 (+   615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.654851 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:50.655463 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 13:19:50.952666 (+297203us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:50.952724 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.952798 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:51.487704 (+534906us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:51.753727 (+266023us) raft_consensus.cc:1685] finished
0709 13:19:51.753750 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.766082 (+ 12332us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":156,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":6569856,"thread_start_us":296733,"threads_started":1,"wal-append.queue_time_us":520461}
I20260709 13:19:51.800905 19627 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.803031 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.803828 19582 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:19:51.813899 19579 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:51.815007 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:51.815850 24726 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:51.816366 24726 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:51.816469 24758 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:51.816689 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.817433 24758 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:51.817286 24726 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.819957 19578 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:19:51.822116 24837 log.cc:927] Time spent T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:19:51.825922 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.813769 24810 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:51.753510 24452 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:51.839159 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:51.840497 24823 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:51.841120 24834 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:51.842561 24752 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:51.844570 19627 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.845849 24821 raft_consensus.cc:3055] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:51.846165 24448 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:51.846288 24821 raft_consensus.cc:740] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:19:51.846591 24448 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:51.846825 19627 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.847608 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:51.847503 24448 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:51.848248 19660 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:51.848759 24448 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:51.849241 24730 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:51.849933 24730 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:51.850373 19657 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:19:51.766171 24831 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:51.768151 24732 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:51.851465 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:51.852090 19659 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:51.851578 24732 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:51.855480 24732 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:51.855968 24804 consensus_meta.cc:287] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.000s
I20260709 13:19:51.856439 24804 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.857796 19655 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:51.861038 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.847275 24821 consensus_queue.cc:260] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:51.825425 24758 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:51.867308 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:51.871335 24811 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:51.774783 24750 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:51.880218 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:51.881285 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.883529 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.886991 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.836947 24810 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.882629 19625 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:19:51.890465 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:51.858814 24452 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:51.892026 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:51.892134 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:51.892704 19652 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:51.864013 24834 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:51.895100 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:51.896773 19627 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.897527 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:51.898489 19627 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.881629 24811 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.905469 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:51.887791 24812 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:51.907974 19512 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:19:51.891563 24810 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:51.900691 19627 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:51.910614 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 46636.8us
I20260709 13:19:51.908839 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:51.914306 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:51.914561 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:51.914690 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:51.915288 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:51.917527 19508 raft_consensus.cc:2410] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:19:51.915689 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:51.896477 24750 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:51.919190 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:51.921640 19512 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:51.921960 20629 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.919974 19625 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:51.897378 24452 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:51.907864 24692 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:51.931459 24724 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:51.931846 19476 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:51.899808 24677 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:51.886436 24663 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.902024 24751 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:51.934270 19478 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:51.902515 24561 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:19:51.934790 24788 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:51.935894 24552 consensus_queue.cc:1059] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:51.936053 24788 consensus_queue.cc:1059] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:51.936759 20665 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:51.900522 24817 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:51.901548 24758 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:51.941160 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.906631 24811 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:51.942391 19512 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:51.923444 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:51.943226 19660 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:51.908059 24826 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:51.924121 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.915452 24821 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:51.945181 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:51.950233 24750 raft_consensus.cc:697] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:51.950814 24815 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:19:51.951401 24788 raft_consensus.cc:3055] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:51.951215 24750 consensus_queue.cc:237] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:51.951922 24788 raft_consensus.cc:740] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:51.948295 24561 raft_consensus.cc:2764] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:19:51.948619 24677 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:51.962855 24677 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.963264 24677 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:51.948884 24505 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:51.965760 24539 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:51.966162 24539 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:51.938931 24730 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:51.966991 24539 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.967430 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:51.945588 24752 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:51.968099 24752 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:51.968195 24497 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:51.968641 24752 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:51.969792 24676 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:51.970422 24676 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:19:51.951268 24798 consensus_meta.cc:287] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.634s	user 0.008s	sys 0.004s
I20260709 13:19:51.970929 24834 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:51.971379 24676 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.971642 24798 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.972280 19627 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:51.975211 24802 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:51.954514 24826 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.975656 24802 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.976073 24802 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:51.980484 24824 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.981019 24824 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.982303 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:51.983026 19584 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:51.942276 24693 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:51.984023 24693 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.984484 24693 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:51.912851 24734 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:19:51.986220 24734 consensus_queue.cc:1243] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:51.961925 24804 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:51.991545 24692 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.992307 24692 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:51.993810 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:51.994575 24798 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:51.994583 19583 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:51.998817 24804 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.999387 24804 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.007921 24812 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:52.008661 24812 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:52.009275 24788 consensus_queue.cc:260] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.010619 24788 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:52.011754 19581 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 13:19:52.013370 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 47310.5us
W20260709 13:19:52.018121 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 52923.2us
I20260709 13:19:52.019759 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:52.101034 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:52.101220 24817 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:52.101833 19507 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:52.026656 24692 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:52.104094 19654 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:52.103850 24677 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.101856 24817 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.060053 19510 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:19:52.064365 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:52.048717 19505 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:52.089231 19625 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:52.020963 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 48768.2us
I20260709 13:19:52.123319 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:52.046132 19476 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:52.125229 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 79197.7us
I20260709 13:19:52.114389 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:52.129287 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:52.131253 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:52.135556 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:52.136653 19476 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:52.138696 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:52.139534 19659 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:52.142259 19509 pending_rounds.cc:85] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 7
I20260709 13:19:52.142745 19509 pending_rounds.cc:107] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:19:52.143009 19509 raft_consensus.cc:2889] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:52.143304 24619 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:52.143926 24619 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:52.144850 24619 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.147512 24834 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:52.148401 24834 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.151327 24448 consensus_queue.cc:1059] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:52.151284 24834 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:52.152988 24448 raft_consensus.cc:3055] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:52.153451 24448 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:52.153539 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:52.158861 24676 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:52.159277 19551 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:52.161177 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:52.162487 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:52.163239 19504 raft_consensus.cc:2368] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16.
W20260709 13:19:52.165720 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 51942.3us
I20260709 13:19:52.163900 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:52.168457 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:52.169428 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:52.026634 24663 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:52.026547 24826 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:52.027653 24798 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:52.245373 24798 raft_consensus.cc:697] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:52.246340 24798 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.132474 24735 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:52.033381 24589 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:52.238492 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:52.022987 24804 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:52.238943 19583 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
W20260709 13:19:52.239748 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 73121.2us
I20260709 13:19:52.253949 19627 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:52.242767 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 78937.6us
I20260709 13:19:52.241845 24693 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.258248 24693 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:52.252161 24735 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.258939 24735 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:52.165076 24574 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:52.262411 24677 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:52.074777 24452 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.264102 19652 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:52.264281 24799 raft_consensus.cc:2243] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.265285 24799 raft_consensus.cc:2272] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.033102 24539 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:52.268628 24799 ts_tablet_manager.cc:1916] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:19:52.272312 24735 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.252856 19506 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:52.049947 24528 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.191s
I20260709 13:19:52.276563 24752 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.052057 24406 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.191s
I20260709 13:19:52.076488 24811 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.255681 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:52.047390 24732 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:52.280061 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 225258us
I20260709 13:19:52.280153 24811 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:52.280504 24732 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:52.281124 19660 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:52.282658 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:52.262115 24574 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.263250 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:52.284570 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:52.249246 24726 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:52.285647 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:52.239521 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 99993.3us
I20260709 13:19:52.293219 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:52.297967 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:52.319427 19656 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:19:52.332441 19585 raft_consensus.cc:2393] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:52.332873 19578 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:52.239084 24834 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:52.265355 24452 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:52.350915 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 65371.6us
I20260709 13:19:52.349339 19581 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:52.352192 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:52.379938 19476 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:52.319247 24758 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:52.343144 24496 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:52.392580 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 60238.1us
W20260709 13:19:52.383662 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 129801us
I20260709 13:19:52.416010 19627 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:52.410147 24732 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:52.418380 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:52.364029 24663 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:52.426931 19653 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 15: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:52.435031 19625 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:52.435078 19627 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:52.375407 24632 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.399232 24824 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:52.399734 24630 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:52.435425 24793 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:52.351086 24448 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.473769 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:52.454234 19625 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:52.423666 24663 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.422498 24732 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:52.453109 24815 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.440732 24452 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:52.482380 19656 raft_consensus.cc:2410] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:19:52.384938 24812 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.475805 19627 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:52.440698 24740 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:52.434263 24817 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:52.425463 24217 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:19:52.455709 24693 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:19:52.507371 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 154002us
I20260709 13:19:52.456140 24630 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:52.526851 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:52.527839 19586 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:19:52.420845 24810 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.457719 24742 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:52.437990 24335 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:19:52.486717 24809 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:52.486830 24803 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:52.484262 24732 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:52.481523 24663 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:52.552156 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 76481.9us
I20260709 13:19:52.516590 24589 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:52.448588 24632 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.555104 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:52.556212 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:52.522303 24735 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:52.533221 24630 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:52.562978 19625 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:52.529304 24452 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.528631 24693 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:52.616925 24693 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:52.566973 19655 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:19:52.549278 24448 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:52.560963 24752 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:52.551187 24742 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.533063 24817 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:52.551986 24734 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.616278 24836 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:52.553692 24809 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.620973 24589 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:52.629160 24589 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.630419 24734 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.631249 24810 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:52.633077 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:52.633734 24809 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:52.633913 19587 raft_consensus.cc:2393] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:52.634950 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:52.635901 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:52.636581 19587 raft_consensus.cc:2368] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19.
I20260709 13:19:52.637249 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:52.637949 24751 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:52.638067 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 75203.7us
I20260709 13:19:52.637323 24732 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:52.639642 24802 consensus_meta.cc:287] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.663s	user 0.008s	sys 0.007s
I20260709 13:19:52.640329 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:52.502522 24815 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.641403 19586 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:52.651013 24574 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:52.567605 24803 raft_consensus.cc:697] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:52.666553 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:52.644560 19625 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:52.669992 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:52.622618 24676 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:52.619383 24539 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.675122 19587 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:52.621188 24742 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:52.680056 19587 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:52.651816 24751 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.676190 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:52.681561 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 329427us
I20260709 13:19:52.690354 24812 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:52.621840 24452 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.695909 24452 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:52.697132 24859 log.cc:927] Time spent T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.081s	user 0.000s	sys 0.003s
I20260709 13:19:52.699232 24632 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:52.701344 24815 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:52.702478 24803 consensus_queue.cc:237] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.674067 24817 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:52.704746 24817 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.705122 24817 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:52.666350 24802 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.707015 19660 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 20: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:52.708021 24802 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:52.708678 24826 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:52.709175 24826 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:52.710065 24826 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.714208 24751 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:52.714860 24833 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.715385 24833 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.710599 24539 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.719877 24539 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:52.724023 24693 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.717511 24833 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:52.725564 24740 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:52.734779 24740 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:52.738865 24539 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:52.739646 24724 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:52.740724 24815 raft_consensus.cc:3055] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:19:52.741145 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.741097 24815 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:52.742316 24539 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:52.742125 24815 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.742853 24539 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.743304 24815 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:52.745797 24531 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:52.746187 24531 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:52.747079 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:52.746950 24531 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.748070 24531 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:52.748302 19661 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:52.748790 24740 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.749365 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:52.750033 19661 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:52.750859 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:52.751474 19656 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:52.752276 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:52.765673 24539 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:52.766911 24734 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:52.767537 24740 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:52.750881 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:52.771545 19661 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:52.778043 24496 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:52.778749 24496 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:52.780788 24751 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:52.786283 24869 log.cc:927] Time spent T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.133s	user 0.000s	sys 0.002s
W20260709 13:19:52.792769 24861 log.cc:927] Time spent T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:19:52.793900 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:52.796492 24855 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
W20260709 13:19:52.797290 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.800642 19587 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:52.794581 19655 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:52.804462 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 119306us
I20260709 13:19:52.809666 19586 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:52.809525 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:52.813421 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:52.814292 19587 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:52.810671 19578 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:52.820688 19658 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:19:52.821897 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:52.822513 19586 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:52.827832 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:52.832228 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.834860 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:52.837452 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:52.837652 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:52.818591 24798 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.009s	sys 0.026s
I20260709 13:19:52.835731 19579 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:52.794613 24693 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:52.725310 24742 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.850368 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:52.849002 19476 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:52.858950 19476 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:52.863354 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:52.864988 19511 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:52.867551 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:52.867827 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:52.868403 19512 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:52.845572 24798 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.010s	sys 0.027s
I20260709 13:19:52.872515 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:52.874341 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:52.875013 19551 leader_election.cc:400] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16.
I20260709 13:19:52.875545 19551 leader_election.cc:403] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:52.876360 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:52.875018 19509 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:19:52.877385 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:52.877930 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:52.874671 19508 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:19:52.880434 19507 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:52.880674 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:52.872290 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:52.881858 19506 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:52.877451 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:52.884148 19654 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:52.885771 19661 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:52.886677 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:52.870995 19476 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:52.888993 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:52.889663 19652 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:19:52.889878 19658 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 19: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:52.890002 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:52.891407 19476 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:52.890058 19652 pending_rounds.cc:85] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 11
I20260709 13:19:52.892547 19652 pending_rounds.cc:107] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:19:52.893018 19652 raft_consensus.cc:2889] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:52.860136 24539 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:52.868856 24876 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:19:52.889042 24834 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16.
I20260709 13:19:52.894053 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:52.899626 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:52.903183 19586 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:52.907667 19512 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:19:52.871340 24693 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:52.914474 19656 raft_consensus.cc:2393] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 17: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:52.898310 19504 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:52.902403 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:52.903594 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:52.900450 24812 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:52.915987 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:52.912237 19627 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:52.912369 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:52.874145 24758 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:52.913872 19660 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:19:52.879478 24495 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:52.922168 19627 leader_election.cc:400] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19.
I20260709 13:19:52.925364 19508 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:19:52.922384 19505 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:19:52.934958 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:52.893741 24406 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:52.912809 24574 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:52.935601 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:52.948772 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:52.872411 24809 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.909080 24491 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:52.947717 19656 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:52.874054 24663 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.871125 24813 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:19:52.959548 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:52.938184 24495 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.960295 24871 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:19:52.970350 24663 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:52.970431 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.960507 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:52.972218 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:52.973848 24865 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:52.974416 24865 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:52.974887 24865 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:52.976015 24751 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:52.976753 24834 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:52.977388 24834 consensus_queue.cc:1243] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:19:52.978480 24834 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:52.978928 24834 raft_consensus.cc:697] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:52.945771 24806 consensus_queue.cc:1059] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:19:52.979828 24834 consensus_queue.cc:237] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.980803 24864 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:52.963191 24812 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:52.984393 24812 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:52.985003 24812 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:52.985332 24826 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:52.963479 19580 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 16: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:52.986243 24730 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:52.986733 24730 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.966023 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:52.988833 24730 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:52.966385 24732 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:52.990000 19505 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:52.967227 24815 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:19:52.992177 24505 raft_consensus.cc:3055] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:52.992559 24505 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:52.992931 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:52.993494 19582 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:52.993382 24505 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.993995 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:52.994688 24505 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:52.996644 24491 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.997014 24491 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:52.997723 24741 consensus_queue.cc:1059] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:52.998013 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:52.998845 19511 raft_consensus.cc:2410] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:19:52.999439 24741 raft_consensus.cc:3055] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:52.998850 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:53.000435 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:52.968803 24495 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:53.003228 24864 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:52.938532 24804 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:19:53.003746 24864 raft_consensus.cc:697] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:53.004652 24864 consensus_queue.cc:237] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:52.980825 24734 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:19:52.923815 24740 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:19:53.006843 24740 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:53.007227 24740 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:53.007344 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:53.008090 24740 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.000011 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:53.008188 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:53.015615 19512 pending_rounds.cc:85] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 8
I20260709 13:19:53.016477 19512 pending_rounds.cc:107] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:19:53.016944 19512 raft_consensus.cc:2889] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:53.019397 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:52.933586 24811 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:53.034752 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:52.961032 19478 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:53.012116 19506 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:19:52.984611 19503 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:19:53.039229 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:53.032809 19654 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:19:53.016443 19511 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:53.046869 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:53.047959 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:53.048626 19511 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:52.999814 24741 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:53.048913 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 102112us
I20260709 13:19:53.060217 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:53.009418 24740 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:53.050012 19655 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:53.058399 19653 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:52.945760 24406 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.063853 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:53.065462 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 104523us
I20260709 13:19:53.072088 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:53.072934 19506 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:19:52.984723 24742 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:53.074405 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:53.072521 19656 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:53.102862 19660 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:52.957029 24630 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.074872 24406 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:53.010704 24496 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.111369 19582 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:53.034024 24817 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.058442 24663 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:19:53.087244 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:53.088310 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:53.089506 24539 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:53.092224 24875 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:53.142378 19511 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:53.143375 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:53.138109 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:53.144063 19508 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.087244 24798 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:19:53.089598 24824 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:53.148437 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.149403 24528 consensus_queue.cc:1059] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:53.150074 24868 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:53.154838 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 65990.9us
I20260709 13:19:53.161808 19511 pending_rounds.cc:85] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 12
I20260709 13:19:53.220736 19511 pending_rounds.cc:107] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:19:53.221225 19511 raft_consensus.cc:2889] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:53.164160 24877 log.cc:927] Time spent T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.147s	user 0.004s	sys 0.000s
I20260709 13:19:53.126907 24552 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:53.171141 24809 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:53.172446 24872 log.cc:927] Time spent T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:19:53.131855 24539 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:53.174636 24874 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:19:53.174777 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:53.174891 24496 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:53.189484 24630 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:53.194437 24799 ts_tablet_manager.cc:1929] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.7
I20260709 13:19:53.194744 24865 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.118229 24741 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.196506 24812 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:53.201226 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 59118.8us
I20260709 13:19:53.262601 24865 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:53.263046 24812 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:53.133944 24876 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:53.264678 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:53.231789 19625 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:53.232008 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:53.266357 19657 raft_consensus.cc:2368] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15.
I20260709 13:19:53.241252 19478 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:53.268939 24448 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:53.269074 19478 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:53.219681 24693 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:53.269937 24693 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.272259 24693 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:53.241789 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:53.249661 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 74954.1us
I20260709 13:19:53.219388 24758 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:53.252183 24726 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:53.252379 24552 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:53.288298 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:53.275339 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:53.253124 19507 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 13.
I20260709 13:19:53.276849 19508 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:53.273873 24813 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:53.279479 19476 leader_election.cc:400] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15.
I20260709 13:19:53.292128 19476 leader_election.cc:403] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:19:53.254309 24856 log.cc:927] Time spent T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:19:53.248445 24539 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.295559 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:53.287493 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 447497us
I20260709 13:19:53.265600 19579 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:53.290373 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:53.285494 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:53.297292 19586 raft_consensus.cc:2368] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15.
I20260709 13:19:53.222553 24734 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:19:53.302352 19578 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:53.229504 24824 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.239840 24750 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:19:53.291391 24677 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:53.250639 24577 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:19:53.289224 24619 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.231653 24868 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.322412 24826 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.329032 24826 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.330067 24868 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:53.331794 24826 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:53.310585 24497 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15.
I20260709 13:19:53.322970 24537 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.333475 24537 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:53.336619 24537 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:53.337649 19509 raft_consensus.cc:2410] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:19:53.310881 24812 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:53.325220 24448 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.340163 24448 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.345036 24817 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:53.326659 24491 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.347385 19504 raft_consensus.cc:2368] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17.
I20260709 13:19:53.327566 24619 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.305365 24799 log.cc:1199] T 46d39387ed0c44978cdb2b736f9c1ccf P d56df3728fc04e37b2d29a3bcd91d167: Deleting WAL directory at /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-0-root/wals/46d39387ed0c44978cdb2b736f9c1ccf
I20260709 13:19:53.339183 24552 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.294687 24726 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:19:53.349021 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 85068.8us
I20260709 13:19:53.353384 19478 leader_election.cc:400] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15.
I20260709 13:19:53.310108 24876 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:53.355756 19478 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:53.355917 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:53.363059 19660 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
W20260709 13:19:53.358744 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 127044us
I20260709 13:19:53.364141 19625 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:53.289862 24495 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.366043 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:53.366580 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:53.372076 20665 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:53.372426 19579 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:53.361109 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:53.374998 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:53.366469 19627 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:53.367547 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:53.372337 19581 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:53.365163 19476 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:53.394239 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:53.395011 20666 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:53.373287 19656 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:53.399534 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:53.313606 24865 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:19:53.401952 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:53.370997 19505 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:53.405826 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:53.410933 19578 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:53.411444 24730 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:53.405382 24589 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:53.417990 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2403) took 1277 ms. Trace:
I20260709 13:19:53.418701 24726 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.419651 24448 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:53.418421 19510 rpcz_store.cc:276] 0709 13:19:52.140475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.140630 (+   155us) service_pool.cc:224] Handling call
0709 13:19:52.238601 (+ 97971us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:52.242507 (+  3906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.242537 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:52.774543 (+532006us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b2c00000c88. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:19:52.774959 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 13:19:53.061913 (+286954us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:53.394199 (+332286us) log.cc:844] Serialized 14 byte log entry
0709 13:19:53.406622 (+ 12423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.406724 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.406768 (+    44us) raft_consensus.cc:1685] finished
0709 13:19:53.417754 (+ 10986us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.417928 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14824,"raft.queue_time_us":3996,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":28386,"spinlock_wait_cycles":15985024,"thread_start_us":594873,"threads_started":2,"wal-append.queue_time_us":410662}
I20260709 13:19:53.411518 24799 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50816 (request call id 75) took 2924 ms. Trace:
I20260709 13:19:53.421319 24799 rpcz_store.cc:276] 0709 13:19:50.487251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.487494 (+   243us) service_pool.cc:224] Handling call
0709 13:19:50.894271 (+406777us) ts_tablet_manager.cc:1151] Deleting tablet 46d39387ed0c44978cdb2b736f9c1ccf
0709 13:19:50.894402 (+   131us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:19:52.729231 (+1834829us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:53.194273 (+465042us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:53.411428 (+217155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1114693,"tablet-delete.queue_time_us":303801,"thread_start_us":270894,"threads_started":1}
I20260709 13:19:53.423926 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:53.425438 24589 raft_consensus.cc:697] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:53.399955 24780 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.426501 24589 consensus_queue.cc:237] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.361582 24809 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.431571 19510 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:19:53.435022 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:53.436420 19578 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:53.355475 24574 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:53.441207 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:53.396687 24873 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:53.438129 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:19:53.444447 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.444703 19659 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:19:53.440192 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:53.442245 19654 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:53.437875 19625 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:53.361461 24811 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:53.394456 24813 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:53.400575 24876 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:53.454365 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:53.456615 19578 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.455272 19625 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:53.453559 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:53.457120 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:53.431668 24497 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:53.459430 19652 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:53.456503 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:53.462354 19653 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:53.468950 19654 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:53.427703 24217 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:19:53.441895 24804 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:53.362593 24406 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:53.500694 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 45531.1us
W20260709 13:19:53.511022 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 60921.5us
I20260709 13:19:53.443943 24864 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:53.512235 24873 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:53.529114 24574 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:53.536844 19625 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:53.538435 19654 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:19:53.542286 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:53.543118 19654 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 17: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:53.549353 19578 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:53.550635 19654 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:53.539104 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:53.551903 19660 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:53.538475 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:53.427222 24780 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:53.553577 19661 raft_consensus.cc:2393] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 17: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:53.463905 24750 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:53.461728 24497 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.579221 19510 raft_consensus.cc:2368] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 16. Current term is 17.
I20260709 13:19:53.530582 24804 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.588744 19654 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:53.447934 24809 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.629089 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:53.630076 19506 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:19:53.561836 24825 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.562397 24864 raft_consensus.cc:697] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:53.563272 24826 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:53.580379 24742 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:53.591092 24497 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:53.597739 24804 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:53.560787 24798 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:19:53.624549 24750 raft_consensus.cc:697] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:53.561084 24574 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:53.701040 24826 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.733546 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:53.734472 19506 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:53.742297 24406 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:53.743394 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:53.725950 24742 raft_consensus.cc:697] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:53.734591 24826 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:53.704512 24825 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:53.752091 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 298592us
I20260709 13:19:53.737041 24619 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:53.758895 19506 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:53.757366 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:53.716544 24876 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.749176 24865 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:53.788555 19659 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:53.781049 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:53.790534 19654 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:53.784907 19478 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:53.786868 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:53.748660 24531 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:19:53.772918 24886 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:19:53.792858 19660 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:53.791290 19625 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:53.823064 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:53.823299 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:53.823956 19581 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:19:53.824061 19587 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 17: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:53.825304 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:53.827025 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:53.827664 19580 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:53.831270 19581 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
W20260709 13:19:53.850165 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 58947.4us
I20260709 13:19:53.851089 19625 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:53.789590 24406 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:53.792353 24823 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:53.792822 24865 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:53.847187 24531 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.825922 24804 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.883396 19660 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
W20260709 13:19:53.941941 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 89654.4us
I20260709 13:19:53.883273 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:53.948807 19505 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.954447 19580 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
W20260709 13:19:53.974802 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.864699 24873 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:19:53.875276 24892 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:19:53.876333 24894 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 13:19:53.875826 24899 log.cc:927] Time spent T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:19:53.867172 24730 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:53.892004 24780 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:53.950932 24865 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:53.950523 24823 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.898430 24809 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:53.991641 19653 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:19:53.893093 24496 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.792115 24864 consensus_queue.cc:237] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.887838 24495 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:54.007680 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2726) took 1720 ms. Trace:
I20260709 13:19:53.900002 24406 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.005576 24734 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:53.892684 24742 consensus_queue.cc:237] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.040165 24825 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:54.040905 24902 log.cc:927] Time spent T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:19:54.044138 19660 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:54.044276 24734 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:53.869297 24811 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.133s
I20260709 13:19:53.981987 24835 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:54.030970 24496 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:53.864073 24217 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:54.057919 24217 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.060227 24217 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:54.036633 19505 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:54.063498 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:53.848332 24750 consensus_queue.cc:237] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.012120 24823 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:54.046841 19658 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:54.030927 19584 rpcz_store.cc:276] 0709 13:19:52.287610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.287756 (+   146us) service_pool.cc:224] Handling call
0709 13:19:52.288129 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:52.826309 (+538180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.826357 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:52.882729 (+ 56372us) log.cc:844] Serialized 26 byte log entry
0709 13:19:53.280497 (+397768us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:53.280551 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.280637 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.007423 (+726786us) raft_consensus.cc:1685] finished
0709 13:19:54.007447 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.007598 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85249,"raft.queue_time_us":194914,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":38566,"thread_start_us":806621,"threads_started":2,"wal-append.queue_time_us":593794}
I20260709 13:19:54.066926 19658 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:54.052390 19660 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:19:54.053257 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 104824us
I20260709 13:19:54.067720 19658 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.068465 19478 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:54.068672 19658 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:54.069849 24496 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:54.071477 24910 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:54.072001 24910 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:54.071926 24798 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:54.047739 19659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:54.074172 19659 raft_consensus.cc:606] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:54.074523 19659 raft_consensus.cc:614] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:54.075878 24741 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:54.077525 19659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:54.078187 19659 raft_consensus.cc:606] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:54.078526 19659 raft_consensus.cc:614] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:54.081501 19659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:54.082300 19659 raft_consensus.cc:606] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:54.082767 19659 raft_consensus.cc:614] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:54.085439 19659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:54.086158 19659 raft_consensus.cc:606] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:19:54.086598 19659 raft_consensus.cc:614] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:54.089283 19659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db4589d6497c49308384eacc43241a32"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:19:54.092221 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2420) took 1055 ms. Trace:
I20260709 13:19:54.092226 19659 raft_consensus.cc:606] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:54.069927 24835 raft_consensus.cc:697] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:54.093978 19659 raft_consensus.cc:614] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:54.094909 19582 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:19:54.038136 19625 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.129:38645 timed out after 1.517s (SENT) [suppressed 1 similar messages]
I20260709 13:19:54.091571 19658 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:19:54.093262 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:54.055589 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3387) took 1040 ms. Trace:
I20260709 13:19:54.096493 19658 pending_rounds.cc:85] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 9
I20260709 13:19:54.097247 19658 pending_rounds.cc:107] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:19:54.096203 19512 rpcz_store.cc:276] 0709 13:19:53.014845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.014972 (+   127us) service_pool.cc:224] Handling call
0709 13:19:53.015380 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:53.017901 (+  2521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.017932 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:53.034153 (+ 16221us) log.cc:844] Serialized 26 byte log entry
0709 13:19:53.373994 (+339841us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:53.374033 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.374092 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.055314 (+681222us) raft_consensus.cc:1685] finished
0709 13:19:54.055345 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.055513 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":293512,"threads_started":1,"wal-append.queue_time_us":658042}
I20260709 13:19:54.097913 19658 raft_consensus.cc:2889] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:54.098659 19512 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:54.027223 24619 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:54.092804 19507 rpcz_store.cc:276] 0709 13:19:53.036904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.294053 (+257149us) service_pool.cc:224] Handling call
0709 13:19:53.294341 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:53.305853 (+ 11512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.305884 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:53.342871 (+ 36987us) log.cc:844] Serialized 26 byte log entry
0709 13:19:53.745265 (+402394us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:53.745318 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.746594 (+  1276us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.092001 (+345407us) raft_consensus.cc:1685] finished
0709 13:19:54.092020 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.092154 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25631,"raft.queue_time_us":11328,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":7395,"thread_start_us":362650,"threads_started":1,"wal-append.queue_time_us":723356}
I20260709 13:19:54.105211 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:54.072994 24910 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.037957 24898 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:54.119907 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:54.118964 19507 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:54.125069 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2419) took 1088 ms. Trace:
I20260709 13:19:54.092329 24726 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:19:54.091457 24866 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:19:54.123281 24873 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:54.117548 24920 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.150760 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:54.153568 24574 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:54.115836 24619 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.155923 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:54.157889 19509 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:54.165619 19553 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:54.175446 24619 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:54.129535 24751 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:19:54.106523 24798 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:19:54.106510 24834 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 13:19:54.182812 24539 consensus_meta.cc:287] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.872s	user 0.011s	sys 0.000s
I20260709 13:19:54.184083 24497 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.123602 24898 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.171542 24873 raft_consensus.cc:697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:54.136538 19511 rpcz_store.cc:276] 0709 13:19:53.036301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.159106 (+122805us) service_pool.cc:224] Handling call
0709 13:19:53.161543 (+  2437us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:53.231633 (+ 70090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.231663 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:53.244076 (+ 12413us) log.cc:844] Serialized 52 byte log entry
0709 13:19:53.643882 (+399806us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:53.962142 (+318260us) log.cc:844] Serialized 14 byte log entry
0709 13:19:53.973148 (+ 11006us) log.cc:844] Serialized 14 byte log entry
0709 13:19:54.124608 (+151460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.124719 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.124777 (+    58us) raft_consensus.cc:1685] finished
0709 13:19:54.124800 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.124974 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20685,"prepare.queue_time_us":150871,"prepare.run_cpu_time_us":147,"prepare.run_wall_time_us":7447,"raft.queue_time_us":215901,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":4246,"thread_start_us":700023,"threads_started":3,"wal-append.queue_time_us":439649}
W20260709 13:19:54.203896 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 134434us
I20260709 13:19:54.144826 24811 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:19:54.189486 19509 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:19:54.215536 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:54.219348 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:54.221942 19511 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:54.211617 24539 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.238826 19506 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:19:54.223501 24632 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:54.156162 24920 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.227027 19503 raft_consensus.cc:2410] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:19:54.227165 24406 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:54.155418 24835 consensus_queue.cc:237] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.232123 24873 consensus_queue.cc:237] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.234877 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:54.353191 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 131752us
I20260709 13:19:54.229099 24826 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:54.210531 24804 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:54.211596 24734 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:54.351061 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 128956us
W20260709 13:19:54.375952 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.376353 19478 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:54.370563 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:54.212368 24876 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.139s
I20260709 13:19:54.384382 19507 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:19:54.387075 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:54.388806 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:54.399780 19582 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:54.400243 19582 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:54.391037 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:54.391575 19659 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
W20260709 13:19:54.352967 24577 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.011s	sys 0.015s
W20260709 13:19:54.350698 24889 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:19:54.396569 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 358454us
I20260709 13:19:54.259476 24632 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:54.347908 24726 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:54.417033 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:54.417809 19659 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:54.425808 19658 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 21: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:54.419368 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:54.401263 19582 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.361162 24741 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.427721 19625 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
W20260709 13:19:54.415951 24577 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.012s	sys 0.015s
I20260709 13:19:54.402792 24919 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:54.446578 24741 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.465679 24817 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:54.477041 19582 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.484851 19508 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:54.440181 24730 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:54.514501 19625 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:54.427326 24676 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:19:54.503235 24539 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:54.522969 24914 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:54.527201 24497 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:54.527729 24803 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:54.516342 24919 raft_consensus.cc:697] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:54.515827 24817 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:54.517048 24730 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.557401 24741 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:54.525993 24823 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:54.587147 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 64381.1us
I20260709 13:19:54.589360 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:54.577039 24914 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:54.587332 24788 raft_consensus.cc:3055] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:54.545892 24632 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.589335 24898 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:54.610427 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 256059us
I20260709 13:19:54.600725 24741 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:54.614389 24931 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:19:54.618896 24632 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:54.596427 24826 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:54.599774 24751 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:54.601260 24788 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:54.631767 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:54.632540 19509 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:54.637387 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:54.598472 24914 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.639810 19625 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:54.598572 24919 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.624366 24741 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.644418 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:54.646068 24730 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:54.636675 24920 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:54.646915 24788 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.643643 24758 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:54.670790 24758 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.625403 24817 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.672887 24758 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:54.644137 24803 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:54.674005 24803 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.674364 24803 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:54.676003 24865 consensus_meta.cc:287] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.661s	user 0.011s	sys 0.000s
I20260709 13:19:54.676452 24865 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.677670 19587 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:54.682875 19584 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:54.642920 24898 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:54.682915 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3403) took 1363 ms. Trace:
I20260709 13:19:54.684135 19505 rpcz_store.cc:276] 0709 13:19:53.319316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.065374 (+746058us) service_pool.cc:224] Handling call
0709 13:19:54.092690 (+ 27316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.176290 (+ 83600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.176321 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.176367 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:54.176406 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.682698 (+506292us) spinlock_profiling.cc:243] Waited 83.4 ms on lock 0x7b54001833d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:54.682740 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.682858 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191737088}
I20260709 13:19:54.669307 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:54.686472 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:54.687223 19584 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:54.687884 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:54.689095 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:54.690155 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:54.690688 19584 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:54.705317 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:54.706070 19579 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:54.709967 24865 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:54.633636 24938 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:19:54.714536 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:54.721451 24724 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.725395 24724 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:54.727593 24946 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:19:54.728016 24724 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:54.730062 19586 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
W20260709 13:19:54.734086 19552 connection.cc:256] RPC call timeout handler was delayed by -1.0513988109998991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:19:54.735400 24866 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:54.735836 24866 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:54.736688 24866 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.738906 24833 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:54.739465 24833 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:54.740419 24531 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:54.703625 24898 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.742197 24741 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:54.742457 24491 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:54.744102 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 2424) took 1430 ms. Trace:
I20260709 13:19:54.744191 24898 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:54.744485 19510 rpcz_store.cc:276] 0709 13:19:53.316445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.441120 (+124675us) service_pool.cc:224] Handling call
0709 13:19:54.743882 (+1302762us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54001e1254. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:54.744012 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276669184}
I20260709 13:19:54.747978 24823 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:54.749606 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:54.750932 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:54.751456 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:54.701267 24826 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.745421 19584 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:19:54.861172 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:54.751999 19654 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:19:54.782425 19478 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:54.850646 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2421) took 1813 ms. Trace:
I20260709 13:19:54.755604 19551 leader_election.cc:400] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 16. Current term is 17.
I20260709 13:19:54.858548 19652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 2466) took 1318 ms. Trace:
I20260709 13:19:54.857473 19504 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:54.774371 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:54.856082 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 2461) took 1318 ms. Trace:
I20260709 13:19:54.754613 19579 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:54.843995 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:54.811103 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:54.819329 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:54.904479 24813 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:54.904302 24826 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.904922 24813 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.905323 24813 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:54.781500 19578 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:19:54.905884 24788 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:54.883526 24888 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 1.150s	user 0.009s	sys 0.002s
I20260709 13:19:54.907020 24826 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:54.779186 19509 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:54.817519 24865 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:54.909973 24865 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.910288 24804 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:54.910691 19581 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 18: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:54.910936 24804 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:54.912150 24865 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:54.816743 24947 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.806550 24866 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:54.885113 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:54.752485 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:54.928277 19660 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:19:54.901087 19652 rpcz_store.cc:276] 0709 13:19:53.540289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.542304 (+  2015us) service_pool.cc:224] Handling call
0709 13:19:53.542585 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:53.710415 (+167830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.710459 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:53.711025 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:19:53.947273 (+236248us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:53.947505 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.858076 (+910571us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54003f3c54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:54.858143 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.858204 (+    61us) raft_consensus.cc:1685] finished
0709 13:19:54.858223 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.858478 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":974,"raft.queue_time_us":7981,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":4729,"spinlock_wait_cycles":384845568,"thread_start_us":208556,"threads_started":1,"wal-append.queue_time_us":334530}
I20260709 13:19:54.903355 19551 leader_election.cc:403] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:19:54.779481 24833 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:54.930078 24865 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 16. Current term is 17.
W20260709 13:19:54.930255 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 174871us
I20260709 13:19:54.935521 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:54.900367 19508 rpcz_store.cc:276] 0709 13:19:53.037444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.294581 (+257137us) service_pool.cc:224] Handling call
0709 13:19:53.294843 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.485516 (+1190673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.850402 (+364886us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002a9ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:54.850582 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2641943936}
I20260709 13:19:54.935847 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:54.936154 19661 raft_consensus.cc:1813] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Handling vote request from an unknown peer 2cfd02601ea44976833027665abc93bf
I20260709 13:19:54.937068 19661 raft_consensus.cc:2410] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:19:54.775449 24875 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:19:54.936115 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:54.938194 19512 raft_consensus.cc:2368] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14.
W20260709 13:19:54.777139 24945 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:19:54.774150 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:54.949743 19659 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
W20260709 13:19:54.863125 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:54.952373 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.807093 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:54.900612 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 118309us
I20260709 13:19:54.956251 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:54.902168 19653 rpcz_store.cc:276] 0709 13:19:53.537842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.538873 (+  1031us) service_pool.cc:224] Handling call
0709 13:19:53.584916 (+ 46043us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.012114 (+427198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.855817 (+843703us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54000e7ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:54.856023 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":929721600}
I20260709 13:19:54.702086 24758 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:54.853510 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 2779) took 1029 ms. Trace:
I20260709 13:19:54.751906 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:54.810819 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:19:54.923534 19578 raft_consensus.cc:1275] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:19:54.959333 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.959295 20659 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:54.779389 19503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 3392) took 1757 ms (client timeout 1673 ms). Trace:
I20260709 13:19:54.961475 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:54.859143 24824 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:54.815706 24898 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:54.959896 19503 rpcz_store.cc:269] 0709 13:19:53.021917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.039841 (+ 17924us) service_pool.cc:224] Handling call
0709 13:19:54.779175 (+1739334us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54000249d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:54.779319 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2634899840}
I20260709 13:19:54.778370 24914 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:54.979344 19625 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:54.958256 19587 rpcz_store.cc:276] 0709 13:19:53.823773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.825018 (+  1245us) service_pool.cc:224] Handling call
0709 13:19:54.853310 (+1028292us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b5400267854. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:54.853449 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1958311680}
I20260709 13:19:54.960525 19657 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:54.965847 19661 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:54.822073 24677 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:54.982805 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3407) took 1168 ms. Trace:
I20260709 13:19:54.982964 24804 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:54.983191 19507 rpcz_store.cc:276] 0709 13:19:53.814419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.131794 (+317375us) service_pool.cc:224] Handling call
0709 13:19:54.132245 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.398174 (+265929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.982555 (+584381us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54001838d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:54.982752 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578985728}
I20260709 13:19:54.984452 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:54.985224 19507 raft_consensus.cc:2393] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:54.986418 19653 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:54.988791 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:54.989220 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:54.967465 19512 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:54.967367 19654 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
W20260709 13:19:54.970019 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.971051 24809 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:54.973084 24806 consensus_queue.cc:1048] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:54.853885 24938 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:54.990603 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:54.991737 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:54.992051 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:55.017966 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:54.987521 19476 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:54.988049 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:55.019915 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:55.021164 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:54.977849 24875 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.974761 24758 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.029721 19661 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 17: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:54.962320 19511 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 18: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:55.003984 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:54.985049 24677 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:54.962765 24947 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.004122 24826 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.007714 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:54.997254 24878 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.994728 24865 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:19:54.980742 24834 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:54.992686 24914 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:55.013475 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:55.052273 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 318291us
I20260709 13:19:55.052460 19587 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 18: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:54.996438 19625 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:55.032145 19512 raft_consensus.cc:2410] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:19:55.008283 24809 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.033133 19478 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:55.015722 24726 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:55.038821 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51404.4us
I20260709 13:19:55.061640 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:55.062410 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:55.063016 19581 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:19:55.043355 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:54.988200 24898 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.051080 20659 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:19:54.993988 24663 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:19:55.033278 24491 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:55.064380 24619 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:19:55.066429 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 65314.5us
W20260709 13:19:55.033372 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 224503us
I20260709 13:19:55.067682 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:55.116392 19654 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:55.068145 19551 leader_election.cc:400] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14.
I20260709 13:19:55.070117 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:55.071110 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:55.119624 19508 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:19:55.077859 24730 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:55.078869 24953 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:19:55.084661 19458 auto_rebalancer.cc:629] Failed to schedule move for tablet d9242425d3a744c3b8742c30995129f4: Illegal state: Replica e19c80e9149b4b8d88ae13bde8e43864 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:55.035723 24875 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.090397 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2422) took 1920 ms. Trace:
I20260709 13:19:55.091333 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3401) took 1864 ms. Trace:
I20260709 13:19:55.131381 19504 rpcz_store.cc:276] 0709 13:19:53.226970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.884209 (+657239us) service_pool.cc:224] Handling call
0709 13:19:53.884619 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.901496 (+1016877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.091127 (+189631us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b540003e3d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:55.091279 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2236961664}
I20260709 13:19:55.130362 19506 rpcz_store.cc:276] 0709 13:19:53.170263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.763700 (+593437us) service_pool.cc:224] Handling call
0709 13:19:53.798919 (+ 35219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.239340 (+440421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.090159 (+850819us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54002201d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:55.090340 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011066240}
I20260709 13:19:55.040323 24826 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.143558 19476 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:55.145246 19508 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:19:55.116346 24914 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.095278 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:55.097281 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:55.148301 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:55.104300 24898 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:55.056885 24834 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.040225 24924 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:55.117626 19551 leader_election.cc:403] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:55.128369 24491 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:55.128718 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.031418 24938 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.109217 24619 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:55.144519 19625 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:55.091173 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:55.049602 24878 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.105026 24758 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:55.129451 24919 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:55.128365 24495 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.097774 24726 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.204823 24809 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:55.171044 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 103029us
I20260709 13:19:55.172199 19476 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:55.117399 19578 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:19:55.188053 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 96982us
I20260709 13:19:55.208598 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:55.212566 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:55.140233 24811 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:19:55.129938 24813 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.162181 24868 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:55.162436 24876 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:55.212670 19478 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:55.188756 24741 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:55.146144 24803 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.191833 24619 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:55.147651 24817 consensus_queue.cc:1059] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 13:19:55.219187 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 47066.4us
I20260709 13:19:55.187896 24924 raft_consensus.cc:697] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:55.202229 24663 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:55.206225 24833 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:55.219587 24949 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:55.219745 24758 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:55.205780 24495 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:55.247952 24632 consensus_meta.cc:287] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.000s
I20260709 13:19:55.165465 24914 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.235201 24938 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:55.243469 19583 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:55.248961 19476 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:55.225502 24724 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:55.229269 24813 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:55.224438 24912 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:55.216804 24798 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:19:55.274201 19507 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:19:55.252971 24833 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.248062 24932 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:55.251159 24947 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:55.303949 24730 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:55.304440 24833 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:55.304606 24730 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.306763 24803 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:55.306856 24730 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:55.307461 24677 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.308336 24724 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:55.310001 24677 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:55.311053 24932 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:55.253420 24907 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:55.225724 24876 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:55.254879 24528 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:19:55.254488 24663 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:55.247931 24950 consensus_queue.cc:1059] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:19:55.321749 19583 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:55.273864 24758 raft_consensus.cc:697] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:55.371119 24932 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:55.255102 24491 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:55.314386 24835 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:55.389972 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:55.386179 24726 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:55.402254 19458 auto_rebalancer.cc:629] Failed to schedule move for tablet 5456af6e274a4116a91b4bc0e326ca5f: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:19:55.418530 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 295256us
I20260709 13:19:55.398276 24875 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:55.419662 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:55.401999 24834 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:55.379587 24924 consensus_queue.cc:237] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.440316 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:55.427860 24878 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:55.439756 24958 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
W20260709 13:19:55.448479 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 304028us
I20260709 13:19:55.429824 24960 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:55.440215 24898 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14.
I20260709 13:19:55.452416 19625 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:55.445127 24914 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:55.460079 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:55.472856 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:55.493453 19580 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:55.496963 19510 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:55.498373 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:55.463990 19578 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:55.456410 24495 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:55.484805 24871 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:55.486382 24949 consensus_queue.cc:1059] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:55.461915 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:55.423779 24758 consensus_queue.cc:237] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.506137 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:55.514400 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:55.515246 19510 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:55.510572 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:55.517915 19509 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:55.525095 19578 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:19:55.531726 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:55.564267 24959 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.247s	user 0.004s	sys 0.000s
W20260709 13:19:55.565052 24866 consensus_meta.cc:287] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.000s
I20260709 13:19:55.521540 24803 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:55.529037 24876 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:19:55.572962 19659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.013s	sys 0.023s
W20260709 13:19:55.575517 19659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.013s	sys 0.023s
I20260709 13:19:55.581393 19503 raft_consensus.cc:1275] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:19:55.590274 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 341368us
I20260709 13:19:55.569458 24663 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:55.569202 24811 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:55.578293 24826 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:55.588042 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 317846us
I20260709 13:19:55.580165 24742 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:55.588930 24949 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.574177 24803 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.597365 24817 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.646171 24873 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:55.755690 24961 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:19:55.636826 24811 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:55.831770 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 392268us
W20260709 13:19:55.798593 24968 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.352s	user 0.000s	sys 0.001s
I20260709 13:19:55.734728 24742 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:55.763224 24949 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.840246 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:19:55.833869 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 236244us
I20260709 13:19:55.844760 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:19:55.833194 24969 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 13:19:55.780151 24817 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.794268 24873 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:55.847658 24833 consensus_meta.cc:287] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.543s	user 0.012s	sys 0.001s
I20260709 13:19:55.833570 24750 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:55.859236 24914 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
W20260709 13:19:55.849946 24903 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.016s	sys 0.108s
W20260709 13:19:55.868613 24966 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
W20260709 13:19:55.897135 24981 log.cc:927] Time spent T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:19:55.894994 24973 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 13:19:55.887099 24980 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:19:55.913590 24903 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.016s	sys 0.109s
I20260709 13:19:55.900202 24811 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:55.882691 24920 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:55.885063 24803 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:55.898972 24949 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:55.933274 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 91691.4us
I20260709 13:19:55.887580 25003 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:55.946863 19509 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:19:55.897497 24833 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.931393 24676 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:55.916719 24750 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:55.970484 24990 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:19:55.967429 24619 consensus_meta.cc:287] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.715s	user 0.014s	sys 0.000s
I20260709 13:19:55.952374 24920 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.986419 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:55.989763 24893 log.cc:927] Time spent T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 2.252s	user 0.005s	sys 0.002s
I20260709 13:19:55.990253 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:55.990911 19581 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:19:55.992314 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 2819) took 2925 ms. Trace:
I20260709 13:19:55.992607 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:55.992717 19655 rpcz_store.cc:276] 0709 13:19:53.067176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.070672 (+  3496us) service_pool.cc:224] Handling call
0709 13:19:53.071004 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:53.078817 (+  7813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.078853 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:53.079420 (+   567us) log.cc:844] Serialized 52 byte log entry
0709 13:19:53.384959 (+305539us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:53.384996 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.385061 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:55.417969 (+2032908us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:55.989401 (+571432us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b2400397208. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e4f39c4 00007f6c2e4f1acb 00007f6c2e6acdc9 00007f6c2e6aca55 00007f6c2e6ac09d 00007f6c312de10e 00007f6c312f588c 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221
0709 13:19:55.992054 (+  2653us) raft_consensus.cc:1685] finished
0709 13:19:55.992076 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.992209 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15040,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":15295,"spinlock_wait_cycles":27990784,"thread_start_us":268569,"threads_started":1,"wal-append.queue_time_us":531047}
I20260709 13:19:55.997859 24949 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:55.997749 24871 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:55.984622 24619 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.998598 24949 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:55.998648 24871 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.000661 24619 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:56.001171 24986 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
W20260709 13:19:56.005671 24994 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:55.967358 24676 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:55.896374 25002 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:19:55.968504 25003 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:56.013805 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 177314us
I20260709 13:19:56.014811 19625 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:56.015955 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 2473) took 1081 ms. Trace:
I20260709 13:19:56.013216 24589 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:56.016829 24589 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.016374 19660 rpcz_store.cc:276] 0709 13:19:54.934762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.940051 (+  5289us) service_pool.cc:224] Handling call
0709 13:19:54.940412 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.968134 (+ 27722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.968179 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:55.076969 (+108790us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b2c0002b1b8. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:19:55.108731 (+ 31762us) log.cc:844] Serialized 26 byte log entry
0709 13:19:55.414404 (+305673us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:55.414463 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.414529 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:56.011780 (+597251us) raft_consensus.cc:1685] finished
0709 13:19:56.011811 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.015886 (+  4075us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6853,"raft.queue_time_us":24349,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":4937472,"thread_start_us":257962,"threads_started":1,"wal-append.queue_time_us":454633}
I20260709 13:19:56.021565 19625 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:56.024179 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:56.014420 25006 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.012828 24730 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:56.020506 24803 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:56.021468 25001 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:56.028627 24975 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:56.023888 24663 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:56.031384 25006 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.029060 24914 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:19:56.053208 24663 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.065529 24974 raft_consensus.cc:3055] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:56.039072 25004 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:56.050776 24817 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:56.049824 24985 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.038096 24730 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:56.073731 24804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.006s	sys 0.026s
I20260709 13:19:56.070763 24873 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:56.069824 24974 raft_consensus.cc:740] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:56.075723 25004 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.048837 25001 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.039264 24676 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:56.088002 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.081895 24804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.006s	sys 0.026s
I20260709 13:19:56.086333 24833 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:56.085928 24589 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:56.092305 25006 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:56.081069 24985 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.094836 24985 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:56.098726 24663 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:56.094972 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 3424) took 1090 ms. Trace:
I20260709 13:19:56.085204 25004 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:56.107656 19507 rpcz_store.cc:276] 0709 13:19:55.004997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.017641 (+ 12644us) service_pool.cc:224] Handling call
0709 13:19:56.094728 (+1077087us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b5400073ad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:56.094886 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587556608}
I20260709 13:19:56.105866 24676 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:56.113788 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.114120 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.114674 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:56.114931 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:56.118788 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.120649 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2481) took 1150 ms. Trace:
I20260709 13:19:56.126144 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:56.119413 19507 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:19:56.125298 19509 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:56.137907 19654 rpcz_store.cc:276] 0709 13:19:54.970660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.015547 (+ 44887us) service_pool.cc:224] Handling call
0709 13:19:56.120447 (+1104900us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b54001239d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:56.120561 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41283840}
I20260709 13:19:56.122855 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:56.122555 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:56.126031 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:56.140020 19658 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:19:56.141250 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:56.142030 19658 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 11.
I20260709 13:19:56.143087 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:56.144816 19658 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:19:56.120936 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.121140 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.146140 19506 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:19:56.146418 19510 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:19:56.123178 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:56.113037 25001 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:56.149406 19659 raft_consensus.cc:2393] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:56.150344 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.150681 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:56.147850 19653 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:19:56.151718 19510 raft_consensus.cc:2410] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:19:56.123462 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:56.154188 19661 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:19:56.120118 24809 raft_consensus.cc:3055] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:56.160864 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:56.126571 24677 raft_consensus.cc:3055] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:56.125695 25003 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:56.163344 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:56.165555 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.166885 19509 raft_consensus.cc:1813] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Handling vote request from an unknown peer 2cfd02601ea44976833027665abc93bf
I20260709 13:19:56.167327 19509 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 14: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:56.167536 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:56.167667 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:56.168123 19654 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:19:56.169322 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:56.161924 24809 raft_consensus.cc:740] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:56.172816 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.170094 24663 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:56.163067 24677 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:56.109373 24974 consensus_queue.cc:260] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.181885 24974 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.184418 24730 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:56.171267 24758 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:56.194002 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2810) took 1125 ms. Trace:
I20260709 13:19:56.194618 19584 rpcz_store.cc:276] 0709 13:19:55.068776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.068928 (+   152us) service_pool.cc:224] Handling call
0709 13:19:55.069316 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:55.197939 (+128623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:55.197986 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:55.198046 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:55.198091 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.193680 (+995589us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540011dad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:56.193746 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.193905 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295077760}
W20260709 13:19:56.196759 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 605437us
I20260709 13:19:56.197496 19476 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:56.171221 24864 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:56.199589 19476 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:56.199743 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.201691 24809 consensus_queue.cc:260] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.202898 24751 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:56.203228 24809 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:56.203461 24920 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:56.203723 19627 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:56.201753 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 570740us
I20260709 13:19:56.207151 25002 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:56.207620 25002 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.163849 24750 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:56.179862 19509 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:19:56.208585 24878 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:56.227514 24878 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:56.227979 24878 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:56.228878 24907 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:56.177883 19510 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:19:56.223963 20619 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:56.230202 25002 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:56.232203 24907 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:56.244721 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:56.285319 19657 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:56.287420 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.288084 19585 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:56.288378 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.289013 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.289180 19579 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:56.289587 19585 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:56.246616 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:56.290145 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.291132 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.292029 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.246062 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:56.248904 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:56.244555 19625 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:56.229735 24826 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:56.296571 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:56.292938 19652 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
W20260709 13:19:56.304893 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 133291us
W20260709 13:19:56.256832 24955 log.cc:927] Time spent T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 1.069s	user 0.005s	sys 0.000s
I20260709 13:19:56.236490 24960 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:56.264277 24677 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.271730 24949 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:56.273128 24871 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:56.310581 19410 catalog_manager.cc:5697] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 5 to 13, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New cstate: current_term: 14 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:56.279346 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.282075 24919 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.283927 24742 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:56.288544 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.296841 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.297219 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.281260 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:56.344477 19583 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:19:56.344743 19655 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:56.298928 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.345634 19584 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:56.247428 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:56.305927 19627 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:56.309599 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:19:56.312270 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 84929.4us
I20260709 13:19:56.344007 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:53.825332 19395 catalog_manager.cc:5028] TS d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): tablet 46d39387ed0c44978cdb2b736f9c1ccf (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
I20260709 13:19:56.347545 19478 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:56.348217 19580 raft_consensus.cc:2410] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:19:56.381428 19655 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:19:56.375398 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:56.358892 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:56.388827 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 144400us
I20260709 13:19:56.239666 24751 consensus_queue.cc:1048] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 13:19:56.389961 19625 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:56.355360 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:56.396606 19657 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:19:56.322945 24806 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:19:56.348824 19395 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 2.5235e+06us
I20260709 13:19:56.347483 24989 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.354310 19410 catalog_manager.cc:5697] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:56.391842 24677 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:56.410610 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 104766us
I20260709 13:19:56.437148 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:56.411154 25006 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:56.412600 25003 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:19:56.420943 25015 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
W20260709 13:19:56.421757 19409 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48840 (request call id 166) took 55039 ms (client timeout 15000 ms). Trace:
I20260709 13:19:56.432247 25001 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.342928 24919 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:56.436285 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.437554 19410 catalog_manager.cc:5697] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 4 to 8, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New cstate: current_term: 13 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:56.443732 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:19:56.464874 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 117439us
I20260709 13:19:56.466001 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:56.437862 24955 log.cc:927] Time spent T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:19:56.406950 24806 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.470328 19627 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:56.484794 24910 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.485894 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.487398 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.408735 24750 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:56.491741 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.488963 19505 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:56.489880 19507 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:19:56.489979 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.499372 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.500285 19507 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
W20260709 13:19:56.463063 25010 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:56.508298 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.509115 19512 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:19:56.440526 25006 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:56.513226 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.515086 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.443567 25003 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:56.442765 24813 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:56.464210 24833 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:56.463693 24871 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:56.520085 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.492887 24804 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:56.532269 19661 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:56.503722 24806 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:56.507483 24824 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:56.440451 24989 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.520406 25006 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:56.521507 25003 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:56.521064 24873 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:56.468664 25001 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.549345 19503 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:56.521279 24750 raft_consensus.cc:697] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:19:56.564635 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 49841.5us
I20260709 13:19:56.536170 24804 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:19:56.443949 19409 rpcz_store.cc:269] 0709 13:19:01.382258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.382617 (+   359us) service_pool.cc:224] Handling call
0709 13:19:56.421656 (+55039039us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:51.713805 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:51.714480 (+   675us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:51.714533 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:19:51.714552 (+    19us) tablet.cc:662] Decoding operations
0709 13:19:51.714945 (+   393us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:51.715011 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:51.715035 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:19:51.715303 (+   268us) tablet.cc:701] Row locks acquired
0709 13:19:51.715348 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:19:51.715510 (+   162us) write_op.cc:270] Start()
0709 13:19:51.715651 (+   141us) write_op.cc:276] Timestamp: P: 1783603191715445 usec, L: 0
0709 13:19:51.715674 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:19:51.716379 (+   705us) log.cc:844] Serialized 543 byte log entry
0709 13:19:52.568361 (+851982us) op_driver.cc:464] REPLICATION: finished
0709 13:19:53.248191 (+679830us) write_op.cc:301] APPLY: starting
0709 13:19:53.254007 (+  5816us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:53.255977 (+  1970us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:53.256141 (+   164us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:53.257546 (+  1405us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:53.352035 (+ 94489us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:19:53.354814 (+  2779us) write_op.cc:312] APPLY: finished
0709 13:19:53.417949 (+ 63135us) log.cc:844] Serialized 24 byte log entry
0709 13:19:53.740578 (+322629us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:53.748561 (+  7983us) write_op.cc:454] Released schema lock
0709 13:19:53.753691 (+  5130us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:53.754198 (+   507us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:53.754232 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2435135,"reported_tablets":58,"child_traces":[["op",{"apply.queue_time_us":575231,"apply.run_cpu_time_us":16651,"apply.run_wall_time_us":506015,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"mutex_wait_us":10535,"num_ops":1,"prepare.queue_time_us":91221,"prepare.run_cpu_time_us":29430,"prepare.run_wall_time_us":191086,"raft.queue_time_us":509456,"raft.run_cpu_time_us":15496,"raft.run_wall_time_us":543731,"replication_time_us":832121,"thread_start_us":1012324,"threads_started":5,"wal-append.queue_time_us":720816,"wal-append.run_cpu_time_us":96728,"wal-append.run_wall_time_us":2585989}]]}
I20260709 13:19:56.568892 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3098) took 1594 ms. Trace:
I20260709 13:19:56.582440 19586 rpcz_store.cc:276] 0709 13:19:54.974391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.974535 (+   144us) service_pool.cc:224] Handling call
0709 13:19:54.974869 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.975098 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.975123 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.988352 (+ 13229us) log.cc:844] Serialized 26 byte log entry
0709 13:19:54.988504 (+   152us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:54.988547 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.988607 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:56.568626 (+1580019us) raft_consensus.cc:1685] finished
0709 13:19:56.568657 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.568817 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:56.505441 24910 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:56.585676 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.541421 24949 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:56.536545 25016 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:56.586582 25016 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:56.585484 24910 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:56.590870 25016 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:56.591773 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.513993 24988 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:19:56.605551 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.606779 19504 raft_consensus.cc:2410] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:19:56.608419 24907 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.545596 25002 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.611455 25002 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:56.611886 24676 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:56.612416 24676 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.600272 24983 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.613525 24750 consensus_queue.cc:237] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.614316 24983 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.615243 24898 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.615895 24898 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.616590 24983 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:56.622128 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 68950.1us
I20260709 13:19:56.622923 19476 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:56.624588 19476 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:56.574483 24873 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.626245 24824 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:56.626705 24824 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.627029 24491 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:56.627570 24491 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:56.627921 24873 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:56.628376 24491 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.537704 24813 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:56.628973 24806 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.631045 24813 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:56.631248 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:19:56.631537 24813 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.631992 24813 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.633592 24912 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.627050 24824 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:56.634953 24912 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.637035 24912 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:56.535027 24871 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.639446 24806 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:56.641134 24871 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:56.633971 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:56.625461 19476 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:56.647728 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:56.658450 19652 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:56.593333 24804 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:56.663511 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:56.669874 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:56.674773 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:56.675534 19661 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:19:56.677137 19653 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:56.687688 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.688709 19509 raft_consensus.cc:2410] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:19:56.634426 24826 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:56.660885 24552 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:19:56.723858 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.651253 24676 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:56.679147 24528 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:56.720794 24903 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:19:56.745791 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 386952us
I20260709 13:19:56.684805 24878 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.753355 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:56.759210 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.759806 19551 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:56.728940 24833 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:19:56.745438 24528 raft_consensus.cc:697] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:56.756773 25024 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.803045 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.776815 24898 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:56.777063 24813 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:56.787125 24730 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:56.819378 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.820053 19582 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:56.820438 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.826102 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.827056 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.828419 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:56.828986 19585 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:56.830687 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.831801 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.832332 19583 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:56.833115 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:56.834009 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:56.834903 19578 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 17: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:56.835419 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:56.835812 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.837138 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.840085 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.842573 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.842962 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:56.843724 19583 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:56.844448 24813 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:56.847349 19582 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:56.848649 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:56.849296 19582 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:56.846066 19478 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:56.851665 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:56.782150 24824 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.817747 24552 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:56.757284 24903 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.802677 25036 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:56.856734 19585 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
W20260709 13:19:56.869778 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.873695 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.874787 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.875782 25032 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.876362 25032 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.877911 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.877811 24528 consensus_queue.cc:237] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.880069 25032 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:56.859306 19586 raft_consensus.cc:2410] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:19:56.872888 19478 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:19:56.883189 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.883347 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:56.883801 19586 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:56.885085 19627 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:56.886149 19583 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:19:56.887539 19627 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:56.894111 19582 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:56.821023 25034 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:56.903215 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:56.905102 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:56.912175 19582 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:56.854123 25031 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:56.859020 24813 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:56.849794 24898 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:56.911664 24985 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:56.873917 24663 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:56.815068 25024 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.906611 24815 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:56.905331 25001 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:56.898198 24989 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:56.905807 24537 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:56.903607 25032 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:56.938089 24898 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.945338 24985 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:56.945784 24663 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.911983 24914 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:56.922217 24589 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.932127 24864 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:56.928718 24865 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:56.908680 24826 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:19:56.949007 24815 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.906198 25036 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:56.962200 25027 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
W20260709 13:19:56.956321 25018 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:19:56.985965 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:56.956703 25032 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.953827 25028 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:56.988114 19512 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:56.981743 24914 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:56.912338 25034 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:56.990263 24878 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:56.986882 25003 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:57.002465 25021 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 13:19:56.951977 24987 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 13:19:56.979343 24677 consensus_meta.cc:287] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.002s
I20260709 13:19:57.006867 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:57.013437 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:56.970144 24865 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:56.981495 24815 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:57.028257 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:57.029891 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:57.043100 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 283363us
I20260709 13:19:56.993193 25032 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:57.049618 19508 raft_consensus.cc:2410] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:19:57.054339 19510 raft_consensus.cc:2393] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:56.929090 25031 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:57.054870 19580 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:19:57.055457 19578 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:19:57.047711 19551 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:57.033049 25026 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 13:19:56.977154 24589 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:57.049230 19512 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:19:57.072314 24824 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:57.068820 25004 consensus_meta.cc:287] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.958s	user 0.017s	sys 0.000s
I20260709 13:19:56.955596 24552 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:57.054507 25022 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 13:19:57.031483 24528 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:57.095297 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:57.079247 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:57.040094 24663 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:57.046334 24865 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:57.040871 24730 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:57.038657 24903 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:57.037072 25036 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:57.100342 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:57.060094 24949 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.104826 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:57.041476 25024 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:57.004815 25028 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:57.096865 24677 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:57.160955 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 56242.8us
W20260709 13:19:57.145992 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 416102us
I20260709 13:19:57.158665 24730 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:57.173357 25036 raft_consensus.cc:2764] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:19:57.174290 25034 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:57.112054 24758 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:19:57.192730 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 225029us
W20260709 13:19:57.180568 25021 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:19:57.184079 19580 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:19:57.183725 19551 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:57.188419 19625 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:57.183825 19476 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:57.042044 24914 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:57.041195 24985 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:57.178535 25043 log.cc:927] Time spent T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:19:57.097816 25004 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:57.173408 24949 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:57.200728 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:57.209297 19476 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:57.174331 25047 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:57.197151 24758 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.214175 19625 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:57.232520 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:57.155936 24528 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:57.242260 19660 raft_consensus.cc:2368] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18.
I20260709 13:19:57.206110 25036 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:57.210139 25038 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:57.244606 19625 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:57.212735 24910 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:57.215381 24898 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:57.250428 19625 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:57.232354 25006 consensus_meta.cc:287] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.659s	user 0.005s	sys 0.006s
W20260709 13:19:57.236292 24491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.008s	sys 0.043s
W20260709 13:19:57.296502 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 46184.2us
W20260709 13:19:57.301154 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.238106 24758 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:57.233314 25025 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:57.243011 24677 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:57.214701 25013 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 13:19:57.343639 19458 auto_rebalancer.cc:629] Failed to schedule move for tablet dff318d429f74439a25e68f54950fb36: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:19:57.247440 24751 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:57.242134 24988 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.107s
I20260709 13:19:57.236232 25047 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:57.364204 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:57.259601 25002 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:57.366267 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:57.364210 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:57.336511 24491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.012s	sys 0.043s
I20260709 13:19:57.240442 24826 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:57.311985 19625 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:57.418061 19652 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:57.421250 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:57.312084 24975 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:19:57.373379 24809 consensus_meta.cc:287] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 1.170s	user 0.014s	sys 0.001s
W20260709 13:19:57.427760 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 115996us
I20260709 13:19:57.313549 25038 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:57.437152 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:57.430924 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:57.374995 25003 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:57.345188 24878 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:57.344506 25025 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:57.356336 24910 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:19:57.433020 19504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.006s	sys 0.002s
I20260709 13:19:57.403693 24677 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:57.464542 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:57.483671 19657 raft_consensus.cc:2368] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18.
I20260709 13:19:57.484441 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:57.428251 24751 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:57.471980 19458 auto_rebalancer.cc:629] Failed to schedule move for tablet 9c9a4266bc2b4d15ac7862c48149bb66: Illegal state: Replica d56df3728fc04e37b2d29a3bcd91d167 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:19:57.436815 19625 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:57.426831 24826 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.476886 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:57.476845 25025 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:57.479415 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:57.343324 25006 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:57.486114 25051 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:19:57.473305 24878 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:57.485790 19657 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:57.492440 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:57.478145 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:19:57.485949 25057 log.cc:927] Time spent T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
W20260709 13:19:57.480507 19504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.007s	sys 0.002s
W20260709 13:19:57.499147 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 62462.3us
I20260709 13:19:57.485425 24677 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:57.508142 24878 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:57.509972 25064 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.527937 25064 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:57.530695 25064 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:57.494560 25028 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:57.495087 24826 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:57.514061 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:57.491360 25031 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:57.437909 24975 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:57.487555 24491 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:57.506390 19625 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:57.714789 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:57.722551 25072 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:19:57.853930 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2835) took 1026 ms. Trace:
I20260709 13:19:58.442847 19584 rpcz_store.cc:276] 0709 13:19:56.827235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.827824 (+   589us) service_pool.cc:224] Handling call
0709 13:19:56.828044 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:57.014923 (+186879us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:57.015228 (+   305us) log.cc:844] Serialized 14 byte log entry
0709 13:19:57.079746 (+ 64518us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:57.079854 (+   108us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:57.079928 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.368839 (+288911us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b18003dafe0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e63b2a6 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419
0709 13:19:57.853599 (+484760us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400106654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:57.853685 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:57.853854 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46938,"prepare.queue_time_us":11510,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":9664,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8707,"spinlock_wait_cycles":463132800,"thread_start_us":54460,"threads_started":1,"wal-append.queue_time_us":161331,"wal-append.run_cpu_time_us":1075,"wal-append.run_wall_time_us":1001110}
I20260709 13:19:58.079823 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:58.257515 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:58.297467 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:58.310091 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:58.240180 20665 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:58.281461 24491 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.155647 24495 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.643186 24495 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:58.644582 25053 log.cc:927] Time spent T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 1.302s	user 0.003s	sys 0.010s
I20260709 13:19:57.647328 24528 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:57.619755 24676 consensus_meta.cc:287] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.882s	user 0.001s	sys 0.010s
I20260709 13:19:57.726804 24677 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.650254 24491 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.651538 24491 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:58.652071 24677 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.652737 24677 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:57.624961 24730 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:57.505113 24750 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:57.715366 24758 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:57.616612 24804 consensus_meta.cc:287] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.929s	user 0.005s	sys 0.003s
I20260709 13:19:58.786208 24804 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.787606 24758 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.788252 24758 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:58.788477 24804 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:57.623118 24815 consensus_meta.cc:287] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.002s
I20260709 13:19:58.306545 24589 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:58.790316 24815 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:57.718816 24865 consensus_meta.cc:287] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.559s	user 0.000s	sys 0.011s
I20260709 13:19:57.485388 24910 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.230389 24912 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:58.795004 24912 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:58.796167 24910 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.797273 24912 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:58.120074 24907 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:57.669497 24919 consensus_meta.cc:287] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 1.177s	user 0.013s	sys 0.000s
I20260709 13:19:57.616609 24949 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.282915 24975 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:58.805341 24949 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:58.113696 24987 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:57.511755 25004 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:57.612738 25006 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:58.806926 24987 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:57.725443 25025 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.813179 24987 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:58.143412 25029 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.897s	user 0.000s	sys 0.005s
W20260709 13:19:57.620510 25032 consensus_meta.cc:287] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.548s	user 0.000s	sys 0.009s
I20260709 13:19:58.295367 25037 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:58.843362 25037 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:57.695384 25047 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.855616 24987 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:58.328728 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.856186 24987 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:57.711972 25019 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.976s	user 0.000s	sys 0.010s
I20260709 13:19:58.192704 25052 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.859828 25052 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.862597 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2454) took 2703 ms. Trace:
I20260709 13:19:58.863934 25114 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.863111 19506 rpcz_store.cc:276] 0709 13:19:56.159401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.161666 (+  2265us) service_pool.cc:224] Handling call
0709 13:19:56.173701 (+ 12035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:56.261145 (+ 87444us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:56.261183 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:56.261745 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:19:56.470618 (+208873us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:56.470674 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.470771 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:57.711425 (+1240654us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:58.862189 (+1150764us) raft_consensus.cc:1685] finished
0709 13:19:58.862217 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.862504 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":171244,"raft.queue_time_us":87381,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":6913920,"thread_start_us":208416,"threads_started":1,"wal-append.queue_time_us":381623}
I20260709 13:19:58.156915 25056 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.865758 25056 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:58.174036 25058 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.932s	user 0.005s	sys 0.000s
W20260709 13:19:58.290762 25060 log.cc:927] Time spent T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.811s	user 0.005s	sys 0.000s
W20260709 13:19:58.331367 25062 log.cc:927] Time spent T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Append to log took a long time: real 0.852s	user 0.000s	sys 0.008s
W20260709 13:19:58.187464 25068 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.756s	user 0.007s	sys 0.014s
I20260709 13:19:58.343492 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:58.875375 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:58.876497 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:58.876950 25052 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.877537 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:58.878556 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:58.879652 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:58.378024 25031 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:58.382054 25085 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:58.410434 25087 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:58.880483 25031 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.880699 25085 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.880985 25087 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.882586 25031 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.882766 25085 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:58.883170 25031 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.434171 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3469) took 1369 ms. Trace:
W20260709 13:19:58.457369 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 951014us
I20260709 13:19:58.884697 19625 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:58.883790 19507 rpcz_store.cc:276] 0709 13:19:57.064434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.064684 (+   250us) service_pool.cc:224] Handling call
0709 13:19:57.097108 (+ 32424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:57.097535 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:57.097574 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:57.107409 (+  9835us) log.cc:844] Serialized 26 byte log entry
0709 13:19:57.418190 (+310781us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:57.462936 (+ 44746us) log.cc:844] Serialized 14 byte log entry
0709 13:19:57.465553 (+  2617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.465678 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:58.134898 (+669220us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b1800024100. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d522 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:19:58.400480 (+265582us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b1800024100. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:19:58.433878 (+ 33398us) raft_consensus.cc:1685] finished
0709 13:19:58.433901 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.434089 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2184,"prepare.queue_time_us":17453,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":366,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":18779,"spinlock_wait_cycles":14758656,"thread_start_us":225852,"threads_started":1,"wal-append.queue_time_us":316364}
I20260709 13:19:58.464395 25089 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.465699 25086 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:58.885881 19625 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:58.886137 25086 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.887531 19625 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:58.888307 25086 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.888793 25006 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:58.888949 25086 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:19:58.466876 19660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2490) took 2342 ms (client timeout 1730 ms). Trace:
I20260709 13:19:58.470361 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:58.485947 25082 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:58.889916 25004 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:58.889770 19660 rpcz_store.cc:269] 0709 13:19:56.121491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.125849 (+  4358us) service_pool.cc:224] Handling call
0709 13:19:58.454787 (+2328938us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400020654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:58.463380 (+  8593us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2538855808}
I20260709 13:19:58.890115 25082 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.890746 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:58.891284 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:58.891929 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:58.892385 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:58.892515 19652 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:19:58.495414 24552 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:58.502049 25081 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:58.893561 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:58.502682 25054 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 1.131s	user 0.009s	sys 0.001s
I20260709 13:19:58.499845 25001 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:58.894519 19652 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 19: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:58.517652 25092 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:58.529870 25091 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:58.894745 25001 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.895048 25092 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.896934 25001 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:58.513747 25090 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:58.897318 25092 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.536039 24217 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.542783 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:58.897722 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:58.546197 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:58.898067 24217 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.894012 25081 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.899230 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:58.899847 19579 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:58.900249 24217 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.551056 25094 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:58.900848 25081 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.555809 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:58.580492 25096 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:58.901051 25094 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:58.902292 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:58.901968 25096 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:58.903388 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:58.577968 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3458) took 1670 ms. Trace:
I20260709 13:19:58.903911 25094 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:58.585393 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:58.553896 24537 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:58.590617 24989 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:58.904878 19661 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:58.587538 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:58.905156 24989 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:58.590034 19578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 3150) took 1756 ms (client timeout 1885 ms). Trace:
W20260709 13:19:58.906013 19578 rpcz_store.cc:269] 0709 13:19:56.833718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.836862 (+  3144us) service_pool.cc:224] Handling call
0709 13:19:58.589587 (+1752725us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b540011dfd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:58.589942 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":500584320}
I20260709 13:19:58.610131 25100 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:58.907178 24989 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.590991 25093 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:58.907490 25100 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.907917 25093 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.612408 25101 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:58.909996 25093 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.909885 25101 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.895999 25031 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:58.659693 19580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 2823) took 1844 ms (client timeout 2022 ms). Trace:
I20260709 13:19:58.912127 25101 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.614157 24811 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:19:58.912230 19580 rpcz_store.cc:269] 0709 13:19:56.814997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.815118 (+   121us) service_pool.cc:224] Handling call
0709 13:19:58.659457 (+1844339us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b540011e9d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:58.659605 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465356032}
I20260709 13:19:58.646081 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2845) took 1815 ms. Trace:
W20260709 13:19:58.656024 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 92955.5us
I20260709 13:19:58.913136 19585 rpcz_store.cc:276] 0709 13:19:56.830187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.909799 (+ 79612us) service_pool.cc:224] Handling call
0709 13:19:56.910135 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:56.926739 (+ 16604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:56.926784 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:56.948568 (+ 21784us) log.cc:844] Serialized 26 byte log entry
0709 13:19:57.096618 (+148050us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:57.096660 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.103546 (+  6886us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:58.644064 (+1540518us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:58.645779 (+  1715us) raft_consensus.cc:1685] finished
0709 13:19:58.645802 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.646019 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12173,"raft.queue_time_us":56716,"raft.run_cpu_time_us":466,"raft.run_wall_time_us":17085,"spinlock_wait_cycles":301347584,"thread_start_us":134814,"threads_started":1,"wal-append.queue_time_us":375300}
I20260709 13:19:58.915361 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:58.649112 24676 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.904232 25096 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:58.919615 24676 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.920449 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:58.921110 25031 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.682696 25105 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:58.684752 25102 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:58.652087 24491 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.921962 25102 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.912957 24811 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.923887 24491 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.788764 24758 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.924566 25102 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:58.925403 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 52468.7us
I20260709 13:19:58.926141 24811 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:58.926273 24758 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.789829 19657 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:58.897768 25090 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:58.927554 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:58.928642 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:58.928761 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:58.928912 25090 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:57.715291 24826 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.904075 19509 rpcz_store.cc:276] 0709 13:19:56.908017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.908973 (+   956us) service_pool.cc:224] Handling call
0709 13:19:56.926601 (+ 17628us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:56.972889 (+ 46288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:56.972916 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:57.732672 (+759756us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b2c00000c88. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:19:57.733009 (+   337us) log.cc:844] Serialized 26 byte log entry
0709 13:19:57.734619 (+  1610us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:57.734674 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.577422 (+842748us) spinlock_profiling.cc:243] Waited 45.9 ms on lock 0x7b54000753d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:58.577507 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:58.577588 (+    81us) raft_consensus.cc:1685] finished
0709 13:19:58.577610 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.577871 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":9695,"spinlock_wait_cycles":113904256,"thread_start_us":1227,"threads_started":1,"wal-append.queue_time_us":924,"wal-append.run_cpu_time_us":16868,"wal-append.run_wall_time_us":1044871}
I20260709 13:19:58.294646 24873 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.791955 24865 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.932349 24873 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.800462 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:58.802779 24919 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.934490 24865 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.935042 24919 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.830299 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 2879) took 2582 ms. Trace:
I20260709 13:19:58.936610 24873 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:58.935704 19656 rpcz_store.cc:276] 0709 13:19:56.247929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.252965 (+  5036us) service_pool.cc:224] Handling call
0709 13:19:56.253486 (+   521us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:56.387726 (+134240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:56.387766 (+    40us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:56.392532 (+  4766us) log.cc:844] Serialized 78 byte log entry
0709 13:19:56.600933 (+208401us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:56.600972 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.601047 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:58.142793 (+1541746us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:58.817929 (+675136us) raft_consensus.cc:1685] finished
0709 13:19:58.817958 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.830112 (+ 12154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98786,"raft.queue_time_us":102350,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":14899,"spinlock_wait_cycles":9450240,"thread_start_us":132281,"threads_started":1,"wal-append.queue_time_us":751684}
I20260709 13:19:58.937467 19657 raft_consensus.cc:2410] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:19:58.937951 19508 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 18: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:58.801203 24815 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.810124 25108 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:58.938776 25108 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.940070 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 3470) took 1866 ms. Trace:
I20260709 13:19:58.940425 19508 rpcz_store.cc:276] 0709 13:19:57.073737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.075081 (+  1344us) service_pool.cc:224] Handling call
0709 13:19:58.939891 (+1864810us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54000fc654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:58.940000 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4107894016}
I20260709 13:19:58.941453 25108 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.817359 25032 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.943598 25032 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:58.943789 19657 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:58.837904 25110 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:58.822247 25025 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.846836 25037 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:58.847091 24956 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:58.852289 25111 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:58.944671 25110 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.856555 25112 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.945222 24956 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:58.945914 25112 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:58.946842 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:19:58.329358 19654 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.005s	sys 0.014s
W20260709 13:19:58.947669 19654 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.457s	user 0.006s	sys 0.015s
I20260709 13:19:58.947909 24956 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.857023 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3460) took 1898 ms. Trace:
I20260709 13:19:58.948408 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 2502) took 1589 ms. Trace:
I20260709 13:19:58.858572 24987 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.948890 19587 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:58.949218 20665 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:19:58.949883 19659 raft_consensus.cc:2393] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:58.951083 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2503) took 1586 ms. Trace:
I20260709 13:19:58.948482 19503 rpcz_store.cc:276] 0709 13:19:56.959180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.960020 (+   840us) service_pool.cc:224] Handling call
0709 13:19:58.248653 (+1288633us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:19:58.248923 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:58.643433 (+394510us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:58.685514 (+ 42081us) log.cc:844] Serialized 14 byte log entry
0709 13:19:58.839177 (+153663us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:58.839239 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:58.839289 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.856790 (+ 17501us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54002aa8d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:58.856835 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.856969 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":42057,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":88,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":740,"spinlock_wait_cycles":910496896,"thread_start_us":194873,"threads_started":2,"wal-append.queue_time_us":154955}
I20260709 13:19:58.951472 19659 rpcz_store.cc:276] 0709 13:19:57.364977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.365972 (+   995us) service_pool.cc:224] Handling call
0709 13:19:58.950868 (+1584896us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54000ada54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:58.951012 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3544731008}
I20260709 13:19:58.948752 25025 consensus_queue.cc:1059] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:19:58.945276 25111 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.954066 19655 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:19:58.954289 24865 raft_consensus.cc:3055] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:58.954854 24865 raft_consensus.cc:740] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:58.955864 25111 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.955672 24865 consensus_queue.cc:260] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.956933 24865 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:58.958767 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:58.880681 25056 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.883412 25087 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:58.430585 24619 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.961309 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:58.961971 24619 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.889467 25006 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:58.892607 25082 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.489094 24803 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:58.885891 25089 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.976410 25089 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:58.976774 25101 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:58.977298 19658 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:58.895128 25091 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.530815 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 2505) took 1165 ms. Trace:
I20260709 13:19:58.978389 19551 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:58.979548 25117 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:58.978340 19653 rpcz_store.cc:276] 0709 13:19:57.365670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.365822 (+   152us) service_pool.cc:224] Handling call
0709 13:19:57.366198 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:58.281674 (+915476us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:58.340490 (+ 58816us) log.cc:844] Serialized 14 byte log entry
0709 13:19:58.467792 (+127302us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:58.467852 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:58.467910 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.530391 (+ 62481us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b54002184d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:58.530481 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.530731 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17069,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":69143,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":2104856832,"thread_start_us":184633,"threads_started":2,"wal-append.queue_time_us":128450}
I20260709 13:19:58.980845 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:58.537299 25005 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:58.981954 25005 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:58.983099 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:58.983996 25005 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:58.900396 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:58.984921 19652 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:58.900784 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:58.541607 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:58.898536 19584 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:19:58.614308 25097 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:58.986508 25097 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.988636 25097 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.907223 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:58.977582 25101 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:58.989333 19578 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:58.913519 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:58.653183 24677 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.671591 24495 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.921885 25105 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.893435 24552 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:58.930919 25093 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:58.931489 24826 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.792600 19505 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 17: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:58.931591 25031 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:58.793581 25103 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:58.946997 25110 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.948010 25112 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:58.948822 19654 rpcz_store.cc:276] 0709 13:19:57.359206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.365861 (+  6655us) service_pool.cc:224] Handling call
0709 13:19:57.371470 (+  5609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:57.371733 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:57.482619 (+110886us) log.cc:844] Serialized 14 byte log entry
0709 13:19:58.948089 (+1465470us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:58.948143 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:58.948189 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.948254 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.948354 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35776,"prepare.queue_time_us":161165,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":78,"raft.queue_time_us":1250,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":1507927,"threads_started":2,"wal-append.queue_time_us":247254,"wal-append.run_cpu_time_us":16409,"wal-append.run_wall_time_us":1048771}
I20260709 13:19:58.967757 24619 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.958616 19659 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:58.970670 19478 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:58.963732 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:58.971972 25100 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.972795 19583 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 19: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:58.964815 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:58.979787 25091 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.670404 24730 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:58.993134 19658 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:19:58.996793 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:58.999748 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:59.001663 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:59.003408 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.004859 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.006203 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.007369 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:59.008600 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:59.011377 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:58.893448 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:59.012609 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 125159us
I20260709 13:19:59.017587 19584 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:19:59.017920 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:59.046381 25025 raft_consensus.cc:2764] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:19:59.046494 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.046989 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.019723 25082 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:59.021023 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.050132 19504 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:19:59.050010 25082 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:59.051056 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.052064 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.020772 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.052749 19510 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 14.
I20260709 13:19:59.053588 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.054217 19510 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:19:59.053185 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.054983 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.025774 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 3466) took 2019 ms. Trace:
I20260709 13:19:59.055647 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:59.055912 19505 rpcz_store.cc:276] 0709 13:19:57.006368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.006513 (+   145us) service_pool.cc:224] Handling call
0709 13:19:59.025542 (+2019029us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b5400402754. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:19:59.025701 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4023126400}
I20260709 13:19:59.056644 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.056929 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.057197 19504 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:19:59.058041 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.058749 19505 raft_consensus.cc:2393] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 15: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:59.026484 25103 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:59.060915 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.061259 25103 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:58.990018 25101 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:59.027370 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:59.065346 19654 raft_consensus.cc:2410] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:19:59.058555 19625 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:59.028638 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:59.066397 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:59.067032 25006 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:59.067551 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:59.029489 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 58899us
I20260709 13:19:59.068297 19505 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:59.030356 19509 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:59.068917 19478 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:59.069571 19509 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:58.864425 25114 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:59.070854 24826 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:59.070951 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:59.071363 24826 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:59.071796 24826 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:59.072065 25114 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:59.072347 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:59.028576 24552 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:59.034493 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:59.073846 19585 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:19:59.074652 24815 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:59.075021 24815 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:59.075418 24815 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:59.075362 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.076371 19654 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:59.076593 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:59.077242 19585 raft_consensus.cc:2376] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18. Re-sending same reply.
I20260709 13:19:59.077363 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:59.035871 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:59.078215 19658 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:59.038089 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:59.030606 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:59.082369 19652 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:19:59.083258 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:59.083668 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:59.083920 19652 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 20: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:59.041075 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.085285 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:59.085372 19581 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:59.086141 19585 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 18: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:59.086442 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.086984 19581 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 7.
I20260709 13:19:59.087872 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.088488 19581 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:59.089145 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:59.041414 19551 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.131:33295 timed out after 1.730s (SENT) [suppressed 3 similar messages]
I20260709 13:19:59.041565 19579 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 20: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:19:59.066740 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:59.093562 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.094242 19579 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:59.095148 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:19:59.095463 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 54098us
I20260709 13:19:59.041970 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.068377 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:59.096856 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:59.097232 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:59.042724 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.098268 19582 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:59.098320 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:59.098815 25091 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:59.099208 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.099871 19582 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:19:59.099473 25091 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:59.100713 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.101287 19582 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:59.110040 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:59.110391 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:59.110785 19585 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 17: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:59.110945 19582 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.111559 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.112396 19585 raft_consensus.cc:2410] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:19:59.084754 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:59.043989 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:59.017920 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:59.101835 25093 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:59.119468 19655 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:19:59.047616 19507 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:19:59.020711 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.121025 19652 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:19:59.052071 25082 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:19:59.103474 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.103897 25091 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:59.018904 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:59.079430 19478 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:59.105533 25005 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:59.123994 19580 raft_consensus.cc:2410] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:19:59.124804 19660 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
W20260709 13:19:59.125053 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45719.7us
I20260709 13:19:59.125495 19658 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:19:59.024926 19661 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:19:59.026695 19587 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:19:59.131887 19587 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:59.123399 19625 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:59.133749 25082 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:59.106184 24826 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:59.029137 24619 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:59.029709 25105 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:59.075034 25056 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:59.040781 25031 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:59.039146 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:59.135970 19511 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:59.136035 19503 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:59.136883 19510 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:19:59.020434 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.137686 19512 raft_consensus.cc:2368] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13.
I20260709 13:19:59.040165 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.078105 19654 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:59.031179 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.139544 19583 raft_consensus.cc:2410] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:19:59.140841 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:59.035833 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:59.140856 19578 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:59.142102 19653 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:19:59.021798 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:59.037222 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:59.084759 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:59.101438 25103 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:59.120364 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:59.103082 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:59.147615 19655 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 7.
I20260709 13:19:59.099436 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:58.872155 25115 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.148707 19659 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
W20260709 13:19:59.041137 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 118045us
I20260709 13:19:59.151511 19478 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:19:59.143558 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 121825us
I20260709 13:19:59.144304 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.144330 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:19:59.148089 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 45133.9us
I20260709 13:19:59.153401 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.147006 19657 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:59.161520 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:59.162154 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:59.163021 19657 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:19:59.163215 19551 leader_election.cc:400] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18.
I20260709 13:19:59.155557 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:59.164713 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.165833 19506 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:59.166613 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.167564 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.168548 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:59.180371 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:19:59.180656 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:59.181140 19661 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.181294 19657 raft_consensus.cc:2410] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:19:59.182619 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:59.183828 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.184437 19512 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:19:59.185295 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.159420 19478 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:59.047119 19584 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:19:59.163702 19551 leader_election.cc:403] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:59.191238 19584 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:59.165274 19511 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:19:59.192610 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.193645 19511 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:59.191485 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:59.194134 19584 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:59.200322 19582 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:59.158150 19587 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:59.220892 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:19:59.222622 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:19:59.224819 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 56820.1us
I20260709 13:19:59.225068 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:59.226802 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 56958.9us
I20260709 13:19:59.227698 19503 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:19:59.228080 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:59.228461 19511 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:59.228883 19503 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:59.229179 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:19:59.222828 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:19:59.230206 19506 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:19:59.230542 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:59.229909 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.231551 19587 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:19:59.232754 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.235379 19652 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:19:59.038537 24677 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:59.239867 19655 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:19:59.240137 19654 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:19:59.236817 19627 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:59.242172 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:59.228747 19508 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:59.238945 19625 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:59.243818 19659 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:59.246224 19661 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:19:59.246407 19655 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:59.246922 19653 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:59.156899 25105 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:59.265231 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:59.251160 19625 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:59.251600 19657 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:59.233341 19587 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:19:59.250072 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:59.268618 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:19:59.268883 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 109688us
I20260709 13:19:59.269081 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:59.179409 25091 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:59.273478 24217 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:59.269927 19625 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:59.135521 25031 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:59.266309 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:59.269738 19478 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:59.228307 25093 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18.
I20260709 13:19:59.234249 25082 raft_consensus.cc:2764] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:19:59.271528 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:59.307009 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.283524 19476 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
W20260709 13:19:59.302490 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 59677.2us
W20260709 13:19:59.303113 19458 auto_rebalancer.cc:629] Failed to schedule move for tablet b91cdbdc59c54db98e6692ac65df1b3b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:19:59.307701 19582 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:59.235674 24956 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:59.248215 25112 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:59.238081 25025 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:59.249704 25005 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:59.307668 19625 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:59.167095 25056 consensus_queue.cc:1059] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 13:19:59.315145 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:59.264670 25032 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:59.263049 25111 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:59.272398 24730 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:19:59.331060 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 64824.6us
I20260709 13:19:59.332131 19627 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:59.226002 24495 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:19:59.271982 24811 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:59.271721 24758 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:59.326568 19579 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:59.281930 25096 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:59.322275 24983 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:59.334432 24912 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:59.313598 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:59.296469 25117 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.186359 25103 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:59.314116 25112 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.263448 24989 consensus_queue.cc:1059] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:19:59.323053 24552 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:59.324038 25105 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:59.240460 24815 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:59.295974 25108 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:59.591003 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:19:59.591097 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 276046us
I20260709 13:19:59.676815 19478 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:59.333587 19627 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:19:59.629077 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 321481us
I20260709 13:19:59.678560 19625 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:19:59.629122 24217 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:19:59.630133 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 346665us
I20260709 13:19:59.308915 25047 consensus_queue.cc:1059] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.275s
I20260709 13:19:59.598539 19508 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:19:59.634008 24912 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:59.494236 24811 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
W20260709 13:19:59.653270 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 339748us
I20260709 13:19:59.689817 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:59.689823 24217 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:19:59.657748 19579 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:19:59.322446 24956 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:19:59.691825 24217 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:59.663709 25110 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.628093 24537 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:59.179736 25115 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:19:59.681505 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 348003us
I20260709 13:19:59.669235 25101 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:19:59.683450 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:19:59.654654 25112 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.687815 19476 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:59.595006 24758 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:59.655175 24873 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:19:59.713464 25122 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:19:59.740101 19585 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:59.740305 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.752326 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:19:59.753185 19579 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:19:59.744941 19586 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:19:59.709820 24676 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:59.694451 24811 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:59.694689 24919 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:59.710875 24956 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:19:59.711733 19682 debug-util.cc:398] Leaking SignalData structure 0x7b08002ca960 after lost signal to thread 18417
W20260709 13:19:59.776484 19682 debug-util.cc:398] Leaking SignalData structure 0x7b08002c2000 after lost signal to thread 19444
W20260709 13:19:59.777822 19682 debug-util.cc:398] Leaking SignalData structure 0x7b08002fefc0 after lost signal to thread 19536
W20260709 13:19:59.778828 19682 debug-util.cc:398] Leaking SignalData structure 0x7b08002ca920 after lost signal to thread 19611
W20260709 13:19:59.779769 19682 debug-util.cc:398] Leaking SignalData structure 0x7b0800395380 after lost signal to thread 19685
I20260709 13:19:59.729602 25006 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:59.712440 25103 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:19:59.712670 25124 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:19:59.663316 25097 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:59.714120 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3169) took 1162 ms. Trace:
I20260709 13:19:59.664422 25114 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:19:59.670900 25105 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:19:59.717489 19627 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:19:59.652887 25037 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:59.675566 24989 raft_consensus.cc:3055] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:19:59.728655 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45299.3us
I20260709 13:19:59.690613 24912 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.719906 24537 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.694391 25085 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:59.643154 25117 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:59.586499 24589 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:59.915208 25105 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.747498 25032 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:19:59.721521 25110 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:59.744442 24815 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:59.734565 19476 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
W20260709 13:20:00.011650 19578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.022s	sys 0.080s
I20260709 13:19:59.929477 25031 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:59.695953 24826 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:19:59.780984 19682 debug-util.cc:398] Leaking SignalData structure 0x7b08002e6f00 after lost signal to thread 20690
W20260709 13:20:00.016381 19682 debug-util.cc:398] Leaking SignalData structure 0x7b080038bf80 after lost signal to thread 20691
I20260709 13:19:59.932111 25137 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:59.913355 25114 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:59.734766 24987 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:00.022441 24987 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:00.022918 24987 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:00.023823 25114 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:59.754573 24758 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:59.787971 19581 rpcz_store.cc:276] 0709 13:19:58.551664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.120606 (+568942us) service_pool.cc:224] Handling call
0709 13:19:59.120995 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.121180 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:59.229176 (+107996us) log.cc:844] Serialized 14 byte log entry
0709 13:19:59.713693 (+484517us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:59.713760 (+    67us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:59.713820 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.713894 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.714048 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44461,"prepare.queue_time_us":160459,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":106784,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":3725,"thread_start_us":544082,"threads_started":2}
W20260709 13:19:59.918056 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 200686us
I20260709 13:19:59.920790 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:19:59.780218 24730 raft_consensus.cc:697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:19:59.924154 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3170) took 1372 ms. Trace:
I20260709 13:20:00.026531 19580 rpcz_store.cc:276] 0709 13:19:58.551956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.126391 (+574435us) service_pool.cc:224] Handling call
0709 13:19:59.126686 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.126877 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:59.250790 (+123913us) log.cc:844] Serialized 14 byte log entry
0709 13:19:59.798698 (+547908us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b1800306ca0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c313024bc 00007f6c2e65048b 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa23a
0709 13:19:59.923732 (+125034us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:59.923789 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:59.923835 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.923902 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.924077 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":164057,"prepare.queue_time_us":184695,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":125770,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":21312,"spinlock_wait_cycles":15303168,"thread_start_us":433835,"threads_started":2,"wal-append.queue_time_us":510874}
I20260709 13:19:59.783478 24676 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:19:59.784080 25006 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:19:59.731237 25101 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:19:59.927147 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 229883us
I20260709 13:19:59.787837 25097 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.772842 24873 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:59.746112 25115 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:59.916285 25037 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.040802 25037 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:00.041036 24873 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:19:59.918737 24989 raft_consensus.cc:740] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:19:59.933512 25134 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:19:59.932444 24537 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:00.045949 24989 consensus_queue.cc:260] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.047088 25101 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:00.047211 24989 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:00.038018 25097 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:59.965466 25122 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:19:59.932034 25085 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:00.050834 25085 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:00.053910 24537 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:00.054787 25121 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:20:00.056077 20665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59430 (request call id 181) took 1084 ms. Trace:
I20260709 13:20:00.056309 24537 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:00.030028 25006 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:59.681757 25108 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:00.025440 20666 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:00.058248 25108 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:00.016176 25081 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:00.039839 24676 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.039750 24730 consensus_queue.cc:237] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:19:59.971729 24983 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.063046 24983 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.063711 25110 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:00.066397 24983 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:00.072109 25132 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.310s	user 0.004s	sys 0.003s
I20260709 13:20:00.074992 25085 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:00.078892 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 163056us
I20260709 13:20:00.021437 24804 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:00.019178 25137 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:00.077011 25037 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.080818 25081 raft_consensus.cc:697] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:00.084380 25137 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:00.092258 25138 log.cc:927] Time spent T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:20:00.097848 25112 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.100168 25112 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:00.101485 25105 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.102001 25117 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:00.101575 25137 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.104048 25137 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:00.104152 25105 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:19:59.962220 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:00.012089 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 277599us
I20260709 13:20:00.142021 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:19:59.919461 19478 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:00.007948 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 318116us
W20260709 13:19:59.950253 19503 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.019s	sys 0.085s
W20260709 13:20:00.147800 19503 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.020s	sys 0.085s
I20260709 13:20:00.148223 19551 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:20:00.150071 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2482) took 1116 ms. Trace:
I20260709 13:20:00.152390 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:00.150722 19504 rpcz_store.cc:276] 0709 13:19:59.033867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.062587 (+ 28720us) service_pool.cc:224] Handling call
0709 13:19:59.062866 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.063212 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.063240 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.063674 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:19:59.236918 (+173244us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:59.252437 (+ 15519us) log.cc:844] Serialized 14 byte log entry
0709 13:19:59.287294 (+ 34857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.287450 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.149256 (+861806us) raft_consensus.cc:1685] finished
0709 13:20:00.149325 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.149766 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29976,"prepare.queue_time_us":15489,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":32808,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":157,"thread_start_us":172866,"threads_started":1,"wal-append.queue_time_us":234400}
I20260709 13:20:00.153926 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:00.154443 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3475) took 1009 ms. Trace:
I20260709 13:20:00.156342 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:00.154912 19507 rpcz_store.cc:276] 0709 13:19:59.144706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.144881 (+   175us) service_pool.cc:224] Handling call
0709 13:19:59.219680 (+ 74799us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.272755 (+ 53075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.272788 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.273285 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:19:59.766556 (+493271us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:59.791739 (+ 25183us) log.cc:844] Serialized 14 byte log entry
0709 13:19:59.792117 (+   378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.792235 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.153848 (+361613us) raft_consensus.cc:1685] finished
0709 13:20:00.153892 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.154241 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60422,"prepare.queue_time_us":77363,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":54283,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":70417,"thread_start_us":427066,"threads_started":1,"wal-append.queue_time_us":731091}
W20260709 13:20:00.012131 19578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.022s	sys 0.080s
I20260709 13:20:00.162931 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.165031 19507 raft_consensus.cc:2393] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 14: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:00.165174 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2868) took 1500 ms. Trace:
I20260709 13:20:00.166007 19578 rpcz_store.cc:276] 0709 13:19:58.665036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.220457 (+555421us) service_pool.cc:224] Handling call
0709 13:19:59.263367 (+ 42910us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.263763 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.263795 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.264267 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.164217 (+899950us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:00.164346 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.164563 (+   217us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.164648 (+    85us) raft_consensus.cc:1685] finished
0709 13:20:00.164666 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.164904 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1852,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":11728,"thread_start_us":840985,"threads_started":1,"wal-append.queue_time_us":745768}
I20260709 13:20:00.168959 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:19:59.769302 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:00.170506 19579 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:00.172438 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:00.175145 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2870) took 1509 ms. Trace:
I20260709 13:20:00.175627 19579 rpcz_store.cc:276] 0709 13:19:58.665569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.173581 (+1508012us) service_pool.cc:224] Handling call
0709 13:20:00.174381 (+   800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.174749 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.174773 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.174828 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:00.174856 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.174909 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.175053 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.177898 19579 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:00.178864 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2871) took 1491 ms. Trace:
I20260709 13:20:00.179344 19579 rpcz_store.cc:276] 0709 13:19:58.687232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.176758 (+1489526us) service_pool.cc:224] Handling call
0709 13:20:00.177251 (+   493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.178430 (+  1179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.178775 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.030987 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:00.025391 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:00.180716 19582 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
W20260709 13:20:00.182922 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 143887us
I20260709 13:20:00.020872 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 2924) took 1683 ms. Trace:
I20260709 13:20:00.188853 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2873) took 1401 ms. Trace:
I20260709 13:20:00.189471 19581 rpcz_store.cc:276] 0709 13:19:58.787666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.187224 (+1399558us) service_pool.cc:224] Handling call
0709 13:20:00.187809 (+   585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.188281 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.188304 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.188375 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:00.188426 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.188487 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.188639 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.190150 19580 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
W20260709 13:20:00.185206 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 159958us
I20260709 13:20:00.193077 19627 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:00.193159 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:00.193960 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2874) took 1406 ms. Trace:
I20260709 13:20:00.194516 19580 rpcz_store.cc:276] 0709 13:19:58.788060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.192539 (+1404479us) service_pool.cc:224] Handling call
0709 13:20:00.193192 (+   653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.193558 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.193584 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.193666 (+    82us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:00.193701 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.193754 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.193879 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.196504 19627 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:00.197041 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2875) took 1408 ms. Trace:
I20260709 13:20:00.188342 19656 rpcz_store.cc:276] 0709 13:19:58.337910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.245305 (+907395us) service_pool.cc:224] Handling call
0709 13:19:59.245582 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.245780 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:59.727995 (+482215us) log.cc:844] Serialized 14 byte log entry
0709 13:20:00.020500 (+292505us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.020552 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:00.020597 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.020682 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.020798 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97856,"prepare.queue_time_us":390064,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":2802,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":3284,"thread_start_us":695797,"threads_started":2,"wal-append.queue_time_us":315703}
I20260709 13:20:00.200592 24873 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:00.204535 24873 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:00.056463 20665 rpcz_store.cc:276] 0709 13:19:58.971673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.971808 (+   135us) service_pool.cc:224] Handling call
0709 13:19:58.972223 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:58.972683 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.972727 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:58.973318 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:19:59.316890 (+343572us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:59.316931 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.317007 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.055820 (+738813us) raft_consensus.cc:1685] finished
0709 13:20:00.055843 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.055974 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":79,"thread_start_us":343198,"threads_started":1,"wal-append.queue_time_us":684738}
I20260709 13:20:00.207989 24873 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:00.208776 24873 raft_consensus.cc:697] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:00.210347 24537 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:00.211329 24537 raft_consensus.cc:697] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:00.212457 19627 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:00.208659 24495 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:00.214668 19580 rpcz_store.cc:276] 0709 13:19:58.788358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.195745 (+1407387us) service_pool.cc:224] Handling call
0709 13:20:00.196246 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.196706 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.196738 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.196802 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:00.196830 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.196882 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.196989 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.225337 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2872) took 1428 ms. Trace:
I20260709 13:20:00.226338 19579 rpcz_store.cc:276] 0709 13:19:58.787194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.185512 (+1398318us) service_pool.cc:224] Handling call
0709 13:20:00.186350 (+   838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.186810 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.186847 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.186918 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:00.186962 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.215011 (+ 28049us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.215194 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.229231 19579 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:20:00.211233 24873 consensus_queue.cc:237] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.231360 19579 pending_rounds.cc:85] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 9
W20260709 13:20:00.224607 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 79809.3us
I20260709 13:20:00.242784 24919 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:00.244025 24919 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:00.246100 25105 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:00.246738 25105 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:00.247308 25105 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:00.248518 25037 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:00.250092 25112 raft_consensus.cc:2764] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:20:00.251988 25032 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:00.252643 25032 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:00.253180 25032 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:00.236003 24217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.004s	sys 0.008s
W20260709 13:20:00.256626 24217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.004s	sys 0.008s
I20260709 13:20:00.257418 25004 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.258265 25004 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.259734 25085 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:00.260730 25004 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:00.246109 24989 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:00.250172 25001 raft_consensus.cc:3055] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:00.262557 25001 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:00.101444 25108 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.263821 25001 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.265168 25108 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:00.265938 24826 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:00.090374 25097 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.270577 24758 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.278286 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.279296 25110 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:00.237524 19579 pending_rounds.cc:107] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:20:00.279341 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2864) took 1615 ms. Trace:
I20260709 13:20:00.278402 25001 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:00.280467 19579 raft_consensus.cc:2889] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:00.299062 24537 consensus_queue.cc:237] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.306834 25097 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:00.311064 25137 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:00.312186 25137 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.312832 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3171) took 1308 ms. Trace:
I20260709 13:20:00.313382 19579 rpcz_store.cc:276] 0709 13:19:59.004385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.227742 (+1223357us) service_pool.cc:224] Handling call
0709 13:20:00.228459 (+   717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.312434 (+ 83975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.312729 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.315019 25101 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:00.315517 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3186) took 1037 ms. Trace:
I20260709 13:20:00.315841 24983 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:00.316373 24983 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:00.316956 24983 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.319151 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:00.320245 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:00.321545 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:00.321924 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.315539 25101 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:00.323860 25101 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:00.322052 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:00.323784 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.327265 19505 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 23: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:00.327692 25081 consensus_queue.cc:237] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.328586 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.334338 19581 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:00.335158 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2876) took 1546 ms. Trace:
I20260709 13:20:00.335564 19581 rpcz_store.cc:276] 0709 13:19:58.788648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.234663 (+1446015us) service_pool.cc:224] Handling call
0709 13:20:00.334020 (+ 99357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.334846 (+   826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.335085 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.336148 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:00.339592 25137 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:00.213557 24907 consensus_queue.cc:1059] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:20:00.281841 19584 rpcz_store.cc:276] 0709 13:19:58.663880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.195387 (+531507us) service_pool.cc:224] Handling call
0709 13:19:59.195757 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.196017 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:59.306153 (+110136us) log.cc:844] Serialized 14 byte log entry
0709 13:20:00.278284 (+972131us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b1800271600. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c313024bc 00007f6c2e65048b 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa23a
0709 13:20:00.278623 (+   339us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.278702 (+    79us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:00.278815 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.278926 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.279148 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20194,"prepare.queue_time_us":138453,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":88491,"spinlock_wait_cycles":116009216,"thread_start_us":399023,"threads_started":2,"wal-append.queue_time_us":456186}
I20260709 13:20:00.316046 19579 rpcz_store.cc:276] 0709 13:19:59.277884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.314308 (+1036424us) service_pool.cc:224] Handling call
0709 13:20:00.314690 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.315113 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.315142 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.315218 (+    76us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:00.315298 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.315355 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.315468 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.343644 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3189) took 1064 ms. Trace:
I20260709 13:20:00.344138 19584 rpcz_store.cc:276] 0709 13:19:59.278927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.342385 (+1063458us) service_pool.cc:224] Handling call
0709 13:20:00.342879 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.343270 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.343298 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.343365 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:00.343397 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.343455 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.343582 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:00.250438 25111 consensus_meta.cc:287] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.908s	user 0.005s	sys 0.005s
I20260709 13:20:00.346310 25111 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:00.347766 19578 raft_consensus.cc:2410] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:20:00.352928 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3187) took 1059 ms. Trace:
I20260709 13:20:00.353760 19581 rpcz_store.cc:276] 0709 13:19:59.278244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.336391 (+1058147us) service_pool.cc:224] Handling call
0709 13:20:00.336882 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.337291 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.337317 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.337368 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:00.337405 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.337459 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.337565 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:00.367852 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 155590us
W20260709 13:20:00.372881 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.376216 24907 raft_consensus.cc:3055] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:00.376816 24910 raft_consensus.cc:3055] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:00.379853 24804 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:00.380458 24804 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:00.382175 19476 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:00.386471 25096 consensus_meta.cc:287] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.757s	user 0.007s	sys 0.007s
I20260709 13:20:00.387095 25096 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:00.377310 24910 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:00.382893 24907 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:00.404028 19507 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:00.397838 24826 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:00.412716 24619 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:00.413442 19582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 3185) took 1136 ms (client timeout 1512 ms). Trace:
I20260709 13:20:00.417887 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3495) took 1231 ms. Trace:
W20260709 13:20:00.418069 19582 rpcz_store.cc:269] 0709 13:19:59.277363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.340642 (+ 63279us) service_pool.cc:224] Handling call
0709 13:20:00.413196 (+1072554us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b54001fac54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:00.413369 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1158915968}
I20260709 13:20:00.427265 19653 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:20:00.421491 19503 rpcz_store.cc:276] 0709 13:19:59.186956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.238524 (+ 51568us) service_pool.cc:224] Handling call
0709 13:19:59.238816 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.238999 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:00.148564 (+909565us) log.cc:844] Serialized 14 byte log entry
0709 13:20:00.396716 (+248152us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.399193 (+  2477us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:00.406334 (+  7141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.409973 (+  3639us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.417827 (+  7854us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":208398,"prepare.queue_time_us":31832,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":44,"raft.queue_time_us":29020,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"thread_start_us":1106619,"threads_started":2,"wal-append.queue_time_us":258876}
I20260709 13:20:00.429745 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:00.430495 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.432614 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.431706 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2880) took 1639 ms. Trace:
I20260709 13:20:00.434540 19580 rpcz_store.cc:276] 0709 13:19:58.789944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.239298 (+1449354us) service_pool.cc:224] Handling call
0709 13:20:00.392953 (+153655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.419941 (+ 26988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.419979 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.422614 (+  2635us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:00.428707 (+  6093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.428778 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.428880 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.426401 25148 consensus_queue.cc:1059] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:20:00.438616 25148 raft_consensus.cc:3055] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:00.439211 25148 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:00.442972 19508 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
I20260709 13:20:00.443557 19508 pending_rounds.cc:85] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 7
I20260709 13:20:00.443881 19508 pending_rounds.cc:107] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:20:00.444204 19508 raft_consensus.cc:2889] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:00.446208 25085 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:00.447157 25085 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.449018 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:00.450735 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:00.452198 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:00.446300 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:00.422385 24826 raft_consensus.cc:697] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:00.469089 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 504) took 1172 ms. Trace:
I20260709 13:20:00.469535 19581 rpcz_store.cc:276] 0709 13:19:59.296720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.362896 (+1066176us) service_pool.cc:224] Handling call
0709 13:20:00.417149 (+ 54253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.468832 (+ 51683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.468851 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.468883 (+    32us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:00.468902 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.468941 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.469041 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.470796 24758 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:00.480472 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:00.482241 24910 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.483764 24910 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:00.485651 25146 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:00.486456 25146 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:00.487053 25146 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:00.488394 24987 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.491153 24987 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:00.494377 19582 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:20:00.495616 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:00.496362 19504 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:00.497165 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:00.495697 24730 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:00.497704 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.498142 24730 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.498404 24826 consensus_queue.cc:237] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.500952 24730 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:00.502795 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:00.505093 19582 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 15: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:00.508435 25006 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.510053 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:00.511495 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:00.526048 19580 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:00.526759 19652 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:00.527443 19660 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:00.516027 24811 consensus_meta.cc:287] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.732s	user 0.006s	sys 0.013s
I20260709 13:20:00.518932 25085 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:00.522897 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2856) took 1861 ms. Trace:
I20260709 13:20:00.520191 25052 raft_consensus.cc:3055] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:00.521292 19510 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:20:00.514837 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 503) took 1221 ms. Trace:
I20260709 13:20:00.524168 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 3183) took 1298 ms. Trace:
I20260709 13:20:00.539860 19578 rpcz_store.cc:276] 0709 13:19:59.276522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.168288 (+891766us) service_pool.cc:224] Handling call
0709 13:20:00.523968 (+355680us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54003bf954. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:00.524103 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408403712}
W20260709 13:20:00.523576 19586 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 3159) took 1981 ms (client timeout 2461 ms). Trace:
I20260709 13:20:00.529165 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:00.538545 19584 rpcz_store.cc:276] 0709 13:19:59.293571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.345203 (+1051632us) service_pool.cc:224] Handling call
0709 13:20:00.414257 (+ 69054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.419015 (+  4758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.419043 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.421020 (+  1977us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:00.424233 (+  3213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.424314 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.514651 (+ 90337us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b54001fac50. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:00.514777 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136813440}
W20260709 13:20:00.541157 19586 rpcz_store.cc:269] 0709 13:19:58.542363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.542543 (+   180us) service_pool.cc:224] Handling call
0709 13:20:00.523260 (+1980717us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b54003d09d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:00.523418 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1947057408}
I20260709 13:20:00.555876 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:00.530227 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.556968 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.558385 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.558521 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:00.559650 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:00.560192 19653 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:00.560348 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:00.560832 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.563512 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:00.565327 19586 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:20:00.566334 25006 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:00.566905 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:00.567408 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:00.568173 19586 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:00.569057 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:00.570423 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.571717 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.574515 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:00.522122 25133 log.cc:927] Time spent T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.759s	user 0.009s	sys 0.010s
I20260709 13:20:00.575455 19503 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:00.575613 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.576999 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2898) took 1259 ms. Trace:
I20260709 13:20:00.577386 19580 rpcz_store.cc:276] 0709 13:19:59.318116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.454696 (+1136580us) service_pool.cc:224] Handling call
0709 13:20:00.525780 (+ 71084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.542875 (+ 17095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.576801 (+ 33926us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b54003bf950. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:00.576942 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111721728}
I20260709 13:20:00.543035 25052 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:00.581907 19509 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:00.582732 25052 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.583972 25052 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:00.584158 24912 consensus_meta.cc:287] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.634s	user 0.013s	sys 0.003s
I20260709 13:20:00.584806 24912 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:00.441039 25148 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.526443 24907 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.610095 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:00.537353 19585 rpcz_store.cc:276] 0709 13:19:58.661581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.148183 (+486602us) service_pool.cc:224] Handling call
0709 13:19:59.739820 (+591637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.750522 (+ 10702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.522504 (+771982us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b5400106150. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:00.522737 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1359913216}
W20260709 13:20:00.522532 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 603006us
I20260709 13:20:00.589898 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.586887 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:00.593604 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:00.594461 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:00.602947 24619 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:00.605520 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:00.606575 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:00.607343 25091 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.615794 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:00.615896 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:00.616884 19661 raft_consensus.cc:2393] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:00.615943 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:00.616392 25091 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.619854 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:00.608450 19587 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:00.553438 24811 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:00.609021 24758 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:00.609606 25114 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:00.615836 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:00.520247 25101 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:00.621402 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:00.651150 19654 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:00.537178 24983 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:00.655061 19657 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:00.625139 19627 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:00.657863 25001 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:00.628479 24811 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:00.658484 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:00.629539 19659 raft_consensus.cc:1240] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:00.626531 25091 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:00.636960 25105 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.660593 19654 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:00.623889 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:00.614733 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 75997.4us
I20260709 13:20:00.664366 19581 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:00.638834 19511 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:00.638159 19586 raft_consensus.cc:2393] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 12: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:00.649886 19579 raft_consensus.cc:1240] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:00.627538 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.621379 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:00.639175 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:00.649580 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:20:00.681533 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 57759.2us
I20260709 13:20:00.684228 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:00.626286 24907 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:00.625825 24589 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:00.638629 19478 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:00.656486 24983 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:00.688572 19581 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:00.622793 25112 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:00.706110 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.712371 19658 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:00.715216 19503 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:00.626096 24619 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:00.640976 25101 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Requested vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:00.758399 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:00.703691 24758 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:00.710582 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 182891us
I20260709 13:20:00.651150 24912 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:00.629141 24919 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:00.761457 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:00.729550 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57942.8us
I20260709 13:20:00.703900 24491 consensus_queue.cc:1059] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:20:00.762709 19661 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:00.762881 24589 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:00.723930 25112 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:00.771023 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 86899.5us
I20260709 13:20:00.762811 25114 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:00.779196 25148 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:00.777122 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.764065 25082 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:00.684680 25146 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:00.759512 24804 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.804028 24804 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:00.770874 25006 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:00.808305 25006 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.728813 25032 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.790455 24589 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.813974 24803 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:00.814651 24803 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.799130 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:00.817059 24803 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:00.817467 19509 raft_consensus.cc:2393] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 17: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:00.818614 20619 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:00.819092 25110 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:00.819772 25110 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:00.822106 20666 raft_consensus.cc:1813] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Handling vote request from an unknown peer 2cfd02601ea44976833027665abc93bf
I20260709 13:20:00.822714 20666 raft_consensus.cc:2368] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15.
I20260709 13:20:00.800395 25146 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:00.810281 19627 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:00.774276 25112 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:00.811932 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 502) took 1520 ms. Trace:
I20260709 13:20:00.828917 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:00.829675 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 47696.1us
W20260709 13:20:00.790369 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 151924us
I20260709 13:20:00.810794 25006 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:00.835904 19579 rpcz_store.cc:276] 0709 13:19:59.291591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.342921 (+1051330us) service_pool.cc:224] Handling call
0709 13:20:00.343367 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.669219 (+325852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.811592 (+142373us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54003bf454. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:00.811819 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691359616}
I20260709 13:20:00.850425 25095 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:00.851200 25095 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:00.851635 25095 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:00.853824 25089 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:00.854511 25089 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.854780 25098 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:20:00.850584 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 68600.4us
I20260709 13:20:00.859232 25137 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:00.859714 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 71244.6us
I20260709 13:20:00.860666 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:00.861989 25114 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:00.862486 25114 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:00.862928 25114 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:00.863041 25098 raft_consensus.cc:3055] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:00.863699 25098 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:00.871130 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
W20260709 13:20:00.871884 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.822834 25032 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:00.895664 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:00.898628 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.899888 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:00.901189 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:00.902626 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 44987.5us
I20260709 13:20:00.903930 25001 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:00.904374 25001 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:00.905344 25006 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:00.905864 19627 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:00.864910 25098 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.905227 24803 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:20:00.870118 25101 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.910883 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2853) took 2253 ms. Trace:
W20260709 13:20:00.911212 19458 auto_rebalancer.cc:629] Failed to schedule move for tablet 03f9956d44294112accb74ea1a18065b: Illegal state: Replica d56df3728fc04e37b2d29a3bcd91d167 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:00.912209 20659 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:00.883389 25146 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:00.917831 19478 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:00.919852 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2869) took 2254 ms. Trace:
I20260709 13:20:00.921569 24826 raft_consensus.cc:3055] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:00.924455 25131 consensus_queue.cc:1059] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:00.904774 25001 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:00.932016 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 71493.9us
I20260709 13:20:00.913812 25105 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:00.961457 19625 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:00.965488 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57599.6us
I20260709 13:20:00.964385 19587 rpcz_store.cc:276] 0709 13:19:58.665301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.273000 (+607699us) service_pool.cc:224] Handling call
0709 13:19:59.273307 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.626484 (+1353177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.919514 (+293030us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540011e9d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:00.919779 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3068952960}
W20260709 13:20:00.974190 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 68400us
I20260709 13:20:00.961098 19583 rpcz_store.cc:276] 0709 13:19:58.657158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.141165 (+484007us) service_pool.cc:224] Handling call
0709 13:20:00.541915 (+1400750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:00.555709 (+ 13794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.555737 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:00.556278 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.761947 (+205669us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:00.761992 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.762053 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.909872 (+147819us) raft_consensus.cc:1685] finished
0709 13:20:00.909893 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.910510 (+   617us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54003d09d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:00.910708 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2249,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":200,"spinlock_wait_cycles":3198778240,"thread_start_us":168547,"threads_started":1,"wal-append.queue_time_us":300318}
I20260709 13:20:00.978564 19627 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:00.978521 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:00.979374 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 144997us
I20260709 13:20:00.979904 19512 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 15: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:00.967926 24826 raft_consensus.cc:740] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:00.984604 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:00.986991 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:00.987541 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 93181.5us
I20260709 13:20:00.989019 19478 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:00.976564 25032 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:00.989852 25032 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:00.990890 25032 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.992266 25032 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:00.992641 24804 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:00.992758 24619 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.978703 25082 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:00.994416 25082 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:00.994779 19476 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:00.995471 24495 consensus_queue.cc:1059] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:00.996821 24495 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:00.997311 24495 raft_consensus.cc:697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:00.998690 24552 raft_consensus.cc:3055] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:01.001965 19652 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:00.977874 25006 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:01.002790 19659 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:01.008546 25105 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:01.008698 25142 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:01.005141 24552 raft_consensus.cc:740] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:01.009995 24912 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:01.011046 19657 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:01.011703 24495 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.011080 19478 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:01.027112 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 48633.9us
I20260709 13:20:01.025092 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:00.986107 25098 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:00.994825 25082 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.036069 24537 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:01.037338 19478 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.037770 24826 consensus_queue.cc:260] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.038537 25149 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:01.038959 19478 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.039354 24826 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:01.041149 24552 consensus_queue.cc:260] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:00.980726 25101 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.082571 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:00.985165 24589 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:01.068220 19410 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 54) took 10518 ms. Trace:
I20260709 13:20:01.079388 19573 tablet_service.cc:1558] Processing DeleteTablet for tablet d05498e224814b9b8f31e3f965ab2583 with delete_type TABLET_DATA_TOMBSTONED (TS 2cfd02601ea44976833027665abc93bf not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:45038
I20260709 13:20:01.079557 19571 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eb38e2ac9064d3286fe2f20aeb2381c with delete_type TABLET_DATA_TOMBSTONED (TS 2cfd02601ea44976833027665abc93bf not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:45038
W20260709 13:20:01.054396 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:01.095095 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 117346us
I20260709 13:20:01.042583 24552 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:01.099704 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 70447.4us
I20260709 13:20:01.082376 25149 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:01.107452 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 82438us
I20260709 13:20:01.094023 24804 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:01.089349 19410 rpcz_store.cc:276] 0709 13:19:50.550068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.550280 (+   212us) service_pool.cc:224] Handling call
0709 13:20:01.067887 (+10517607us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:56.819521 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:56.946327 (+126806us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:56.946376 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:19:56.946398 (+    22us) tablet.cc:662] Decoding operations
0709 13:19:56.947003 (+   605us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:56.947064 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:56.947099 (+    35us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:19:56.947444 (+   345us) tablet.cc:701] Row locks acquired
0709 13:19:56.947462 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:19:56.947626 (+   164us) write_op.cc:270] Start()
0709 13:19:56.947744 (+   118us) write_op.cc:276] Timestamp: P: 1783603196947576 usec, L: 0
0709 13:19:56.947766 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:19:56.996334 (+ 48568us) log.cc:844] Serialized 1311 byte log entry
0709 13:19:58.330527 (+1334193us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:19:58.969670 (+639143us) op_driver.cc:464] REPLICATION: finished
0709 13:19:59.916375 (+946705us) write_op.cc:301] APPLY: starting
0709 13:19:59.926041 (+  9666us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:00.103995 (+177954us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:00.104023 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:00.106094 (+  2071us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:00.251147 (+145053us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:20:00.251292 (+   145us) write_op.cc:312] APPLY: finished
0709 13:20:00.252025 (+   733us) log.cc:844] Serialized 41 byte log entry
0709 13:20:00.393131 (+141106us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:00.415420 (+ 22289us) write_op.cc:454] Released schema lock
0709 13:20:00.421593 (+  6173us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:00.476888 (+ 55295us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:00.476941 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1674337,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":815964,"apply.run_cpu_time_us":18656,"apply.run_wall_time_us":586420,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16661,"num_ops":3,"prepare.queue_time_us":287371,"prepare.run_cpu_time_us":42513,"prepare.run_wall_time_us":401133,"raft.queue_time_us":95009,"raft.run_cpu_time_us":91990,"raft.run_wall_time_us":373401,"replication_time_us":2021629,"spinlock_wait_cycles":6885120,"thread_start_us":872111,"threads_started":5,"wal-append.queue_time_us":597763,"wal-append.run_cpu_time_us":32027,"wal-append.run_wall_time_us":2537222}]]}
I20260709 13:20:01.096778 25131 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:01.095669 24589 raft_consensus.cc:697] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:01.107836 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
W20260709 13:20:01.123749 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 84893.1us
I20260709 13:20:01.123868 19627 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:01.124840 19660 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:01.129774 19503 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:01.130297 19509 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:01.132023 24912 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:01.139837 19661 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:20:01.140666 19661 raft_consensus.cc:606] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:01.143054 25089 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:01.142757 25114 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.145038 25114 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:01.024396 25162 consensus_queue.cc:1059] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:20:01.149430 24619 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:01.151691 25095 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.158399 19652 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:01.118718 24983 consensus_queue.cc:1059] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:20:01.160013 19553 leader_election.cc:400] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Vote denied by peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615) with higher term. Message: Invalid argument: T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15.
W20260709 13:20:01.160192 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.160386 19553 leader_election.cc:403] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:20:01.161005 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 51922.3us
W20260709 13:20:01.161947 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 54462.9us
I20260709 13:20:01.162448 19478 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.164286 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.165686 19511 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:01.142896 25052 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:01.165666 19478 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:01.171607 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 52650.6us
I20260709 13:20:01.120318 24537 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:20:01.170058 24758 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:20:01.172027 25148 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:01.182452 25089 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:01.133249 24910 consensus_queue.cc:1059] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:20:01.185354 25114 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:20:01.207921 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 43805.4us
I20260709 13:20:01.208664 19627 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:01.184945 24987 consensus_queue.cc:1059] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:20:01.263749 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 133306us
I20260709 13:20:01.223981 25115 consensus_queue.cc:1059] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:20:01.222080 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:01.204908 24907 consensus_meta.cc:287] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.520s	user 0.012s	sys 0.000s
I20260709 13:20:01.180722 25149 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:20:01.235991 24803 raft_consensus.cc:3055] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:01.242213 25089 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:01.254377 24589 consensus_queue.cc:237] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.190531 25105 consensus_queue.cc:1059] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:20:01.226293 25146 raft_consensus.cc:3055] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:20:01.230082 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 64943.6us
W20260709 13:20:01.267666 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.180127 25112 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.269594 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:01.271559 19510 raft_consensus.cc:2393] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:01.185087 25091 consensus_queue.cc:1059] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:20:01.207562 24619 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:01.211658 25095 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:01.275600 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:01.276384 19458 auto_rebalancer.cc:629] Failed to schedule move for tablet 313f9daf7de442378ef2abf1f4a4e665: Illegal state: Replica d56df3728fc04e37b2d29a3bcd91d167 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:01.190912 25110 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.276105 19505 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:01.289219 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.271675 25004 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:01.292968 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.299520 25090 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:20:01.269495 24803 raft_consensus.cc:740] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:01.301651 25175 consensus_queue.cc:1059] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:20:01.302827 25005 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:20:01.303442 25001 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:01.305435 24989 raft_consensus.cc:3055] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:01.306342 25131 raft_consensus.cc:3055] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:01.269915 25146 raft_consensus.cc:740] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:01.279335 24619 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:01.330271 19655 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:01.271040 24873 consensus_queue.cc:1059] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:20:01.312964 25101 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:01.278589 25089 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.312460 25004 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:01.344408 19660 raft_consensus.cc:1240] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 10. Current term is 11. Ops: []
W20260709 13:20:01.349912 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 160906us
I20260709 13:20:01.351063 19627 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:01.329756 25131 raft_consensus.cc:740] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:01.329409 24989 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:01.335294 24619 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:01.343042 24983 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:01.365291 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 87681.9us
I20260709 13:20:01.348930 25004 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:01.357339 24491 consensus_queue.cc:1059] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:20:01.368206 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.371338 19551 leader_election.cc:400] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 12. Current term is 13.
I20260709 13:20:01.372658 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.373797 25178 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:01.374796 25178 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:01.378844 25001 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:01.383947 19504 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:01.387310 24758 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615) with higher term. Message: Invalid argument: T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15.
I20260709 13:20:01.387801 25112 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:01.389595 25131 consensus_queue.cc:260] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:01.391360 25131 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:01.392184 24491 raft_consensus.cc:3055] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:01.392570 24491 raft_consensus.cc:740] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:01.392488 25146 consensus_queue.cc:260] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:01.393975 25146 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.393565 24491 consensus_queue.cc:260] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.395771 24491 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:01.399109 19458 auto_rebalancer.cc:629] Failed to schedule move for tablet 2c1d08b75392466298c02ea9d4d765dd: Illegal state: Replica 2cfd02601ea44976833027665abc93bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:01.405515 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.406750 24495 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:01.369856 25095 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:01.408666 24804 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:01.358047 25101 raft_consensus.cc:3055] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:01.416750 19661 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:20:01.417472 19661 raft_consensus.cc:606] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:01.417881 19661 raft_consensus.cc:614] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:01.432452 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:01.420857 25101 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:01.438812 19510 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
W20260709 13:20:01.446292 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 73792.8us
I20260709 13:20:01.369939 24983 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.447479 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.448966 25178 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:01.449478 19661 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:20:01.449860 25188 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:01.450274 19661 raft_consensus.cc:606] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:01.444747 19478 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.449337 24983 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:01.453259 25148 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:20:01.435384 24758 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:01.440730 25112 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:01.430335 24919 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:20:01.460678 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:01.463696 19583 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 18.
I20260709 13:20:01.465086 19656 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:01.466650 25096 raft_consensus.cc:3055] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:01.467123 25096 raft_consensus.cc:740] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:01.467865 19656 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:01.467990 25096 consensus_queue.cc:260] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.472816 25114 raft_consensus.cc:3055] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:01.473313 25114 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:01.474257 25091 raft_consensus.cc:3055] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:01.474753 25091 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:01.475621 25091 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.477012 25091 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:01.477675 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.481295 25179 tablet_replica.cc:333] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:20:01.461073 25112 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:01.443796 24989 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.454444 25188 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:01.500629 19655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:20:01.482225 25186 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:01.504611 19655 raft_consensus.cc:606] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:01.505106 19655 raft_consensus.cc:614] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:01.510560 25180 raft_consensus.cc:3055] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:01.511080 25180 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:01.532691 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:01.535195 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 184250us
I20260709 13:20:01.505571 25186 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:01.536561 25186 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.542295 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:01.542640 19627 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:01.512064 24803 consensus_queue.cc:260] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:01.546789 24803 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:01.506215 25112 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:01.587617 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 87986.9us
I20260709 13:20:01.534086 24910 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.505999 25188 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:01.597725 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 141524us
I20260709 13:20:01.549150 25098 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:01.598852 19627 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:01.604925 25194 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.474261 25114 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.534473 25082 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:01.606967 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.593320 25089 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:01.610783 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:01.611486 19652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:20:01.598902 24907 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.612985 19652 raft_consensus.cc:606] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:01.642092 19652 raft_consensus.cc:614] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:01.613844 19512 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:01.611850 24919 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.615186 25082 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:01.618827 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:01.512064 25180 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.620858 19627 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:01.621507 25005 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:01.643507 24907 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.611340 24589 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:01.648736 19585 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:20:01.649899 24907 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:01.650158 19586 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:01.650604 19586 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:01.622136 24910 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.651467 19586 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.652411 19586 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:01.652647 24910 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:01.653951 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:01.654320 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:01.654605 19656 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:01.655025 19661 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:01.629047 25149 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:20:01.656533 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.657701 24589 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:01.657974 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:01.654336 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:01.658732 19578 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.659876 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:20:01.662236 25181 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.302s	user 0.008s	sys 0.003s
I20260709 13:20:01.632433 25004 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.665000 25137 raft_consensus.cc:993] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:20:01.665542 25085 raft_consensus.cc:1081] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Signalling peer d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:20:01.666628 25004 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:01.637854 20629 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.637722 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:01.638017 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:01.638579 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:01.668233 19579 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:01.639266 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:01.669976 19581 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:01.669695 25112 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.671828 25112 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:01.674760 20631 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:01.675640 25178 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:01.675346 25101 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.676050 25178 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:01.676404 25101 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.676501 25178 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:01.678315 24919 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.658015 19627 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:01.642602 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:01.648648 25081 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:01.610708 25114 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.627460 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:01.689350 19581 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:01.690307 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:01.686371 25081 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:01.686038 24919 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:01.720295 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 93029.4us
I20260709 13:20:01.730779 19584 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:01.731841 20659 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 15: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:20:01.735039 19579 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:20:01.736651 19578 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:01.739794 25194 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:01.740284 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.628541 24619 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.743490 25180 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:01.744426 24537 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:01.745205 24619 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:01.745946 25098 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:01.746439 25096 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.746450 24537 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:01.747781 19661 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:01.747752 19587 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:01.750885 24989 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:01.755031 25110 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:01.756521 19625 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:01.756425 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:01.757804 25082 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:01.758164 25085 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:01.758720 25085 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:01.759101 25085 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:01.759176 25089 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:01.758224 25082 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:01.761019 25082 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:01.765097 19476 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:01.765336 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.766975 25149 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:01.767196 24619 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:01.767407 25149 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.767892 25149 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:01.776593 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:01.776829 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:01.777530 19660 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:01.777864 25200 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:01.778600 25200 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.779138 25081 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.780790 25200 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:01.780957 25105 consensus_queue.cc:1059] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:01.781435 25081 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:01.782236 24758 raft_consensus.cc:3055] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:01.781590 25112 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:01.777585 19509 raft_consensus.cc:2410] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:20:01.786728 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:01.792979 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:01.785650 24758 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:01.798717 19582 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:01.799746 19586 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:20:01.794708 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:01.800814 19586 pending_rounds.cc:85] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 10
I20260709 13:20:01.801853 19586 pending_rounds.cc:107] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:20:01.802477 19586 raft_consensus.cc:2889] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:01.802743 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.806596 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:01.784160 25087 consensus_queue.cc:1059] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:20:01.806674 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.809433 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:01.810343 19578 raft_consensus.cc:2393] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 8: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:01.810562 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:01.810153 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:01.835522 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.783854 24589 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:01.730386 25004 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:01.812834 19476 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:01.786053 25112 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.846911 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:01.849776 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:01.850036 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:01.850383 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:01.850905 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:01.851589 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:01.851706 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:01.852144 19658 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:01.852257 19508 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:01.853152 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:01.777671 25149 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.853965 19661 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:01.854430 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:01.859612 19507 raft_consensus.cc:2368] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16.
I20260709 13:20:01.859783 19587 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:01.866124 19653 raft_consensus.cc:2393] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 8: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:01.813252 25110 raft_consensus.cc:2764] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:01.855365 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:01.880278 19582 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:01.881105 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:01.882232 19581 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 17: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:01.856329 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:01.854911 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:01.836604 25052 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:01.857342 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:01.857609 19656 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:01.884696 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:01.891744 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 85148.2us
I20260709 13:20:01.892798 19478 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.850715 25148 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:01.899081 19511 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:01.857203 25112 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:01.905128 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:01.848357 25194 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:01.849480 19505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:50822
I20260709 13:20:01.906805 19505 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:01.907306 19505 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:01.856144 24987 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:01.899704 19586 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:20:01.910236 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.911520 19584 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 17: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:01.903512 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:01.904322 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:01.798453 25186 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.909534 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.815028 24919 consensus_queue.cc:1059] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
W20260709 13:20:01.914074 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 78625us
I20260709 13:20:01.877961 25105 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:01.916460 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:01.928987 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.887521 25052 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.890522 25137 raft_consensus.cc:3055] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:01.943572 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:01.935951 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:01.851683 25175 consensus_queue.cc:1059] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:20:01.946360 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:01.947798 19580 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:20:01.950035 19580 pending_rounds.cc:85] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 9
I20260709 13:20:01.950340 19580 pending_rounds.cc:107] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:20:01.950630 19580 raft_consensus.cc:2889] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:01.909433 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:01.932153 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:01.940615 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.948081 19478 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.951943 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:01.945820 25148 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:01.960913 25148 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.916448 24907 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:01.964069 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:01.940461 24811 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.910236 24987 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.928161 24910 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:01.931994 24912 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:01.983142 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:01.946998 25137 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:01.973608 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:01.946035 25052 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:01.981520 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:01.983914 19586 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:01.986533 19584 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:01.959501 24491 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:01.882673 25188 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.917958 25194 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.000689 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:01.980866 24987 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:02.012871 25146 raft_consensus.cc:3055] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:02.013370 25146 raft_consensus.cc:740] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:01.985527 25091 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:02.018160 19584 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:01.985836 24537 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:02.019958 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:01.987352 25110 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:02.027549 19581 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:01.977905 24811 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.991838 24912 raft_consensus.cc:697] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:02.036154 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 54716.4us
W20260709 13:20:02.032055 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.038807 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:01.986723 24910 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:01.972990 24758 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.024197 25115 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:02.049608 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:02.056680 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.056005 19581 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:02.051412 19584 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:02.066622 19586 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:02.074542 19510 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:02.082703 19586 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:02.086030 24811 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:02.087234 24910 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.090097 24912 consensus_queue.cc:237] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:02.090811 25202 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:20:02.092602 25115 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:02.093389 25115 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.094666 20659 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 11.
I20260709 13:20:02.096506 25115 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:02.099344 25199 log.cc:927] Time spent T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:20:02.108718 19653 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:20:02.108968 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:02.109848 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:02.110230 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:02.053296 25149 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.121217 19508 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:02.014362 25146 consensus_queue.cc:260] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:02.034149 25110 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.122503 19659 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:02.117966 20666 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 8.
I20260709 13:20:02.134296 19504 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:02.080273 25179 raft_consensus.cc:2243] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.120954 24491 raft_consensus.cc:697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:02.131656 25215 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:20:02.142632 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:02.152738 19512 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
W20260709 13:20:02.155222 25205 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:20:02.159909 25207 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:20:02.131805 24758 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:02.169397 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 132307us
I20260709 13:20:02.170794 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:02.181126 25204 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:20:02.184672 19627 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:02.068845 25137 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.191141 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:02.186160 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:02.181756 25210 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:02.181231 25179 raft_consensus.cc:2272] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.220364 19661 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:02.220896 25137 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:02.216758 25210 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.220911 25179 ts_tablet_manager.cc:1916] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:02.222150 25082 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:02.248148 19505 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.190837 25005 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:20:02.226042 25101 consensus_meta.cc:287] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260709 13:20:02.230013 24491 consensus_queue.cc:237] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:02.237736 25206 log.cc:927] Time spent T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.100s	user 0.004s	sys 0.000s
W20260709 13:20:02.238282 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 67645us
I20260709 13:20:02.261561 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:02.239343 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:02.263043 19658 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 17: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:02.239673 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:02.265798 25005 raft_consensus.cc:697] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:02.266909 25194 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.267185 25005 consensus_queue.cc:237] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:02.268298 25110 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:02.247393 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 61345.9us
I20260709 13:20:02.270143 25210 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.270798 25188 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.256639 25096 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.272210 25096 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.274472 25096 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:02.275031 25052 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:02.276801 25178 consensus_meta.cc:287] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.000s
I20260709 13:20:02.251235 24589 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:02.279250 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:02.280998 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:02.284075 24589 raft_consensus.cc:697] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:02.285512 24589 consensus_queue.cc:237] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:02.290077 25032 consensus_queue.cc:1059] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:20:02.292033 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.293218 19585 raft_consensus.cc:2368] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20.
I20260709 13:20:02.294633 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:02.317075 19585 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:02.326946 19505 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.327860 19584 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:02.251820 19582 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
W20260709 13:20:02.254736 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.197882 25212 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:02.174681 25186 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.295859 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:02.346196 19583 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:02.296754 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:02.224422 25085 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.277271 25178 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:02.313839 25210 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.316430 25032 raft_consensus.cc:3055] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:02.413014 25032 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:02.414090 25032 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.415551 25032 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:02.418726 19654 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:02.375483 19584 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 13:20:02.411056 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.422384 19584 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:02.423697 19584 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:02.425028 19584 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:02.425877 24987 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.428402 24987 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:02.429574 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.430794 19656 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:02.436169 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:02.450699 19586 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:20:02.453744 19659 raft_consensus.cc:2368] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20.
I20260709 13:20:02.339373 25194 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:02.301337 25112 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.459846 19657 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:02.459734 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:02.463757 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:02.474419 19585 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:02.378682 25096 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.476167 19652 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 13:20:02.478535 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 181860us
I20260709 13:20:02.480991 20665 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:02.447961 25180 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.490311 19579 raft_consensus.cc:2368] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22.
I20260709 13:20:02.456598 25105 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:02.458709 24989 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.490135 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:02.499570 19661 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:02.484300 24912 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:02.506623 24912 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.506798 19405 catalog_manager.cc:5697] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 15 to 17, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 17 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.509227 24912 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.510610 25085 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:02.515513 25178 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:02.516933 25112 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.519006 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:02.438532 25210 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.508818 19405 catalog_manager.cc:5697] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 11 to 13, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 13 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.540822 19661 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:02.530762 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:02.547534 25210 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.548554 19405 catalog_manager.cc:5697] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 11 to 16, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 16 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:02.550424 19405 catalog_manager.cc:5697] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.551901 19405 catalog_manager.cc:5697] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:02.553808 19405 catalog_manager.cc:5697] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.555614 19405 catalog_manager.cc:5697] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.558053 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:02.559562 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:02.560209 19652 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:02.560544 19652 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:02.562042 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:02.558357 19405 catalog_manager.cc:5697] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 6 to 14. New cstate: current_term: 14 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:02.487026 25096 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.586707 19583 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
W20260709 13:20:02.574167 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 86112.1us
I20260709 13:20:02.561313 19652 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.588049 19652 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:02.588662 20631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.504585 24989 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.498597 25180 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:02.599804 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.601491 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:02.602432 19661 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:02.604012 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:02.590603 19405 catalog_manager.cc:5697] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 9 to 11, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 11 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.612358 19505 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:02.613099 19476 leader_election.cc:400] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20.
I20260709 13:20:02.613451 19476 leader_election.cc:403] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:20:02.613605 19551 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:02.614982 24495 consensus_queue.cc:1059] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:02.617801 25214 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20.
I20260709 13:20:02.619150 25214 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:02.620759 19476 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:02.622159 24912 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:02.622722 24912 raft_consensus.cc:697] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:02.623006 25096 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:02.610347 25188 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:02.623903 24912 consensus_queue.cc:237] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.627102 25180 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.603739 24491 consensus_queue.cc:1059] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:20:02.629155 24491 raft_consensus.cc:3055] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:02.629549 24491 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:02.615190 24758 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:02.635929 25082 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:02.641300 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:02.643922 24758 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.644505 24758 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.610730 19405 catalog_manager.cc:5697] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:02.646698 24758 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.646876 19405 catalog_manager.cc:5697] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:02.615013 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:02.648178 25052 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.649879 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:02.650707 25188 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:02.651401 25188 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:02.652621 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:02.653375 24491 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.654050 19655 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:20:02.654743 24491 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:02.660166 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2903) took 1014 ms. Trace:
W20260709 13:20:02.660821 25222 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.107s	user 0.002s	sys 0.001s
I20260709 13:20:02.660723 19580 rpcz_store.cc:276] 0709 13:20:01.646088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.646221 (+   133us) service_pool.cc:224] Handling call
0709 13:20:01.653969 (+  7748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.973095 (+319126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.659829 (+686734us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b5400267854. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:02.660083 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652889344}
I20260709 13:20:02.592990 24989 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.667688 25146 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:02.672708 25188 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:02.641316 25179 ts_tablet_manager.cc:1929] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.7
I20260709 13:20:02.674060 25179 log.cc:1199] T d05498e224814b9b8f31e3f965ab2583 P 2cfd02601ea44976833027665abc93bf: Deleting WAL directory at /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-1-root/wals/d05498e224814b9b8f31e3f965ab2583
I20260709 13:20:02.674939 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:02.675325 25179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45038 (request call id 2) took 1596 ms. Trace:
I20260709 13:20:02.685143 19478 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:02.688968 19661 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:02.693583 19652 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:02.702286 19503 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:02.706740 19551 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:02.692951 25180 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.707777 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:02.693192 24758 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:02.648180 19405 catalog_manager.cc:5697] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 13 to 15, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 15 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:02.703655 24910 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:02.722944 19405 catalog_manager.cc:5697] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:02.726631 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:02.718618 25112 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:02.704387 25052 consensus_queue.cc:1059] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:20:02.734764 19405 catalog_manager.cc:5697] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 15 to 17, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 17 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.735911 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:02.719664 25180 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:02.745069 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:02.751022 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.718365 25081 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:20:02.738469 24758 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:20:02.757790 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 292214us
I20260709 13:20:02.727435 25214 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
W20260709 13:20:02.747532 25224 log.cc:927] Time spent T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:20:02.675709 25179 rpcz_store.cc:276] 0709 13:20:01.078765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.079044 (+   279us) service_pool.cc:224] Handling call
0709 13:20:01.280937 (+201893us) ts_tablet_manager.cc:1151] Deleting tablet d05498e224814b9b8f31e3f965ab2583
0709 13:20:01.281088 (+   151us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:20:01.481058 (+199970us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54002fbf54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c31762ff9 00007f6c36770482 00007f6c367a12d0 00007f6c3678783d 00007f6c367877e9 00007f6c36787779 00007f6c36787741 00007f6c3678696d 000000000038f354 000000000038f199
0709 13:20:02.348401 (+867343us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:02.641177 (+292776us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:02.675247 (+ 34070us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":319957,"spinlock_wait_cycles":277048576,"tablet-delete.queue_time_us":185720,"thread_start_us":82983,"threads_started":1}
I20260709 13:20:02.765053 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:02.742658 25190 raft_consensus.cc:3055] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:02.762984 25229 log.cc:927] Time spent T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.224s	user 0.000s	sys 0.003s
I20260709 13:20:02.769281 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:02.770332 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:02.773496 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:02.774158 19583 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:02.774390 19582 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:02.775303 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:02.777179 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:02.770682 19405 catalog_manager.cc:5697] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 9 to 11, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 11 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.768472 19476 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:02.777809 19508 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:02.778342 19509 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:02.781036 19507 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:02.777745 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:02.780275 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 97157.4us
I20260709 13:20:02.729470 25210 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:20:02.780035 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:02.783129 19506 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:02.784004 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:02.784153 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:02.784781 19586 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:02.778985 19476 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:02.785755 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:02.786363 19581 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:02.786202 19405 catalog_manager.cc:5697] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 9 to 12, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 12 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:02.749688 25105 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:20:02.787567 19578 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:02.761049 25112 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:02.788810 20631 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:02.789566 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:02.790796 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:02.799821 19655 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:02.791299 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:02.791736 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:02.792183 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:02.792934 19627 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:02.793534 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:02.771956 25190 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:02.793684 25085 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.806792 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:02.796703 25175 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.797288 24589 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.811913 24589 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.812592 25131 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:02.814299 24589 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:02.768030 25082 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.814633 25180 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.814985 25082 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.787189 25090 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:20:02.817163 25082 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.803383 19653 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 17: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:02.776158 25188 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:02.784845 25214 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:02.805172 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:02.807296 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:02.797320 19397 catalog_manager.cc:5028] TS 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): tablet d05498e224814b9b8f31e3f965ab2583 (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
I20260709 13:20:02.804235 25112 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:02.815241 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:02.777249 25101 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:02.802330 19405 catalog_manager.cc:5697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 10 to 13, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 13 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:02.819924 19655 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:02.797590 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:02.821142 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:02.828521 19627 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:02.894892 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:02.830776 19508 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:02.835584 25236 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:02.836838 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 48110.3us
W20260709 13:20:02.837942 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 60302.1us
I20260709 13:20:02.897814 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:02.897090 19405 catalog_manager.cc:5697] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 11 to 13, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 13 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.898280 19551 leader_election.cc:400] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16.
I20260709 13:20:02.898451 19655 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:02.898674 19551 leader_election.cc:403] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:20:02.899174 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.899297 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:02.899835 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:02.801240 25052 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:02.899860 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:02.900897 25210 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16.
I20260709 13:20:02.817575 25085 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.901548 25210 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:02.841787 25142 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:02.839702 25082 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.849108 25188 raft_consensus.cc:697] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:02.826637 25175 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:02.840516 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:02.840817 19397 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 43665.3us
I20260709 13:20:02.890470 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:02.827504 25005 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.901580 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:02.903308 25085 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:02.903569 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:02.904042 25082 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.911836 25179 tablet_replica.cc:333] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:20:02.913002 25179 raft_consensus.cc:2243] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.913187 19511 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:20:02.904332 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:02.888144 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:02.914391 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:02.914975 19654 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:20:02.915242 25105 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:02.916522 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:02.840059 19657 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:20:02.911633 19582 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:02.919214 19655 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:02.920645 19655 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:20:02.922326 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.922425 19476 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:02.842347 19652 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:02.923720 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:02.880699 25214 raft_consensus.cc:697] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:02.896835 19581 raft_consensus.cc:2393] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 17: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:02.905148 25188 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.926918 25082 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.926786 25214 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.930394 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:02.896908 25190 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.905339 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:02.935209 25190 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:02.935704 19587 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:02.937803 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:02.937920 25200 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:02.938606 19578 raft_consensus.cc:2393] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 17: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:20:02.939883 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 111484us
I20260709 13:20:02.940125 25089 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:02.940908 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 98908.5us
I20260709 13:20:02.906270 19586 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:02.941408 19658 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 13:20:02.904546 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:02.908519 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:02.941061 19627 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:02.905541 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:02.907188 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:02.942700 19508 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 15.
I20260709 13:20:02.943735 19660 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:02.943923 19585 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
W20260709 13:20:02.942036 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.907444 19509 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:02.946468 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:02.909862 19458 auto_rebalancer.cc:629] Failed to schedule move for tablet d073a31754234c93b24b8ffbc9f8fb3b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:20:02.941970 19658 pending_rounds.cc:85] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 11
I20260709 13:20:02.950867 19658 pending_rounds.cc:107] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 13:20:02.951252 19658 raft_consensus.cc:2889] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:02.906600 19653 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:02.839254 25239 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:02.880740 24758 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:02.966631 19405 catalog_manager.cc:5697] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 13 to 15, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 15 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:02.979471 25081 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:02.985261 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 3220) took 1101 ms. Trace:
I20260709 13:20:02.985725 19579 rpcz_store.cc:276] 0709 13:20:01.883717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.884177 (+   460us) service_pool.cc:224] Handling call
0709 13:20:02.983829 (+1099652us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b540011dfd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:02.985188 (+  1359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1326935424}
I20260709 13:20:02.986745 25081 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.987308 25081 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:02.987591 25233 log.cc:927] Time spent T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:20:02.984843 24907 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.989128 24907 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:02.991348 24907 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.952610 25052 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:02.966747 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:02.907327 25175 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.991528 25180 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.956313 25105 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:02.974473 19587 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:02.994566 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:02.997008 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 56034.4us
I20260709 13:20:02.997714 19627 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:02.975059 25239 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:02.998594 24873 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.000777 19659 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:02.907701 25005 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:03.018711 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 72375.9us
I20260709 13:20:03.002862 19627 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:02.966156 25001 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:20:03.029799 24912 raft_consensus.cc:3055] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:03.030228 24912 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:03.018249 25179 raft_consensus.cc:2272] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.034103 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:03.034895 25179 ts_tablet_manager.cc:1916] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:03.035832 19586 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:20:03.036955 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:03.037279 19578 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:03.037554 19585 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:20:03.037869 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:03.038491 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:03.039108 19584 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:20:03.039402 25005 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:03.040129 19652 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 15.
I20260709 13:20:03.040378 19625 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:03.041585 24619 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:03.041993 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:03.042217 24589 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:03.042804 19478 leader_election.cc:400] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20.
I20260709 13:20:03.043151 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:03.044008 25175 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:03.044421 25175 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.044780 25175 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.022264 25052 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.045886 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:03.046548 19579 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:03.023288 25188 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:03.019268 24803 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:03.025987 25089 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.026453 19505 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:03.026584 24758 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.053812 25239 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.055140 25239 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:03.031029 24912 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.060138 25214 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:03.060750 24912 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:03.056458 25001 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:03.042826 24589 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:03.062700 25214 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:03.063135 25214 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:03.022413 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:03.063293 24589 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.065647 25105 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:03.066228 25105 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:03.066398 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:03.066570 25112 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:03.067236 25110 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:03.067595 25234 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:03.067920 25212 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:03.068262 25110 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:03.068359 25212 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:03.068673 25110 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:03.042843 19586 raft_consensus.cc:2410] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:20:03.026332 24910 raft_consensus.cc:3055] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:03.041337 19625 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:02.999672 24989 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:02.995545 25186 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:20:03.050813 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 48099.1us
I20260709 13:20:03.051620 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:03.052546 25089 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.080664 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:03.080796 25214 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.081061 25110 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.080552 24619 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:20:03.082100 25089 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:03.048468 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:03.082355 25110 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:03.070698 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:03.083344 24495 consensus_queue.cc:1059] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:03.084591 24495 raft_consensus.cc:3055] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:03.084955 24495 raft_consensus.cc:740] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:03.085726 24495 consensus_queue.cc:260] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.086247 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:03.083405 24619 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:20:03.087584 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:03.087913 25101 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:03.088397 25101 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.088928 25101 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:03.088868 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:03.089887 25188 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:03.090587 25188 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:03.070341 24910 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:03.068720 25235 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:02.996708 25180 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.098093 25235 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:03.096330 19511 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:20:03.081650 20665 raft_consensus.cc:2393] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 11: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:03.067157 25105 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.082190 25214 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.088404 25200 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.068841 25212 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:02.996385 24826 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:20:03.113713 25200 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.116472 25200 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:03.105099 25180 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:02.999861 19405 catalog_manager.cc:5697] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 13 to 17, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 17 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:03.080523 24803 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:03.010206 19476 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:03.057792 19509 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:03.096768 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:03.093786 24495 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:03.099152 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:20:03.099731 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:03.102708 19505 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:03.092902 24989 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.121800 25089 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:03.105398 19458 auto_rebalancer.cc:629] Failed to schedule move for tablet df137c733a0a470c9e35fa2b09c6c619: Illegal state: Replica d56df3728fc04e37b2d29a3bcd91d167 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:03.106009 25112 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:03.106173 19652 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:20:03.091831 24910 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:03.107389 25186 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:03.123538 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 113509us
I20260709 13:20:03.123869 19507 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:20:03.098084 25001 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:20:03.104276 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:03.127152 19405 catalog_manager.cc:5697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:03.127820 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:03.127852 19627 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:03.144043 19476 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:03.126444 19625 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:03.144832 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:03.091585 25081 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.124306 25235 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:03.096244 19478 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:03.130213 24989 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:03.130970 25005 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:20:03.150671 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 54521.1us
I20260709 13:20:03.101213 25148 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:20:03.123440 25200 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.131117 25188 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:03.158527 19405 catalog_manager.cc:5697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 6 to 13, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 13 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:03.124631 24803 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.161018 19405 catalog_manager.cc:5697] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 12 to 14, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 14 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:03.124488 25180 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:03.155975 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:03.156944 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:03.148432 25236 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:03.148911 25087 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:03.150254 24912 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:03.156373 24907 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:03.152575 25210 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:03.153113 19625 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:03.159762 24910 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:03.175130 19405 catalog_manager.cc:5697] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:03.158962 25096 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:03.178288 19551 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:03.141714 25089 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.150365 24491 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:20:03.162844 25180 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.195915 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:03.164477 24803 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:03.199343 19405 catalog_manager.cc:5697] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 15 to 16, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 16 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:03.198078 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 52741.9us
I20260709 13:20:03.173100 25087 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.207897 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:03.210683 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:03.169706 25082 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:20:03.172953 24912 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.174705 25236 raft_consensus.cc:697] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:03.192862 25096 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.192189 25235 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:03.162245 25200 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:03.222467 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 71013.7us
I20260709 13:20:03.197082 25005 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:03.253283 19660 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:03.171363 25006 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:20:03.166141 24811 consensus_queue.cc:1059] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:20:03.203552 25180 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:03.196650 24907 raft_consensus.cc:697] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:03.254487 19405 catalog_manager.cc:5697] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 6 to 10, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 10 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:03.224275 25146 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.216620 25087 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:03.219313 24912 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:03.220269 25188 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:03.262629 19627 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:03.223837 25112 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:03.266557 19458 auto_rebalancer.cc:629] Failed to schedule move for tablet b91cdbdc59c54db98e6692ac65df1b3b: Illegal state: Replica e19c80e9149b4b8d88ae13bde8e43864 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 23 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:03.257171 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:20:03.198849 25098 consensus_queue.cc:1059] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:20:03.255020 25096 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.296151 24811 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:03.296799 24811 raft_consensus.cc:697] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:03.296725 19627 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:03.261077 25005 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.276787 24907 consensus_queue.cc:237] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.277578 24873 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:03.278775 25081 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:03.289851 19405 catalog_manager.cc:5697] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 10 to 12, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 12 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:03.312150 19405 catalog_manager.cc:5697] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 12 to 14, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 14 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:03.303187 25005 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.264436 24987 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.216456 25186 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:03.316792 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 59750.7us
I20260709 13:20:03.309903 25246 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:03.348873 19405 catalog_manager.cc:5697] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:03.318259 24811 consensus_queue.cc:237] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.311800 24989 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.319468 24983 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:03.321345 19657 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:03.339658 19478 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:03.346814 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:03.351377 19653 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:03.359781 19656 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:03.274684 25146 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:03.364511 19405 catalog_manager.cc:5697] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
W20260709 13:20:03.367525 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 70885.1us
I20260709 13:20:03.338227 25052 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:03.370373 19627 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:03.372377 19405 catalog_manager.cc:5697] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 10 to 11, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 11 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:03.374401 19405 catalog_manager.cc:5697] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 11 to 12, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 12 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:03.352598 24983 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:03.362361 25112 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.382710 19627 leader_election.cc:400] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22.
I20260709 13:20:03.393519 19627 leader_election.cc:403] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:20:03.364559 25250 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.347874 24987 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.397919 19405 catalog_manager.cc:5697] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 11 to 12, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 12 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:03.401970 25001 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22.
I20260709 13:20:03.379876 24983 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.358592 25246 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:03.406065 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:03.403836 19654 consensus_queue.cc:237] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
W20260709 13:20:03.412223 25244 log.cc:927] Time spent T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:20:03.415097 19405 catalog_manager.cc:5697] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 9 to 12, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 12 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:03.424289 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:03.424160 19405 catalog_manager.cc:5697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 7 to 13, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 13 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:03.429243 20665 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:20:03.430665 19405 catalog_manager.cc:5697] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:03.431982 19405 catalog_manager.cc:5697] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 10 to 12, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 12 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:03.395251 25112 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:03.440430 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 80170.9us
I20260709 13:20:03.442309 19653 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:20:03.442437 19405 catalog_manager.cc:5697] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 10 to 12, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 12 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:03.447532 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:03.433172 25200 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:03.451330 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:03.421790 25006 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.454484 20666 raft_consensus.cc:1275] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:20:03.454698 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:03.457180 19653 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 11.
I20260709 13:20:03.454221 19476 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:03.369288 25236 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.458283 20619 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:03.410494 25148 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:20:03.422956 25052 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:20:03.455112 25085 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:03.449482 25175 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:03.446065 25101 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.486153 24989 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:03.487037 25175 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:03.459122 25254 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:20:03.487707 25175 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:03.488099 25175 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.488427 25175 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:03.456887 25087 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.494261 24619 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:03.468072 24983 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.495316 25087 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:03.495618 20659 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:20:03.497097 24983 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:03.511127 19660 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:03.515944 25250 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:03.518821 25090 raft_consensus.cc:3055] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:03.518821 25180 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.501019 24987 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:03.462605 25006 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.520893 25188 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:03.521541 25006 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:03.503226 25258 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:03.521960 24912 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.522373 25258 raft_consensus.cc:697] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:03.523244 25258 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.524031 24912 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:03.462298 25082 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:20:03.526634 25089 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:03.528900 25180 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:03.505775 25239 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:03.529915 25239 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.507470 25234 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.531899 25234 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.474176 24826 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:20:03.533360 24803 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.551236 24803 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:03.519414 25090 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:03.549279 25101 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:03.554103 19578 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:03.555888 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:03.582655 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:03.583827 20659 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 19: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:20:03.584604 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:03.585455 19586 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:20:03.499689 25096 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:03.560529 19583 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:20:03.537786 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:03.586755 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:03.561821 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:03.587914 19658 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:03.548882 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:03.589187 19584 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:03.507694 25146 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:03.541978 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:03.603221 19506 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 19: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:03.592203 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:03.595329 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:03.605041 19508 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:03.603924 19507 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:20:03.606931 19660 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:03.608583 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:03.598012 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.609380 19580 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
W20260709 13:20:03.536748 25243 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.277s	user 0.000s	sys 0.003s
W20260709 13:20:03.610594 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 156434us
I20260709 13:20:03.611184 19657 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:20:03.611510 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 153314us
I20260709 13:20:03.629081 19659 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:03.632167 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:03.535038 25085 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:03.540546 25105 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:03.548269 25112 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:03.546146 25246 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:03.548501 25194 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:03.641245 19625 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:03.648412 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:03.614432 25179 ts_tablet_manager.cc:1929] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.12
I20260709 13:20:03.649581 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:03.650672 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:03.656827 19586 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:03.650213 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:03.658274 19583 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:03.535730 25212 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.652599 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:03.668596 19508 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.669414 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:03.670209 19655 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:03.649202 19578 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:20:03.649896 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:03.673149 19584 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.658939 19656 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 19: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:03.652503 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:03.675398 19652 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:03.660930 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 217350us
I20260709 13:20:03.678409 19478 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:03.679440 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:03.680183 19580 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:03.684571 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:03.685926 19478 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:03.542275 25175 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:03.687781 19658 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:20:03.647935 25085 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:03.670316 25179 log.cc:1199] T 6eb38e2ac9064d3286fe2f20aeb2381c P 2cfd02601ea44976833027665abc93bf: Deleting WAL directory at /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-1-root/wals/6eb38e2ac9064d3286fe2f20aeb2381c
I20260709 13:20:03.694074 19657 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 21: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:03.658617 25137 raft_consensus.cc:3055] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:03.711759 19578 raft_consensus.cc:1275] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:20:03.658548 25253 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.713367 19508 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 16.
I20260709 13:20:03.730449 19652 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
W20260709 13:20:03.733551 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 47697.7us
I20260709 13:20:03.690516 25004 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:03.692687 25186 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:03.677794 25052 consensus_queue.cc:1059] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:20:03.648878 25105 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.754372 25186 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.678994 25005 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.684146 25142 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:20:03.678222 25200 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:20:03.665957 25194 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.727008 25137 raft_consensus.cc:740] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:03.749594 25004 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.771407 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:03.690750 25101 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:20:03.772662 20666 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:03.763131 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 140422us
I20260709 13:20:03.708426 24907 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:20:03.777819 19661 raft_consensus.cc:2393] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:03.776489 19508 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:03.763255 25186 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:03.792577 19627 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:03.748924 25253 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:03.805511 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 102033us
I20260709 13:20:03.772490 19586 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:03.778246 25179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45038 (request call id 1) took 2697 ms. Trace:
I20260709 13:20:03.713146 25090 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.771420 25260 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:03.778102 25004 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.814311 25005 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:03.815052 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:03.861039 19587 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:03.815785 25137 consensus_queue.cc:260] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:03.817471 25212 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:03.818588 25263 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:20:03.821475 25253 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:03.909503 19476 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:03.911070 24619 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:03.910987 25085 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.911882 24619 raft_consensus.cc:697] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:03.913280 25085 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:03.807049 25254 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:20:03.780596 25236 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:03.839874 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:03.934723 19584 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:03.837430 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:03.847460 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:03.935819 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:03.936424 19584 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:03.850131 19627 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:03.839972 25101 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:03.878149 25175 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:03.881091 19580 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:03.951259 19585 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 19: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:03.953188 19584 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:03.883442 25105 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:03.889101 25186 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.900177 25239 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:03.902166 25261 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:20:03.903241 25264 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:20:03.904278 25234 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:03.803263 25006 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:20:03.824211 25096 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:03.847325 25271 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:03.913048 24619 consensus_queue.cc:237] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.903146 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:04.023523 24912 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.104393 24912 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.106809 24912 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:04.107504 25146 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:04.108163 25146 raft_consensus.cc:697] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 16 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:03.922688 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:04.109148 25146 consensus_queue.cc:237] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:04.110590 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:04.112056 19654 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:03.924630 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:04.114058 19656 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:03.920567 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:04.117583 19652 raft_consensus.cc:2368] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18.
I20260709 13:20:03.957676 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:03.860421 25250 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:04.120895 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 163378us
I20260709 13:20:04.120672 25250 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:03.964828 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:04.121903 19586 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
W20260709 13:20:04.024863 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 174851us
I20260709 13:20:04.122689 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:04.032120 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:03.926877 25137 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:04.035099 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:04.130297 19506 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:04.131754 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:04.035362 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:04.038338 19507 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:04.040297 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:04.043105 19505 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:04.037045 24803 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:03.927090 25194 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:04.044843 19585 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:20:04.084484 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:04.085536 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:04.086395 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:04.156446 19503 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:04.087301 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:04.092087 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 189055us
I20260709 13:20:04.151507 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:03.921921 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:04.159874 19660 raft_consensus.cc:2393] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 13: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:04.093348 19512 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:20:04.159904 19658 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:04.023941 25085 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:03.831970 25179 rpcz_store.cc:276] 0709 13:20:01.078229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.079110 (+   881us) service_pool.cc:224] Handling call
0709 13:20:02.911482 (+1832372us) ts_tablet_manager.cc:1151] Deleting tablet 6eb38e2ac9064d3286fe2f20aeb2381c
0709 13:20:02.911553 (+    71us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:20:03.449299 (+537746us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:03.581454 (+132155us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:03.774464 (+193010us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13599,"tablet-delete.queue_time_us":1813383}
I20260709 13:20:04.023190 25236 raft_consensus.cc:697] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:04.099329 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:04.088759 25271 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:03.964315 25101 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.138269 19551 leader_election.cc:400] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18.
I20260709 13:20:04.192095 19551 leader_election.cc:403] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:20:03.917555 25212 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:04.145999 19511 raft_consensus.cc:2393] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:04.139536 19627 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:04.193522 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 54120.7us
I20260709 13:20:04.148295 25175 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.103114 25186 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:04.165300 19659 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:04.169754 19509 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:04.174142 19658 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 12.
I20260709 13:20:04.235222 19585 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:04.158269 25001 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:04.195292 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 65620.3us
I20260709 13:20:04.147523 24803 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:04.154425 19654 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:20:04.244426 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:04.247643 19661 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:04.242353 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:04.253139 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:20:04.258668 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:04.158995 24910 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:20:04.158571 25096 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:20:04.240859 25175 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:04.314505 25175 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:04.315698 25101 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:04.246491 25087 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:04.321930 25256 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:04.322057 25087 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.322679 25256 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:04.324379 25087 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:04.236943 25188 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18.
I20260709 13:20:04.324772 25256 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:04.161378 25004 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.194855 25271 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:04.190183 25085 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.250846 24803 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:04.234073 24811 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:04.260546 25105 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:04.202564 25212 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.165088 25259 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 13:20:04.239454 25001 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:04.355578 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 93998.6us
I20260709 13:20:04.264221 25112 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:04.365249 25096 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:04.376739 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.358919 25101 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:04.365918 25105 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.366125 25235 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:04.372184 25001 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:04.372648 25112 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:04.386590 25005 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:04.392316 25105 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:04.386380 24811 raft_consensus.cc:697] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:04.437924 25194 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.438568 25194 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.441040 25250 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:04.384863 25096 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.417273 25112 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:04.369578 25236 consensus_queue.cc:237] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.466171 24811 consensus_queue.cc:237] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.421464 19585 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:04.457769 25296 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:04.470700 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 311150us
I20260709 13:20:04.388039 25101 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:04.399621 25272 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:20:04.481925 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:04.497552 19586 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:04.491700 19476 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:04.515152 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:04.475365 25250 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.430011 25005 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:04.529918 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 271357us
I20260709 13:20:04.534400 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:04.537575 20619 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:04.491379 25085 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:04.524415 25282 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:04.557403 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:04.564316 19658 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:04.561152 19656 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:04.526232 25246 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:04.530642 25188 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:04.481324 25296 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.546806 25239 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:04.558569 25175 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:04.571736 19656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:20:04.580973 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:04.536757 25250 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.563722 25282 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.522042 25260 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:20:04.594972 19656 raft_consensus.cc:606] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:04.565637 25258 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.596470 19509 raft_consensus.cc:2393] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 19: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:20:04.598626 25286 log.cc:927] Time spent T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:20:04.600548 25250 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:04.563527 25200 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:20:04.603633 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:04.605340 25282 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:04.607607 19656 raft_consensus.cc:614] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:04.574805 25004 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:04.616816 25175 raft_consensus.cc:697] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 12 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:04.617789 25212 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:04.614115 19658 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
W20260709 13:20:04.618515 25288 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:20:04.622334 25101 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:04.570080 25236 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:20:04.585508 25188 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.640367 25105 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.652460 25259 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.657521 19476 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:04.615415 25194 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:04.613591 25302 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.677532 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:04.680583 19476 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:04.683619 25112 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:04.646692 25096 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:04.673808 25101 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.685635 25101 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.687240 25105 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:04.687793 25101 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:04.689786 25302 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:04.691179 25188 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:04.692430 19627 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:04.692830 25302 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:04.680230 25259 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.694361 25148 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:04.694818 25148 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.695178 25148 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:04.696347 25259 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:04.702991 25175 consensus_queue.cc:237] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:04.708644 25279 log.cc:927] Time spent T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.397s	user 0.001s	sys 0.000s
I20260709 13:20:04.708707 25260 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:04.709373 25260 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.709869 25260 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.712455 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:04.712890 19655 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:04.707302 25148 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.719221 19653 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:04.614521 25258 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.723762 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:04.728536 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:04.730041 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:04.729722 19584 raft_consensus.cc:2393] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:04.730545 19585 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.731652 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:04.735169 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:04.737205 19658 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:04.738618 19580 raft_consensus.cc:2393] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 18: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:04.741932 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:04.743363 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:04.727360 24619 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.729673 25254 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:04.719276 24826 consensus_queue.cc:1059] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:20:04.739152 25253 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:20:04.754715 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 212538us
W20260709 13:20:04.757073 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.759061 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:04.759919 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3241) took 1212 ms. Trace:
I20260709 13:20:04.761919 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:04.760736 19579 rpcz_store.cc:276] 0709 13:20:03.547461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.548905 (+  1444us) service_pool.cc:224] Handling call
0709 13:20:03.561704 (+ 12799us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635f8c 00007f6c2e635ef6 0000000000375939 00007f6c366a91e0 00007f6c367720c4 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:20:03.561821 (+   117us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.607615 (+ 45794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.607673 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:03.619954 (+ 12281us) log.cc:844] Serialized 26 byte log entry
0709 13:20:03.937970 (+318016us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:04.033712 (+ 95742us) log.cc:844] Serialized 14 byte log entry
0709 13:20:04.044237 (+ 10525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.044323 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:04.707969 (+663646us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:20:04.759719 (+ 51750us) raft_consensus.cc:1685] finished
0709 13:20:04.759745 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.759862 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36642,"prepare.queue_time_us":95525,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":18259,"raft.queue_time_us":48343,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":15649,"spinlock_wait_cycles":52593792,"thread_start_us":260920,"threads_started":1,"wal-append.queue_time_us":546434}
I20260709 13:20:04.764514 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:04.738072 25190 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 13:20:04.768210 25298 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:20:04.739225 24910 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:20:04.771103 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:04.775993 19580 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 15: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:04.766687 25188 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:04.784386 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:04.781054 19655 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:04.766142 25254 raft_consensus.cc:697] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:04.752664 24619 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.783574 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:04.783192 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:04.782816 19653 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:20:04.781101 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:04.781410 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:04.782032 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:04.792870 25200 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:20:04.793572 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:04.790828 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:04.790221 19585 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:04.791029 19580 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:20:04.796134 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:04.795698 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:04.797348 19503 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:04.797431 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:04.798246 19580 raft_consensus.cc:2393] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 18: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:04.799593 19627 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:04.803505 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:04.792143 19506 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:04.804176 19586 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:04.765865 24826 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:20:04.769975 25253 raft_consensus.cc:697] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:04.805430 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:04.807057 19657 raft_consensus.cc:2368] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12.
I20260709 13:20:04.779106 25105 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:04.805590 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:04.789402 25312 log.cc:927] Time spent T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.003s
I20260709 13:20:04.809224 19658 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:04.766068 25302 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:20:04.771899 25142 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:20:04.784689 24987 raft_consensus.cc:3055] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:04.815562 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:04.816740 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:04.822604 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:04.823539 19653 raft_consensus.cc:2410] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:20:04.818894 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:04.824508 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:04.817801 24803 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.833155 24803 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:04.833807 19652 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:04.819391 19627 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:04.838655 19506 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:20:04.818987 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:04.842185 19585 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.842482 19657 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:04.846352 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:04.844121 19658 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:04.806689 25200 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.850184 19586 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:04.808898 25096 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:04.813364 25146 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.818709 24987 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:04.854854 24910 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.839393 25194 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:04.798923 25271 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.901227 19503 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:04.933887 19585 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
W20260709 13:20:04.934911 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 44811.5us
I20260709 13:20:04.825692 25296 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:04.823665 25001 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.851541 25239 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:04.953809 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:04.941056 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:04.855310 25142 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:04.959570 19661 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:04.964047 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:04.933290 25194 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.897699 25096 raft_consensus.cc:697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:04.964720 19509 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.970312 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:05.007068 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:05.012864 19660 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:05.023320 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:04.855058 25200 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.027493 25315 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:05.028055 25306 log.cc:927] Time spent T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:20:05.030026 19510 raft_consensus.cc:2393] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:20:05.039258 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:05.040752 19505 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:20:05.042059 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:05.043495 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:04.936444 25146 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:04.937424 24910 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.970978 25142 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:04.964856 25112 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:04.984390 25137 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.958102 25239 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:04.951459 24803 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 13:20:05.063735 19625 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:05.070869 19509 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:05.071269 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:05.078076 19510 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:05.073683 19505 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:05.025820 25194 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:05.073902 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:05.074632 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
W20260709 13:20:05.099673 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 241199us
I20260709 13:20:05.102252 20665 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 19: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:20:05.064375 25142 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:05.076963 25239 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:04.959506 25254 consensus_queue.cc:237] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:04.971449 25253 consensus_queue.cc:237] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.131201 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:05.050474 25101 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:20:05.102548 25190 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:05.131940 19578 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.021245 24987 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:05.139554 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 390611us
I20260709 13:20:05.095753 25137 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.130193 24811 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:05.053508 25315 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:05.173846 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:05.178516 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:05.133819 25004 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:05.132527 24619 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:05.202788 19653 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
W20260709 13:20:05.217453 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 43720.9us
I20260709 13:20:05.151831 25190 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:05.221585 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 167710us
I20260709 13:20:05.224202 19625 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:05.131501 25096 consensus_queue.cc:237] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.204475 25004 raft_consensus.cc:697] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:05.235142 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 161227us
I20260709 13:20:05.204923 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:05.232000 19578 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:20:05.239830 19658 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:05.239885 19578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 2953) took 1498 ms (client timeout 1877 ms). Trace:
W20260709 13:20:05.240545 19578 rpcz_store.cc:269] 0709 13:20:03.741573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.756097 (+ 14524us) service_pool.cc:224] Handling call
0709 13:20:05.131006 (+1374909us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:20:05.239822 (+108816us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19583872}
I20260709 13:20:05.254180 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:05.228822 25271 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:05.245028 25322 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.244601 25329 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:05.283762 19658 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:05.293872 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:05.252954 25314 log.cc:927] Time spent T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:20:05.251586 25082 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:05.299770 25302 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:20:05.300499 25317 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:20:05.301697 25321 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.291147 25200 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:05.302387 25308 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.353s	user 0.000s	sys 0.001s
W20260709 13:20:05.303366 25316 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:20:05.308516 25323 log.cc:927] Time spent T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:20:05.265122 25282 consensus_meta.cc:287] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.619s	user 0.012s	sys 0.001s
I20260709 13:20:05.292026 25137 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:05.310343 25190 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:05.311851 25315 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:20:05.312482 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 44777.8us
W20260709 13:20:05.313020 25319 log.cc:927] Time spent T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:05.371495 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:05.316694 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:05.296581 19476 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:05.257712 25105 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:05.372797 19661 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:05.373168 25105 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:05.373770 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:05.374452 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:05.374933 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:05.375289 19512 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:05.261502 25101 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.255993 25318 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:05.302146 25311 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.328s	user 0.002s	sys 0.000s
I20260709 13:20:05.261333 25330 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:05.369313 25332 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.372716 19586 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:05.379503 19510 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:05.297287 19658 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:20:05.384271 19625 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:05.354293 25146 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:05.407230 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:05.359270 25004 consensus_queue.cc:237] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.405548 24910 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:05.409790 19508 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:05.298660 25322 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:05.386646 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 90162.4us
I20260709 13:20:05.406893 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:05.389111 25332 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.402431 25005 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:05.366079 25302 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:20:05.404552 20631 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 1.559s (SENT)
I20260709 13:20:05.406539 25137 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:05.406847 19654 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:05.319759 25329 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.407871 20659 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:05.397998 25148 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:05.418311 19586 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:05.419795 19661 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:05.436362 19509 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:05.349908 25082 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.439190 19658 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:05.463477 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:05.463663 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:05.464184 19510 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 19.
I20260709 13:20:05.464291 19658 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:05.455814 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:05.460793 19397 catalog_manager.cc:5028] TS 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): tablet 6eb38e2ac9064d3286fe2f20aeb2381c (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
I20260709 13:20:05.414790 24619 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:05.467555 19661 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:05.468189 19476 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:05.483270 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:05.454720 25137 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:05.495064 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 110871us
I20260709 13:20:05.390902 25101 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.368084 25282 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.500547 19625 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:05.355854 25321 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.438818 25239 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.511710 19476 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:05.515975 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:05.489039 25148 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:05.435068 25105 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.434585 25318 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.497591 25315 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.519846 19625 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:05.478335 25313 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:20:05.499006 24619 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:05.537885 25330 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:05.514572 25246 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:20:05.579926 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 175371us
I20260709 13:20:05.548705 19511 raft_consensus.cc:2393] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 18: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:05.549259 19582 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:05.510301 25137 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:05.548772 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 66423.7us
I20260709 13:20:05.571019 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:05.491637 25331 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:20:05.543562 25148 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.545861 25052 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:05.581875 20631 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:05.557773 25253 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:05.609853 25081 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:05.611693 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2955) took 1861 ms. Trace:
I20260709 13:20:05.544304 25256 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:20:05.585603 25296 raft_consensus.cc:3055] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:05.613670 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:05.579789 25246 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.615101 19587 rpcz_store.cc:276] 0709 13:20:03.750295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.165956 (+415661us) service_pool.cc:224] Handling call
0709 13:20:04.234952 (+ 68996us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:04.247928 (+ 12976us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:04.321905 (+ 73977us) log.cc:844] Serialized 14 byte log entry
0709 13:20:04.692952 (+371047us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b18000ec6e0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa23a 00007f6c31764a2a
0709 13:20:04.757357 (+ 64405us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:04.757846 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:20:04.765045 (+  7199us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:04.765230 (+   185us) log.cc:844] Serialized 14 byte log entry
0709 13:20:04.765415 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.765497 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:05.611429 (+845932us) raft_consensus.cc:1685] finished
0709 13:20:05.611460 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.611611 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12216,"prepare.queue_time_us":19826,"raft.queue_time_us":1701,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":21525,"spinlock_wait_cycles":13080448,"thread_start_us":63660,"threads_started":1,"wal-append.queue_time_us":484086}
I20260709 13:20:05.600838 25052 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.601001 25148 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:05.642504 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:05.645036 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:05.651558 19503 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:05.571980 25315 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:05.660099 25345 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:20:05.659849 25358 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:05.660818 19509 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:20:05.661221 19509 pending_rounds.cc:85] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 10
I20260709 13:20:05.655553 25338 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:05.641757 25246 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:05.655877 25347 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.694303 25347 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.556779 25302 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:05.696981 25338 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.698140 25318 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:05.656821 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:05.700089 25332 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:05.657738 25334 log.cc:927] Time spent T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:05.657115 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:05.658236 25256 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:05.658519 25352 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:05.637467 25296 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:05.661586 19509 pending_rounds.cc:107] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:20:05.603368 25032 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:20:05.659734 25354 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:20:05.656853 25333 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:05.695210 25341 log.cc:927] Time spent T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 13:20:05.658430 25335 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:20:05.650724 25052 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:05.661749 25194 consensus_meta.cc:287] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.553s	user 0.012s	sys 0.000s
I20260709 13:20:05.709157 19509 raft_consensus.cc:2889] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:05.702832 19504 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:05.719907 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:05.643864 25250 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:20:05.716499 25096 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:05.665107 24619 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.722312 25333 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:05.824293 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 184841us
W20260709 13:20:05.790867 25260 consensus_meta.cc:287] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 1.080s	user 0.015s	sys 0.000s
I20260709 13:20:05.808010 25258 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:05.761911 25090 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:05.762379 25282 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:05.806522 25342 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:05.787930 25322 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:05.754441 25082 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:05.738181 25194 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.774992 25354 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:05.833091 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 222388us
I20260709 13:20:05.851671 19657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:20:05.852268 19657 raft_consensus.cc:606] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:05.852568 19657 raft_consensus.cc:614] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:20:05.829819 25142 consensus_meta.cc:287] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.703s	user 0.013s	sys 0.000s
I20260709 13:20:05.766785 25096 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.778474 25246 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:05.859005 19625 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:05.891928 20619 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:05.859515 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:05.893793 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 312051us
I20260709 13:20:05.898923 25355 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:05.899641 25355 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.901278 25328 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:05.902009 25328 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.903049 25363 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:05.903539 25363 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.903936 25363 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:05.905864 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3275) took 1055 ms. Trace:
I20260709 13:20:05.906445 19583 rpcz_store.cc:276] 0709 13:20:04.850233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.380229 (+529996us) service_pool.cc:224] Handling call
0709 13:20:05.380586 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:05.426373 (+ 45787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:05.426419 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:05.439242 (+ 12823us) log.cc:844] Serialized 26 byte log entry
0709 13:20:05.723591 (+284349us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:05.723676 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.723919 (+   243us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:05.905516 (+181597us) raft_consensus.cc:1685] finished
0709 13:20:05.905547 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.905789 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45107,"raft.queue_time_us":87001,"spinlock_wait_cycles":16542976,"thread_start_us":225662,"threads_started":1,"wal-append.queue_time_us":378170}
I20260709 13:20:05.909024 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:05.850780 25032 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:05.819774 25296 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.850708 25258 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:20:05.918905 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 59997.4us
I20260709 13:20:05.920706 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:05.921435 19580 raft_consensus.cc:2368] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for earlier term 19. Current term is 20.
I20260709 13:20:05.832321 25260 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.920068 25005 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:05.928128 25296 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:05.928303 25332 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.925500 25329 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:05.860831 25142 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.854703 25354 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.959149 25364 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:05.960772 25137 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.967151 19506 raft_consensus.cc:2368] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16.
I20260709 13:20:05.880052 25342 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:05.999967 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 79343.6us
I20260709 13:20:05.916800 25032 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:05.930557 25258 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:06.128281 25372 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:20:06.131762 25342 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.137373 25089 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.138113 25089 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.138566 25194 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.141996 25258 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.146301 25260 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.147096 25032 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:06.147503 25369 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:06.148131 25369 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:06.148576 25369 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:06.155140 25005 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:06.157298 25364 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.163777 25368 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:06.164601 25368 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.116009 19625 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:06.189291 19586 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:20:06.290285 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 174390us
W20260709 13:20:06.398386 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 106806us
I20260709 13:20:06.432919 25374 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.433899 25374 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.436980 25374 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.448007 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:06.448937 19504 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:06.105496 25332 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:06.393121 25194 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:06.409897 25090 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:20:06.482195 19626 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.005s	sys 0.024s
W20260709 13:20:06.482596 19626 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.005s	sys 0.024s
I20260709 13:20:06.488493 19582 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:20:06.473434 25372 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:20:06.494668 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:06.485688 25148 consensus_meta.cc:287] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.818s	user 0.007s	sys 0.006s
I20260709 13:20:06.473606 25333 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.475730 25366 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:06.501737 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:06.503191 19582 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:06.504443 19652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3060) took 2583 ms. Trace:
I20260709 13:20:06.504674 25364 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:06.505014 19652 rpcz_store.cc:276] 0709 13:20:03.921225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.119413 (+198188us) service_pool.cc:224] Handling call
0709 13:20:04.119642 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.834338 (+714696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.504189 (+1669851us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b5400023ad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:06.504367 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1642050432}
W20260709 13:20:06.486289 24491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.015s	sys 0.015s
I20260709 13:20:06.474177 25090 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.516157 25090 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:06.514385 25200 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:06.517357 25200 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.524286 25089 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:06.526757 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 3603) took 1554 ms. Trace:
I20260709 13:20:06.527199 19506 rpcz_store.cc:276] 0709 13:20:04.971916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.010785 (+ 38869us) service_pool.cc:224] Handling call
0709 13:20:06.526486 (+1515701us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b5400208ad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:06.526662 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2164395776}
I20260709 13:20:06.528508 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:06.530822 25137 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:06.535176 25052 consensus_meta.cc:287] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.798s	user 0.010s	sys 0.000s
I20260709 13:20:06.495826 25340 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:06.476480 25194 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.515012 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3272) took 1789 ms. Trace:
W20260709 13:20:06.536974 25296 consensus_meta.cc:287] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.000s
I20260709 13:20:06.511159 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:06.539085 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:06.539496 24491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.015s	sys 0.015s
I20260709 13:20:06.551330 19578 rpcz_store.cc:276] 0709 13:20:04.725233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.292371 (+567138us) service_pool.cc:224] Handling call
0709 13:20:05.300756 (+  8385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:05.301142 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:05.301177 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:05.802914 (+501737us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b2c0002d418. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:20:05.803499 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:20:05.804759 (+  1260us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b4800222258. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c36683aa1 00007f6c3667ab37 00007f6c3667a9ca 00007f6c3677226f 00007f6c36771f37 00007f6c3678655c 00007f6c36786508 00007f6c36786488 00007f6c36786443 00007f6c367856ec 00007f6c356afa96
0709 13:20:05.926461 (+121702us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:06.397329 (+470868us) log.cc:844] Serialized 14 byte log entry
0709 13:20:06.514212 (+116883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.514511 (+   299us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:06.514688 (+   177us) raft_consensus.cc:1685] finished
0709 13:20:06.514714 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:06.514930 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27525,"prepare.queue_time_us":188278,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":156006,"raft.run_cpu_time_us":1606,"raft.run_wall_time_us":420025,"spinlock_wait_cycles":106013824,"thread_start_us":663728,"threads_started":3,"wal-append.queue_time_us":155381}
I20260709 13:20:06.521410 25200 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.564133 25354 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.565691 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:06.558025 25367 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:20:06.547467 25089 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.556421 19506 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:06.500388 25148 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.561843 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:06.562711 25368 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.556316 19582 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:20:06.573139 20659 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:20:06.566493 19578 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:06.506940 25366 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.568370 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:06.570891 25089 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:06.583830 19652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:20:06.584952 19652 raft_consensus.cc:606] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:06.585421 19652 raft_consensus.cc:614] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:06.560452 24987 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:06.589198 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:06.576331 25363 consensus_meta.cc:287] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.672s	user 0.012s	sys 0.000s
I20260709 13:20:06.593228 19510 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 18: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:06.594440 19582 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 18: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:06.601817 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:06.601926 19652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:20:06.602802 19652 raft_consensus.cc:606] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:06.603287 19652 raft_consensus.cc:614] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:06.611073 20659 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:06.612218 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:06.549146 25052 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.613554 19656 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:06.614243 19506 raft_consensus.cc:2368] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15.
I20260709 13:20:06.617352 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:06.596299 25354 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:06.567705 25340 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.598227 25368 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:06.633520 25148 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.646351 25090 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.646795 19656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db4589d6497c49308384eacc43241a32"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:20:06.647235 25089 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:06.647518 19656 raft_consensus.cc:606] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:06.647955 19656 raft_consensus.cc:614] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:06.632181 25368 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.629143 25330 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:06.660864 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 48309.6us
I20260709 13:20:06.595633 25363 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:06.670665 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:06.629662 25354 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.672892 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:06.651203 25090 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:06.639503 25332 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:06.645193 25098 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:06.694582 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:06.695341 19587 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:06.680505 25200 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:06.705487 25384 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.706403 25200 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.706903 25052 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.673538 25354 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.709818 25366 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:06.706624 25384 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.706643 25194 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.718175 19504 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:20:06.719507 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 78602.2us
I20260709 13:20:06.708639 25386 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:06.690856 25098 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.734927 19587 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:06.746034 25368 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.750738 25200 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.751350 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:06.752571 19587 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 11.
I20260709 13:20:06.724864 25340 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.754256 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:06.755086 25384 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.755090 25098 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:06.756053 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:06.757576 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:06.758368 19587 raft_consensus.cc:2393] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 18: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:06.680684 25330 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.723759 25386 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.762045 25315 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.769570 19579 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:06.812222 19587 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:20:06.812722 19587 pending_rounds.cc:85] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 9
I20260709 13:20:06.812949 19587 pending_rounds.cc:107] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:20:06.813179 19587 raft_consensus.cc:2889] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:06.767382 25315 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:06.766348 25363 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:06.818545 25355 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:06.819278 25344 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 1.042s	user 0.000s	sys 0.026s
W20260709 13:20:06.824314 19511 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 2555) took 2041 ms (client timeout 1716 ms). Trace:
I20260709 13:20:06.826884 19579 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:20:06.826467 19511 rpcz_store.cc:269] 0709 13:20:04.783175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.783331 (+   156us) service_pool.cc:224] Handling call
0709 13:20:06.824068 (+2040737us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b54000749d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:06.824230 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1740721536}
I20260709 13:20:06.828866 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:06.829511 19511 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:06.830286 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:06.833113 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:06.816664 25142 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:06.834390 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:06.837190 25330 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:06.840395 19511 raft_consensus.cc:2368] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16.
I20260709 13:20:06.816779 25315 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.841655 25330 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:06.848620 25330 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:06.842502 25346 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 1.294s	user 0.002s	sys 0.009s
I20260709 13:20:06.842724 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:06.839303 25386 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:06.845841 25239 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.847288 25355 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.852648 25355 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.850907 25142 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:06.856330 25330 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:06.856120 25142 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.855268 25355 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:06.857813 25369 consensus_meta.cc:287] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.709s	user 0.010s	sys 0.004s
W20260709 13:20:06.833779 25395 log.cc:927] Time spent T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:20:06.858645 25315 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.860445 25142 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:06.860678 25321 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.867368 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:06.866468 25369 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.871105 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:06.875315 25347 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.876922 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:06.879343 25321 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:06.884974 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:06.885593 19507 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:06.886855 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:06.889055 25105 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:06.887311 25321 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:06.891461 25338 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.892612 25321 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:06.893887 25369 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:06.898059 19511 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:20:06.900525 19511 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:20:06.908874 20665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59444 (request call id 210) took 1834 ms (client timeout 1856 ms). Trace:
I20260709 13:20:06.911327 19582 raft_consensus.cc:2410] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:20:06.914860 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3071) took 2454 ms. Trace:
W20260709 13:20:06.915764 20665 rpcz_store.cc:269] 0709 13:20:05.074041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.074269 (+   228us) service_pool.cc:224] Handling call
0709 13:20:06.908457 (+1834188us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b5400018454. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:06.908737 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10244480}
I20260709 13:20:06.915309 19659 rpcz_store.cc:276] 0709 13:20:04.460124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.462281 (+  2157us) service_pool.cc:224] Handling call
0709 13:20:04.462613 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:04.484029 (+ 21416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:04.484059 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:04.484660 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 13:20:04.643647 (+158987us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:04.643696 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.914423 (+2270727us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b5400103954. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:06.914473 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:06.914519 (+    46us) raft_consensus.cc:1685] finished
0709 13:20:06.914532 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:06.914788 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1963,"raft.queue_time_us":6686,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":6093,"spinlock_wait_cycles":48313728,"thread_start_us":76257,"threads_started":1,"wal-append.queue_time_us":212067,"wal-append.run_cpu_time_us":4021,"wal-append.run_wall_time_us":1718044}
I20260709 13:20:06.927253 19507 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:06.924175 24983 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.004652 20666 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:06.924455 24803 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:07.007910 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:06.918562 25105 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:06.929654 25321 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:07.021880 25006 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:07.024833 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3076) took 2466 ms. Trace:
I20260709 13:20:07.025388 19660 rpcz_store.cc:276] 0709 13:20:04.557967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.558183 (+   216us) service_pool.cc:224] Handling call
0709 13:20:04.558547 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.022197 (+463650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.024523 (+2002326us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54001ecb54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:07.024763 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044274048}
I20260709 13:20:07.024966 25006 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:07.026966 25350 log.cc:927] Time spent T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 1.267s	user 0.000s	sys 0.013s
I20260709 13:20:07.028220 25006 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:07.030321 25236 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.030546 25001 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:07.030984 25236 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.022375 24803 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.041332 25236 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:07.039649 25001 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:07.043761 25001 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.046321 24803 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:07.029335 25105 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.048983 25105 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:07.049180 25096 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:07.032986 25321 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:07.050981 25382 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.563s	user 0.004s	sys 0.000s
I20260709 13:20:07.051199 25246 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:07.035154 25253 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:07.067795 25001 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:07.016322 24983 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.039260 25328 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:07.071988 24983 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:07.075429 19580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35102 (request call id 515) took 1550 ms (client timeout 1526 ms). Trace:
W20260709 13:20:07.075902 19580 rpcz_store.cc:269] 0709 13:20:05.525051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.570723 (+ 45672us) service_pool.cc:224] Handling call
0709 13:20:07.075208 (+1504485us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54002fc454. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:07.075354 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":770545024}
W20260709 13:20:07.086225 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 63056.5us
I20260709 13:20:07.087605 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:07.078523 25101 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:07.091517 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:07.092736 19584 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:07.066850 25253 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.095783 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:07.097771 19587 raft_consensus.cc:2393] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:07.096282 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:07.099025 19579 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:07.096896 25101 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:07.100486 25101 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.101166 25321 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:07.103219 25101 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:07.104388 25398 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:20:07.105772 25376 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:07.106395 25376 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:07.107971 25253 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:07.108798 25376 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:20:07.110049 19653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 3088) took 1964 ms (client timeout 1871 ms). Trace:
W20260709 13:20:07.110466 19653 rpcz_store.cc:269] 0709 13:20:05.145421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.145730 (+   309us) service_pool.cc:224] Handling call
0709 13:20:07.109823 (+1964093us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b54001ebc54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:07.109946 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53639552}
I20260709 13:20:07.096087 19584 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:07.115980 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3621) took 1260 ms. Trace:
I20260709 13:20:07.116569 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3246) took 3562 ms. Trace:
I20260709 13:20:07.120393 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:07.117079 19581 rpcz_store.cc:276] 0709 13:20:03.556300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.556412 (+   112us) service_pool.cc:224] Handling call
0709 13:20:03.608157 (+ 51745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.790836 (+182679us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:04.044608 (+253772us) log.cc:844] Serialized 14 byte log entry
0709 13:20:04.361033 (+316425us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:04.361106 (+    73us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:04.364005 (+  2899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.478392 (+1114387us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b18001a9320. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e63b2a6 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419
0709 13:20:07.116315 (+1637923us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b5400246b54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:07.116364 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.116487 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28623,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":2253,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":3597,"spinlock_wait_cycles":425343616,"thread_start_us":549900,"threads_started":2,"wal-append.queue_time_us":470232,"wal-append.run_cpu_time_us":2017,"wal-append.run_wall_time_us":1106085}
I20260709 13:20:07.116437 19509 rpcz_store.cc:276] 0709 13:20:05.855967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.856095 (+   128us) service_pool.cc:224] Handling call
0709 13:20:05.856391 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:05.858042 (+  1651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:05.858072 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:06.873199 (+1015127us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b2c00000c88. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:20:06.882267 (+  9068us) log.cc:844] Serialized 26 byte log entry
0709 13:20:07.034298 (+152031us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:07.034347 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.034498 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:07.115652 (+ 81154us) raft_consensus.cc:1685] finished
0709 13:20:07.115674 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.115916 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3567,"raft.queue_time_us":1913,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":22777,"spinlock_wait_cycles":26208512,"thread_start_us":144893,"threads_started":1,"wal-append.queue_time_us":204197}
I20260709 13:20:07.123901 19583 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:20:07.119879 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3288) took 1153 ms. Trace:
I20260709 13:20:07.124723 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.127194 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.127524 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2565) took 1472 ms. Trace:
I20260709 13:20:07.127980 19660 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 17: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:07.109460 25376 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:07.128928 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:07.129554 19659 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:07.128938 25376 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:07.130544 25392 log.cc:927] Time spent T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.422s	user 0.002s	sys 0.000s
I20260709 13:20:07.127912 19503 rpcz_store.cc:276] 0709 13:20:05.655029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.660712 (+  5683us) service_pool.cc:224] Handling call
0709 13:20:05.661098 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:05.701385 (+ 40287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:05.701418 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:05.701881 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:20:05.860054 (+158173us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:05.948501 (+ 88447us) log.cc:844] Serialized 14 byte log entry
0709 13:20:07.127206 (+1178705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.127291 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:07.127336 (+    45us) raft_consensus.cc:1685] finished
0709 13:20:07.127349 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.127470 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1213409,"prepare.queue_time_us":69651,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":53728,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5473,"thread_start_us":209864,"threads_started":2,"wal-append.queue_time_us":234282,"wal-append.run_cpu_time_us":24407,"wal-append.run_wall_time_us":1057215}
I20260709 13:20:07.125034 19586 rpcz_store.cc:276] 0709 13:20:05.966511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.132675 (+166164us) service_pool.cc:224] Handling call
0709 13:20:06.132967 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:06.190023 (+ 57056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.119548 (+929525us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b54002fce54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:07.119795 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128339328}
I20260709 13:20:07.132346 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:07.134032 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.134850 19660 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:07.134961 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.136329 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.137089 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.137936 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.138283 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.138850 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.138959 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.138295 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.139891 19660 raft_consensus.cc:2393] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 15: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:07.141310 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:07.142081 19503 raft_consensus.cc:2368] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19.
W20260709 13:20:07.142495 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.142854 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.143136 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.143537 19652 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:20:07.140487 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.144822 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.142526 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.145609 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.145666 19503 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:07.146227 19653 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:07.148455 19654 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 24: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:07.148360 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.151687 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:07.147352 25101 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:07.199576 25282 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.487460 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:07.495522 25101 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.495986 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.161345 25259 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.335s
I20260709 13:20:07.496325 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.244194 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.496712 19656 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:20:07.372552 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3604) took 2360 ms. Trace:
I20260709 13:20:07.228617 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.497241 19655 raft_consensus.cc:2410] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:20:07.487025 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:07.488281 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 327871us
W20260709 13:20:07.419473 19510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 2567) took 1703 ms (client timeout 1542 ms). Trace:
I20260709 13:20:07.157758 19625 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:07.169984 19581 raft_consensus.cc:2393] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 18: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:07.496433 19506 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:07.198419 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:07.163036 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.271835 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.148216 25188 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:07.303712 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 117413us
I20260709 13:20:07.487123 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.503508 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:07.184877 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.503660 19504 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:07.503878 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.140599 25081 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:07.504639 19655 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:07.215507 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:07.504387 19660 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:07.154232 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.502601 19661 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:07.506752 19654 raft_consensus.cc:2393] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:07.497814 19505 rpcz_store.cc:276] 0709 13:20:05.011928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.101080 (+ 89152us) service_pool.cc:224] Handling call
0709 13:20:05.101458 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.247588 (+146130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:05.247635 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:05.247690 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:05.247737 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.372231 (+2124494us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54000ecc54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:07.372278 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.372448 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335490304}
I20260709 13:20:07.184569 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.508826 19657 raft_consensus.cc:2410] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:20:07.215662 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.509164 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:07.486860 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:07.509773 19653 raft_consensus.cc:2368] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19.
I20260709 13:20:07.509867 19583 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:07.500253 19510 rpcz_store.cc:269] 0709 13:20:05.715853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.716030 (+   177us) service_pool.cc:224] Handling call
0709 13:20:07.419171 (+1703141us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b54002085d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:07.419372 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1988272384}
I20260709 13:20:07.193193 19659 raft_consensus.cc:2410] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:20:07.502563 19478 connection.cc:256] RPC call timeout handler was delayed by -1.3928605490000336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
I20260709 13:20:07.509754 19581 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
W20260709 13:20:07.511492 19478 connection.cc:256] RPC call timeout handler was delayed by -1.3784605490000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 13:20:07.511996 25254 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:07.148609 25321 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:07.518009 19476 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:07.518386 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:07.512799 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 355178us
I20260709 13:20:07.513168 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:07.504652 19586 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 10.
I20260709 13:20:07.515138 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:07.519258 19652 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:20:07.155052 25180 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:07.520012 19581 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:07.522128 19625 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:07.499955 25137 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.502774 25271 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.161594 24983 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:07.154044 25001 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:07.157204 25190 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:07.516623 25236 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:07.163278 25052 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:07.526328 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:07.532305 19586 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:20:07.532563 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.527161 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.534456 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.528666 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.503397 25376 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:07.533404 19652 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:07.530364 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.530592 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:07.535324 19625 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:07.531334 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:07.535975 19654 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:07.518102 25246 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.537066 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:07.547817 19478 connection.cc:256] RPC call timeout handler was delayed by -1.0760605489999762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
I20260709 13:20:07.538641 19553 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:20:07.546607 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
W20260709 13:20:07.550544 19478 connection.cc:256] RPC call timeout handler was delayed by -1.0724605489999703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
I20260709 13:20:07.550571 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.551074 20666 raft_consensus.cc:2368] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20.
I20260709 13:20:07.199879 25328 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.326s
I20260709 13:20:07.553828 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.540150 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:07.551442 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:07.524976 25180 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:07.549307 19625 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:07.588691 25180 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.589742 19625 leader_election.cc:400] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16.
W20260709 13:20:07.590008 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.590104 19625 leader_election.cc:403] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:07.590405 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:07.591038 19658 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:07.554296 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:07.592737 19586 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:07.593824 25004 raft_consensus.cc:2764] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:07.531374 24983 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.594658 25004 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:20:07.595358 25258 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.595872 25258 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.535265 25001 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.550143 19510 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:07.599185 25001 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:07.535619 25190 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.600111 25180 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:07.556666 19478 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:07.601686 25190 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:07.602260 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45688.1us
I20260709 13:20:07.603050 19478 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:07.604111 25142 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:07.604804 19478 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:07.558670 19583 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:07.606101 25142 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:07.560130 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:07.607015 25260 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:07.607328 19503 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:07.608731 25260 raft_consensus.cc:2764] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:20:07.495550 25282 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:07.561575 25376 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:07.609826 25376 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.610221 25376 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:07.611086 25282 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:07.558952 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:07.611893 19580 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.602288 25190 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:07.555510 24907 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.565939 19657 raft_consensus.cc:2393] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 18: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:07.519888 25081 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:07.579461 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:07.589867 24987 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:07.567831 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.615320 19578 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:20:07.615509 24987 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:07.616084 24987 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:07.616322 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.615474 25258 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:07.527827 25186 consensus_queue.cc:1059] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:20:07.617589 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.618230 25186 raft_consensus.cc:3055] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:07.618618 25186 raft_consensus.cc:740] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:07.569682 25101 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:07.619891 25186 consensus_queue.cc:260] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.570859 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:07.570007 25246 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.546247 25052 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:07.578166 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:07.567857 25320 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:07.622726 19659 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:07.623009 25320 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:07.550676 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.579402 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.529847 24811 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:07.552760 25259 raft_consensus.cc:2764] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:20:07.623876 24811 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:07.536572 25236 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.624387 24811 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:07.523351 25321 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.537750 25342 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:07.531670 25137 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.626646 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.628154 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.620028 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.629873 25246 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:07.596174 24983 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:07.630352 25052 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:07.613919 24907 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.631022 25321 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:07.632690 24907 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:07.565982 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:07.633416 19579 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:07.633808 25137 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:07.634457 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:07.634624 19504 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:20:07.635082 19579 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:07.635605 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.636233 19504 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:20:07.636425 24987 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.637068 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.616271 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:07.587232 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:07.620965 19581 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:07.637951 19578 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:20:07.568173 25338 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:07.638839 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:07.623888 25320 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:07.587671 25296 raft_consensus.cc:3055] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:07.639655 19510 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:07.639912 25296 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:07.640347 19581 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:07.640551 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:07.641156 19510 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:07.640766 25296 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.531894 25271 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.660702 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.664706 19659 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:20:07.642508 25236 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:07.643356 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.606353 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:07.645570 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.638841 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:07.709643 19583 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:07.709885 19578 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:07.646783 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.710451 19506 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:07.597296 19627 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:07.711318 19511 raft_consensus.cc:2393] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 19: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:07.652311 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:07.629405 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.655189 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.659171 19586 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:07.509439 25188 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.680191 25137 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:07.681380 25258 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:07.681732 25271 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:07.682585 25296 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:07.683024 24907 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:07.687414 24811 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.645896 19625 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:07.689246 19510 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 20.
I20260709 13:20:07.689739 25321 raft_consensus.cc:3055] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:07.691156 25004 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16.
I20260709 13:20:07.691040 19478 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:07.732828 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.691710 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.733448 19512 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:07.660992 25186 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:07.694052 19661 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:07.695031 24987 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:07.696918 25376 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.702986 25081 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:07.705965 19580 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 12.
I20260709 13:20:07.707021 19579 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:07.739989 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.741751 19587 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:07.707265 19503 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:07.743085 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.744138 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.744834 19503 raft_consensus.cc:2410] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:20:07.712332 19658 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:07.746461 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.747642 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.748795 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:07.713459 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.750801 19505 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:07.716241 20631 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:07.718397 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.719340 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.757840 19652 raft_consensus.cc:2368] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19.
I20260709 13:20:07.758291 19478 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:07.755682 19656 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:07.721103 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:07.726154 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:07.726312 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 80495.7us
I20260709 13:20:07.726990 20619 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf
W20260709 13:20:07.727557 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 130336us
I20260709 13:20:07.729049 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.761468 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:07.734189 19476 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:07.737404 19660 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 20: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:07.728688 25321 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:07.773195 19625 leader_election.cc:400] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15.
I20260709 13:20:07.773579 19625 leader_election.cc:403] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:20:07.774449 19506 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:20:07.762329 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.730580 25366 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:07.763412 19478 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:07.745565 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:07.738837 25214 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.018s	sys 0.032s
W20260709 13:20:07.770855 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 43960.4us
I20260709 13:20:07.763214 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.774611 19656 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:07.731731 25253 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:07.778373 19478 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:07.787173 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:07.756372 24987 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:20:07.777302 25001 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:20:07.791985 24987 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:07.772619 25190 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:07.782784 25214 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.019s	sys 0.032s
I20260709 13:20:07.792897 25188 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:07.793715 25180 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:07.794148 25180 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:07.794512 25180 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.763371 25262 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:07.804884 19476 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:07.778820 25267 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:07.777590 25256 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:07.779225 24619 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:07.772765 25259 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:20:07.783370 25253 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:07.807634 25032 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15.
I20260709 13:20:07.825379 24811 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:07.788967 25271 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:20:07.830919 19476 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:07.846078 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:07.834904 25253 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:07.829586 25267 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:07.811098 25260 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:07.840620 24619 raft_consensus.cc:697] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:07.811903 25146 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:20:07.840453 25256 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 20 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:07.941876 19476 leader_election.cc:400] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19.
I20260709 13:20:07.942286 19476 leader_election.cc:403] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:07.947263 19476 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:07.944859 25260 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:07.927198 25081 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:07.829275 25321 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:07.953688 25081 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:07.956660 24987 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:20:07.967801 25081 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:07.973043 25406 log.cc:927] Time spent T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:20:07.976715 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3627) took 1570 ms. Trace:
I20260709 13:20:08.005996 19508 rpcz_store.cc:276] 0709 13:20:06.406867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.478290 (+ 71423us) service_pool.cc:224] Handling call
0709 13:20:06.491381 (+ 13091us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:07.149396 (+658015us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:07.149428 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:07.149924 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:20:07.519290 (+369366us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:07.519359 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.519465 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:07.976458 (+456993us) raft_consensus.cc:1685] finished
0709 13:20:07.976486 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.976644 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":701210,"raft.queue_time_us":660785,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":88,"thread_start_us":368911,"threads_started":1,"wal-append.queue_time_us":808090}
I20260709 13:20:07.966306 24907 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:08.018697 19551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.000s
I20260709 13:20:07.971470 25376 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:08.019189 19551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.008s	sys 0.000s
W20260709 13:20:08.022274 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 518839us
I20260709 13:20:08.023309 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:08.025835 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:08.002876 25148 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.000s	sys 0.008s
I20260709 13:20:07.950920 25260 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:07.968631 25190 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
W20260709 13:20:08.062594 24491 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.003s	sys 0.007s
I20260709 13:20:08.031284 25188 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:08.031509 25032 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.048923 19654 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:07.997771 25267 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:08.010782 24619 consensus_queue.cc:237] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:08.061479 19553 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.007s	sys 0.004s
W20260709 13:20:08.106853 19553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.007s	sys 0.004s
W20260709 13:20:08.063176 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 284854us
I20260709 13:20:08.028395 25256 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:08.048264 25180 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:08.055512 24826 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.000s	sys 0.012s
W20260709 13:20:08.108069 19509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.007s	sys 0.007s
W20260709 13:20:08.101577 25148 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.000s	sys 0.009s
W20260709 13:20:08.036072 19582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.006s	sys 0.003s
W20260709 13:20:08.103286 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 77532.6us
W20260709 13:20:08.070767 25404 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:20:08.132004 19551 leader_election.cc:400] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12.
I20260709 13:20:08.132953 19551 leader_election.cc:403] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:20:08.133729 19582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.006s	sys 0.003s
I20260709 13:20:08.107141 25320 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:08.134487 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3290) took 1045 ms. Trace:
I20260709 13:20:08.146311 19551 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:08.078055 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 302520us
W20260709 13:20:08.082119 25407 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.125s	user 0.001s	sys 0.001s
I20260709 13:20:08.139629 19582 rpcz_store.cc:276] 0709 13:20:07.088656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.088828 (+   172us) service_pool.cc:224] Handling call
0709 13:20:07.090228 (+  1400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:07.090520 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:07.099924 (+  9404us) log.cc:844] Serialized 14 byte log entry
0709 13:20:07.157285 (+ 57361us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b1800402940. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e63b2a6 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9
0709 13:20:08.134149 (+976864us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:08.134202 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:08.134244 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:08.134306 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:08.134430 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85077,"prepare.queue_time_us":9269,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":90930,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3795,"spinlock_wait_cycles":3816832,"thread_start_us":884472,"threads_started":2,"wal-append.queue_time_us":830848}
W20260709 13:20:08.075920 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 302849us
W20260709 13:20:08.108770 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 553186us
I20260709 13:20:08.110738 19478 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:08.103202 24491 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.004s	sys 0.008s
I20260709 13:20:08.100991 25366 raft_consensus.cc:697] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:08.118547 19509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.007s	sys 0.008s
W20260709 13:20:08.116710 24826 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.000s	sys 0.012s
I20260709 13:20:08.156291 19627 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:08.178848 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.194101 19627 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:08.107491 25032 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:08.197642 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 87016.6us
I20260709 13:20:08.198355 19478 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:08.181150 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:08.209388 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:08.217557 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:08.218312 19579 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:08.203279 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:20:08.219331 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:08.221776 19585 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:20:08.220045 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:08.173713 25188 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 11. Current term is 12.
I20260709 13:20:08.224089 19578 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:20:08.231889 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:08.232620 19583 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:08.200690 25052 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:08.247720 19627 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:08.253724 19627 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:08.222755 25186 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:08.272253 19627 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:08.276484 19627 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:08.178264 25254 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:20:08.223521 25236 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:08.274240 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2574) took 1121 ms. Trace:
I20260709 13:20:08.278460 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:08.282745 19627 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:08.284587 19507 rpcz_store.cc:276] 0709 13:20:07.152918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.153536 (+   618us) service_pool.cc:224] Handling call
0709 13:20:07.573392 (+419856us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:20:07.573659 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:07.573894 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:08.027830 (+453936us) log.cc:844] Serialized 14 byte log entry
0709 13:20:08.273848 (+246018us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:08.273924 (+    76us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:08.273983 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:08.274055 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:08.274184 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":362064,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":2841,"spinlock_wait_cycles":12181248,"thread_start_us":698372,"threads_started":2}
I20260709 13:20:08.250036 25006 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:08.254951 25188 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:08.225554 25214 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:20:08.226984 25282 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:20:08.277696 24811 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:08.274396 25148 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:08.279453 25369 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:08.286600 25004 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:08.286437 25142 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:08.286770 24589 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:20:08.305573 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 356364us
I20260709 13:20:08.244922 25366 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:08.291174 25006 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:08.290541 25137 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:08.298584 24811 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:08.301867 25369 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:08.304397 25004 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:08.336274 19625 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:08.310097 25142 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:08.339589 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:08.315821 24589 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:08.344960 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:08.345732 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:08.340274 19510 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:20:08.331813 24811 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:08.345095 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:08.323269 25006 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:08.340854 19625 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:20:08.319535 25137 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:08.355352 25415 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:08.355858 25137 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:08.356706 25425 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:08.357534 25425 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:08.357944 25425 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:08.358299 25425 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:08.351727 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:08.362036 25430 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:08.362308 19510 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:20:08.362756 25430 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:08.363289 25430 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:08.355024 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:08.368495 19625 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:08.334596 25369 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:08.321414 24983 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:20:08.371147 19507 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:08.341250 25004 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:08.342442 25142 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:08.335573 24619 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:08.343840 25254 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:08.367259 25414 log.cc:927] Time spent T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:20:08.399998 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 188869us
I20260709 13:20:08.365717 25427 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.347318 24589 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:08.402086 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 117820us
I20260709 13:20:08.407362 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:08.354218 25180 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:08.367609 25420 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:08.378499 25236 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:08.366936 25411 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.124s
I20260709 13:20:08.424310 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:08.417145 25412 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:08.366402 25426 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.193s
I20260709 13:20:08.427513 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:08.432703 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:08.419052 25376 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:08.435238 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:08.423391 25254 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:08.436916 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2576) took 1209 ms. Trace:
I20260709 13:20:08.404062 25081 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:08.440109 25338 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:08.405891 24619 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:08.441812 19507 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:08.441488 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:08.439394 19509 rpcz_store.cc:276] 0709 13:20:07.227961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.228215 (+   254us) service_pool.cc:224] Handling call
0709 13:20:07.242855 (+ 14640us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:07.510066 (+267211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:07.510095 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:07.510542 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:20:08.197828 (+687286us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:08.197867 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:08.197969 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:08.436675 (+238706us) raft_consensus.cc:1685] finished
0709 13:20:08.436696 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:08.436856 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":288830,"raft.queue_time_us":269556,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":3914,"thread_start_us":663740,"threads_started":1,"wal-append.queue_time_us":613460}
I20260709 13:20:08.428730 25412 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.454984 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:08.416510 25427 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:08.465377 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:08.477502 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:08.478940 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:08.483613 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:08.484860 19553 leader_election.cc:400] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Vote denied by peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615) with higher term. Message: Invalid argument: T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20.
I20260709 13:20:08.438800 25415 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:08.417958 25420 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:08.450673 25338 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.439224 25260 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:08.488435 19585 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:08.509886 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:08.494722 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:08.498478 25435 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:20:08.500739 24619 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:08.502089 25434 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:20:08.502700 25427 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:08.502965 25440 log.cc:927] Time spent T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:20:08.441788 25032 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:08.439831 25439 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:08.447690 25376 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:08.477229 25188 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:20:08.486070 25431 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:20:08.464296 25412 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:08.495460 25429 log.cc:927] Time spent T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:20:08.595691 25376 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:08.588299 25436 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:20:08.539961 19585 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:08.489971 25415 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.495672 25437 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:08.606189 25415 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:08.606401 25437 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:08.607424 25420 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:08.609200 25437 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:08.583679 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 173072us
I20260709 13:20:08.485895 25444 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:08.515105 25338 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:08.618294 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:08.588220 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:20:08.562825 25441 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:20:08.562072 25428 log.cc:927] Time spent T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.235s	user 0.000s	sys 0.007s
W20260709 13:20:08.634085 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.643404 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:08.654878 19510 raft_consensus.cc:1240] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:08.644070 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:08.644254 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 178948us
W20260709 13:20:08.694734 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 50763.6us
I20260709 13:20:08.694969 19551 leader_election.cc:400] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19.
I20260709 13:20:08.695376 19551 leader_election.cc:403] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:20:08.695564 19627 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:08.562821 25439 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:08.731756 25455 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:08.731891 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:08.732504 25455 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:08.733008 25455 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:08.733376 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:08.584777 25188 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:08.650554 25253 consensus_meta.cc:287] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.713s	user 0.006s	sys 0.007s
I20260709 13:20:08.744001 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:08.723263 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:08.622221 25444 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:08.749007 25444 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:08.490850 25236 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:08.535871 25260 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:08.741196 25254 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:20:08.756208 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 379353us
I20260709 13:20:08.762737 19625 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:08.764463 19625 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:08.739429 25439 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:08.748090 25188 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:08.768316 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:08.785979 19510 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:08.651345 25137 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:08.797837 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 102343us
I20260709 13:20:08.813683 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:08.816584 19510 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:08.818409 19627 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:08.822708 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:08.851552 19657 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:08.785496 25032 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:08.809307 25427 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:08.755523 25253 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:08.815548 25001 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:20:08.760015 25425 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:08.873224 25422 log.cc:927] Time spent T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.732s	user 0.006s	sys 0.002s
I20260709 13:20:08.870698 25321 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:08.890837 25457 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:20:08.876127 25411 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:09.051544 25411 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:09.052183 25411 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:08.877002 25456 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:09.053948 25456 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.054397 25456 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:08.891613 25452 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:08.866578 25455 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:08.861202 25458 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19.
W20260709 13:20:08.862833 24987 consensus_meta.cc:287] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.853s	user 0.007s	sys 0.006s
I20260709 13:20:09.057819 24987 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19.
I20260709 13:20:08.901685 24912 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:09.058557 24912 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:09.059368 24912 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.060348 24912 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:09.060735 25425 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:20:08.903118 25430 consensus_meta.cc:287] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.000s
I20260709 13:20:08.866428 25142 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:08.864868 24589 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:08.915736 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:08.924263 25137 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:08.926839 24907 consensus_meta.cc:287] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.909s	user 0.013s	sys 0.000s
I20260709 13:20:08.892231 25449 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:08.963673 25369 consensus_meta.cc:287] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.563s	user 0.005s	sys 0.004s
W20260709 13:20:08.968449 24811 consensus_meta.cc:287] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.000s
I20260709 13:20:09.014875 25427 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:08.976073 25004 consensus_meta.cc:287] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.572s	user 0.006s	sys 0.004s
W20260709 13:20:08.986102 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 252818us
I20260709 13:20:08.760923 25254 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:09.012861 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 190290us
I20260709 13:20:09.089967 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:09.091292 19553 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.003s	sys 0.019s
I20260709 13:20:09.092760 19627 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:09.030498 19409 catalog_manager.cc:5697] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 15 to 18, leader changed from 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 18 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:09.013067 25032 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.034133 25253 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:09.034801 19654 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:09.042308 25259 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:09.050642 25467 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:09.065199 19582 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:09.075500 19512 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:09.077405 19655 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: []
W20260709 13:20:08.968978 25006 consensus_meta.cc:287] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.579s	user 0.006s	sys 0.005s
I20260709 13:20:08.960841 25412 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.096103 19627 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:09.109366 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 378065us
I20260709 13:20:09.077466 24907 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:09.093091 19553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.003s	sys 0.019s
W20260709 13:20:09.106817 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 332466us
I20260709 13:20:09.065496 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:09.119303 19660 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:09.120728 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:09.121402 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:09.089941 25427 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:09.123980 19509 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:09.094341 25254 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:09.127307 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:09.087162 25449 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:09.129771 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:09.137244 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:09.131862 25467 raft_consensus.cc:697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:09.095201 25032 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:09.137662 19478 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.129279 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:09.105415 25458 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:09.140056 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:09.140458 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:09.105865 25455 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:09.078202 25430 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.112085 25137 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:09.142190 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:09.164530 19507 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:20:09.144245 19505 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23. Ops: []
W20260709 13:20:09.116987 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.147796 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:09.078747 25444 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.085078 25369 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.142764 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:09.170243 19506 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:09.170475 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:09.089676 24811 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.153373 19509 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:09.088644 25338 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.154479 19510 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:09.155889 19657 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:09.156945 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:09.159338 19478 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.087544 25415 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.128811 25001 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:09.182046 25001 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:09.168965 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:09.095896 25004 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.183301 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.181571 19508 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:09.118163 25006 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:09.114212 25259 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.186084 19584 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:09.246873 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:09.179172 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:09.186252 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:09.187026 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 52196.8us
I20260709 13:20:09.154124 25458 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:09.250530 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:09.233191 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:09.251968 19581 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:09.252286 19585 raft_consensus.cc:2393] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 15: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:09.234217 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:09.182590 25001 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:09.195668 19652 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:09.162328 24491 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:09.168176 25137 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:09.251353 19584 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:09.254791 19653 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:09.255471 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 128265us
W20260709 13:20:09.256238 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 73013.2us
W20260709 13:20:09.259002 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 145656us
I20260709 13:20:09.262276 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:09.263072 19658 raft_consensus.cc:1240] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:09.270823 19581 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:09.272253 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:09.273015 19581 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:09.263279 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:09.235186 24987 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:09.288650 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:09.275380 19657 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:09.262987 19584 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:09.278841 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.264667 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.293747 19627 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:09.297513 19478 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.302522 19478 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.261407 25137 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:09.256285 25458 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:09.309851 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 45973.4us
I20260709 13:20:09.311635 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.309191 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.315017 19551 leader_election.cc:400] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19.
I20260709 13:20:09.315961 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.317842 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.258186 25425 consensus_queue.cc:1059] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:20:09.319725 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:09.326367 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.321861 19581 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 12.
I20260709 13:20:09.324258 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:09.327353 19579 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:09.277951 25461 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:20:09.304589 25186 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:09.306442 24589 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:09.339880 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 46238.9us
I20260709 13:20:09.311755 24907 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:09.324270 25376 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:09.312752 25236 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:09.293781 25470 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:09.328080 25320 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:09.304993 25258 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:20:09.318305 25426 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:09.338197 19625 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:09.316161 25453 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:09.277477 25411 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.357941 19625 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:09.359390 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:09.364687 24589 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:09.346271 24983 consensus_queue.cc:1059] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:20:09.365272 24589 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.365763 24589 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:09.365850 25468 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:09.366411 25468 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:09.366675 25464 log.cc:927] Time spent T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:20:09.366967 25468 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:09.367498 25466 log.cc:927] Time spent T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 13:20:09.368976 25465 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:20:09.370126 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3663) took 1033 ms. Trace:
I20260709 13:20:09.371445 25411 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:09.370546 19511 rpcz_store.cc:276] 0709 13:20:08.337010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.337143 (+   133us) service_pool.cc:224] Handling call
0709 13:20:08.351085 (+ 13942us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:08.583053 (+231968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:08.583100 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:08.583716 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 13:20:08.983310 (+399594us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:08.983356 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:08.983427 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:09.369890 (+386463us) raft_consensus.cc:1685] finished
0709 13:20:09.369911 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.370064 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20596,"raft.queue_time_us":43533,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":66,"thread_start_us":455839,"threads_started":2,"wal-append.queue_time_us":416294}
I20260709 13:20:09.374078 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3334) took 1144 ms. Trace:
I20260709 13:20:09.374531 19587 rpcz_store.cc:276] 0709 13:20:08.250938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.252386 (+  1448us) service_pool.cc:224] Handling call
0709 13:20:08.276761 (+ 24375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:08.280187 (+  3426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:08.280231 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:08.285545 (+  5314us) log.cc:844] Serialized 52 byte log entry
0709 13:20:08.892396 (+606851us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b1800463fc0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa0d1 00007f6c31715a0f
0709 13:20:08.899712 (+  7316us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b4800222258. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c36683aa1 00007f6c3667ab37 00007f6c3667a9ca 00007f6c3677226f 00007f6c36771f37 00007f6c3678655c 00007f6c36786508 00007f6c36786488 00007f6c36786443 00007f6c367856ec 00007f6c356afa96
0709 13:20:09.153948 (+254236us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:09.301299 (+147351us) log.cc:844] Serialized 14 byte log entry
0709 13:20:09.301506 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.301579 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:09.373763 (+ 72184us) raft_consensus.cc:1685] finished
0709 13:20:09.373797 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.374013 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2901,"prepare.queue_time_us":219210,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":22649,"raft.run_cpu_time_us":16396,"raft.run_wall_time_us":600824,"spinlock_wait_cycles":17601152,"thread_start_us":373222,"threads_started":2,"wal-append.queue_time_us":1045697}
I20260709 13:20:09.376820 25444 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:09.362012 25453 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:09.378738 25453 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:09.376895 25254 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.340929 25142 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:09.356644 25445 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:09.382228 25445 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:09.382469 25430 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:09.382606 25445 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:09.383003 25254 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:09.384516 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.366467 25259 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:09.390986 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 71358.9us
I20260709 13:20:09.392338 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.334724 25463 raft_consensus.cc:2764] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:20:09.344944 24907 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:09.414672 24907 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:09.415422 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3138) took 1104 ms. Trace:
I20260709 13:20:09.415784 19654 rpcz_store.cc:276] 0709 13:20:08.310800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.325524 (+ 14724us) service_pool.cc:224] Handling call
0709 13:20:08.325964 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.094828 (+768864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.415176 (+320348us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b54003f3754. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:09.415338 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1629651200}
I20260709 13:20:09.420826 19510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:09.421478 19510 raft_consensus.cc:606] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:09.421977 19510 raft_consensus.cc:614] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:09.423360 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3141) took 1111 ms. Trace:
I20260709 13:20:09.423786 19655 rpcz_store.cc:276] 0709 13:20:08.311853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.314104 (+  2251us) service_pool.cc:224] Handling call
0709 13:20:08.314438 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.111734 (+797296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.423127 (+311393us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54002c88d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:09.423299 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754036480}
I20260709 13:20:09.391215 25376 raft_consensus.cc:697] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:09.426381 25376 consensus_queue.cc:237] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.426872 24811 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:09.398357 25469 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:20:09.393827 25411 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.403236 25006 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:09.404103 25260 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:09.405794 25426 raft_consensus.cc:697] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:09.406123 25004 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:09.407992 19586 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:20:09.293249 25449 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.438405 25032 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.452060 25032 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:09.452431 25369 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:09.410431 25142 raft_consensus.cc:3055] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:09.412322 25451 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:09.464298 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 3670) took 1045 ms. Trace:
I20260709 13:20:09.466094 19503 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:09.414171 25338 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:09.427872 19655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:20:09.472163 19652 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:20:09.394590 25188 consensus_meta.cc:287] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.002s
I20260709 13:20:09.439776 19586 pending_rounds.cc:85] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 13
I20260709 13:20:09.445408 25411 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.484083 19586 pending_rounds.cc:107] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:20:09.446777 25426 consensus_queue.cc:237] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.448016 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:09.438347 25258 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.449791 25296 consensus_queue.cc:1059] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:09.293179 25467 consensus_queue.cc:237] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:09.461447 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 97671.1us
I20260709 13:20:09.444229 25452 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:09.471067 25439 consensus_meta.cc:287] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.658s	user 0.008s	sys 0.005s
I20260709 13:20:09.469408 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.427726 25472 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:09.426469 25412 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:09.473244 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:09.474013 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:09.430533 25081 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:09.457844 25142 raft_consensus.cc:740] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:09.476805 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:09.484555 19586 raft_consensus.cc:2889] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:09.440322 25447 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:20:09.464931 19508 rpcz_store.cc:276] 0709 13:20:08.418632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.418813 (+   181us) service_pool.cc:224] Handling call
0709 13:20:09.464075 (+1045262us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b540012fa54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:09.464219 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1610813696}
I20260709 13:20:09.497970 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:09.509060 19585 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:09.476284 19658 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:09.499751 19653 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:09.499890 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.519752 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.477569 25463 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:09.528587 19476 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.502373 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:09.506613 19657 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:09.518111 19653 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:09.483357 19661 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:09.441926 25001 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.532706 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3338) took 1053 ms. Trace:
I20260709 13:20:09.533090 19578 rpcz_store.cc:276] 0709 13:20:08.479680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.481721 (+  2041us) service_pool.cc:224] Handling call
0709 13:20:08.482117 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:08.647854 (+165737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:08.647899 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:08.783502 (+135603us) log.cc:844] Serialized 26 byte log entry
0709 13:20:08.875885 (+ 92383us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b1800422e60. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d557 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:20:09.113540 (+237655us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:09.113592 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.113679 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:09.509673 (+395994us) raft_consensus.cc:1685] finished
0709 13:20:09.509717 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.532640 (+ 22923us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82574,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":36025,"spinlock_wait_cycles":7669888,"thread_start_us":430878,"threads_started":2,"wal-append.queue_time_us":348057}
I20260709 13:20:09.535605 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:09.530864 19652 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:09.462620 25432 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:20:09.534405 19478 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.540082 19661 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:09.496389 25452 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:09.531899 25473 consensus_queue.cc:1059] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:20:09.538128 19476 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.493995 25486 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.530709 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.546108 19653 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:09.548538 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:09.553943 19580 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.022s	sys 0.046s
I20260709 13:20:09.560513 19585 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:09.561311 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 521) took 1122 ms. Trace:
I20260709 13:20:09.500149 25258 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.504480 25444 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:09.501825 25439 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.492452 25188 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.581027 19582 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 18: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:09.561774 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:09.562407 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 74375us
I20260709 13:20:09.592471 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:09.599897 19585 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 18: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:09.561831 19580 rpcz_store.cc:276] 0709 13:20:08.438796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.438953 (+   157us) service_pool.cc:224] Handling call
0709 13:20:08.464905 (+ 25952us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:08.583410 (+118505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:08.583444 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:08.627149 (+ 43705us) log.cc:844] Serialized 26 byte log entry
0709 13:20:08.984464 (+357315us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:09.560654 (+576190us) log.cc:844] Serialized 14 byte log entry
0709 13:20:09.560975 (+   321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.561058 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:09.561098 (+    40us) raft_consensus.cc:1685] finished
0709 13:20:09.561110 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.561248 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":376196,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":49508,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":14485,"thread_start_us":896683,"threads_started":3,"wal-append.queue_time_us":371649}
I20260709 13:20:09.533104 25472 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:09.541056 25236 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:09.604053 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:09.601426 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:09.532835 25463 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:09.526374 25006 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:09.532079 25142 consensus_queue.cc:260] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.542743 25180 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:09.634505 19586 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 22: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:20:09.642189 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 80557us
I20260709 13:20:09.643354 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.539042 24912 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:20:09.651643 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.573726 25186 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:09.667680 19627 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:09.667920 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 133624us
I20260709 13:20:09.656224 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:09.539644 25470 consensus_queue.cc:1059] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:20:09.570065 25412 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:09.624264 25236 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:09.549063 25175 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.092s
I20260709 13:20:09.675845 19654 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:09.662792 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:09.678804 19580 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:09.544543 25468 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.626343 25463 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:09.562029 24589 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.613716 25259 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
W20260709 13:20:09.703226 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 51706.3us
I20260709 13:20:09.598958 25137 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.620901 25267 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:20:09.704352 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.572443 25486 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.562764 25453 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.636619 25282 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:20:09.621223 24491 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
W20260709 13:20:09.662472 25464 log.cc:927] Time spent T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:09.663257 25296 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.797567 25470 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:09.797493 25296 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.798046 25470 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:09.798961 25470 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.800007 25296 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:09.800315 25470 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:09.694211 25456 consensus_meta.cc:287] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.639s	user 0.013s	sys 0.000s
I20260709 13:20:09.801457 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:09.801757 25456 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.802134 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:09.802733 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:09.803920 25456 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:09.804040 25146 raft_consensus.cc:3055] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:09.690411 25321 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:09.804492 25146 raft_consensus.cc:740] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:09.804668 25321 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:09.805136 25321 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:09.716657 19478 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.798053 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:09.806095 25081 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:20:09.806241 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 89692.4us
I20260709 13:20:09.717253 25180 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.718218 25259 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:09.806439 25458 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.806681 25081 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:09.807083 25259 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:09.808126 25453 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:09.807922 25259 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.808766 25453 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:09.723218 25271 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:09.809187 25259 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:09.661980 25491 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:09.809476 25271 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:09.676503 25455 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:09.727065 25468 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:09.691553 24826 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:09.810901 24826 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:09.810549 25271 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.811301 24826 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:09.812338 24907 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.719835 25412 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:09.814013 25412 raft_consensus.cc:697] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:09.814431 25447 raft_consensus.cc:3055] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:09.814517 25180 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.814983 25447 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:09.815019 25412 consensus_queue.cc:237] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.816079 25447 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.727671 25175 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:09.817936 25175 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:09.819383 19578 raft_consensus.cc:2393] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 18: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:09.820286 25175 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:09.700088 25260 consensus_queue.cc:1059] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:20:09.727216 19580 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:09.715059 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.738998 25188 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:09.827373 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 112570us
I20260709 13:20:09.736796 25445 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.739567 25432 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:09.748651 24619 raft_consensus.cc:3055] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:09.750135 25411 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:09.754279 25439 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:09.755155 25320 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.755477 25001 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:09.692212 25451 consensus_queue.cc:1059] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:20:09.636492 25006 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:09.761549 25137 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:09.762151 19658 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:09.700116 25142 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:09.767992 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
W20260709 13:20:09.881668 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 113746us
W20260709 13:20:09.777935 25482 log.cc:927] Time spent T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 13:20:09.885903 25449 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:09.787829 25256 raft_consensus.cc:3055] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:09.788781 25420 raft_consensus.cc:3055] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:09.710088 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:09.863579 25473 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.806617 19585 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 19: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:09.807734 25081 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:09.808840 25415 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:09.718984 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.692376 25236 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:09.821096 19578 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:09.821321 19478 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:09.822781 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 196780us
I20260709 13:20:09.919013 19625 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:09.825327 19586 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:09.712899 25488 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:09.743671 24589 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:09.807763 25486 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:09.831351 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:09.831416 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:09.962592 19580 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 11.
I20260709 13:20:09.839262 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:09.809389 24987 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:09.817499 25447 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:09.824532 25453 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:09.832180 25491 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:09.863878 24491 raft_consensus.cc:3055] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:09.794234 24912 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:09.871897 25296 consensus_queue.cc:1059] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.136s
I20260709 13:20:09.952215 25001 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:09.805464 25146 consensus_queue.cc:260] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:10.054589 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:09.947467 19578 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:09.940469 19585 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:09.948163 25432 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:09.928197 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:09.975387 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:09.976982 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:09.950166 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:09.882593 25180 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:09.887645 25458 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:10.012045 25453 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:10.002727 19582 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:09.980769 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 149478us
I20260709 13:20:09.889194 25282 raft_consensus.cc:3055] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:10.002285 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:09.892594 25420 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:10.010995 20631 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
W20260709 13:20:10.086218 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 75335.6us
I20260709 13:20:09.883232 25320 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.017889 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:09.889550 25256 raft_consensus.cc:740] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:09.865427 24619 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:09.981137 25499 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:20:10.145032 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:10.070434 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:09.953940 25451 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:10.003165 25415 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:10.003845 24987 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:10.002161 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:09.938270 25473 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:10.076736 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 126644us
I20260709 13:20:10.083051 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:10.017791 24491 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:10.037729 24589 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.037405 25488 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:10.144819 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:10.172987 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2997) took 1003 ms. Trace:
I20260709 13:20:10.152030 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:10.156685 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:10.085377 25282 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:10.144553 25001 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:10.167770 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:10.055891 24912 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.142836 25175 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:10.181598 25175 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:10.182078 25175 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:10.185325 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2999) took 1015 ms. Trace:
I20260709 13:20:10.185801 19586 rpcz_store.cc:276] 0709 13:20:09.172333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.802988 (+630655us) service_pool.cc:224] Handling call
0709 13:20:09.825133 (+ 22145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.920105 (+ 94972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.185133 (+265028us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b540011e9d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:10.185261 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50230144}
I20260709 13:20:10.186544 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:10.187212 19511 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:10.143975 24907 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:10.171969 25415 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:10.169044 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.142302 25426 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:20:09.921484 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 104423us
I20260709 13:20:10.175199 25451 raft_consensus.cc:697] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:10.189915 25426 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.190873 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:10.191156 25471 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:10.175009 25511 raft_consensus.cc:3055] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:10.191912 25511 raft_consensus.cc:740] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:10.192152 25426 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:10.166874 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 83965.4us
I20260709 13:20:10.193250 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:10.193821 24619 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.194770 24907 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:10.154322 25366 raft_consensus.cc:3055] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:10.191782 25471 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.195195 24619 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:10.195263 25320 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:10.195593 25426 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:10.175961 19580 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 19: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:10.197659 25473 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:10.165203 25137 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.199014 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:10.194306 25296 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:10.198805 25137 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.200517 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:10.081110 25432 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.201372 19580 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:10.173436 19581 rpcz_store.cc:276] 0709 13:20:09.169117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.329961 (+160844us) service_pool.cc:224] Handling call
0709 13:20:09.330221 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:09.546288 (+216067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.546333 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:09.546984 (+   651us) log.cc:844] Serialized 26 byte log entry
0709 13:20:09.666370 (+119386us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:09.745771 (+ 79401us) log.cc:844] Serialized 14 byte log entry
0709 13:20:09.746463 (+   692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.746572 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.172755 (+426183us) raft_consensus.cc:1685] finished
0709 13:20:10.172772 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.172902 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47729,"prepare.queue_time_us":78640,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":97964,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":40355,"thread_start_us":334462,"threads_started":2,"wal-append.queue_time_us":315846}
I20260709 13:20:10.187116 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:10.190795 25451 consensus_queue.cc:237] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.193018 25511 consensus_queue.cc:260] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.140985 25503 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:10.169581 25271 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.208657 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:10.215343 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3006) took 1039 ms. Trace:
I20260709 13:20:10.171170 25260 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:10.219588 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:10.229552 19581 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:20:10.230199 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3008) took 1053 ms. Trace:
I20260709 13:20:10.230492 19581 rpcz_store.cc:276] 0709 13:20:09.176637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.228973 (+1052336us) service_pool.cc:224] Handling call
0709 13:20:10.229331 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:10.229948 (+   617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.230136 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:10.231791 19581 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:20:10.232445 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3010) took 1055 ms. Trace:
I20260709 13:20:10.232750 19581 rpcz_store.cc:276] 0709 13:20:09.177332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.231246 (+1053914us) service_pool.cc:224] Handling call
0709 13:20:10.231561 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:10.232179 (+   618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.232391 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:10.235761 25452 consensus_meta.cc:287] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.000s
I20260709 13:20:10.236228 25452 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.237232 19659 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:10.240090 25427 consensus_meta.cc:287] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 1.092s	user 0.011s	sys 0.000s
I20260709 13:20:10.240518 25445 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:10.241300 25503 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:10.242298 25432 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:10.242415 24491 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.243625 24491 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:10.244688 25321 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.197121 25471 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:10.227129 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.244596 25282 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.179015 25488 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.217092 25296 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.247865 25458 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:10.224643 19580 rpcz_store.cc:276] 0709 13:20:09.175943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.200910 (+1024967us) service_pool.cc:224] Handling call
0709 13:20:10.201205 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.215063 (+ 13858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.215284 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:10.201864 25366 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:10.254390 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 60814.7us
I20260709 13:20:10.220419 25320 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:10.262362 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:10.258381 19581 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:10.264147 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3014) took 1085 ms. Trace:
I20260709 13:20:10.264595 19581 rpcz_store.cc:276] 0709 13:20:09.178603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.233473 (+1054870us) service_pool.cc:224] Handling call
0709 13:20:10.249050 (+ 15577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.263809 (+ 14759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.264076 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:10.254904 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:10.266168 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.175174 24589 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.251447 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:10.195290 24907 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.270206 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:10.273054 19580 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:10.219368 25186 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:20:10.203392 24987 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.172348 25420 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.279160 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3015) took 1088 ms. Trace:
I20260709 13:20:10.283775 19580 rpcz_store.cc:276] 0709 13:20:09.188811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.268357 (+1079546us) service_pool.cc:224] Handling call
0709 13:20:10.272590 (+  4233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.277054 (+  4464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.277272 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:10.284335 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:10.240587 25427 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.260170 25458 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:10.289557 19580 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:10.305912 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3016) took 1116 ms. Trace:
I20260709 13:20:10.222337 24826 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.254098 25260 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.306438 19580 rpcz_store.cc:276] 0709 13:20:09.189112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.284802 (+1095690us) service_pool.cc:224] Handling call
0709 13:20:10.289234 (+  4432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.305442 (+ 16208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.305825 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:10.279297 25282 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:10.276078 25006 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:10.316829 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:10.317423 19580 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:10.311637 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2650) took 1186 ms. Trace:
I20260709 13:20:10.273192 25445 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:10.321126 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:10.327769 24619 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:10.253510 25271 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:10.328553 24619 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.309273 25458 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:10.256618 25491 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:20:10.215335 25256 consensus_queue.cc:260] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:10.318030 19660 rpcz_store.cc:276] 0709 13:20:09.125550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.127054 (+  1504us) service_pool.cc:224] Handling call
0709 13:20:10.311419 (+1184365us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b54001ecb54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:10.311564 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997771648}
W20260709 13:20:10.314838 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.306010 25492 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:10.242334 25503 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.291105 25471 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
W20260709 13:20:10.330034 25498 log.cc:927] Time spent T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:20:10.330056 25445 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.337742 24912 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:10.338181 25260 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:10.339813 24826 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:10.400918 25258 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:10.401679 20618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.341346 25427 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:10.342991 25321 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:10.315560 19510 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:10.353170 19580 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
W20260709 13:20:10.404413 25508 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:20:10.405196 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:10.321257 25489 raft_consensus.cc:2764] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:20:10.407263 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:10.408373 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:10.408702 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:10.409049 19585 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:10.304682 25001 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:10.410074 25510 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:20:10.317003 25320 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:10.410744 25320 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:10.411644 25504 log.cc:927] Time spent T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.269s	user 0.000s	sys 0.000s
I20260709 13:20:10.412982 25320 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:10.413853 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2998) took 1244 ms. Trace:
I20260709 13:20:10.414256 19587 rpcz_store.cc:276] 0709 13:20:09.169405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.376757 (+207352us) service_pool.cc:224] Handling call
0709 13:20:09.377128 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:09.395776 (+ 18648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.395812 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:09.404046 (+  8234us) log.cc:844] Serialized 26 byte log entry
0709 13:20:09.609224 (+205178us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:09.630666 (+ 21442us) log.cc:844] Serialized 14 byte log entry
0709 13:20:09.651055 (+ 20389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.651136 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.404674 (+753538us) spinlock_profiling.cc:243] Waited 9.82 ms on lock 0x7b1800463de0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:20:10.413517 (+  8843us) raft_consensus.cc:1685] finished
0709 13:20:10.413644 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.413795 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89187,"prepare.queue_time_us":27003,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":5654,"raft.queue_time_us":120516,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":3215,"spinlock_wait_cycles":97487360,"thread_start_us":204730,"threads_started":1,"wal-append.queue_time_us":232624}
I20260709 13:20:10.416456 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:10.417011 19587 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:10.417143 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:10.418577 19657 raft_consensus.cc:2410] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 19 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:20:10.418486 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:10.419679 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:10.362470 19625 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:10.420370 25271 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:10.420780 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:10.421104 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 58746.5us
I20260709 13:20:10.421883 19625 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:10.319535 25420 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:10.422801 24907 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:10.369647 19660 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:10.424069 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:10.424698 25488 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:10.425158 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:10.425599 25452 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:10.426858 25296 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:10.426968 19625 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:10.308465 25470 consensus_queue.cc:1059] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:20:10.428049 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:10.428263 19625 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:10.305753 25439 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:20:10.428810 25470 raft_consensus.cc:3055] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:10.429174 25452 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:10.328948 25188 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:10.429782 25449 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:10.430133 25188 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:10.430459 25412 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:10.430550 25188 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:10.430989 25412 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:10.431102 19625 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:10.429199 25146 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.431927 25412 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.329074 25411 consensus_queue.cc:1059] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:20:10.434136 25411 raft_consensus.cc:3055] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:10.434507 25411 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:10.435173 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 2996) took 1266 ms. Trace:
I20260709 13:20:10.435313 25411 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.435842 25137 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:10.356235 25180 consensus_queue.cc:1059] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:20:10.436146 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:10.436820 19582 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:10.437137 25411 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:10.437470 25471 raft_consensus.cc:3055] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:10.437891 25471 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:10.438706 25471 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.402941 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:10.440754 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:10.441740 25271 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:10.441977 19658 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:10.442044 19655 raft_consensus.cc:606] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:10.442569 19655 raft_consensus.cc:614] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:10.443090 19660 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:10.436908 25509 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:20:10.443936 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:10.444597 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48052 (request call id 42) took 1019 ms. Trace:
I20260709 13:20:10.445035 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:10.320331 25366 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.410187 19653 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:10.453792 19659 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:10.448186 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:10.443966 19658 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:10.419679 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:10.435572 19579 rpcz_store.cc:276] 0709 13:20:09.168814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.328095 (+159281us) service_pool.cc:224] Handling call
0709 13:20:09.328416 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:09.439442 (+111026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.439491 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:09.459057 (+ 19566us) log.cc:844] Serialized 26 byte log entry
0709 13:20:09.794098 (+335041us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:09.868519 (+ 74421us) log.cc:844] Serialized 14 byte log entry
0709 13:20:09.869784 (+  1265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.186032 (+316248us) spinlock_profiling.cc:243] Waited 65.8 ms on lock 0x7b5400247054. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:10.186082 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.434850 (+248768us) raft_consensus.cc:1685] finished
0709 13:20:10.434950 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.435109 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37518,"prepare.queue_time_us":46633,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":84847,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":25412,"spinlock_wait_cycles":151336960,"thread_start_us":284043,"threads_started":1,"wal-append.queue_time_us":402266}
I20260709 13:20:10.461555 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:10.461812 19511 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:10.441421 19581 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:10.444983 19655 rpcz_store.cc:276] 0709 13:20:09.425281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.427748 (+  2467us) service_pool.cc:224] Handling call
0709 13:20:10.444391 (+1016643us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b54001ec154. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c31754853 00007f6c3672260a 00007f6c2fca87d4 00007f6c2fca8762 00007f6c2fca8691 00007f6c2fca860c 00007f6c2fca78c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:10.444513 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2231409408}
I20260709 13:20:10.392832 25453 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.463081 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:10.465809 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:10.468876 19585 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:10.502267 24619 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:10.469633 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:10.503017 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:10.481127 19660 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:10.360110 25492 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.504402 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:10.369984 24589 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:10.454456 25463 consensus_meta.cc:287] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.743s	user 0.010s	sys 0.000s
I20260709 13:20:10.388783 25256 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:10.452545 25445 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:10.369724 25175 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:10.444590 19582 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
W20260709 13:20:10.481694 25259 consensus_meta.cc:287] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.654s	user 0.011s	sys 0.000s
I20260709 13:20:10.512598 25492 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:10.508221 25296 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:20:10.508970 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:10.429199 25470 raft_consensus.cc:740] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:10.511059 24907 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:20:10.450488 25081 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:10.433493 25412 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:10.501950 25004 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:10.502117 25449 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:20:10.523074 20618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.375440 25415 consensus_queue.cc:1059] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.137s
I20260709 13:20:10.509722 25366 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:10.517786 24987 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:10.506006 25451 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
W20260709 13:20:10.554823 25472 consensus_meta.cc:287] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.926s	user 0.012s	sys 0.000s
W20260709 13:20:10.554589 25236 consensus_meta.cc:287] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.552s	user 0.008s	sys 0.003s
I20260709 13:20:10.556396 25511 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:10.518110 25463 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.594890 25472 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:10.630609 25518 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:20:10.630867 25471 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:10.633248 25524 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:10.634539 25524 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:10.635311 25524 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.601989 25470 consensus_queue.cc:260] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.636909 25470 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:10.464177 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.680346 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:10.682471 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.683259 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:10.684371 19503 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:10.685760 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:10.477001 19478 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:10.466301 19504 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
W20260709 13:20:10.690173 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 213126us
W20260709 13:20:10.681308 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.693426 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:10.696416 19507 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:10.704193 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:10.475660 19509 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:10.708129 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:10.709313 19511 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:10.710187 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:10.711740 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:10.712543 19504 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:10.714097 19478 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:10.714686 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:10.715619 19510 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 20.
I20260709 13:20:10.716085 19509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:10.716496 19478 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:10.717103 19509 raft_consensus.cc:606] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:10.717684 19509 raft_consensus.cc:614] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:10.717888 19478 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:10.737919 19511 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:10.725034 19510 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:10.739259 19512 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:10.739501 19511 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:10.727278 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:10.743667 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 413170us
I20260709 13:20:10.508625 19581 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 19: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:10.746842 19583 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:10.513366 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:10.914374 19585 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:10.915764 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:10.916548 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.917004 19581 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 22: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:10.748248 19584 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:10.746457 19510 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:10.748770 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3007) took 1572 ms. Trace:
I20260709 13:20:10.751616 19507 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 25.
W20260709 13:20:10.753328 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.474488 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:10.930078 19584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 3343) took 1488 ms (client timeout 1922 ms). Trace:
W20260709 13:20:10.930739 19584 rpcz_store.cc:269] 0709 13:20:09.441913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.471135 (+ 29222us) service_pool.cc:224] Handling call
0709 13:20:10.929764 (+1458629us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002fd854. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:10.929976 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2863665408}
I20260709 13:20:10.767285 19625 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:10.767599 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:10.581118 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.774953 19478 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:10.942899 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 168096us
I20260709 13:20:10.945971 25502 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:20:10.779851 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 461221us
I20260709 13:20:10.795889 24619 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.773731 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:10.805544 24907 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:10.808383 24826 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:10.810139 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.810030 24912 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:10.820981 25001 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:20:10.825184 24491 consensus_meta.cc:287] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.010s
I20260709 13:20:10.825024 25004 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:10.830659 25175 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 12 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:10.833099 25186 consensus_queue.cc:1059] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:10.839982 20665 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:20:10.844099 25180 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:10.948596 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.597656 25236 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.844935 25258 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.864850 25188 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.887490 19511 raft_consensus.cc:606] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:10.915863 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:10.523398 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:10.912405 19504 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:10.914415 25430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.001s	sys 0.009s
W20260709 13:20:10.990065 25430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.002s	sys 0.009s
I20260709 13:20:10.992403 19510 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:11.003717 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:10.932852 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:10.917939 25458 consensus_meta.cc:287] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.552s	user 0.001s	sys 0.009s
I20260709 13:20:11.005019 19656 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:10.946681 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:11.006405 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:10.947324 25463 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.007825 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:11.008816 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:11.009989 19656 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 19: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:10.948683 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:10.945132 19478 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:11.012087 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 67120.2us
I20260709 13:20:10.974972 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:10.971953 20618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.976655 19585 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
W20260709 13:20:10.935626 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 168809us
I20260709 13:20:10.980728 19582 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:10.980999 25258 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:10.981295 24907 raft_consensus.cc:697] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:10.982771 25236 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:10.983163 19511 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:10.983400 19507 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:10.983723 19580 raft_consensus.cc:2393] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 15: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:10.950696 25503 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:10.970566 24826 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:10.969133 24912 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:11.003978 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:11.004887 19584 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:11.008982 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:10.980362 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.843981 19508 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:10.926815 19503 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:11.017891 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:11.014217 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:11.013832 19581 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:10.974472 24619 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.025695 19583 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:10.958846 25514 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:10.975805 25180 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:11.005034 25458 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.030403 24907 consensus_queue.cc:237] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.033536 25001 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.033608 25180 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.033026 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:11.031841 19509 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:11.035378 19579 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:11.035892 19625 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:11.036656 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:11.037902 19625 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:11.039836 19654 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:11.043800 20666 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:11.038539 19584 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:11.039719 19625 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:11.040366 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:10.982803 25453 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.020498 24826 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:11.044757 20619 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:11.063063 19510 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:11.063162 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:11.045830 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:11.067061 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3018) took 1874 ms. Trace:
I20260709 13:20:10.918581 19586 rpcz_store.cc:276] 0709 13:20:09.176312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.219532 (+1043220us) service_pool.cc:224] Handling call
0709 13:20:10.219848 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:10.220221 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:10.220253 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:10.220761 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:20:10.308547 (+ 87786us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:10.323577 (+ 15030us) log.cc:844] Serialized 14 byte log entry
0709 13:20:10.747870 (+424293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.748045 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.748126 (+    81us) raft_consensus.cc:1685] finished
0709 13:20:10.748139 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.748549 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":286,"prepare.queue_time_us":15168,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":14277,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":36655,"thread_start_us":510887,"threads_started":2,"wal-append.queue_time_us":303808}
I20260709 13:20:11.067533 19584 rpcz_store.cc:276] 0709 13:20:09.189783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.037864 (+1848081us) service_pool.cc:224] Handling call
0709 13:20:11.038327 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.063715 (+ 25388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.063923 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.023324 24912 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:11.069849 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:10.946825 25502 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.074528 19653 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:11.075421 25502 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:11.039060 25486 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:11.077183 19627 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:11.078830 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:11.079123 24619 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.079931 25006 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:11.080350 25006 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:11.080629 19478 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:11.039358 25258 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.075817 19582 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:11.035279 25458 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.080813 25006 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:11.055922 25004 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.098508 25004 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:11.029410 25514 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:11.076946 25001 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:11.105893 25514 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:11.106292 25081 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:11.106925 25081 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:11.107545 25081 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:11.082294 19478 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:11.109333 25258 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:11.110673 25006 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.040508 25425 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:11.088529 19586 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:11.082257 25503 raft_consensus.cc:697] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:11.094323 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3019) took 1858 ms. Trace:
I20260709 13:20:11.083068 25463 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:11.131474 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3020) took 1855 ms. Trace:
I20260709 13:20:11.132107 19586 rpcz_store.cc:276] 0709 13:20:09.276019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.080443 (+1804424us) service_pool.cc:224] Handling call
0709 13:20:11.081420 (+   977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.131212 (+ 49792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.131416 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.085672 19503 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:20:11.112906 25535 log.cc:927] Time spent T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:20:11.122406 25449 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:11.120967 25366 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:11.121421 25525 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:11.120453 19504 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
W20260709 13:20:11.189437 19587 consensus_meta.cc:287] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.610s	user 0.029s	sys 0.000s
I20260709 13:20:11.199892 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 3704) took 1053 ms. Trace:
I20260709 13:20:11.191854 19511 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:11.126854 19579 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 25.
W20260709 13:20:11.077342 25282 consensus_meta.cc:287] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.757s	user 0.008s	sys 0.009s
I20260709 13:20:11.133684 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:11.133576 25463 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.129871 19582 rpcz_store.cc:276] 0709 13:20:09.235650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.075144 (+1839494us) service_pool.cc:224] Handling call
0709 13:20:11.075498 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.091361 (+ 15863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.094234 (+  2873us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.092303 25186 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:11.182461 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:11.120472 19585 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:11.195241 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:11.200352 19504 rpcz_store.cc:276] 0709 13:20:10.147042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.713293 (+566251us) service_pool.cc:224] Handling call
0709 13:20:11.199717 (+486424us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.203980 19511 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:11.131438 25006 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:11.206411 25524 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:11.206614 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:11.208686 25463 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.214905 19587 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:11.198019 25525 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.194633 25366 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:11.218719 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3340) took 1774 ms. Trace:
I20260709 13:20:11.222429 19656 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 22: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:20:11.223223 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 183704us
I20260709 13:20:11.224162 19625 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:11.224056 25503 consensus_queue.cc:237] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:11.224010 25256 consensus_meta.cc:287] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.703s	user 0.008s	sys 0.009s
W20260709 13:20:11.226227 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 181601us
I20260709 13:20:11.227917 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:11.228885 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:11.229136 19654 raft_consensus.cc:1275] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:11.229522 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:11.232273 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:11.233132 19655 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:11.211920 25186 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:11.221143 19585 rpcz_store.cc:276] 0709 13:20:09.440989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.107481 (+1666492us) service_pool.cc:224] Handling call
0709 13:20:11.108247 (+   766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.214832 (+106585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.215195 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.237073 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 3365) took 1519 ms. Trace:
I20260709 13:20:11.237493 19583 rpcz_store.cc:276] 0709 13:20:09.717335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.802526 (+ 85191us) service_pool.cc:224] Handling call
0709 13:20:11.236835 (+1434309us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b54002fd354. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:11.237006 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2169281280}
I20260709 13:20:11.219512 19511 raft_consensus.cc:606] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:11.241166 19586 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: [16.11-17.12]
I20260709 13:20:11.242152 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3341) took 1800 ms. Trace:
I20260709 13:20:11.242563 19498 tablet_service.cc:1558] Processing DeleteTablet for tablet 46d39387ed0c44978cdb2b736f9c1ccf with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:50816
I20260709 13:20:11.241089 25006 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:11.244022 25006 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.244472 25006 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:11.244984 25412 consensus_meta.cc:287] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.659s	user 0.009s	sys 0.003s
I20260709 13:20:11.245937 19578 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:11.246702 19505 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:11.247732 25425 consensus_queue.cc:1059] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:11.249266 25425 raft_consensus.cc:3055] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:11.249745 25425 raft_consensus.cc:740] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:11.219447 25525 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:11.246694 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:11.250882 25425 consensus_queue.cc:260] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:11.252410 25425 raft_consensus.cc:3060] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:11.253515 19405 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48826 (request call id 181) took 29860 ms (client timeout 15000 ms). Trace:
I20260709 13:20:11.258661 19503 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:11.260315 19503 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:11.220474 25366 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:11.262605 25486 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:11.263477 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3686) took 1336 ms. Trace:
I20260709 13:20:11.264210 19625 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:11.264969 24912 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.263898 19506 rpcz_store.cc:276] 0709 13:20:09.927005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.929636 (+  2631us) service_pool.cc:224] Handling call
0709 13:20:10.007127 (+ 77491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:10.455890 (+448763us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b1800496780. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c313024bc 00007f6c2e65048b 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66a455 00007f6c31752060 00007f6c31752bfb 00007f6c3175d64b
0709 13:20:10.456039 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:10.456065 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:10.456598 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:20:10.995768 (+539170us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:10.997216 (+  1448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.998812 (+  1596us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:11.263039 (+264227us) raft_consensus.cc:1685] finished
0709 13:20:11.263058 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.263268 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":135555,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":10895,"spinlock_wait_cycles":3380096,"thread_start_us":620585,"threads_started":2,"wal-append.queue_time_us":804268}
I20260709 13:20:11.267983 24912 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.268247 25481 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:11.270159 25481 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:11.270570 19657 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:11.240056 25188 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.271335 25481 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.272863 19583 raft_consensus.cc:1240] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:11.273648 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3348) took 1784 ms. Trace:
I20260709 13:20:11.273967 19583 rpcz_store.cc:276] 0709 13:20:09.488855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.272232 (+1783377us) service_pool.cc:224] Handling call
0709 13:20:11.272619 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.273374 (+   755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.273557 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.274480 25282 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:11.274678 19578 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:11.275127 25282 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:11.275336 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3350) took 1771 ms. Trace:
I20260709 13:20:11.275514 19583 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:11.275735 19578 rpcz_store.cc:276] 0709 13:20:09.503579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.273982 (+1770403us) service_pool.cc:224] Handling call
0709 13:20:11.274389 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.275136 (+   747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.275288 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.276120 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3351) took 1769 ms. Trace:
W20260709 13:20:11.276481 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.276435 19583 rpcz_store.cc:276] 0709 13:20:09.506706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.274834 (+1768128us) service_pool.cc:224] Handling call
0709 13:20:11.275217 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.275892 (+   675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.276073 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.277087 19578 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:11.277252 25282 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:11.278685 25514 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.280556 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:20:11.244519 25492 consensus_meta.cc:287] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.005s
I20260709 13:20:11.281404 25514 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.282219 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3357) took 1672 ms. Trace:
I20260709 13:20:11.281939 25492 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.282869 25260 raft_consensus.cc:3055] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:11.282948 19578 rpcz_store.cc:276] 0709 13:20:09.610269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.276521 (+1666252us) service_pool.cc:224] Handling call
0709 13:20:11.276804 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.277442 (+   638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.282138 (+  4696us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.283389 25260 raft_consensus.cc:740] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:11.242551 19586 rpcz_store.cc:276] 0709 13:20:09.441297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.199815 (+1758518us) service_pool.cc:224] Handling call
0709 13:20:11.237008 (+ 37193us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:11.241798 (+  4790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.242087 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.284441 25258 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:11.287389 19582 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:20:11.287544 25258 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:11.289865 25258 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:11.284636 25260 consensus_queue.cc:260] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.237576 25186 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:11.298050 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:11.291546 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:11.298761 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3359) took 1687 ms. Trace:
I20260709 13:20:11.298764 19586 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:11.298238 25260 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:11.281781 25282 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:11.304306 25282 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:11.307797 25282 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:20:11.254426 19405 rpcz_store.cc:269] 0709 13:19:41.377856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.389643 (+ 11787us) service_pool.cc:224] Handling call
0709 13:19:42.308363 (+918720us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54002ec7d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c4090 00007f6c31762f3a 00007f6c375191cc 00007f6c3761737e 00007f6c35ad82a4 00007f6c35ad8232 00007f6c35ad8161 00007f6c35ad80dc 00007f6c35ad7392 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:19:42.407036 (+ 98673us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b5400002210. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e636640 00007f6c3750db76 00007f6c37617c3e 00007f6c35ad82a4 00007f6c35ad8232 00007f6c35ad8161 00007f6c35ad80dc 00007f6c35ad7392 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:11.235182 (+28828146us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:04.385894 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:04.442366 (+ 56472us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:04.442442 (+    76us) write_op.cc:435] Acquired schema lock
0709 13:20:04.442473 (+    31us) tablet.cc:662] Decoding operations
0709 13:20:04.622758 (+180285us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:04.623072 (+   314us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:04.623106 (+    34us) tablet.cc:685] Acquiring locks for 38 operations
0709 13:20:04.649681 (+ 26575us) tablet.cc:701] Row locks acquired
0709 13:20:04.649735 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:20:04.649919 (+   184us) write_op.cc:270] Start()
0709 13:20:04.650088 (+   169us) write_op.cc:276] Timestamp: P: 1783603204649848 usec, L: 0
0709 13:20:04.650109 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:20:04.650960 (+   851us) log.cc:844] Serialized 14999 byte log entry
0709 13:20:05.352758 (+701798us) op_driver.cc:464] REPLICATION: finished
0709 13:20:05.660353 (+307595us) write_op.cc:301] APPLY: starting
0709 13:20:05.660471 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:06.817941 (+1157470us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b54002ec7d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175732a 00007f6c316dcf14 00007f6c316dcec3 00007f6c316dce38 00007f6c316dcdf3 00007f6c316dc0dc 00007f6c31705e16 00007f6c316edcbb 00007f6c316d839d 00007f6c316dbd75
0709 13:20:06.912732 (+ 94791us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:06.912788 (+    56us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:08.504378 (+1591590us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:08.504865 (+   487us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=76,key_file_lookups=76,delta_file_lookups=76,mrs_lookups=0
0709 13:20:08.504934 (+    69us) write_op.cc:312] APPLY: finished
0709 13:20:08.505554 (+   620us) log.cc:844] Serialized 324 byte log entry
0709 13:20:08.824403 (+318849us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:08.866723 (+ 42320us) write_op.cc:454] Released schema lock
0709 13:20:08.866829 (+   106us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:08.867338 (+   509us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:08.867377 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1412,"reported_tablets":57,"spinlock_wait_cycles":1121471104,"child_traces":[["op",{"apply.queue_time_us":303626,"apply.run_cpu_time_us":103354,"apply.run_wall_time_us":3206965,"cfile_cache_hit":154,"cfile_cache_hit_bytes":162891,"num_ops":38,"prepare.queue_time_us":557266,"prepare.run_cpu_time_us":20671,"prepare.run_wall_time_us":296532,"raft.queue_time_us":206470,"raft.run_cpu_time_us":34178,"raft.run_wall_time_us":1569433,"replication_time_us":644886,"spinlock_wait_cycles":18550144,"thread_start_us":847137,"threads_started":5,"wal-append.queue_time_us":556915,"wal-append.run_cpu_time_us":17364,"wal-append.run_wall_time_us":2477301}]]}
I20260709 13:20:11.307934 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:11.309785 19581 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 12.
W20260709 13:20:11.240334 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 54583.9us
I20260709 13:20:11.299245 19583 rpcz_store.cc:276] 0709 13:20:09.610895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.277291 (+1666396us) service_pool.cc:224] Handling call
0709 13:20:11.286896 (+  9605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.298372 (+ 11476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.298398 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:11.298456 (+    58us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:11.298487 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.298540 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.298684 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.300304 25492 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.294704 19655 raft_consensus.cc:2468] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 12.
I20260709 13:20:11.284389 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:11.316334 19578 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:11.318014 19587 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:11.318223 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:11.319555 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 50072.5us
I20260709 13:20:11.321274 24619 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.318356 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 3028) took 1004 ms. Trace:
I20260709 13:20:11.322652 19580 rpcz_store.cc:276] 0709 13:20:10.314402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.404899 (+ 90497us) service_pool.cc:224] Handling call
0709 13:20:11.314773 (+909874us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b54001fb154. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:11.318297 (+  3524us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1327922432}
I20260709 13:20:11.326982 19583 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:11.334179 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:11.344947 19586 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:11.346174 19585 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:11.347394 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:11.350816 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3361) took 1714 ms. Trace:
I20260709 13:20:11.351233 19586 rpcz_store.cc:276] 0709 13:20:09.637234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.345728 (+1708494us) service_pool.cc:224] Handling call
0709 13:20:11.350185 (+  4457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.350507 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.350531 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:11.350591 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:11.350620 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.350668 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.350765 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.353297 19478 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:11.353533 25282 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:11.354411 25282 consensus_queue.cc:1243] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:11.354563 24619 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.354977 25282 consensus_queue.cc:1059] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:11.355711 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3363) took 1645 ms. Trace:
I20260709 13:20:11.356003 25282 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:11.356637 19505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 3687) took 1429 ms (client timeout 1550 ms). Trace:
I20260709 13:20:11.356906 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:11.357070 19505 rpcz_store.cc:269] 0709 13:20:09.927327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.929732 (+  2405us) service_pool.cc:224] Handling call
0709 13:20:11.356381 (+1426649us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b54001ef0d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:11.356533 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1947147008}
I20260709 13:20:11.358064 25511 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:11.358486 25511 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:11.358592 25259 raft_consensus.cc:3055] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:11.359025 25259 raft_consensus.cc:740] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:11.356648 24619 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.319160 25258 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:11.363715 19583 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:11.356046 19579 rpcz_store.cc:276] 0709 13:20:09.710163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.354825 (+1644662us) service_pool.cc:224] Handling call
0709 13:20:11.355130 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.355376 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.355402 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:11.355456 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:11.355482 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.355535 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.355640 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.364755 19586 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:11.370240 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:11.381793 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 3695) took 1404 ms. Trace:
I20260709 13:20:11.383327 19508 rpcz_store.cc:276] 0709 13:20:09.977480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.070007 (+ 92527us) service_pool.cc:224] Handling call
0709 13:20:11.362152 (+1292145us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b5400184cd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:11.381716 (+ 19564us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1256594816}
I20260709 13:20:11.386957 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:11.387400 19578 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:11.388084 19655 raft_consensus.cc:2410] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:20:11.388116 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3360) took 1769 ms. Trace:
I20260709 13:20:11.388662 19578 rpcz_store.cc:276] 0709 13:20:09.618743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.347032 (+1728289us) service_pool.cc:224] Handling call
0709 13:20:11.387105 (+ 40073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.387856 (+   751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.388061 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.389700 20631 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
W20260709 13:20:11.390506 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 72607.7us
I20260709 13:20:11.390537 25486 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:11.391872 25486 raft_consensus.cc:3055] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:11.391907 25258 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:11.393083 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3344) took 1950 ms. Trace:
I20260709 13:20:11.359907 25282 raft_consensus.cc:697] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:11.393800 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3347) took 1920 ms. Trace:
I20260709 13:20:11.394642 25258 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:11.394583 25282 consensus_queue.cc:237] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.359440 25511 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.395682 19476 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:11.396373 25511 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:11.397125 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3346) took 1927 ms. Trace:
W20260709 13:20:11.397686 25514 consensus_queue.cc:1175] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e19c80e9149b4b8d88ae13bde8e43864" responder_term: 18 status { last_received { term: 18 index: 11 } last_committed_idx: 10 last_received_current_leader { term: 18 index: 11 } }
I20260709 13:20:11.398778 24987 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:11.397063 19476 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:11.363902 25259 consensus_queue.cc:260] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.393436 19582 rpcz_store.cc:276] 0709 13:20:09.442194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.214434 (+1772240us) service_pool.cc:224] Handling call
0709 13:20:11.217595 (+  3161us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:11.287831 (+ 70236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.392811 (+104980us) spinlock_profiling.cc:243] Waited 67.1 ms on lock 0x7b54002288d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:11.393009 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154372992}
I20260709 13:20:11.404485 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3362) took 1713 ms. Trace:
I20260709 13:20:11.380995 19581 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
W20260709 13:20:11.405922 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.397689 19585 rpcz_store.cc:276] 0709 13:20:09.469538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.239976 (+1770438us) service_pool.cc:224] Handling call
0709 13:20:11.345992 (+106016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.347094 (+  1102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.396911 (+ 49817us) spinlock_profiling.cc:243] Waited 8.97 ms on lock 0x7b54003d0ed0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:11.397057 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20623616}
I20260709 13:20:11.394197 19587 rpcz_store.cc:276] 0709 13:20:09.473466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.258950 (+1785484us) service_pool.cc:224] Handling call
0709 13:20:11.317033 (+ 58083us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.318465 (+  1432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.393566 (+ 75101us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b54001fb150. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:11.393741 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132360960}
I20260709 13:20:11.392459 25486 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:11.410346 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.366675 25449 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.404860 19586 rpcz_store.cc:276] 0709 13:20:09.690869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.352132 (+1661263us) service_pool.cc:224] Handling call
0709 13:20:11.364535 (+ 12403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.365286 (+   751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.404222 (+ 38936us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b5400303250. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:11.404409 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27676928}
I20260709 13:20:11.403096 19625 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:11.393806 19580 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:11.417424 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:11.417635 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:11.418354 19655 raft_consensus.cc:2393] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:11.418728 25186 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.420012 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3374) took 1413 ms. Trace:
I20260709 13:20:11.420400 19581 rpcz_store.cc:276] 0709 13:20:10.007084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.416938 (+1409854us) service_pool.cc:224] Handling call
0709 13:20:11.419358 (+  2420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.419657 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.419683 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:11.419743 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:11.419772 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.419829 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.419937 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.422050 19508 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:11.422144 19586 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:11.422605 25525 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:11.424787 24912 raft_consensus.cc:993] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:11.425100 25525 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:11.425318 24912 raft_consensus.cc:1081] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:11.409054 25256 raft_consensus.cc:2804] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:11.427304 19476 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:11.428514 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 67606.4us
I20260709 13:20:11.417724 19580 raft_consensus.cc:1240] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:11.430639 19586 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:11.430972 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3368) took 1486 ms. Trace:
I20260709 13:20:11.434643 19578 rpcz_store.cc:276] 0709 13:20:09.944861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.389494 (+1444633us) service_pool.cc:224] Handling call
0709 13:20:11.402148 (+ 12654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.430627 (+ 28479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.430661 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:11.430706 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:11.430740 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.430804 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.430911 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.442263 19478 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:11.442577 19579 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:11.443153 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3367) took 1725 ms. Trace:
I20260709 13:20:11.443478 19579 rpcz_store.cc:276] 0709 13:20:09.717989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.372456 (+1654467us) service_pool.cc:224] Handling call
0709 13:20:11.442407 (+ 69951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.442933 (+   526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.443099 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.443154 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:11.371510 25366 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.431464 25258 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:11.446576 19584 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:11.445065 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:11.452576 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3376) took 1433 ms. Trace:
I20260709 13:20:11.453081 19584 rpcz_store.cc:276] 0709 13:20:10.019225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.410415 (+1391190us) service_pool.cc:224] Handling call
0709 13:20:11.443453 (+ 33038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.452334 (+  8881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.452526 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.453702 20665 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:11.452147 25258 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:11.457033 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:11.457474 25258 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:11.458401 19580 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:11.459436 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:11.460089 19580 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:11.461133 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:11.463143 19587 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:11.463905 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3030) took 1132 ms. Trace:
I20260709 13:20:11.464285 19587 rpcz_store.cc:276] 0709 13:20:10.331342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.416787 (+1085445us) service_pool.cc:224] Handling call
0709 13:20:11.455049 (+ 38262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.463619 (+  8570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.463843 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.466321 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:11.471320 19508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:11.474989 19508 raft_consensus.cc:606] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
W20260709 13:20:11.475414 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 48199us
I20260709 13:20:11.475417 19508 raft_consensus.cc:614] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:11.445250 25502 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:11.443864 25256 raft_consensus.cc:697] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 12 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:11.478071 19579 raft_consensus.cc:1275] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:11.485287 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:11.487950 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45815.1us
I20260709 13:20:11.467947 24987 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:11.437178 25449 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.473774 25186 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:11.495493 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 146325us
W20260709 13:20:11.500967 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.501777 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:11.507011 19579 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:11.511373 19585 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:11.512233 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3377) took 1344 ms. Trace:
I20260709 13:20:11.512663 19585 rpcz_store.cc:276] 0709 13:20:10.168168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.414812 (+1246644us) service_pool.cc:224] Handling call
0709 13:20:11.476957 (+ 62145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.511941 (+ 34984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.512156 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.495014 24987 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.521683 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3717) took 1049 ms. Trace:
I20260709 13:20:11.494747 25502 raft_consensus.cc:697] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:11.522243 19504 rpcz_store.cc:276] 0709 13:20:10.467365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.222992 (+755627us) service_pool.cc:224] Handling call
0709 13:20:11.224366 (+  1374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.224661 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:11.225525 (+   864us) log.cc:844] Serialized 14 byte log entry
0709 13:20:11.515958 (+290433us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:11.516030 (+    72us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:11.516106 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.516222 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.516388 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10855,"prepare.queue_time_us":184,"prepare.run_cpu_time_us":168,"prepare.run_wall_time_us":167,"raft.queue_time_us":13162,"thread_start_us":279049,"threads_started":1}
I20260709 13:20:11.548230 19578 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:11.528827 19587 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:11.552040 25449 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:11.520833 24987 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:11.552850 25449 consensus_queue.cc:1059] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:11.529412 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:11.535102 19553 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:20:11.537707 25453 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:11.538307 19625 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:11.538955 25425 consensus_queue.cc:1059] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:11.539369 25503 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:11.540099 25001 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:11.541399 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:11.542491 25366 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:11.542898 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:11.547241 25081 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:11.548318 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.548236 25256 consensus_queue.cc:237] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:11.548799 25258 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.517973 25486 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.549820 24491 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:11.518746 25514 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:11.556705 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.565696 25259 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:11.583573 25492 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:11.572458 19579 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
W20260709 13:20:11.575024 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 45754.1us
I20260709 13:20:11.534862 25186 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:11.582149 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 64041.9us
I20260709 13:20:11.567420 19627 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:11.593595 19586 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:20:11.597406 19478 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:11.598419 19507 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:11.607435 19510 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:20:11.609846 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:11.587735 25492 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:11.616155 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:11.616254 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:11.618163 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:11.619304 19512 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:11.622884 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 99592.8us
I20260709 13:20:11.627060 25425 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.627660 25425 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.628079 25481 raft_consensus.cc:3055] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:11.628654 25481 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:11.630426 25430 raft_consensus.cc:3055] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:11.631095 25430 raft_consensus.cc:740] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:11.632375 25430 consensus_queue.cc:260] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.634027 25486 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:11.634718 19478 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:11.616133 25492 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:11.636869 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:11.638798 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:11.630481 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:11.642120 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:11.643143 25188 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:11.647677 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3718) took 1180 ms. Trace:
I20260709 13:20:11.648205 19512 rpcz_store.cc:276] 0709 13:20:10.467610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.223474 (+755864us) service_pool.cc:224] Handling call
0709 13:20:11.223884 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.619794 (+395910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.647360 (+ 27566us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b5400402754. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:11.647601 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":908843392}
I20260709 13:20:11.649557 24987 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.651832 24987 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.618522 25366 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:11.596374 25186 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.622824 25180 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:11.652575 25524 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:11.618359 25449 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:11.653182 19586 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
W20260709 13:20:11.654353 25544 log.cc:927] Time spent T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:20:11.657645 25081 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.620385 25502 consensus_queue.cc:237] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.658713 24907 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:11.659034 25258 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.645179 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:11.630656 19655 raft_consensus.cc:2393] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:11.586483 25453 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.660358 19478 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:11.653988 25481 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.668953 24912 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:11.673868 25430 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:11.668738 25180 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:11.693738 19509 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
W20260709 13:20:11.700395 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 55388.6us
I20260709 13:20:11.696329 19478 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:11.702467 19478 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:11.687417 19587 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60808
I20260709 13:20:11.669179 25004 consensus_queue.cc:1059] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:20:11.675625 25001 consensus_queue.cc:1059] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:20:11.692507 24912 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.705921 19587 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:11.711118 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:20:11.713245 19587 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:11.689527 25425 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:11.700981 25180 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:11.719007 19625 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:11.723511 25186 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.703554 25282 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:11.706943 25081 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:11.693799 25524 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.729856 20665 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:11.732784 24619 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:11.736768 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:11.706568 25412 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:20:11.761163 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 211746us
I20260709 13:20:11.716117 24912 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:11.751549 25541 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:20:11.715309 25258 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:11.741663 25453 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.762468 19587 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:11.770321 25186 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:20:11.718547 24987 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:11.804371 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 91394.2us
I20260709 13:20:11.807727 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:11.707902 25006 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
W20260709 13:20:11.813194 25550 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:20:11.806061 25259 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:20:11.815091 19587 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.759650 24907 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:11.817142 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 89956.8us
I20260709 13:20:11.769825 25081 raft_consensus.cc:697] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:11.788997 25258 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.810669 25481 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:11.804363 24987 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:11.790831 25503 consensus_queue.cc:1059] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 13:20:11.852442 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 196063us
I20260709 13:20:11.828619 25258 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:11.896957 24912 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:11.901541 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 93777.9us
I20260709 13:20:11.904551 25001 raft_consensus.cc:3055] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:20:11.920701 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.848904 24987 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:11.927374 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:11.894377 24826 consensus_meta.cc:287] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.805s	user 0.013s	sys 0.000s
I20260709 13:20:11.862041 25366 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:11.909967 24912 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.942885 24491 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:11.845554 25412 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.073s
I20260709 13:20:11.947072 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:11.886793 25449 raft_consensus.cc:697] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:11.948158 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:11.977335 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:11.947841 24491 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.917961 25282 raft_consensus.cc:697] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:11.862509 25511 consensus_queue.cc:1059] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:20:11.980476 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:11.987142 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:11.918973 25001 raft_consensus.cc:740] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:11.982667 24491 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:11.986442 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 215311us
I20260709 13:20:11.980928 19661 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:11.948581 25555 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:12.002133 19625 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:12.000022 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:12.011845 24491 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.014156 24491 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.998399 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:12.019402 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:11.991164 25524 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:11.947824 24826 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.025708 19660 raft_consensus.cc:2393] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:12.031181 25570 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.031577 19657 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:12.031749 25570 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.044343 25558 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:12.044960 25558 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:12.045416 25558 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:12.048720 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 113641us
I20260709 13:20:12.049100 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:12.051330 19657 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
W20260709 13:20:12.051755 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 233372us
I20260709 13:20:12.028834 25259 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:12.058394 25540 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.431s	user 0.002s	sys 0.000s
I20260709 13:20:12.059728 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:12.032537 19395 catalog_manager.cc:5028] TS d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): tablet 46d39387ed0c44978cdb2b736f9c1ccf (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
W20260709 13:20:12.060964 25548 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
I20260709 13:20:12.061128 25006 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:12.061998 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 523) took 2337 ms. Trace:
I20260709 13:20:12.061545 25001 consensus_queue.cc:260] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.002964 25081 consensus_queue.cc:237] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.062122 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:12.086625 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 101181us
I20260709 13:20:12.063980 25425 raft_consensus.cc:3055] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:20:12.073967 19395 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 97040.4us
I20260709 13:20:12.043045 25412 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:12.079658 19583 rpcz_store.cc:276] 0709 13:20:09.724665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.377290 (+1652625us) service_pool.cc:224] Handling call
0709 13:20:11.414245 (+ 36955us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:11.445579 (+ 31334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.445696 (+   117us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:11.471983 (+ 26287us) log.cc:844] Serialized 26 byte log entry
0709 13:20:11.686389 (+214406us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:11.686433 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.686504 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:11.814713 (+128209us) raft_consensus.cc:1685] finished
0709 13:20:11.814738 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.061724 (+246986us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b54001fa750. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:12.061936 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6163,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":7318,"spinlock_wait_cycles":7576960,"thread_start_us":181489,"threads_started":1,"wal-append.queue_time_us":267232}
I20260709 13:20:12.095726 24826 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.096383 25511 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.097002 25511 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.099568 25511 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.101806 25575 raft_consensus.cc:3055] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:12.102543 25575 raft_consensus.cc:740] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:12.103624 25524 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.104244 25524 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.104046 25575 consensus_queue.cc:260] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.074208 25449 consensus_queue.cc:237] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.107352 25570 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:12.111671 25549 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.387s	user 0.002s	sys 0.000s
W20260709 13:20:12.119261 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 49737.6us
W20260709 13:20:12.120886 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.091991 25412 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:12.028908 25555 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:12.151571 25492 consensus_meta.cc:287] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260709 13:20:12.152024 25492 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:12.152638 25562 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:12.153832 25511 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.154259 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:12.154376 25511 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.153465 25562 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.156567 25511 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.156773 19476 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:12.157155 25511 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.158861 24619 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.159531 25578 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:12.158723 25562 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:12.161775 25574 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:12.161288 25562 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.162339 25574 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.162781 25562 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.163412 25575 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:12.094065 25425 raft_consensus.cc:740] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:12.159587 24619 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.162829 19625 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:12.167091 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:12.168443 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:12.169247 19476 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:12.050853 25282 consensus_queue.cc:237] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:12.174437 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.078824 25259 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.178501 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:12.178491 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:12.179430 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:12.150343 25006 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:12.182128 19656 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:12.083218 25366 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.191879 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3371) took 2228 ms. Trace:
I20260709 13:20:12.192955 19476 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:12.174113 25570 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:12.196377 19476 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:12.198786 24491 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:12.192338 19582 rpcz_store.cc:276] 0709 13:20:09.963363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.410957 (+1447594us) service_pool.cc:224] Handling call
0709 13:20:11.469001 (+ 58044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.500906 (+ 31905us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:11.841011 (+340105us) log.cc:844] Serialized 14 byte log entry
0709 13:20:12.191519 (+350508us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:12.191576 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:12.191630 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.191707 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.191816 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":586563,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":94984,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":132,"thread_start_us":584015,"threads_started":3}
W20260709 13:20:12.213347 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:12.223446 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 135556us
I20260709 13:20:12.165823 25511 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.227165 24619 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.230250 24491 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:12.206856 25514 consensus_meta.cc:287] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.619s	user 0.006s	sys 0.007s
I20260709 13:20:12.231704 25449 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:12.232106 25514 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:12.232228 25524 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.232573 24619 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.233942 24491 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.235677 25567 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:20:12.236229 24491 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.236929 24491 consensus_queue.cc:1059] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:12.233170 24619 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.238847 25425 consensus_queue.cc:260] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.239931 24619 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.242249 25562 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:12.241325 25449 raft_consensus.cc:697] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:12.247982 25486 consensus_meta.cc:287] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.003s
I20260709 13:20:12.251291 25555 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.253253 25577 raft_consensus.cc:993] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:12.253850 25577 raft_consensus.cc:1081] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:12.255519 25569 consensus_queue.cc:1059] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:12.257087 25580 raft_consensus.cc:3055] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:12.257592 25580 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:12.259420 25259 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.259677 25580 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:12.257967 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 95233.3us
I20260709 13:20:12.249233 25449 consensus_queue.cc:237] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.201121 25503 consensus_queue.cc:1059] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:20:12.268545 19625 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:12.268579 25511 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.271486 25511 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.226595 25412 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:12.272130 25511 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.272715 25554 raft_consensus.cc:3055] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:12.273108 25412 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:12.273237 25554 raft_consensus.cc:740] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:12.274400 25004 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:12.274271 25554 consensus_queue.cc:260] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.275115 25004 raft_consensus.cc:697] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:12.275305 25554 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:12.276338 25004 consensus_queue.cc:237] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.267071 25486 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:12.282943 25186 raft_consensus.cc:3055] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:12.283471 25186 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:12.284384 25186 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.265004 25492 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:12.260546 19582 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:12.194860 25188 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:12.197193 25001 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:12.288378 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 144909us
I20260709 13:20:12.197600 24826 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:12.204296 24912 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:12.240051 25425 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:12.226136 25006 raft_consensus.cc:697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:12.285936 25580 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:12.200374 25180 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:12.339672 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 71288.8us
I20260709 13:20:12.339784 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:12.340408 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:12.340734 19507 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:12.341665 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:12.342419 19512 raft_consensus.cc:2368] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 19.
I20260709 13:20:12.341132 19508 raft_consensus.cc:2368] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 24. Current term is 25.
I20260709 13:20:12.344687 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:12.345530 19504 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:12.345904 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:12.349622 19510 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:12.351213 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:12.354241 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:12.363551 19506 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:12.363921 19506 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:12.364709 19506 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.361101 25180 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:12.367187 19625 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:12.362708 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:12.354624 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:12.371608 19503 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:20:12.371809 25492 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.372624 25492 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.337476 25256 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:20:12.378091 25569 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.378599 25511 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.371825 25584 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.378846 25569 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.380963 25258 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.379740 25584 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.383498 25258 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.383827 19506 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:12.389272 25006 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:12.285980 25260 consensus_queue.cc:1175] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e19c80e9149b4b8d88ae13bde8e43864" responder_term: 16 status { last_received { term: 15 index: 10 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:20:12.402158 25430 consensus_meta.cc:287] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.698s	user 0.007s	sys 0.004s
I20260709 13:20:12.403141 19652 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:20:12.409935 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 185039us
I20260709 13:20:12.411213 19476 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:12.415745 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:12.419348 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 51935.8us
I20260709 13:20:12.430019 25260 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:12.430743 25260 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.431200 25260 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:12.436225 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:12.437081 19582 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:12.438990 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 71955.1us
I20260709 13:20:12.440951 19625 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:12.443861 25503 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:12.444401 25503 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:12.444638 25584 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.446472 25492 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.446897 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:12.447541 19584 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:12.450819 25578 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:12.347415 25486 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 13:20:12.458854 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:12.459623 19581 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:12.462623 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:12.462981 25186 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:12.463577 19658 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:12.464723 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:12.465605 19658 raft_consensus.cc:2393] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 13: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:12.466050 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:12.466609 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:12.413918 25524 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:12.467710 19658 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:12.468050 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:12.467967 25524 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.468637 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:12.468973 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:12.470152 25524 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.466050 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:12.472963 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:12.473675 19512 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:12.475939 25574 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.479471 25502 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:12.467278 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:12.481216 19654 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:12.482836 19504 raft_consensus.cc:2410] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:20:12.485262 19509 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:20:12.436151 19476 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:12.487463 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 71847us
I20260709 13:20:12.487726 20665 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:12.488509 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:12.488906 19510 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:12.436053 25593 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:12.501024 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:12.501308 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:12.502830 24491 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:12.503295 24491 raft_consensus.cc:697] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:12.503847 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.510672 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:12.514029 19504 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:12.516232 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:12.518698 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 82602.3us
I20260709 13:20:12.519304 19510 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:12.527112 19509 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:12.501794 25524 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:12.531806 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:12.532930 19507 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:12.535522 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:12.536341 19587 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:20:12.500460 25574 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:12.541488 19504 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:12.494010 25430 consensus_queue.cc:1059] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
W20260709 13:20:12.552937 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.445346 25503 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.527350 25258 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:12.555518 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:12.558699 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:12.529783 25449 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.554324 24491 consensus_queue.cc:237] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:12.565835 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:12.560087 19581 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 13:20:12.582726 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.585429 19586 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:12.555805 25511 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:12.574209 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 131640us
I20260709 13:20:12.589670 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:12.568326 24987 consensus_meta.cc:287] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.586s	user 0.012s	sys 0.000s
I20260709 13:20:12.566033 25258 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:12.592767 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 62100.8us
I20260709 13:20:12.566368 25569 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.602453 19627 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:12.601009 19584 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:12.567891 25180 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:12.616027 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 93121.7us
I20260709 13:20:12.551230 25567 consensus_queue.cc:1059] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:20:12.539506 25558 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.626477 19586 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:12.619432 19587 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:12.621138 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:12.622159 19582 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
W20260709 13:20:12.617748 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.624639 25180 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.616849 20619 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:12.623517 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:12.629980 19584 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:12.620925 25502 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:12.624930 25600 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:12.625960 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:12.613397 25258 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:12.615053 25006 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:12.638022 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.584084 25449 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.567922 25574 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.638911 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:12.639040 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:12.629597 25481 consensus_meta.cc:287] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.781s	user 0.011s	sys 0.001s
I20260709 13:20:12.649809 25175 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:12.650858 25567 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:12.656080 25567 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:12.656489 25567 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:12.657675 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:12.658370 19507 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:12.660730 19409 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 55) took 9721 ms. Trace:
I20260709 13:20:12.662029 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:12.614120 24987 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:12.613706 25511 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.662837 19512 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:20:12.668486 19507 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:12.670315 25449 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:12.673758 25593 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.661128 19409 rpcz_store.cc:276] 0709 13:20:02.939351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.939618 (+   267us) service_pool.cc:224] Handling call
0709 13:20:12.660525 (+9720907us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:11.207641 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:11.208458 (+   817us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:11.208517 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:20:11.208552 (+    35us) tablet.cc:662] Decoding operations
0709 13:20:11.209026 (+   474us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:11.209138 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:11.209170 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:20:11.209498 (+   328us) tablet.cc:701] Row locks acquired
0709 13:20:11.209545 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:20:11.221405 (+ 11860us) write_op.cc:270] Start()
0709 13:20:11.257817 (+ 36412us) write_op.cc:276] Timestamp: P: 1783603211217165 usec, L: 0
0709 13:20:11.257861 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:20:11.258807 (+   946us) log.cc:844] Serialized 539 byte log entry
0709 13:20:12.226283 (+967476us) op_driver.cc:464] REPLICATION: finished
0709 13:20:12.425575 (+199292us) write_op.cc:301] APPLY: starting
0709 13:20:12.425743 (+   168us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:12.428050 (+  2307us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:12.428212 (+   162us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:12.429181 (+   969us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:12.429568 (+   387us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:20:12.436234 (+  6666us) write_op.cc:312] APPLY: finished
0709 13:20:12.436542 (+   308us) log.cc:844] Serialized 25 byte log entry
0709 13:20:12.458316 (+ 21774us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:12.458422 (+   106us) write_op.cc:454] Released schema lock
0709 13:20:12.458478 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:12.556512 (+ 98034us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:12.561497 (+  4985us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1664588,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":154185,"apply.run_cpu_time_us":5393,"apply.run_wall_time_us":99842,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"num_ops":1,"prepare.queue_time_us":481036,"prepare.run_cpu_time_us":31410,"prepare.run_wall_time_us":282485,"raft.queue_time_us":426642,"raft.run_cpu_time_us":47066,"raft.run_wall_time_us":167285,"replication_time_us":932390,"thread_start_us":610418,"threads_started":4,"wal-append.queue_time_us":324740}]]}
I20260709 13:20:12.674613 25579 raft_consensus.cc:3055] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:12.675994 19584 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:12.676836 19508 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21. Ops: []
W20260709 13:20:12.696216 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 75169.4us
I20260709 13:20:12.677873 19655 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:12.677297 25430 raft_consensus.cc:3055] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:12.684614 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:12.686472 25260 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.698196 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:12.722940 25567 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.695782 25579 raft_consensus.cc:740] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:12.699237 25430 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:12.722721 25573 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.665905 25081 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:12.729015 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.727742 25598 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.662057 25188 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:12.729650 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:12.731892 19511 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:20:12.737316 19506 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:12.752460 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:12.739122 19505 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 20. Current term is 21. Ops: []
W20260709 13:20:12.695189 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 63077.6us
W20260709 13:20:12.728595 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 58360.7us
I20260709 13:20:12.751641 19582 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:12.738468 19503 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:12.755213 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:12.756426 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:12.756531 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:12.757928 19509 raft_consensus.cc:2368] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
W20260709 13:20:12.743822 25575 consensus_meta.cc:287] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.580s	user 0.007s	sys 0.005s
I20260709 13:20:12.759217 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:12.649016 25006 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:12.480165 25561 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.294s
W20260709 13:20:12.760193 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 134215us
I20260709 13:20:12.763051 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:12.652527 25587 consensus_queue.cc:1059] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.224s
I20260709 13:20:12.646402 25559 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.231s
I20260709 13:20:12.733764 25486 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.781953 19656 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 13:20:12.770989 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:12.767412 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 70537us
I20260709 13:20:12.767434 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:12.782894 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:12.768482 19512 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:12.769553 19625 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:12.735126 25481 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:20:12.751664 25569 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.776405 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:12.788223 19582 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:20:12.638945 25600 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:12.699275 25593 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.785398 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:12.584471 25571 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.168s
I20260709 13:20:12.748906 25449 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:20:12.792817 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:12.776121 25524 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:12.793449 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:12.782922 19657 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:12.798609 19587 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:12.758319 25081 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.800416 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:12.800844 19625 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:12.809999 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:12.810853 19582 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:12.815836 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:12.757488 25573 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.820822 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:12.796900 25412 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:12.764042 25598 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.829921 25607 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:12.831328 25602 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:12.836210 25259 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.850795 25574 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.846971 25601 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:12.849793 25583 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:12.786952 25486 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:12.885251 24491 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:12.886801 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 66096.4us
I20260709 13:20:12.790113 25575 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:20:12.860611 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:12.863271 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 78930.3us
W20260709 13:20:12.840915 25605 log.cc:927] Time spent T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.166s	user 0.003s	sys 0.001s
I20260709 13:20:12.808065 25188 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:12.774700 25502 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.854409 25558 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:12.794032 25569 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.860188 25256 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.889037 19659 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:12.894619 19656 raft_consensus.cc:1275] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:12.879880 19582 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:20:12.885854 24491 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.895164 19627 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:12.891906 19587 raft_consensus.cc:2393] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 17: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:12.903829 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:12.905531 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:12.798736 25430 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.906800 19504 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:12.916201 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:12.874681 24912 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:12.919795 19652 raft_consensus.cc:2393] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 16: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:12.800928 25579 consensus_queue.cc:260] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:12.904395 25425 consensus_meta.cc:287] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.004s
I20260709 13:20:12.887723 25524 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:12.875332 25561 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
W20260709 13:20:12.931102 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.931106 19654 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:12.932351 25604 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.932902 25492 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:12.934095 24491 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.934554 25258 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.936444 24912 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.880157 25259 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.918452 25256 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:12.915679 25188 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.926266 25412 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:12.940374 25579 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:12.940821 25568 raft_consensus.cc:3055] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:20:12.921880 25580 consensus_meta.cc:287] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.003s
I20260709 13:20:12.920717 25503 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
W20260709 13:20:12.942052 25603 log.cc:927] Time spent T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:20:12.947667 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 52196.5us
I20260709 13:20:12.977195 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:12.915313 25559 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:12.952776 19661 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:20:12.956815 19660 raft_consensus.cc:2410] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:20:12.956956 19653 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:12.959604 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:12.962682 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:12.961611 25001 consensus_meta.cc:287] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.662s	user 0.014s	sys 0.000s
I20260709 13:20:12.980767 19581 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:12.982858 19587 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60808
I20260709 13:20:12.985492 19583 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 20: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:12.957901 25604 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.987677 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:12.967875 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 167114us
I20260709 13:20:12.990227 19579 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:12.991194 19625 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:12.991958 25259 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.993271 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:12.994141 19579 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:12.994309 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:12.994925 19578 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:12.995146 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:12.995596 25559 raft_consensus.cc:697] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:12.995739 19581 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:12.996802 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:12.996620 25559 consensus_queue.cc:237] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:12.997390 19580 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:20:12.998167 25081 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.999462 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:12.999835 25188 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:12.967834 25568 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:13.001049 25568 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.002535 25568 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:13.002795 19478 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:13.003959 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:13.005050 24912 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.005671 24491 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:13.006345 20665 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:20:13.009728 19578 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:13.011458 19583 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:12.960122 25492 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.020020 19478 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:13.007246 25524 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:12.985132 25412 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:13.024649 24491 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:13.026741 24491 raft_consensus.cc:697] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:13.033695 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:13.028623 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:13.039222 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 62153.5us
I20260709 13:20:13.041137 19478 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:13.024134 25259 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:20:13.028170 19625 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:13.043720 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.009354 24912 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:13.044104 19478 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:13.042245 25571 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:13.048280 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:13.048588 19478 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:13.050326 19584 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:20:13.043576 19625 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:13.045996 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:13.042280 25615 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:20:13.018630 25081 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:20:13.055536 25425 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:13.055835 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:13.055087 25571 raft_consensus.cc:697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:13.056130 25425 raft_consensus.cc:697] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:13.058043 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:13.024145 25573 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.052739 24491 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.059268 19580 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:20:13.062717 19478 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:13.072834 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:13.075161 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.062556 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:13.076130 19587 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.027384 25611 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:13.078383 19587 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:13.079288 19583 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.093811 19579 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:20:13.082904 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:13.083055 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:13.059355 25186 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:20:13.097916 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 52001.6us
I20260709 13:20:13.100018 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:13.072646 24912 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:13.102574 19578 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 8.
I20260709 13:20:13.103202 19580 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:20:13.055573 25615 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:13.100549 19478 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:13.102236 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:13.074188 25598 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:13.077602 25081 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:13.111016 19586 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:13.059859 25606 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:13.080528 25580 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:13.105252 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:13.116909 25258 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.117240 25502 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:13.116789 25412 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.118857 19585 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: [17.10-18.11]
I20260709 13:20:13.104128 25589 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:13.080528 25611 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:13.120800 19583 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
W20260709 13:20:13.127913 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 87646.9us
I20260709 13:20:13.141801 19580 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:13.143477 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:13.109647 25573 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:13.081082 25593 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.125746 20631 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:20:13.138365 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:13.126058 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:13.143373 19587 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.146436 19584 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:13.109483 25486 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:13.107173 25615 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:13.109776 25186 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:13.120388 25606 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.128482 25574 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:13.149308 19581 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:13.119100 25569 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.107525 25601 consensus_queue.cc:1048] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:20:13.140851 25589 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.141664 25524 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:13.158277 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:13.157557 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 55556.2us
I20260709 13:20:13.163422 19586 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:13.143064 25611 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:13.165822 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 107609us
I20260709 13:20:13.150940 25573 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.156665 25259 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:13.178743 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:13.158988 25574 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.157586 25606 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:13.184751 19585 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:20:13.185493 19625 leader_election.cc:400] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
I20260709 13:20:13.173130 25525 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:13.169979 25589 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:13.190635 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:13.190825 19508 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
W20260709 13:20:13.193920 25617 log.cc:927] Time spent T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:20:13.193830 25580 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:13.195155 19503 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:13.195533 25258 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.196127 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:13.196789 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:13.198232 19511 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:20:13.201277 25492 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.195169 25593 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:20:13.153518 25571 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:13.193195 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 67562.3us
I20260709 13:20:13.225083 19509 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:13.188051 25574 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:13.177526 25573 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.192986 25525 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:13.233279 19505 raft_consensus.cc:2393] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 17: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:13.179131 25259 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.233969 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:13.244530 19508 raft_consensus.cc:2368] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
I20260709 13:20:13.192761 25604 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:13.241231 25525 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:13.247426 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 56868.5us
I20260709 13:20:13.247783 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:13.248402 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:13.249178 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:13.249717 19509 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:13.253700 19507 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:13.256477 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:13.257193 19511 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:13.258831 19507 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:13.259023 25525 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:13.245831 25186 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:13.262763 25554 consensus_meta.cc:287] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.987s	user 0.009s	sys 0.007s
I20260709 13:20:13.264250 25260 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.239209 25524 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:13.182801 25626 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
W20260709 13:20:13.234362 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 108391us
I20260709 13:20:13.271211 19551 leader_election.cc:400] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 24. Current term is 25.
I20260709 13:20:13.271577 19551 leader_election.cc:403] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:20:13.270174 25081 raft_consensus.cc:697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:13.272388 19551 leader_election.cc:400] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 19.
I20260709 13:20:13.272706 19551 leader_election.cc:403] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:20:13.245800 25259 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:13.277834 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.271783 19478 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:13.187220 25425 consensus_queue.cc:237] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:13.282742 25525 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.284734 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:13.277433 25621 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 24. Current term is 25.
I20260709 13:20:13.286747 19656 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:13.240142 25258 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.287179 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:13.273703 25492 consensus_queue.cc:1059] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:20:13.288932 25258 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.299327 19510 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:13.264971 25503 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.303771 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:13.273985 25580 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:20:13.322095 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.337775 19478 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:13.318532 25580 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:13.338995 19478 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:13.316169 25569 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 19.
I20260709 13:20:13.339111 19625 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:13.316594 25511 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.315591 25628 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:13.341567 19478 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:13.365216 25607 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:13.365741 25607 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.319368 25503 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.366703 24491 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:13.367599 25554 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:13.368750 25503 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:13.342124 25587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.014s	sys 0.035s
I20260709 13:20:13.336319 25593 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.313694 25621 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:13.366171 25607 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:13.371536 19625 leader_election.cc:400] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
I20260709 13:20:13.341938 25186 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:13.341320 25580 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:13.375464 25587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.014s	sys 0.035s
I20260709 13:20:13.362524 25258 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:13.341137 25629 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:13.371176 25628 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.378453 25621 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:13.341007 25578 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:20:13.338310 25579 consensus_queue.cc:1059] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:20:13.379273 25282 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:13.405680 25186 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:13.453912 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.379602 19625 leader_election.cc:403] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:20:13.419289 25629 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.477456 24491 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:13.446408 25558 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.379319 25593 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.414942 25258 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:13.426318 25628 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:13.447340 25621 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:13.486734 25579 raft_consensus.cc:3055] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:13.470372 25186 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:13.484699 24491 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.489691 25574 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:13.489969 25627 log.cc:927] Time spent T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:20:13.319577 25081 consensus_queue.cc:237] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:13.493046 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 121710us
I20260709 13:20:13.497344 25574 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.509451 25607 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.510919 25606 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.484037 25258 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.483326 25629 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:13.492377 25579 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:13.518234 25578 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:13.475693 25282 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:13.526533 19625 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:13.537596 25607 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:13.526051 25259 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.542920 25282 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:13.491986 25558 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.544937 25558 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:13.545475 25425 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:13.546000 25425 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.546412 25425 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:13.560765 25632 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:13.561345 25632 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:13.562484 25632 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.542186 25259 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.578454 25593 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.586259 25006 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:13.588424 25524 raft_consensus.cc:3055] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:13.588996 25524 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:13.592129 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:13.592577 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:13.593686 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:13.594277 19654 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.596092 19660 raft_consensus.cc:1275] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:13.597322 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:13.598141 25579 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.598769 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:13.599483 19657 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:13.599427 25579 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:13.606892 25606 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:13.610968 25449 raft_consensus.cc:3055] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:13.611495 25449 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:13.611166 25258 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.612423 25449 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.611989 19654 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:13.614609 25258 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.621807 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:13.622614 25256 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.622784 19652 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:13.623447 25608 raft_consensus.cc:3055] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:13.623611 25001 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:13.623893 25608 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:13.623998 25001 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:13.624249 19587 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.625650 25524 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.626576 25180 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.626783 25524 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.627431 25608 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:13.614910 25567 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:13.629976 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:13.617674 25600 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.630520 19578 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:13.631112 25593 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.624972 25001 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.631618 25593 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.632169 25001 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:13.633826 25593 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.628594 25608 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:13.635769 24987 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:13.629278 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:13.638334 19579 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 13.
I20260709 13:20:13.639739 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:13.640439 19586 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:20:13.643589 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:13.643980 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:13.644212 19580 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 25.
I20260709 13:20:13.644577 19583 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:13.645269 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:13.645488 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:13.645918 19584 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:13.646319 20665 raft_consensus.cc:2393] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 21: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:20:13.646765 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:13.647320 19584 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.651425 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:13.653340 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:13.655858 19578 raft_consensus.cc:2468] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 9.
I20260709 13:20:13.653429 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:13.657351 19587 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:13.658012 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
W20260709 13:20:13.662061 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.652566 20631 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:20:13.663977 25449 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:13.664417 20631 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:20:13.664755 25621 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.665935 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:13.666546 19579 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.667063 25186 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.669637 25621 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.669926 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:13.674481 19586 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:13.669881 25600 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:13.670943 19582 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:13.683513 19584 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:13.672585 25573 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.675638 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:13.654101 19652 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 13.
I20260709 13:20:13.694536 19656 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:13.694815 19583 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:13.695525 20665 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:13.697108 19406 catalog_manager.cc:5697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:13.701063 19476 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:13.682370 19579 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:13.677374 19625 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:13.704404 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:13.705116 19579 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:13.686576 19587 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:13.708449 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:13.710044 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:13.723158 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:13.723363 19578 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:13.712469 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:13.676752 25632 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:13.669386 25186 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.713399 19406 catalog_manager.cc:5697] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:13.714306 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:13.731652 19509 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 20. Current term is 21. Ops: []
W20260709 13:20:13.693575 25611 consensus_meta.cc:287] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.001s
I20260709 13:20:13.683372 25600 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.733408 19512 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:20:13.683053 25259 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:13.735841 19476 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:13.732475 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:13.706195 25180 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.738328 19586 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:13.702066 25256 raft_consensus.cc:2804] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:13.669324 25580 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.759483 19503 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:20:13.768852 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:13.759912 19553 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:20:13.713533 25282 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:13.732774 25568 consensus_meta.cc:287] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.730s	user 0.011s	sys 0.002s
I20260709 13:20:13.757887 25366 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:13.745044 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:13.775722 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.750476 24826 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:13.715003 25587 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:13.750837 25511 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:13.757014 25600 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.652959 25589 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.714972 25006 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:20:13.773571 19625 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:13.759976 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:13.788579 19587 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:13.763998 25260 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:13.779690 19509 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:20:13.792733 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:13.785894 19508 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:13.762053 25481 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.773799 19478 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:13.789518 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:13.775547 25593 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:13.735122 25628 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.797842 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:13.758667 25574 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:20:13.756475 25611 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.810699 19478 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:13.811995 19478 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:13.805961 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:13.806667 19507 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:13.808176 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:13.813179 19511 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:13.805811 19505 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:13.780321 25587 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.813474 19506 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:13.778826 25256 raft_consensus.cc:697] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 9 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:13.809607 19578 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:13.774407 25259 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.819501 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:13.787585 25511 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:13.819123 19478 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:13.775588 25639 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
W20260709 13:20:13.835150 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.774551 25180 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.839529 19478 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:13.847923 19507 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:20:13.845642 19506 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:13.799908 24987 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:13.809827 25593 raft_consensus.cc:697] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:13.819147 25282 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:13.853358 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:13.783161 25366 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.810060 25568 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:13.830476 25260 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:13.820591 25571 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:13.806439 25481 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.834285 25587 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:13.863885 19511 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:13.824445 19587 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:13.831784 25561 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:20:13.869665 25260 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.854661 24987 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.855837 25186 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:13.870050 25571 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.862057 25258 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:20:13.899063 25641 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:20:13.900679 25615 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.902050 25615 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:13.876381 25449 consensus_queue.cc:1059] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:20:13.906435 25449 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:13.906917 25449 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:13.908057 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.907923 25449 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.909643 25449 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:13.880604 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 121844us
I20260709 13:20:13.847553 25567 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:20:13.913795 25256 consensus_queue.cc:237] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:13.852002 25575 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:20:13.860354 25282 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.916154 25282 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:13.862545 25612 consensus_queue.cc:1059] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.192s
I20260709 13:20:13.885715 19625 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:13.886754 25186 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:13.917769 25632 raft_consensus.cc:3055] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:13.917963 25186 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:13.918195 25632 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:13.919148 25632 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.920351 25632 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:13.920672 25629 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.921291 25612 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:13.921844 25612 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:13.892035 25430 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:13.922794 25612 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.921792 25511 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:13.893237 25589 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.895160 25180 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.885533 25574 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.874076 25568 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:13.882638 25636 log.cc:927] Time spent T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:13.927729 19509 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 19: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:20:13.927901 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:13.947774 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.884032 25260 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:13.884842 24987 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.865423 25425 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.967320 25425 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:13.978753 25611 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:13.978925 25568 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:13.980178 25259 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:13.926083 25573 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:13.985544 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:13.989255 19551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.009s	sys 0.009s
I20260709 13:20:13.994692 25629 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:14.018107 19551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.010s	sys 0.009s
W20260709 13:20:14.018745 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 734068us
W20260709 13:20:13.998780 25646 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:20:13.946489 25258 raft_consensus.cc:697] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:14.000553 25639 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:14.000890 19476 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:14.047149 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 46335.9us
I20260709 13:20:14.001947 25589 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:14.005709 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 166281us
I20260709 13:20:13.898216 25571 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:14.054373 25628 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:13.997114 25643 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:20:14.019464 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:13.889045 25004 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.159s
I20260709 13:20:14.060454 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:14.064644 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:14.064934 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:14.043974 25561 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.068341 25569 raft_consensus.cc:2764] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:20:14.090703 25561 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:14.091614 25649 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:14.064540 25580 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:14.070286 20629 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.072494 25366 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:14.064184 25573 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:14.094266 25573 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:14.094748 25573 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:14.095758 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:14.078461 25186 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:14.097718 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:14.098368 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.099406 25186 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:14.080816 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:14.102106 25004 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:14.102591 25004 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:14.102710 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:14.103528 25606 consensus_queue.cc:1059] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:14.104346 25606 consensus_queue.cc:1243] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:14.104395 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:14.104955 25606 raft_consensus.cc:3055] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:20:14.082343 25578 consensus_meta.cc:287] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.003s
I20260709 13:20:14.082772 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:14.057705 25589 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:14.092860 25561 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:14.096602 19581 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:13.946182 25574 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:14.106416 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:14.071424 25481 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:14.105592 19508 raft_consensus.cc:2393] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 18: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:14.106617 19509 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:14.111411 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:14.129213 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:14.130719 20665 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
W20260709 13:20:14.112807 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 47959.7us
I20260709 13:20:14.131918 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:20:14.115787 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:14.066532 25621 raft_consensus.cc:2764] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:20:14.105396 25606 raft_consensus.cc:740] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:14.156917 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:14.132890 19587 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:14.159531 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:14.160097 19587 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:14.163237 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:14.164100 19586 raft_consensus.cc:2368] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
W20260709 13:20:14.157708 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 94781.3us
I20260709 13:20:14.169159 19503 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:20:14.170071 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:14.170924 19581 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:14.018577 25593 consensus_queue.cc:237] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:14.066346 25259 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
W20260709 13:20:14.184430 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.185209 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:14.188015 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:14.069448 25587 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:14.180559 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:14.193540 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:14.195055 19506 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:14.193821 19652 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:20:14.196412 19652 pending_rounds.cc:85] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 10
I20260709 13:20:14.194155 19578 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:14.063226 24987 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:14.189383 24491 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:14.189450 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57625.4us
I20260709 13:20:14.126284 24826 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:20:14.111102 25579 consensus_meta.cc:287] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.000s
I20260709 13:20:14.123775 25578 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
I20260709 13:20:14.175041 25621 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.187456 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:14.198400 24491 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:14.236064 24491 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:14.237016 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.107249 25644 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:14.198824 19478 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:14.214814 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:14.241277 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:14.241957 19478 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:14.242875 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.244092 19508 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:14.245599 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:14.172998 25481 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.249362 25481 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:14.245396 25567 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.255338 25567 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:14.258999 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.245142 25621 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:14.248795 24912 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:14.196684 19652 pending_rounds.cc:107] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:20:14.274325 19652 raft_consensus.cc:2889] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:14.252733 19511 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:20:14.254145 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:14.254392 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:14.275884 19581 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:20:14.107406 25629 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 13:20:14.126459 25430 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 13:20:14.262007 19587 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:14.264226 19586 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:14.268357 24491 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:14.270210 19627 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:14.263144 25647 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:20:14.234877 25589 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:14.292392 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:14.295217 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 230627us
I20260709 13:20:14.363526 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:14.327618 19587 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:20:14.199478 25180 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:20:14.103534 25004 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:14.401994 19586 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:14.364252 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3760) took 1112 ms. Trace:
I20260709 13:20:14.402755 19505 rpcz_store.cc:276] 0709 13:20:13.252232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.259689 (+  7457us) service_pool.cc:224] Handling call
0709 13:20:13.259965 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:13.813856 (+553891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.363911 (+550055us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b54000fc654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:14.364154 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1254742912}
I20260709 13:20:14.379339 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:14.382881 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.389967 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:20:14.390879 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 120781us
I20260709 13:20:14.396239 19579 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:20:14.407744 19579 pending_rounds.cc:85] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 10
I20260709 13:20:14.408090 19579 pending_rounds.cc:107] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:20:14.408386 19579 raft_consensus.cc:2889] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:14.397908 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:14.376282 25569 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.398685 25621 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:14.424729 24491 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:14.425052 19505 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:14.329042 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:14.375847 25430 consensus_queue.cc:1243] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 19.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:14.362529 25580 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:14.417052 19578 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:14.420867 25574 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:14.422322 25569 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:14.278366 24826 raft_consensus.cc:697] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:14.427994 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:14.269899 24987 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:14.272372 25644 raft_consensus.cc:697] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:14.199857 25258 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:14.429234 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 252238us
I20260709 13:20:14.406104 25611 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:14.432060 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:14.432518 19656 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
W20260709 13:20:14.443495 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 201576us
I20260709 13:20:14.401847 25567 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:14.378973 25579 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:14.427733 25632 consensus_meta.cc:287] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.003s
I20260709 13:20:14.477815 19627 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:14.478125 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:14.484267 19581 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:14.375154 25260 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:14.477078 19587 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:14.502328 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:14.504238 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:14.508633 19579 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:14.435376 25188 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:14.433832 25081 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.321105 25606 consensus_queue.cc:260] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:14.576610 19625 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.129:38645 timed out after 2.099s (SENT) [suppressed 4 similar messages]
W20260709 13:20:14.582988 25653 log.cc:927] Time spent T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
W20260709 13:20:14.550209 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 72199.8us
I20260709 13:20:14.556991 24987 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:14.606822 19478 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:14.551718 19653 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:14.582048 25650 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:20:14.585852 25481 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:14.474546 25004 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:14.476157 25621 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:14.565771 19504 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:14.552207 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:14.519345 25579 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:14.632779 19658 raft_consensus.cc:2368] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18.
I20260709 13:20:14.558632 25573 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:14.562626 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:14.564952 25260 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:14.551450 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:14.601368 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 48422.3us
I20260709 13:20:14.611133 25188 raft_consensus.cc:697] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:14.549865 25430 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:14.474992 25580 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:14.609977 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 50482.1us
I20260709 13:20:14.609977 19478 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:14.596508 24912 raft_consensus.cc:697] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:14.658730 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:14.632297 25600 consensus_meta.cc:287] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.839s	user 0.012s	sys 0.000s
I20260709 13:20:14.659595 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:14.660193 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:14.660089 25600 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:14.661016 19658 raft_consensus.cc:2393] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:14.661752 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:14.662505 19511 raft_consensus.cc:2393] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 21: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:14.662835 25600 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:14.663261 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:14.663389 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:14.663880 20665 raft_consensus.cc:2393] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:20:14.664413 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:14.665156 19511 raft_consensus.cc:2368] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18.
W20260709 13:20:14.629882 19510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 3736) took 2075 ms (client timeout 2099 ms). Trace:
I20260709 13:20:14.630218 19508 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:14.557114 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:14.650470 19660 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 19: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:14.689404 19654 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
W20260709 13:20:14.658993 25660 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:20:14.659791 24912 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:14.717828 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:14.660852 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:14.719197 19505 raft_consensus.cc:2393] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 19: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:14.595288 19652 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:20:14.651762 19655 raft_consensus.cc:2410] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:20:14.667212 25449 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:14.634296 25621 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:14.609762 25568 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:20:14.615353 24987 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:14.666929 19510 rpcz_store.cc:269] 0709 13:20:12.554947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.555145 (+   198us) service_pool.cc:224] Handling call
0709 13:20:14.617040 (+2061895us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b54002aadd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:14.629822 (+ 12782us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604209024}
I20260709 13:20:14.687656 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:14.668284 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 58377.9us
I20260709 13:20:14.617580 24826 consensus_queue.cc:237] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:14.738777 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:14.714147 19627 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:14.717736 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:14.693722 25260 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:14.725057 19476 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:14.727723 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.605747 25081 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:14.758621 25081 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:14.729017 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:14.759879 19655 raft_consensus.cc:2410] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:20:14.760864 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:14.731426 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:14.733191 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:14.731138 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3092) took 1075 ms. Trace:
I20260709 13:20:14.688544 25578 raft_consensus.cc:3055] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:14.687791 25481 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:14.762375 25671 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:14.736943 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3750) took 1545 ms. Trace:
I20260709 13:20:14.763219 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:14.763161 19512 rpcz_store.cc:276] 0709 13:20:13.191664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.192163 (+   499us) service_pool.cc:224] Handling call
0709 13:20:13.200917 (+  8754us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:13.750444 (+549527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.736608 (+986164us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b54002a9ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:14.736865 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223953152}
I20260709 13:20:14.763891 19655 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:14.764536 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:14.765250 19512 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:14.692134 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:14.762480 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:14.766245 19660 raft_consensus.cc:2368] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19.
I20260709 13:20:14.767012 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:14.690318 25644 consensus_queue.cc:237] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:14.768121 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:14.625339 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:14.769325 19653 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:14.741065 19511 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:20:14.742758 19627 leader_election.cc:400] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
I20260709 13:20:14.771095 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:14.772970 19627 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:14.767035 20665 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:20:14.743366 25675 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:20:14.743065 25621 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:14.743430 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:14.743734 24987 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:14.745337 19510 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20. Ops: []
W20260709 13:20:14.738660 25661 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:20:14.781756 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:14.686553 25587 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:14.777367 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 52405.3us
I20260709 13:20:14.778776 19627 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:14.744560 25562 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:14.781107 19511 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:14.763046 25671 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.768723 19660 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:14.769927 25578 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:14.785881 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:14.780360 25481 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:14.794543 19658 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:14.808477 19655 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:14.925567 20666 raft_consensus.cc:2393] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 21: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:20:14.809279 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:14.925776 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:14.926676 19653 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:20:14.762121 19580 rpcz_store.cc:276] 0709 13:20:13.645750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.648078 (+  2328us) service_pool.cc:224] Handling call
0709 13:20:13.685168 (+ 37090us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:13.706199 (+ 21031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:13.706234 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:13.713310 (+  7076us) log.cc:844] Serialized 26 byte log entry
0709 13:20:13.888296 (+174986us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:13.888992 (+   696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.889094 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:14.720662 (+831568us) raft_consensus.cc:1685] finished
0709 13:20:14.720692 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.720852 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11,"raft.queue_time_us":611,"spinlock_wait_cycles":44940032,"thread_start_us":115341,"threads_started":1,"wal-append.queue_time_us":477828}
W20260709 13:20:14.916644 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 123355us
W20260709 13:20:14.917325 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 406597us
W20260709 13:20:14.927675 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 149008us
I20260709 13:20:14.776826 25260 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:14.962100 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 43534.2us
I20260709 13:20:14.851362 25589 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:14.965590 19653 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:14.798755 25562 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.923098 25671 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:14.980894 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:14.934289 25663 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.953173 25256 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.959546 25615 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:20:14.999060 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 422469us
I20260709 13:20:15.003517 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:14.968027 25567 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.969764 25569 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:14.976989 25562 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:14.987756 25573 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:14.981453 25579 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:15.028373 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:15.018214 25593 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.010s	sys 0.011s
I20260709 13:20:15.019459 25649 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:15.039748 19512 raft_consensus.cc:2368] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19.
W20260709 13:20:15.040150 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 348165us
I20260709 13:20:15.045823 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:15.035810 25569 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:15.054913 19512 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:15.028468 25615 raft_consensus.cc:697] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:15.057821 19580 raft_consensus.cc:1275] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:20:15.058924 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 97793.8us
W20260709 13:20:15.039513 25593 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.011s	sys 0.011s
I20260709 13:20:14.952963 25188 consensus_queue.cc:237] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.017413 25256 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:15.069231 19627 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:15.028069 25652 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:20:15.025334 25567 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:15.071537 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 141638us
I20260709 13:20:15.005131 25669 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:20:15.072695 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:20:15.074743 19625 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:15.017673 25663 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.078199 19476 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:15.020782 25578 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:15.072600 25571 consensus_meta.cc:287] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 1.022s	user 0.014s	sys 0.001s
W20260709 13:20:15.120816 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 46191.2us
I20260709 13:20:15.123718 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:15.125556 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 47449.4us
I20260709 13:20:15.128434 24826 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.128818 19510 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:20:15.127049 19476 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:15.130968 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:15.132685 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 60075.9us
I20260709 13:20:15.078845 25580 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:15.089275 25626 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:15.117806 25587 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:15.162842 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:15.165007 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:15.165050 19625 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:15.129902 24826 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.087684 25600 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:20:15.121011 25639 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.210801 25580 consensus_queue.cc:1059] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:15.130810 25589 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.216604 20666 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:15.063093 25260 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.135135 25430 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:15.221364 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:15.235026 19652 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:15.222417 19512 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
W20260709 13:20:15.167337 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 122142us
I20260709 13:20:15.236630 19551 leader_election.cc:400] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18.
I20260709 13:20:15.237093 19551 leader_election.cc:403] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:15.121215 25632 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:20:15.229508 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:15.245776 24826 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:15.133790 25571 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:15.253083 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 88107.2us
I20260709 13:20:15.254145 25687 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18.
I20260709 13:20:15.258109 24826 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:15.258903 19625 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:15.254345 25580 consensus_queue.cc:1243] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:15.254804 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:15.260202 25574 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:15.258792 24826 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:15.266433 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:15.267352 19512 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:15.268882 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:15.213171 25579 consensus_queue.cc:1059] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:20:15.282196 19551 leader_election.cc:400] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19.
I20260709 13:20:15.282614 19551 leader_election.cc:403] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:20:15.265462 25574 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.283556 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:15.287387 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 160412us
W20260709 13:20:15.262652 25666 log.cc:927] Time spent T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
I20260709 13:20:15.288352 19476 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:15.215196 25626 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:15.258042 25669 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.295619 19507 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:20:15.245860 25694 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:15.301151 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:15.293510 25574 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:15.246613 25589 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.239360 25639 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.294368 25569 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19.
I20260709 13:20:15.297395 25621 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:15.314059 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:15.315186 24826 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:15.324312 24826 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.304361 25652 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:15.298978 25258 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.305853 25694 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:15.300326 25687 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:15.249383 25615 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.324765 24826 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.342742 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:15.345850 19551 leader_election.cc:400] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18.
I20260709 13:20:15.351954 19512 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:15.588385 25720 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:15.348064 24826 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:15.589591 24826 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:15.590062 24826 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.346489 25701 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.591104 25701 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.592149 24826 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:15.347045 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3419) took 1234 ms. Trace:
I20260709 13:20:15.355506 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:15.594008 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 238576us
I20260709 13:20:15.594854 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:15.323144 25621 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:15.329907 25652 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:15.355315 25282 consensus_meta.cc:287] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 1.439s	user 0.016s	sys 0.000s
I20260709 13:20:15.333761 25694 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:15.307359 25669 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.372253 25569 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:15.380092 25698 log.cc:927] Time spent T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:20:15.371714 25579 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.380965 25692 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.381435 25706 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:15.382246 25639 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:15.383299 25628 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:20:15.384269 25004 consensus_meta.cc:287] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.768s	user 0.011s	sys 0.000s
I20260709 13:20:15.339257 25258 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.369233 25188 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:15.393990 25006 raft_consensus.cc:3055] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:15.394785 25580 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.395581 25702 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:15.410979 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:15.389117 25682 log.cc:927] Time spent T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.255s	user 0.001s	sys 0.001s
I20260709 13:20:15.375389 25693 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:15.420277 25677 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.258s	user 0.001s	sys 0.001s
W20260709 13:20:15.421126 25690 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:20:15.421784 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:20:15.422037 25696 log.cc:927] Time spent T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:20:15.624136 25628 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.423586 25626 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:15.391191 25663 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:15.424039 25686 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:20:15.705763 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:15.706588 25574 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:15.707299 25710 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:20:15.708128 20659 raft_consensus.cc:1240] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:15.708349 25258 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:15.708721 25574 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:15.621766 25692 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.424216 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:15.424783 25703 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:15.635672 25702 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.402060 25567 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:15.411015 25256 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:15.732503 25256 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.588734 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:15.334247 25687 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:15.592821 19584 rpcz_store.cc:276] 0709 13:20:14.113074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.115878 (+  2804us) service_pool.cc:224] Handling call
0709 13:20:14.116261 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:14.127615 (+ 11354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:14.127661 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:14.134599 (+  6938us) log.cc:844] Serialized 26 byte log entry
0709 13:20:14.474197 (+339598us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:14.474234 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.474304 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.346713 (+872409us) raft_consensus.cc:1685] finished
0709 13:20:15.346738 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.346933 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1782,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":21892,"thread_start_us":234167,"threads_started":1,"wal-append.queue_time_us":544730}
I20260709 13:20:15.733281 19512 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:20:15.593333 25701 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:15.583745 25629 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.199s	user 0.034s	sys 0.059s
W20260709 13:20:15.602303 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.582952 25571 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:15.615777 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 54742us
W20260709 13:20:15.623299 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 364471us
I20260709 13:20:15.599635 25621 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:15.599900 25652 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:15.599658 25524 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:15.606554 25697 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:15.635710 19659 raft_consensus.cc:2410] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 13:20:15.636190 19580 raft_consensus.cc:2410] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:20:15.639890 19627 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:15.421216 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:15.641013 25683 log.cc:927] Time spent T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
I20260709 13:20:15.606424 25282 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:15.769883 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 130101us
I20260709 13:20:15.771024 19627 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:15.735648 25702 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:15.702666 25628 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:15.705545 25704 raft_consensus.cc:3055] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:15.710376 19660 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
W20260709 13:20:15.449748 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.641654 25713 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.618713 25579 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:15.722316 25562 consensus_meta.cc:287] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.684s	user 0.012s	sys 0.002s
I20260709 13:20:15.724983 25430 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:15.725206 25707 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:15.727360 19657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3265) took 1309 ms. Trace:
I20260709 13:20:15.730185 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3779) took 1809 ms. Trace:
W20260709 13:20:15.730975 25680 log.cc:927] Time spent T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.309s	user 0.001s	sys 0.001s
I20260709 13:20:15.805372 19503 rpcz_store.cc:276] 0709 13:20:13.920419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.169877 (+249458us) service_pool.cc:224] Handling call
0709 13:20:14.170171 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:14.203027 (+ 32856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:14.203075 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:14.786814 (+583739us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b2c00000c88. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:20:14.787244 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.053960 (+266716us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:15.054097 (+   137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.054277 (+   180us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.729794 (+675517us) raft_consensus.cc:1685] finished
0709 13:20:15.729823 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.730118 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19834,"raft.queue_time_us":31496,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":13740,"spinlock_wait_cycles":74664192,"thread_start_us":255743,"threads_started":1,"wal-append.queue_time_us":418768}
I20260709 13:20:15.731393 25685 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:15.401376 24987 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.005s	sys 0.006s
I20260709 13:20:15.741782 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:15.628214 25569 consensus_queue.cc:1059] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:20:15.700524 25720 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:15.635907 25580 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.831941 19509 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:20:15.685348 25004 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
W20260709 13:20:15.742653 25629 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.365s	user 0.034s	sys 0.059s
I20260709 13:20:15.738523 25663 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.768198 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3780) took 1847 ms. Trace:
I20260709 13:20:15.879437 19506 rpcz_store.cc:276] 0709 13:20:13.920719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.195819 (+275100us) service_pool.cc:224] Handling call
0709 13:20:14.247618 (+ 51799us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:14.615925 (+368307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:14.615971 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:14.629858 (+ 13887us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.002463 (+372605us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:15.002500 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.002584 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.767858 (+765274us) raft_consensus.cc:1685] finished
0709 13:20:15.767888 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.768075 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5652,"raft.queue_time_us":128399,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":19730,"thread_start_us":706109,"threads_started":2,"wal-append.queue_time_us":406671}
I20260709 13:20:15.626405 25006 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:15.774351 24826 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.738287 25687 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:15.779851 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3270) took 1166 ms. Trace:
I20260709 13:20:15.794518 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:15.796118 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 194339us
I20260709 13:20:15.685565 25693 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.744948 25256 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:15.790787 25366 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:15.841347 25706 raft_consensus.cc:697] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:15.811838 25562 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.823488 19512 raft_consensus.cc:2410] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:20:15.794431 25524 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:15.903230 19656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 3251) took 2165 ms (client timeout 1865 ms). Trace:
W20260709 13:20:15.825364 19504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 3767) took 2046 ms (client timeout 2048 ms). Trace:
I20260709 13:20:15.781929 25704 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:15.792881 25697 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:15.903800 19656 rpcz_store.cc:269] 0709 13:20:13.731923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.732191 (+   268us) service_pool.cc:224] Handling call
0709 13:20:15.897235 (+2165044us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400217ad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:15.897365 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1153311616}
I20260709 13:20:15.882076 25430 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:15.848461 25716 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260709 13:20:15.822896 24987 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.005s	sys 0.007s
I20260709 13:20:15.877810 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:15.774333 25626 consensus_queue.cc:1059] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:20:15.882380 24826 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.885447 19660 raft_consensus.cc:3055] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:15.881973 19510 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:15.882686 19658 rpcz_store.cc:276] 0709 13:20:14.613272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.934210 (+320938us) service_pool.cc:224] Handling call
0709 13:20:14.974689 (+ 40479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:15.024429 (+ 49740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:15.024477 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:15.028749 (+  4272us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.081397 (+ 52648us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:15.081439 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.081505 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.779516 (+698011us) raft_consensus.cc:1685] finished
0709 13:20:15.779550 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.779765 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32141,"raft.queue_time_us":31478,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":6556,"thread_start_us":52015,"threads_started":1,"wal-append.queue_time_us":271458}
I20260709 13:20:15.901268 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:15.905138 19504 rpcz_store.cc:269] 0709 13:20:13.778824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.792325 (+ 13501us) service_pool.cc:224] Handling call
0709 13:20:14.106165 (+313840us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:20:15.825090 (+1718925us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400250654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:15.825286 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010217984}
I20260709 13:20:15.804014 19657 rpcz_store.cc:276] 0709 13:20:14.418123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.418346 (+   223us) service_pool.cc:224] Handling call
0709 13:20:14.424063 (+  5717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:14.473602 (+ 49539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:14.473652 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:14.499140 (+ 25488us) log.cc:844] Serialized 26 byte log entry
0709 13:20:14.873796 (+374656us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:14.873856 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.873978 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.727015 (+853037us) raft_consensus.cc:1685] finished
0709 13:20:15.727046 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.727253 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49127,"raft.queue_time_us":49290,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":29464,"thread_start_us":374204,"threads_started":1,"wal-append.queue_time_us":531782}
I20260709 13:20:15.828339 25567 consensus_queue.cc:1059] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
W20260709 13:20:15.912658 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 142118us
I20260709 13:20:15.809998 25713 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:15.915285 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 84060.7us
W20260709 13:20:15.793715 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.919800 19506 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:15.929795 19660 raft_consensus.cc:740] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:15.938897 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:15.890867 25663 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.939227 19654 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 20: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:15.926004 25258 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.877313 25720 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.882102 25685 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.907624 25524 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.930609 25430 raft_consensus.cc:697] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:15.913472 25697 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:15.947033 25692 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:15.998250 24826 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:15.950222 19660 consensus_queue.cc:260] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:15.926828 25691 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:15.937222 25569 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:15.916087 25366 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:20:15.913812 25728 consensus_queue.cc:1059] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:20:16.016523 25706 consensus_queue.cc:237] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.017748 25726 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:16.018190 25524 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:16.019534 25727 log.cc:927] Time spent T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.086s	user 0.001s	sys 0.001s
I20260709 13:20:16.019599 25366 raft_consensus.cc:3055] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:16.021350 25366 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:16.021982 19511 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:16.022535 19511 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:16.022367 25366 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.023974 25366 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:16.023618 19511 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.027837 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3775) took 2220 ms. Trace:
I20260709 13:20:16.028333 19507 rpcz_store.cc:276] 0709 13:20:13.807108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.870131 (+ 63023us) service_pool.cc:224] Handling call
0709 13:20:13.881335 (+ 11204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:15.303591 (+1422256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.027466 (+723875us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400184cd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:16.027730 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3251851136}
W20260709 13:20:16.029783 25709 log.cc:927] Time spent T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.126s	user 0.000s	sys 0.002s
I20260709 13:20:16.030252 25587 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:16.030808 25587 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.031574 25430 consensus_queue.cc:237] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.032893 25579 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:16.033663 25579 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:16.034488 25724 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.208s	user 0.002s	sys 0.000s
I20260709 13:20:16.035671 25256 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:16.002028 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 63214us
I20260709 13:20:15.942554 25669 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.008172 19660 raft_consensus.cc:3060] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:16.016022 25720 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.039304 19551 leader_election.cc:400] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19.
W20260709 13:20:16.042454 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 123744us
I20260709 13:20:16.005025 25578 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:16.046144 25716 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:20:16.063103 19584 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:16.064632 19587 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:20:16.069551 19659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 3258) took 1898 ms (client timeout 1806 ms). Trace:
I20260709 13:20:16.026747 25685 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:16.066079 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 126397us
I20260709 13:20:16.046793 25188 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:16.070104 19659 rpcz_store.cc:269] 0709 13:20:14.166525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.166635 (+   110us) service_pool.cc:224] Handling call
0709 13:20:16.064803 (+1898168us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400102554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:16.064964 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3205506304}
I20260709 13:20:16.071457 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:16.075001 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:16.074376 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:15.938275 25006 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.084370 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:16.087777 19581 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:20:16.070816 25644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.006s	user 0.027s	sys 0.041s
I20260709 13:20:16.091320 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:16.090476 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:16.092734 19578 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:20:16.004177 25258 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.096112 19587 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:16.097803 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:16.098546 19583 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:16.068683 25524 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:16.070195 25569 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.118147 25580 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.118424 25562 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:16.118844 25580 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:16.118590 25569 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.119825 25580 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:16.065451 25282 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:16.129026 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.129052 19583 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:20:16.130618 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.131105 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.131183 19583 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:16.132290 19660 raft_consensus.cc:1275] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:16.121277 25569 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.136886 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:16.088233 25732 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:16.145242 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.145471 19584 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:16.123256 25006 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.140615 25687 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:16.095602 25644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.027s	sys 0.041s
I20260709 13:20:16.132925 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59942 (request call id 485) took 1061 ms. Trace:
W20260709 13:20:16.138326 25694 consensus_meta.cc:287] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.007s
I20260709 13:20:16.154410 19660 rpcz_store.cc:276] 0709 13:20:15.071404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.855043 (+783639us) service_pool.cc:224] Handling call
0709 13:20:15.885333 (+ 30290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:16.132687 (+247354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.132871 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:16.151026 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 55738.3us
I20260709 13:20:16.152055 25626 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:16.099193 25685 consensus_queue.cc:1059] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:20:16.099087 25425 consensus_queue.cc:1059] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:20:16.092090 25188 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.118093 25524 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.175221 25687 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.146957 25702 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.066526 25704 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.176905 25524 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.179704 25693 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:16.175238 25188 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.182667 19583 raft_consensus.cc:3055] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:16.183106 19583 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:16.184082 25697 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.183910 19583 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.184966 19583 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:16.185367 25663 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.161715 25713 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.177939 25741 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.165411 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:16.141911 25258 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.161031 25004 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.179908 19585 raft_consensus.cc:2410] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
W20260709 13:20:16.187538 25671 consensus_meta.cc:287] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 1.162s	user 0.005s	sys 0.013s
I20260709 13:20:16.188439 25425 raft_consensus.cc:3055] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:16.150668 19581 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:16.233771 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:16.234494 19581 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:16.236328 25702 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:16.236811 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3784) took 2178 ms. Trace:
I20260709 13:20:16.193969 25587 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:16.237679 25671 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.239221 25587 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:16.239511 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:16.240038 19505 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:16.240772 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:16.150044 25732 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.200627 25606 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.167572 25621 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.180665 25652 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.164628 19625 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:16.214051 19652 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 14.
W20260709 13:20:16.259120 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 94634.9us
I20260709 13:20:16.228607 25741 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.239981 25671 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.237284 19508 rpcz_store.cc:276] 0709 13:20:14.058291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.247467 (+189176us) service_pool.cc:224] Handling call
0709 13:20:14.629842 (+382375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.688926 (+ 59084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.236623 (+1547697us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54002aadd0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:16.236753 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878744448}
I20260709 13:20:16.145696 25628 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.242043 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3789) took 1119 ms. Trace:
I20260709 13:20:16.194911 25593 raft_consensus.cc:3055] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:16.266744 25593 raft_consensus.cc:740] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:16.267959 25621 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.267678 25593 consensus_queue.cc:260] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.268934 25593 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:16.249766 19581 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:16.270360 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:16.270967 19581 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.271364 25732 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:16.232980 25425 raft_consensus.cc:740] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:16.250819 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 159583us
I20260709 13:20:16.272868 25425 consensus_queue.cc:260] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.274426 25425 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.162528 25694 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.275830 25628 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.232556 25004 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.276266 25694 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.264308 19625 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:16.254843 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:16.260864 19583 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 13:20:16.278836 19583 pending_rounds.cc:85] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 12
I20260709 13:20:16.279528 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:16.277310 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:16.280562 19583 pending_rounds.cc:107] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:20:16.284078 19583 raft_consensus.cc:2889] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:16.285228 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:16.285686 19583 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:16.262360 19505 rpcz_store.cc:276] 0709 13:20:15.122994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.123141 (+   147us) service_pool.cc:224] Handling call
0709 13:20:15.123468 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:16.240640 (+1117172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.241804 (+  1164us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002aa3d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:16.241981 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2567496448}
I20260709 13:20:16.289249 19581 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:16.290004 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.290664 19504 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:16.291235 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.290722 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:16.291985 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.293592 19512 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:16.294773 19578 raft_consensus.cc:2393] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:16.295101 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.295571 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:16.296025 25004 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:16.296252 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.296903 19508 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:16.298225 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.298432 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:16.299073 19587 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:16.300266 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:16.300879 19505 raft_consensus.cc:2376] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16. Re-sending same reply.
I20260709 13:20:16.278753 25706 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:16.304270 19507 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:16.304407 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.305832 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.309996 19506 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:16.310139 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:16.296670 25188 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 23 current term: 23 is higher.
I20260709 13:20:16.281730 25587 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:16.313637 25587 raft_consensus.cc:697] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:16.303877 25706 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.313905 25652 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.314394 25706 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:16.314090 25741 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:16.296851 25702 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:20:16.292073 25621 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:16.316344 25621 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:16.316709 25621 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.317881 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.319079 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:16.320130 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.313905 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.323496 19512 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 22: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:16.324406 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.324590 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:16.325006 19512 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:16.325457 19503 raft_consensus.cc:2393] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 21: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:16.326071 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:16.327574 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.328114 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.330068 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:16.330490 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:16.331704 25578 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:16.331851 19655 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 9. (term mismatch)
I20260709 13:20:16.332221 19655 pending_rounds.cc:85] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 8
I20260709 13:20:16.332509 19655 pending_rounds.cc:107] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260709 13:20:16.332453 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:16.332960 19655 raft_consensus.cc:2889] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:16.332123 25578 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:16.334103 25578 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.334672 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:16.335340 19653 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:16.335650 25726 raft_consensus.cc:3055] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:16.336009 25726 raft_consensus.cc:740] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:16.336223 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:16.336854 25726 consensus_queue.cc:260] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.337838 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:16.338418 19587 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:16.338654 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3283) took 1017 ms. Trace:
I20260709 13:20:16.339073 19660 rpcz_store.cc:276] 0709 13:20:15.320796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.157695 (+836899us) service_pool.cc:224] Handling call
0709 13:20:16.158147 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:16.162670 (+  4523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:16.162721 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:16.163502 (+   781us) log.cc:844] Serialized 26 byte log entry
0709 13:20:16.256854 (+ 93352us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:16.256952 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.257093 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:16.338452 (+ 81359us) raft_consensus.cc:1685] finished
0709 13:20:16.338471 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.338600 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25897,"raft.queue_time_us":12300,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":126,"thread_start_us":22002,"threads_started":1,"wal-append.queue_time_us":57649}
I20260709 13:20:16.340866 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:16.341125 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:16.341816 19580 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:16.341820 19581 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 19: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:16.337294 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:16.343313 19653 raft_consensus.cc:2410] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:20:16.341861 19627 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:16.343799 19583 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:16.344131 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.327574 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:16.344938 19505 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:16.345587 19512 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.344928 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:16.349494 19583 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:16.302785 25004 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.350955 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:16.352656 19627 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:20:16.352819 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:16.359781 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.361008 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:16.363592 19581 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:16.354797 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:16.364478 19583 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:16.366647 25644 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.366726 19578 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:16.367506 25644 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.350888 25562 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:16.385317 19512 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:16.386770 19587 raft_consensus.cc:2410] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:20:16.387553 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:16.396139 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:16.390668 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.391278 19507 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:16.390107 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:16.402513 19660 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:16.404192 19512 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 25. Current term is 26. Ops: []
I20260709 13:20:16.358093 25004 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.359869 25593 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:16.363143 25744 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:16.406958 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:16.407142 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 90454.8us
I20260709 13:20:16.373925 25366 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:16.388262 25562 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:16.389691 25685 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.620751 25744 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.622640 25562 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:16.622516 25685 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.624543 25744 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:16.555480 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.631381 25589 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.633038 25644 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.634692 19652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59942 (request call id 487) took 1561 ms. Trace:
I20260709 13:20:16.636196 19656 raft_consensus.cc:1240] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:16.314663 25587 consensus_queue.cc:237] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:16.605399 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.635145 19652 rpcz_store.cc:276] 0709 13:20:15.073533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.268535 (+195002us) service_pool.cc:224] Handling call
0709 13:20:16.634453 (+1365918us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54001eb754. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:16.634629 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1293534464}
I20260709 13:20:16.638844 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:16.607424 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:16.639771 19581 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:16.640163 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:16.399319 25580 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:16.610113 19507 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:20:16.404461 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:16.644732 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 240338us
I20260709 13:20:16.647187 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:16.611538 19653 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:16.405938 25713 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:16.652480 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:16.655158 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:16.657521 19653 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:20:16.660789 19653 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:20:16.661841 25744 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:16.664132 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:16.359679 25707 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:20:16.355063 25687 consensus_queue.cc:1059] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:20:16.666846 25743 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:16.667428 25743 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.667899 25743 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.668256 19659 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:20:16.668642 19659 pending_rounds.cc:85] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 10
I20260709 13:20:16.668859 19659 pending_rounds.cc:107] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:20:16.669109 19659 raft_consensus.cc:2889] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:16.669826 25744 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:20:16.670352 25729 log.cc:927] Time spent T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.635s	user 0.001s	sys 0.000s
I20260709 13:20:16.670461 25744 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:16.671198 25481 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.671761 25481 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.671701 25744 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.672637 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:16.673453 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3282) took 1353 ms. Trace:
I20260709 13:20:16.657320 25649 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:16.674839 25649 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.674067 19659 rpcz_store.cc:276] 0709 13:20:15.320001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.085488 (+765487us) service_pool.cc:224] Handling call
0709 13:20:16.097579 (+ 12091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:16.669567 (+571988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.673196 (+  3629us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b54001ecb54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:16.673394 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1311417728}
I20260709 13:20:16.684814 25663 raft_consensus.cc:3055] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:16.685313 25663 raft_consensus.cc:740] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:16.685348 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:16.686282 19585 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:16.686393 25663 consensus_queue.cc:260] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:16.687225 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:16.687516 25663 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:16.617214 25004 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:16.400055 25728 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.359980 25731 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:20:16.618780 19660 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:16.619962 19478 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:16.622829 19654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 3276) took 1901 ms (client timeout 1731 ms). Trace:
I20260709 13:20:16.624605 25685 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:16.390940 25568 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:20:16.598752 19512 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:20:16.631306 25562 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.649454 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:16.793738 19652 raft_consensus.cc:2410] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:20:16.650681 19627 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:16.794236 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 174357us
W20260709 13:20:16.794642 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 144040us
W20260709 13:20:16.660926 25735 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.642s	user 0.000s	sys 0.004s
I20260709 13:20:16.615222 25621 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.617607 25593 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.693271 25580 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:16.706580 25728 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:16.754892 19654 rpcz_store.cc:269] 0709 13:20:14.721235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.725016 (+  3781us) service_pool.cc:224] Handling call
0709 13:20:16.622617 (+1897601us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400217fd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:16.622758 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2664509696}
I20260709 13:20:16.788739 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:16.818252 19581 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:16.621384 25578 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.795168 19478 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:16.802608 19627 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:16.689371 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:16.825033 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 135724us
W20260709 13:20:16.830219 25706 consensus_meta.cc:287] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.515s	user 0.015s	sys 0.005s
I20260709 13:20:16.831054 19579 raft_consensus.cc:1240] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:16.834332 19581 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:16.836414 19478 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:16.838243 19478 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:16.831354 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 541) took 1512 ms. Trace:
I20260709 13:20:16.812754 25589 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:16.839190 19582 rpcz_store.cc:276] 0709 13:20:15.318781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.318913 (+   132us) service_pool.cc:224] Handling call
0709 13:20:15.319262 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:16.217698 (+898436us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b1800255e80. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c313024bc 00007f6c2e65048b 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66a455 00007f6c31752060 00007f6c31752bfb 00007f6c3175d64b
0709 13:20:16.225315 (+  7617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:16.225355 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:16.240741 (+ 15386us) log.cc:844] Serialized 26 byte log entry
0709 13:20:16.360507 (+119766us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:16.360558 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.360645 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:16.830291 (+469646us) raft_consensus.cc:1685] finished
0709 13:20:16.830317 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.830589 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14422,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7233,"spinlock_wait_cycles":6526848,"thread_start_us":156960,"threads_started":2,"wal-append.queue_time_us":447976}
I20260709 13:20:16.844930 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:16.815819 25004 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:16.846172 19582 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:20:16.841653 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:16.834882 25706 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.852946 19581 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:16.859148 25731 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.859582 25706 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:16.859784 25731 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.861244 25704 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:16.862779 25081 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:16.863206 25081 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.863538 25081 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.870534 25706 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:16.835119 25606 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:16.871210 25706 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.879050 19661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3261) took 2638 ms. Trace:
I20260709 13:20:16.848498 25717 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:16.854182 25644 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:16.882512 19661 rpcz_store.cc:276] 0709 13:20:14.239429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.239566 (+   137us) service_pool.cc:224] Handling call
0709 13:20:14.248648 (+  9082us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:14.263696 (+ 15048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:14.263743 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:15.794596 (+1530853us) spinlock_profiling.cc:243] Waited 8.66 ms on lock 0x7b2c0002b1b8. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:20:15.803076 (+  8480us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.917769 (+114693us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:15.917815 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.917902 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:16.660297 (+742395us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:20:16.877141 (+216844us) raft_consensus.cc:1685] finished
0709 13:20:16.877173 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.877407 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14499,"raft.queue_time_us":15054,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5845,"spinlock_wait_cycles":62733824,"thread_start_us":69130,"threads_started":1,"wal-append.queue_time_us":194504}
W20260709 13:20:16.891551 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 280239us
I20260709 13:20:16.849051 25700 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:16.850641 25687 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:16.852878 25725 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:16.848279 25004 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.911053 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.914865 25706 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:16.915657 25731 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:16.920620 25081 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.921823 25606 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.922472 25562 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:16.922603 25606 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.923413 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:16.924037 19504 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:16.924800 25713 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:16.930423 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.942174 19503 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:16.931892 19586 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:16.936563 19504 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:16.933411 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.948380 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:16.949069 25081 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:16.949865 25753 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.351s	user 0.002s	sys 0.000s
I20260709 13:20:16.951092 25524 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:16.951556 25524 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.951920 25524 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:16.899668 25644 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:16.969283 19627 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:16.964880 19581 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:16.925907 25606 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:16.907579 25725 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:16.942580 25425 consensus_meta.cc:287] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.668s	user 0.011s	sys 0.006s
I20260709 13:20:16.974617 19581 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:16.936609 25004 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:17.026314 19581 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:20:17.033699 19581 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:16.978127 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:17.024689 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 49825.8us
W20260709 13:20:17.021420 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.976348 25691 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:20:17.050418 25580 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:17.051101 25726 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:16.925583 25713 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
I20260709 13:20:17.051366 25644 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.903275 25743 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:16.972666 25717 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.054561 25743 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:17.055809 19476 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:20:17.063462 19586 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:17.070665 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:17.023995 25725 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:17.071553 20666 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 21: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:17.070849 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:17.044586 25702 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:17.075897 19625 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:17.078442 25691 consensus_queue.cc:1059] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:17.079974 25692 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:17.080608 25692 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:17.025095 25731 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:20:17.081871 25425 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:17.083004 19652 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:17.083748 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:17.084407 19660 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:17.085565 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:17.086254 19661 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:17.087446 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:17.087702 25606 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:17.092187 25755 log.cc:927] Time spent T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.302s	user 0.001s	sys 0.001s
I20260709 13:20:17.057915 25707 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:20:17.094527 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3454) took 1017 ms. Trace:
I20260709 13:20:17.031280 25568 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:20:17.094928 19584 rpcz_store.cc:276] 0709 13:20:16.077152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.158862 (+ 81710us) service_pool.cc:224] Handling call
0709 13:20:16.159306 (+   444us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:16.232586 (+ 73280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:16.232621 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:16.243776 (+ 11155us) log.cc:844] Serialized 52 byte log entry
0709 13:20:16.461548 (+217772us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:16.617732 (+156184us) log.cc:844] Serialized 14 byte log entry
0709 13:20:16.618207 (+   475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.618287 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:17.094254 (+475967us) raft_consensus.cc:1685] finished
0709 13:20:17.094281 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.094454 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60276,"prepare.queue_time_us":155603,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":38,"raft.queue_time_us":59500,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":14594,"thread_start_us":203250,"threads_started":1,"wal-append.queue_time_us":383590}
W20260709 13:20:17.101586 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.054008 25717 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:17.103231 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.104055 25728 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:17.104663 25728 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.105159 25728 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.105892 25707 raft_consensus.cc:3055] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:17.106354 25707 raft_consensus.cc:740] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:17.107366 25728 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:17.107625 25449 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:17.107282 25707 consensus_queue.cc:260] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.108112 25449 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:17.110070 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:17.110585 19657 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:17.112509 25578 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:17.113404 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:17.113603 25621 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:17.114125 19652 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:17.115731 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:17.117647 19584 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 21.
I20260709 13:20:17.119861 20631 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
W20260709 13:20:17.120512 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 44688.2us
I20260709 13:20:17.066576 25571 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:17.110589 19656 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:20:17.121505 19625 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:17.147794 19656 pending_rounds.cc:85] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 11
I20260709 13:20:17.148200 19656 pending_rounds.cc:107] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:20:17.148499 19656 raft_consensus.cc:2889] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:17.153031 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:17.162444 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:17.164629 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:17.164779 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:17.165957 19657 raft_consensus.cc:2393] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:17.166891 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:17.168143 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:17.168656 25606 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:17.144713 25707 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:17.169911 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:17.170272 25524 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.171300 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:17.172494 25524 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:17.172621 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:17.173378 19658 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:17.174242 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:17.183315 19660 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
W20260709 13:20:17.180521 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 59125.2us
I20260709 13:20:17.165988 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:17.109027 25449 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.077399 25702 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.172533 25481 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:17.151382 25571 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:17.193228 19652 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:17.202271 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:17.186843 19625 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:17.209342 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:17.175912 25593 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:17.206678 25571 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:17.211941 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:17.215342 19660 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:17.212240 19625 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:17.181931 25568 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:17.176307 25608 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:17.144932 25649 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.205473 25702 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:17.211665 25449 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:17.224325 19625 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:17.216985 25691 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:17.232352 25579 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:20:17.237533 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:17.249717 25731 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:17.222265 25706 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:17.259364 25004 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.260900 19654 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:17.263257 25004 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:17.269719 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:17.271133 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:17.271533 19505 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:20:17.219587 25608 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.275857 25608 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:17.220086 25568 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.279774 25568 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:17.296852 19580 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:17.299402 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:17.300312 19505 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:17.300755 19512 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:17.304157 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:17.372583 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 73241.9us
I20260709 13:20:17.374245 25606 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.374094 25481 consensus_queue.cc:1059] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:17.375028 25481 raft_consensus.cc:3055] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:17.374796 25606 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:17.375432 25481 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:17.376283 25481 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.376969 25606 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:17.378438 19505 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:17.379047 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.388322 25649 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:17.304857 25691 raft_consensus.cc:697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:17.390273 25691 consensus_queue.cc:237] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.395354 19658 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:17.405112 19653 raft_consensus.cc:2410] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:20:17.398360 19657 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:17.405897 19505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:17.406791 19505 raft_consensus.cc:606] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:17.407181 19505 raft_consensus.cc:614] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:17.377468 25481 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:17.410300 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:17.416988 19505 raft_consensus.cc:2393] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 19: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:20:17.418715 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.397214 25763 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.371425 25725 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.430806 25573 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.431452 25573 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.422020 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:17.434124 25524 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.434258 25573 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:17.434756 25524 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.437316 25524 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:17.438421 19505 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 26: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:17.408402 25567 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:20:17.425349 19478 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.011s	sys 0.013s
W20260709 13:20:17.453317 19478 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.011s	sys 0.013s
W20260709 13:20:17.454172 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 609278us
W20260709 13:20:17.457019 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.452442 25567 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:17.460175 25567 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.461390 25567 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:17.464030 19504 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
W20260709 13:20:17.457120 19582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.007s	sys 0.020s
I20260709 13:20:17.405501 25606 consensus_queue.cc:1059] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
W20260709 13:20:17.457041 25589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.011s	sys 0.015s
I20260709 13:20:17.452381 25524 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:17.455170 19478 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:17.456179 25726 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:17.472103 25589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.011s	sys 0.016s
I20260709 13:20:17.477056 19654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f949ff511e844749624dedf436dff50"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
W20260709 13:20:17.476819 19587 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.015s	sys 0.027s
W20260709 13:20:17.466006 19582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.008s	sys 0.020s
W20260709 13:20:17.472190 19508 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.006s	sys 0.021s
I20260709 13:20:17.446432 25763 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:17.549382 19508 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.006s	sys 0.021s
W20260709 13:20:17.471544 19551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.000s	sys 0.027s
W20260709 13:20:17.550344 19551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.000s	sys 0.028s
W20260709 13:20:17.550761 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 709193us
I20260709 13:20:17.554358 19652 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:17.472029 25687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.004s	sys 0.023s
I20260709 13:20:17.490895 25725 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:17.491253 25608 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:17.474174 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:17.476281 25573 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:20:17.475826 25744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.007s	sys 0.020s
I20260709 13:20:17.465284 25568 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:17.527251 20619 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.013s	sys 0.021s
W20260709 13:20:17.597153 20619 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.013s	sys 0.021s
I20260709 13:20:17.476104 25524 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.503865 25706 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:17.565567 25687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.004s	sys 0.023s
I20260709 13:20:17.507038 25707 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:17.549121 19587 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.015s	sys 0.027s
I20260709 13:20:17.559317 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:17.557334 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:17.612671 19505 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:20:17.614142 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:17.496639 25615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.014s	sys 0.016s
W20260709 13:20:17.571369 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 97306.5us
W20260709 13:20:17.597575 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 747928us
I20260709 13:20:17.598807 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:17.618721 19478 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:17.599604 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:17.620157 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:20:17.477478 25726 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:17.592700 19551 connection.cc:256] RPC call timeout handler was delayed by -1.1490406109999185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
W20260709 13:20:17.596258 25744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.007s	sys 0.020s
I20260709 13:20:17.616940 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3123) took 1298 ms. Trace:
I20260709 13:20:17.626755 25621 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.627385 25621 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.627897 25608 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:17.631137 25769 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:20:17.633283 25763 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:17.634029 25770 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:17.634814 25770 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:17.622670 25707 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.635771 25770 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:17.623394 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:17.610361 25687 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:17.637898 25726 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:17.638221 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3813) took 1285 ms. Trace:
I20260709 13:20:17.638442 25687 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.601418 25573 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:17.640142 25573 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.638657 19507 rpcz_store.cc:276] 0709 13:20:16.352773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.647925 (+295152us) service_pool.cc:224] Handling call
0709 13:20:16.700991 (+ 53066us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:16.776050 (+ 75059us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:16.776087 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:16.793705 (+ 17618us) log.cc:844] Serialized 26 byte log entry
0709 13:20:17.214581 (+420876us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:17.214629 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.214723 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:17.637999 (+423276us) raft_consensus.cc:1685] finished
0709 13:20:17.638024 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.638165 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21407,"raft.queue_time_us":21586,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":10185,"thread_start_us":379096,"threads_started":1,"wal-append.queue_time_us":719980}
I20260709 13:20:17.642313 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:17.643527 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:17.644629 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:17.637940 19652 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:17.646906 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:17.647403 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:17.648854 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:17.595945 25593 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.651113 25593 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.548614 25702 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.596468 25649 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:17.649573 19660 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:17.647707 19507 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 15: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:17.633963 25767 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:17.658253 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:17.663626 19505 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:17.624336 19587 rpcz_store.cc:276] 0709 13:20:16.318454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.917186 (+598732us) service_pool.cc:224] Handling call
0709 13:20:16.917531 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:16.917802 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:16.918147 (+   345us) log.cc:844] Serialized 14 byte log entry
0709 13:20:17.616555 (+698408us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:17.616627 (+    72us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:17.616684 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.616756 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.616880 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5277,"prepare.queue_time_us":662,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"thread_start_us":692688,"threads_started":1}
I20260709 13:20:17.638576 25726 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:17.621928 19478 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:20:17.623503 25615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.014s	sys 0.016s
W20260709 13:20:17.666090 19659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.011s	sys 0.043s
W20260709 13:20:17.668156 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 46556.2us
W20260709 13:20:17.670425 19659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.011s	sys 0.043s
W20260709 13:20:17.671134 19585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.015s	sys 0.025s
I20260709 13:20:17.655923 25702 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:17.591864 25589 raft_consensus.cc:697] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:17.673014 19585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.016s	sys 0.025s
I20260709 13:20:17.674944 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:17.675751 19476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.010s	sys 0.040s
W20260709 13:20:17.680145 19476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.010s	sys 0.040s
I20260709 13:20:17.680176 19660 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
W20260709 13:20:17.680589 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 506330us
I20260709 13:20:17.676684 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3281) took 2358 ms. Trace:
I20260709 13:20:17.667104 25767 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.682619 19655 rpcz_store.cc:276] 0709 13:20:15.318686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.955877 (+637191us) service_pool.cc:224] Handling call
0709 13:20:15.956364 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:16.333464 (+377100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.676353 (+1342889us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54000e88d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:17.676601 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":862767488}
I20260709 13:20:17.685957 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:17.688555 19660 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:17.686188 20631 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.003s	sys 0.037s
I20260709 13:20:17.672441 25725 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:17.617182 25706 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:17.692888 20631 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.003s	sys 0.037s
I20260709 13:20:17.679059 25593 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:17.692294 25725 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.685911 25621 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:17.672674 25726 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.690423 25767 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:17.701081 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 521224us
I20260709 13:20:17.703161 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:17.699805 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:17.685240 25649 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:20:17.692381 25707 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:17.708235 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:17.709399 19587 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:17.697835 19505 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:17.712515 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:17.710820 19659 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 23: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:17.729430 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:17.749024 19505 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:17.720112 19660 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:17.699456 25725 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:17.772435 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.780469 19505 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
W20260709 13:20:17.783440 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.789197 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:17.794489 19587 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 22.
I20260709 13:20:17.729156 25621 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:17.773751 25756 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 1.161s	user 0.000s	sys 0.010s
I20260709 13:20:17.747812 25731 raft_consensus.cc:697] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:17.788254 25571 consensus_meta.cc:287] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.568s	user 0.008s	sys 0.004s
I20260709 13:20:17.794237 25524 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:17.806542 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:17.797528 25568 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:17.811314 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:17.824987 19586 raft_consensus.cc:2410] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:20:17.826731 25726 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:17.815271 20631 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:20:17.748416 25589 consensus_queue.cc:237] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.821079 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:17.825523 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:17.818898 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 147070us
I20260709 13:20:17.828256 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:17.850646 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:17.805927 25649 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:20:17.851830 19505 raft_consensus.cc:2393] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:17.851744 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:17.853103 25593 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:17.854620 25593 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:17.855064 25593 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:17.827247 25621 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.814635 25780 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:20:17.858031 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3457) took 1511 ms. Trace:
I20260709 13:20:17.857570 25621 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:17.827087 25731 consensus_queue.cc:237] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.863660 25706 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:17.864480 25621 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:17.865386 25779 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:17.865105 25621 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:17.866837 25784 log.cc:927] Time spent T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:20:17.867553 25621 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:17.868094 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3455) took 1773 ms. Trace:
I20260709 13:20:17.869165 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:17.870519 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:17.834017 25567 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.871490 25567 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:17.873695 25776 log.cc:927] Time spent T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:20:17.875499 25774 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:20:17.876147 25726 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:17.876992 25726 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:17.877326 25772 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:20:17.878777 19510 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:17.868518 19585 rpcz_store.cc:276] 0709 13:20:16.094585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.688131 (+593546us) service_pool.cc:224] Handling call
0709 13:20:16.688460 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:16.972959 (+284499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:16.972994 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:16.973518 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:20:17.683859 (+710341us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:17.683917 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.684021 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:17.867870 (+183849us) raft_consensus.cc:1685] finished
0709 13:20:17.867896 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.868034 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":63381,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":26530,"thread_start_us":813199,"threads_started":2,"wal-append.queue_time_us":734729}
I20260709 13:20:17.879841 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:17.858631 19579 rpcz_store.cc:276] 0709 13:20:16.347043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.977875 (+630832us) service_pool.cc:224] Handling call
0709 13:20:17.024371 (+ 46496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:17.027183 (+  2812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.027228 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:17.054541 (+ 27313us) log.cc:844] Serialized 26 byte log entry
0709 13:20:17.567174 (+512633us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:17.567226 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.567328 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:17.857710 (+290382us) raft_consensus.cc:1685] finished
0709 13:20:17.857744 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.857947 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2341,"raft.queue_time_us":34301,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":7286,"thread_start_us":489414,"threads_started":1,"wal-append.queue_time_us":719043}
I20260709 13:20:17.884805 19505 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:17.814795 25782 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:17.897135 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3815) took 1284 ms. Trace:
I20260709 13:20:17.896515 19509 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:17.833595 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3122) took 1515 ms. Trace:
I20260709 13:20:17.897843 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:17.899946 19508 rpcz_store.cc:276] 0709 13:20:16.612295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.863629 (+251334us) service_pool.cc:224] Handling call
0709 13:20:16.863973 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:16.864194 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:17.549822 (+685628us) log.cc:844] Serialized 14 byte log entry
0709 13:20:17.896735 (+346913us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:17.896800 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:17.896848 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.896935 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.897076 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":605311,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":1078,"thread_start_us":1031793,"threads_started":2}
I20260709 13:20:17.899686 19582 rpcz_store.cc:276] 0709 13:20:16.318160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.856561 (+538401us) service_pool.cc:224] Handling call
0709 13:20:16.856891 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:16.857110 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:16.857385 (+   275us) log.cc:844] Serialized 14 byte log entry
0709 13:20:17.810091 (+952706us) log.cc:844] Serialized 14 byte log entry
0709 13:20:17.833118 (+ 23027us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:17.833200 (+    82us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:17.833269 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.833365 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.833526 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133,"prepare.queue_time_us":115,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":9031,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":10144,"spinlock_wait_cycles":24448,"thread_start_us":931199,"threads_started":2,"wal-append.queue_time_us":630737}
I20260709 13:20:17.877360 25726 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.831004 25768 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:17.908088 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 226439us
I20260709 13:20:17.834510 25773 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.891146 25744 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.894833 25524 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:17.896757 25621 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:17.907989 25726 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:17.904698 25763 consensus_queue.cc:1059] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:20:17.829247 25571 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:17.947762 25793 consensus_queue.cc:1048] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:20:17.940603 25768 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.906844 25782 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:17.952736 25188 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:17.945176 25786 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:17.945262 25771 log.cc:927] Time spent T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:20:17.912735 25567 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:17.944583 25773 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:17.909116 25687 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 13:20:17.946250 25777 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:20:17.906447 25593 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:17.978838 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 162630us
I20260709 13:20:17.985383 25524 raft_consensus.cc:3055] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:20:17.989806 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.998967 25664 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:18.016163 20631 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:17.984543 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 144524us
W20260709 13:20:18.007279 25481 consensus_meta.cc:287] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.004s
W20260709 13:20:18.019371 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 121625us
I20260709 13:20:17.945737 25744 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:18.017925 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 197623us
W20260709 13:20:18.021828 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 112929us
I20260709 13:20:18.031383 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.033003 19476 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:17.975347 25649 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 13:20:17.976644 25795 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:20:18.035604 19654 raft_consensus.cc:606] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:18.038516 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.040017 19654 raft_consensus.cc:614] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:17.985169 25715 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:20:18.017892 25524 raft_consensus.cc:740] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:18.042965 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:18.034297 25600 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:17.993153 25786 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.036513 25664 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 22 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:18.039564 25763 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.039659 25188 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:18.053395 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:18.052119 25621 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:18.075198 19579 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:18.079316 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.050187 25687 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:18.088419 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.083765 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.089282 19579 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:18.089780 19584 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
W20260709 13:20:18.084023 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51107.3us
I20260709 13:20:18.084470 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.090701 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.091004 19581 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:18.091457 19579 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:18.091912 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.080322 19585 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:18.039915 25794 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:18.086598 19578 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:18.094980 25664 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:18.088620 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.098217 19583 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 23: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:20:18.098088 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 62804.7us
I20260709 13:20:18.102988 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:18.072072 25787 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:20:18.103771 19586 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
W20260709 13:20:18.084749 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 49986.8us
I20260709 13:20:18.090723 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.093870 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.110625 19584 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:18.093053 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.094867 25425 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:18.110718 19585 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:18.086048 25621 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.112028 19581 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
W20260709 13:20:18.113844 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 60515.7us
I20260709 13:20:18.070075 25571 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:18.055155 25740 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:20:18.067989 25773 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.066941 25593 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:18.110587 25788 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:20:18.064589 25798 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:18.127744 19661 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:18.128371 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.141906 19579 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:18.130075 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.142647 19586 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:18.142927 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.131079 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.053372 25731 consensus_queue.cc:1059] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:20:18.144254 19579 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:18.144327 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.135210 19658 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:18.134035 19584 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:18.076021 25188 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:18.147516 25188 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.148708 25188 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:18.114408 19578 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:18.130887 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.143715 19504 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:18.150585 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.151633 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.066134 25804 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:20:18.146260 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.152792 19658 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:18.135210 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.154160 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.154834 19658 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:18.155658 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:18.155874 19579 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:18.156129 19658 raft_consensus.cc:2376] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 14. Re-sending same reply.
I20260709 13:20:18.158036 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.158905 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.159466 19660 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:18.160030 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:18.157311 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.160933 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.161430 19658 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:18.086699 25763 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.122324 25621 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:18.163417 19510 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:18.166627 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.170671 19504 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:18.174661 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.136427 25740 consensus_queue.cc:1243] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:18.176319 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:18.172685 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 107406us
I20260709 13:20:18.122911 25808 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:18.066263 25524 consensus_queue.cc:260] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.186432 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.188249 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:18.189301 19504 raft_consensus.cc:2393] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 19: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:18.177635 25571 consensus_queue.cc:1059] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:20:18.190603 20662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:18.191053 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:18.192469 25818 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:20:18.182070 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.168236 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:18.193477 20659 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:18.175760 19476 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:18.193563 19509 raft_consensus.cc:2393] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 17: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:18.191196 25571 raft_consensus.cc:3055] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:20:18.202247 19478 connection.cc:256] RPC call timeout handler was delayed by -1.4013737390000642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
I20260709 13:20:18.162698 25795 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:18.123430 25425 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.193499 19511 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:18.203238 20659 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:18.199442 19476 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:18.176826 25567 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.210381 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.198336 25571 raft_consensus.cc:740] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:18.224534 19511 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
W20260709 13:20:18.225286 24491 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:20:18.221463 19476 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:18.209865 25809 raft_consensus.cc:2764] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:18.241099 20619 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:18.218616 25524 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:18.220512 25799 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:18.225997 25668 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:18.240031 25767 consensus_meta.cc:287] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.000s
I20260709 13:20:18.232923 25730 raft_consensus.cc:3055] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:18.251148 19476 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:18.232813 25188 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.229148 25768 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.258239 25188 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:18.258881 25810 log.cc:927] Time spent T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:20:18.260591 25763 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.219416 25567 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.243110 25773 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.247826 25781 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:18.260326 25806 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:20:18.244282 25798 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:18.260746 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 3306) took 1095 ms. Trace:
I20260709 13:20:18.252879 25744 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.213194 25795 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:18.233271 19511 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 2654) took 3301 ms (client timeout 2167 ms). Trace:
I20260709 13:20:18.286679 19653 rpcz_store.cc:276] 0709 13:20:17.165443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.165702 (+   259us) service_pool.cc:224] Handling call
0709 13:20:18.260551 (+1094849us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b5400021a54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:18.260684 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499488000}
I20260709 13:20:18.290102 25818 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:18.291843 25818 raft_consensus.cc:697] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:18.292798 25818 consensus_queue.cc:237] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.294055 25731 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:18.294346 25750 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 1.891s	user 0.003s	sys 0.000s
I20260709 13:20:18.288867 25798 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:18.298671 19476 connection.cc:256] RPC call timeout handler was delayed by -1.0131477990000803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260709 13:20:18.260548 25188 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:18.259012 20661 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:18.255846 25730 raft_consensus.cc:740] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:18.300253 19511 rpcz_store.cc:269] 0709 13:20:14.925109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.925305 (+   196us) service_pool.cc:224] Handling call
0709 13:20:16.021795 (+1096490us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b54001e99a0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316d1dc0 00007f6c3175de18 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:18.193072 (+2171277us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b580085a6d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316b60aa 00007f6c31738447 00007f6c31750fe7 00007f6c317527de 00007f6c3175e27c 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c
0709 13:20:18.226773 (+ 33701us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5401580544}
I20260709 13:20:18.304944 25715 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:18.304059 25731 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.290577 25725 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.314723 19505 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:18.314980 25730 consensus_queue.cc:260] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.290388 25799 raft_consensus.cc:697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:18.316545 25799 consensus_queue.cc:237] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.317768 25692 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:20:18.321867 25801 log.cc:927] Time spent T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:20:18.321993 25730 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:18.323467 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:18.253584 25668 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.328153 20663 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 22 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:20:18.329221 19508 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:18.286597 25773 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.257115 25767 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.342526 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.335784 25786 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:18.343956 25715 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:18.303035 25781 raft_consensus.cc:697] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 14 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:18.345456 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.354959 19583 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:18.348255 19659 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:20:18.346657 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.356511 19586 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 23: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:18.302871 25798 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:18.350041 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.358528 19584 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:18.349905 19511 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:18.359434 19511 raft_consensus.cc:606] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:18.359519 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.359826 19511 raft_consensus.cc:614] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:18.360184 19584 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:18.361088 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.350380 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.347317 19657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 3307) took 1181 ms. Trace:
I20260709 13:20:18.362784 19657 rpcz_store.cc:276] 0709 13:20:17.165776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.167891 (+  2115us) service_pool.cc:224] Handling call
0709 13:20:18.347114 (+1179223us) spinlock_profiling.cc:243] Waited 8.54 ms on lock 0x7b5400020dd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:18.347252 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19630848}
I20260709 13:20:18.364151 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.364866 19584 raft_consensus.cc:2393] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 18: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:18.257901 25571 consensus_queue.cc:260] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.367529 19507 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 23: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:18.368408 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.369138 19579 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 17: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:20:18.370644 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 232495us
I20260709 13:20:18.370215 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.371930 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.372052 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.373178 19584 raft_consensus.cc:2410] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:20:18.373821 19583 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:18.374984 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.375674 19586 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:20:18.376590 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:18.345082 25715 raft_consensus.cc:3055] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:18.379017 19584 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:18.381320 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:18.334546 25773 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.345492 25004 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:20:18.385481 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.383299 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:18.386096 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.386909 19584 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:20:18.386921 19579 raft_consensus.cc:2393] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:18.351524 25782 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.350037 25795 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:18.334247 25821 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:20:18.388188 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.394064 19579 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 19: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:18.392174 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:18.395160 25687 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:18.390787 19584 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:20:18.389500 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:18.351601 20664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:18.409269 25725 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.383795 25817 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:18.380018 25715 raft_consensus.cc:740] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:18.397434 19578 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 25. Current term is 26. Ops: [25.13-25.13]
I20260709 13:20:18.410936 25817 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.411507 25715 consensus_queue.cc:260] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:18.412731 25715 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:18.410602 25687 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:18.414177 25687 raft_consensus.cc:697] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:18.414031 25781 consensus_queue.cc:237] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:18.415347 25687 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.420853 19578 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:20:18.387593 25593 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:18.387833 25004 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:18.378540 25763 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:18.423154 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.424497 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.434242 19578 raft_consensus.cc:2410] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 13:20:18.423522 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.435433 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.434722 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:18.436139 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.435883 19579 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:18.436962 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:18.437770 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:18.434216 19580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 3124) took 2080 ms (client timeout 2066 ms). Trace:
W20260709 13:20:18.441354 19580 rpcz_store.cc:269] 0709 13:20:16.318742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.342681 (+ 23939us) service_pool.cc:224] Handling call
0709 13:20:18.398849 (+2056168us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b5400269154. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:18.399025 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077060480}
I20260709 13:20:18.442998 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.444968 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.388494 25571 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:18.450657 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.447156 19586 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:18.449965 19658 raft_consensus.cc:2393] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 17: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:18.451555 19578 raft_consensus.cc:2410] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 13:20:18.452351 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.435420 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:18.452425 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.454471 19584 raft_consensus.cc:2410] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:20:18.392560 25773 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:18.456477 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.459143 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.457746 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.460062 19580 raft_consensus.cc:2376] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20. Re-sending same reply.
I20260709 13:20:18.460525 19578 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:18.462215 25004 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.463516 25004 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:18.464000 19579 raft_consensus.cc:2410] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:20:18.433159 25593 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.465875 25593 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:18.466619 25767 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.467113 19579 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:18.468397 19579 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
W20260709 13:20:18.470014 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 84188.8us
I20260709 13:20:18.446026 25578 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.454473 25821 consensus_queue.cc:1243] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 21.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:18.474042 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.461745 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:18.475296 19584 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:20:18.469996 25589 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:18.458786 25773 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:18.478986 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:18.477972 25726 consensus_meta.cc:287] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.002s
I20260709 13:20:18.498898 25808 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:18.499020 25524 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:18.499605 25524 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.499536 25808 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.500272 25524 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:18.509060 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3814) took 2146 ms. Trace:
I20260709 13:20:18.510581 20660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:18.505146 25621 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.514043 25717 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.514427 19582 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:18.516247 25621 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.509552 19512 rpcz_store.cc:276] 0709 13:20:16.363091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.800993 (+437902us) service_pool.cc:224] Handling call
0709 13:20:16.801394 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:17.301166 (+499772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.508773 (+1207607us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54002071d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:18.508992 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147987200}
I20260709 13:20:18.469756 25644 consensus_queue.cc:1059] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:20:18.522212 25644 consensus_queue.cc:1243] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:20:18.522886 25589 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:18.523087 25188 raft_consensus.cc:3055] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:18.523726 25188 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:18.523932 25589 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.525123 25808 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.487721 25773 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:18.522845 25621 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.527768 25621 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.462319 25744 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
W20260709 13:20:18.529774 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 50876.6us
I20260709 13:20:18.530452 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:18.531124 25744 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:18.531777 25744 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:18.532321 25744 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:18.533192 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:18.538545 19505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:18.541891 25644 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:18.542635 25644 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:18.542824 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.543170 25644 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:18.544023 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.476009 25578 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.548000 25578 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:18.495185 25767 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.549355 25767 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.552181 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.553879 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.554607 19657 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:20:18.533717 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.534466 25726 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.536540 25621 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.542057 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.558090 19658 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:18.559002 19585 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:20:18.534857 19512 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:18.557247 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.559962 19503 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:18.563428 25782 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:18.563607 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.567010 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.524876 25188 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.573558 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.574159 25188 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:18.575656 25425 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:18.578764 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.579764 19658 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:18.586952 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.588627 25567 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:18.589321 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.589903 19580 raft_consensus.cc:2376] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20. Re-sending same reply.
I20260709 13:20:18.590739 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.588681 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:18.591323 19580 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:18.591516 19478 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.591876 19584 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 23: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:18.592643 25673 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:18.594336 25575 raft_consensus.cc:3055] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:18.594496 19658 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:18.594810 25575 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:18.595208 25726 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.595813 25767 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.595713 25575 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.597031 25575 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:18.597301 25593 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.599507 25593 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.600107 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:18.601804 19581 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:20:18.604444 25668 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:18.607832 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.608574 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.610814 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.613016 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:18.614784 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.615782 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.616546 19511 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:18.620671 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.623158 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:18.626890 19503 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:18.623844 19653 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 20: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:18.612638 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.609373 19658 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
I20260709 13:20:18.639592 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:18.642266 19478 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.641217 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.651849 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:18.652711 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.653347 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.655963 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.577176 25744 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.664994 20665 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:20:18.654181 19658 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:18.658991 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:18.659600 19654 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:18.670691 19658 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:18.660517 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.660765 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:18.662621 19505 raft_consensus.cc:606] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:18.660081 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:18.673630 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:18.674803 19657 raft_consensus.cc:2410] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 13:20:18.668421 19508 raft_consensus.cc:2376] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19. Re-sending same reply.
I20260709 13:20:18.625591 25763 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:18.692802 19478 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.693938 25571 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:18.565464 25798 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.698498 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.650699 25668 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:18.695225 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.667476 25767 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:18.694689 25571 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:18.703028 19660 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:20:18.703116 24491 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:18.703438 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:18.709753 19658 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:18.703286 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.658958 25793 consensus_queue.cc:1059] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:20:18.718595 24491 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:18.675207 25621 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:18.719486 19478 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.710866 19503 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:20:18.687232 25817 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.696353 25768 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:18.695405 25573 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:20:18.726501 19507 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:18.664757 25673 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:20:18.718182 25562 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:18.733314 25562 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:18.736287 25562 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:18.728312 25579 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:18.738564 25828 log.cc:927] Time spent T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:20:18.739045 25567 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.739718 25567 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.708289 25639 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:18.703815 25808 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:18.746408 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.746410 19478 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.748786 19511 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:18.746436 19580 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:18.711642 25726 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:18.738090 25579 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:18.757225 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.762135 19510 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:18.750864 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.764562 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.765007 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.774348 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.775341 19504 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:18.765822 19509 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:18.786767 19508 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:18.789280 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.795327 19478 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.710457 25524 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.799155 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:18.742851 25621 raft_consensus.cc:697] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:18.768052 25712 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:18.808162 19658 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:18.804422 19503 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:18.809521 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.808703 24491 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:18.810643 19658 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:18.811388 19478 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.798492 25589 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:18.802413 25562 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.816388 24491 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:18.817034 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:18.823081 25692 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:20:18.806762 25673 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:20:18.821476 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 123060us
I20260709 13:20:18.796926 25425 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:20:18.817516 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.843358 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.797487 25812 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
W20260709 13:20:18.850946 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.847978 24491 raft_consensus.cc:697] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:18.796718 25773 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.807873 25786 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:20:18.818998 25668 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:18.804152 25571 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:20:18.840307 25562 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.838583 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:18.883390 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 65971.2us
I20260709 13:20:18.815618 25799 consensus_queue.cc:1059] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:20:18.899240 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.900718 19658 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 23: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:18.907223 25562 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:18.882387 25726 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:18.908828 25768 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:18.909381 25768 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:18.909984 25726 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:18.910445 25726 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.910806 25726 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:18.909276 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.914853 25524 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.915663 25524 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:18.916028 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.882722 25668 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:18.918421 25668 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.917557 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.907290 25579 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:18.922463 25834 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:20:18.923174 25668 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:18.881734 25567 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:18.924543 25831 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:20:18.925168 25621 consensus_queue.cc:237] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.927142 25773 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.927793 25773 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:18.928864 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.929665 19579 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:18.932230 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 120805us
I20260709 13:20:18.934172 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.932420 24491 consensus_queue.cc:237] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.937634 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:18.935356 19478 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:18.941741 19578 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:20:18.932085 25004 raft_consensus.cc:3055] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:18.878515 25587 consensus_queue.cc:1059] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
W20260709 13:20:18.947736 25837 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:20:18.949447 19578 pending_rounds.cc:85] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 10
I20260709 13:20:18.966054 19578 pending_rounds.cc:107] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:20:18.966387 19578 raft_consensus.cc:2889] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:18.966785 25816 consensus_queue.cc:1059] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:18.898949 25808 consensus_queue.cc:1059] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:20:18.967936 25571 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:18.968514 25816 raft_consensus.cc:3055] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:18.968779 25571 raft_consensus.cc:3055] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:18.968923 25816 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:18.959996 25524 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:20:18.961017 25843 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:20:18.939586 25763 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:18.898769 25780 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:18.970935 19625 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:18.961161 25004 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:18.971865 19625 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:18.972254 25004 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.973268 25575 consensus_queue.cc:1059] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:18.969308 25571 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:18.965867 25692 raft_consensus.cc:2955] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:20:18.979368 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:18.936803 19409 catalog_manager.cc:5697] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:18.973203 25639 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:18.983948 19657 pending_rounds.cc:85] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 12
I20260709 13:20:18.984359 19657 pending_rounds.cc:107] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:20:18.984704 19657 raft_consensus.cc:2889] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:18.934388 25773 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:18.913334 25644 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.962843 24912 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:18.994794 19512 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:18.964408 25817 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:18.965689 25798 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.954345 25744 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:18.974172 25567 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:18.973884 25786 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:19.004458 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:18.973536 25004 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:18.988938 25712 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:20:18.989207 25673 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:20:19.053004 25673 consensus_queue.cc:1243] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer 068c03c9dcc848e6bf909131b1f83065 log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:20:18.981564 25799 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.005182 25817 raft_consensus.cc:697] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:18.998198 24912 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.962743 25726 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:18.981714 25812 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:20:19.005268 25763 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:20:19.054334 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.991644 25188 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:20:19.003664 25567 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.991580 25816 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.007433 25786 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.072677 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:19.085925 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:19.069653 25840 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:20:19.068251 25744 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:19.033236 25773 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 13:20:19.060779 24912 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:19.095624 19551 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:20:19.069994 25763 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.077222 25808 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.082106 25567 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:19.088701 25786 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:19.059999 25799 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.104830 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:19.097365 25744 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.102591 25816 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:19.101583 25188 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:19.106771 25763 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:19.241885 25575 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.180207 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:19.140246 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:19.324082 19660 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:19.324498 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 184537us
I20260709 13:20:19.170082 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 2723) took 1611 ms. Trace:
I20260709 13:20:19.327353 19659 rpcz_store.cc:276] 0709 13:20:17.558516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.771299 (+212783us) service_pool.cc:224] Handling call
0709 13:20:18.347952 (+576653us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.357044 (+  9092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.169860 (+812816us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b5400020dd0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:19.170021 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271180544}
I20260709 13:20:19.145500 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:19.118435 25850 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.144387 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:19.118902 25744 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:19.308672 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.162973 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:19.110450 25808 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:19.343961 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:19.345074 25808 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:19.345412 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:19.101675 25817 consensus_queue.cc:237] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.197214 25644 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:19.144146 25847 log.cc:927] Time spent T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:20:19.351317 19659 raft_consensus.cc:2410] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:20:19.113221 25838 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:19.258518 25848 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:20:19.151945 25795 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:20:19.196959 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.120476 25687 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:19.375901 19660 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:19.331537 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:19.377108 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 45618.4us
W20260709 13:20:19.341054 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.294615 25726 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:19.350113 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.352133 19584 raft_consensus.cc:1275] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:20:19.380717 19584 pending_rounds.cc:85] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 9
I20260709 13:20:19.369505 19653 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:19.382671 19659 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 9. (term mismatch)
W20260709 13:20:19.382916 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.383131 19659 pending_rounds.cc:85] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 8
I20260709 13:20:19.383451 19659 pending_rounds.cc:107] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260709 13:20:19.383689 19659 raft_consensus.cc:2889] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:19.381009 19584 pending_rounds.cc:107] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:20:19.384274 19653 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:20:19.384485 19584 raft_consensus.cc:2889] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:19.384620 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:19.385728 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:19.386222 19584 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:19.386762 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:19.387356 19507 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:19.388182 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:19.384408 19627 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:19.389321 19503 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:19.390429 19660 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:20:19.181216 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.389353 19655 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:19.393464 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:19.384308 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:19.395979 19655 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:19.318861 25768 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.388283 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:19.399236 19512 raft_consensus.cc:2393] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 17: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:19.356362 25838 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.391659 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:19.402688 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:19.403357 19510 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 18: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:19.401314 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:19.405465 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:19.404826 19508 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:20:19.331916 25575 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.374133 25795 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:19.377496 25687 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:19.423854 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:19.426622 19509 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:19.428345 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 44029.2us
I20260709 13:20:19.429157 19627 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:19.429265 19506 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:19.429876 19506 raft_consensus.cc:606] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:19.430346 19506 raft_consensus.cc:614] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:19.397972 25644 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:19.365743 25188 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:20:19.401692 25808 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:19.435247 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:19.440079 19507 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:19.347754 25850 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:19.457785 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.415735 25587 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.410610 25838 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:19.433378 25687 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:19.436651 25562 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.439416 25644 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:19.448328 25579 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:19.437641 25862 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:19.515725 19509 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:19.447417 25799 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:19.424145 25860 consensus_queue.cc:1059] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
W20260709 13:20:19.519322 25649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.395s	user 0.035s	sys 0.030s
I20260709 13:20:19.515640 25644 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:19.531399 25649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.414s	user 0.035s	sys 0.030s
I20260709 13:20:19.536140 19509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:19.539407 19509 raft_consensus.cc:606] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:19.539903 19509 raft_consensus.cc:614] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:19.519049 25579 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:19.497061 25587 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.491381 25567 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.522210 25730 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:19.543726 25579 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:19.513821 25562 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.548880 25587 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:19.549098 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3490) took 1203 ms. Trace:
I20260709 13:20:19.626793 19582 rpcz_store.cc:276] 0709 13:20:18.345463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.353570 (+  8107us) service_pool.cc:224] Handling call
0709 13:20:18.353988 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.514841 (+160853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.548760 (+1033919us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54002fc954. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:19.549018 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368548608}
I20260709 13:20:19.534518 25732 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:20:19.555711 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.540890 25726 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:20:19.595180 25855 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:20:19.596531 25856 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:20:19.601385 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:19.629184 25869 log.cc:927] Time spent T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:20:19.610692 25575 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:19.613981 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 135674us
I20260709 13:20:19.621835 25730 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:19.625777 25567 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:19.553495 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3473) took 1471 ms. Trace:
W20260709 13:20:19.629262 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 200194us
I20260709 13:20:19.683125 19585 rpcz_store.cc:276] 0709 13:20:18.081897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.115506 (+ 33609us) service_pool.cc:224] Handling call
0709 13:20:18.116002 (+   496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.559477 (+443475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.553092 (+993615us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54003d18d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:19.553399 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1018226944}
I20260709 13:20:19.683719 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:19.665905 19510 raft_consensus.cc:2955] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:20:19.686462 19627 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:19.687618 19627 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:19.691807 19660 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: [21.12-21.12]
W20260709 13:20:19.565965 25858 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:20:19.635136 19504 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:19.636011 25649 raft_consensus.cc:3055] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:19.636865 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:19.703289 19506 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:19.639341 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:19.640003 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:19.629796 25692 consensus_meta.cc:287] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.624s	user 0.013s	sys 0.000s
I20260709 13:20:19.603389 25850 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:19.622542 25188 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:20:19.694109 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:19.669728 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:19.684569 25816 consensus_meta.cc:287] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
I20260709 13:20:19.721453 19509 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 15: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:19.726128 19627 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:19.670670 25726 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:19.685160 25730 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:19.731969 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3330) took 1080 ms. Trace:
I20260709 13:20:19.733343 19511 raft_consensus.cc:2410] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:20:19.692417 25567 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:19.691862 25860 raft_consensus.cc:3055] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:19.637815 25732 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.705929 25587 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:19.708485 25639 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:19.739336 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 44352us
I20260709 13:20:19.750011 19625 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:19.732543 19658 rpcz_store.cc:276] 0709 13:20:18.652048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.903126 (+251078us) service_pool.cc:224] Handling call
0709 13:20:18.903597 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.953492 (+ 49895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.953539 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:18.954199 (+   660us) log.cc:844] Serialized 26 byte log entry
0709 13:20:19.330437 (+376238us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:19.330480 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.330572 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:19.731748 (+401176us) raft_consensus.cc:1685] finished
0709 13:20:19.731771 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.731902 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49386,"raft.queue_time_us":62107,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":55,"thread_start_us":375858,"threads_started":1,"wal-append.queue_time_us":469915}
I20260709 13:20:19.706766 25799 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.702232 25649 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:19.739280 25567 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.737056 25768 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:19.752307 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.753571 25877 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.746906 25850 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:20:19.705267 25575 consensus_queue.cc:1059] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:20:19.731760 25874 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.716964 25862 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:19.747884 25587 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:19.761229 19509 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:20:19.718118 25861 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:20:19.739989 25860 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:20:19.764681 19553 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.008s	sys 0.017s
I20260709 13:20:19.758486 19657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3331) took 1097 ms. Trace:
I20260709 13:20:19.741439 25871 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:19.769515 25877 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.770635 25879 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:19.777048 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:19.777184 19657 rpcz_store.cc:276] 0709 13:20:18.661477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.983396 (+321919us) service_pool.cc:224] Handling call
0709 13:20:18.983759 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.989219 (+  5460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.989255 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:18.989887 (+   632us) log.cc:844] Serialized 26 byte log entry
0709 13:20:19.228072 (+238185us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:19.228134 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.228235 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:19.758263 (+530028us) raft_consensus.cc:1685] finished
0709 13:20:19.758282 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.758418 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":223633,"threads_started":1,"wal-append.queue_time_us":381230}
W20260709 13:20:19.777922 19553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.009s	sys 0.017s
I20260709 13:20:19.761946 25567 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:19.788496 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:19.769158 25878 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.772909 25587 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:19.756966 25639 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.772403 25818 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.760638 25799 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.793126 24491 consensus_queue.cc:1059] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:20:19.798267 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 48392us
I20260709 13:20:19.809265 24491 raft_consensus.cc:3055] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:19.809957 24491 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:19.799893 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 73871.3us
I20260709 13:20:19.811839 19627 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:19.780068 25871 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:19.800303 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:20:19.794085 25866 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:20:19.821049 20663 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:19.820884 24491 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.829200 24491 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:19.799794 25575 raft_consensus.cc:2764] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:20:19.785282 25768 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:20:19.800714 25850 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:19.821238 25188 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:19.801056 25562 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:19.794480 25817 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:20:19.772535 25874 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.804911 25763 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.834136 19509 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:19.791879 25712 consensus_queue.cc:1059] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:20:19.822372 25871 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:19.792860 25744 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.817826 25818 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:19.841374 25850 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.789516 25879 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.859982 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 2752) took 1247 ms. Trace:
I20260709 13:20:19.855723 19661 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:19.850735 25004 consensus_meta.cc:287] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.809s	user 0.012s	sys 0.003s
I20260709 13:20:19.792471 25649 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:19.889828 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:19.890401 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:19.836040 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 47605.5us
I20260709 13:20:19.839709 25573 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:19.794483 25726 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.862376 19656 rpcz_store.cc:276] 0709 13:20:18.612874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.612998 (+   124us) service_pool.cc:224] Handling call
0709 13:20:18.613295 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.613690 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.613719 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:19.173031 (+559312us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b2c0002b1b8. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:20:19.173503 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:20:19.399169 (+225666us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:19.399204 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.399268 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:19.855302 (+456034us) raft_consensus.cc:1685] finished
0709 13:20:19.855322 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.859913 (+  4591us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":424,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":27052,"spinlock_wait_cycles":36662656,"thread_start_us":216513,"threads_started":1,"wal-append.queue_time_us":280853}
I20260709 13:20:19.867749 25579 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.914525 25579 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:19.800799 25862 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.915633 25573 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.868394 25799 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:19.870373 25879 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:19.862717 25562 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:19.827713 25882 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:20:19.836635 25860 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:19.874003 25786 consensus_meta.cc:287] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.757s	user 0.010s	sys 0.003s
I20260709 13:20:19.919214 25882 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:19.919535 25786 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.919740 25882 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.863049 25188 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.921794 25882 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:19.922057 25188 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.863343 25850 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:19.874400 25644 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:19.930377 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 123448us
I20260709 13:20:19.931598 25644 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:19.876261 25639 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:19.878070 25763 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:19.878183 25890 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:19.879401 25744 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:19.880236 25712 raft_consensus.cc:3055] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:19.850911 25692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:39174 (request call id 4) took 16473 ms. Trace:
I20260709 13:20:19.921802 25786 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:19.889593 25649 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:19.934728 25562 raft_consensus.cc:697] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:19.924695 25188 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:19.933454 25712 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:19.935618 25562 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.884344 25877 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:19.862470 25731 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:19.859871 25885 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:19.885839 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:20:19.888098 25881 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:20:19.888352 25873 log.cc:927] Time spent T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:20:19.888657 25876 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:20:19.906476 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:19.918857 25879 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.933863 25692 rpcz_store.cc:276] 0709 13:20:03.365592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.365742 (+   150us) service_pool.cc:224] Handling call
0709 13:20:03.442004 (+ 76262us) log.cc:844] Serialized 513 byte log entry
0709 13:20:03.905348 (+463344us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b54003cdaa0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316d3062 00007f6c316b3eaa 00007f6c316bad53 00007f6c316bacd9 00007f6c316bac69 00007f6c316bac31 00007f6c316b9dfd 000000000038f354 000000000038f199 00007f6c2e66d475
0709 13:20:03.908636 (+  3288us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b18003618a0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:20:19.832127 (+15923491us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44744,"raft.queue_time_us":88627,"raft.run_cpu_time_us":3077,"raft.run_wall_time_us":139689,"spinlock_wait_cycles":80938112,"thread_start_us":333903,"threads_started":2,"wal-append.queue_time_us":324912,"wal-append.run_cpu_time_us":3258,"wal-append.run_wall_time_us":1413233}
I20260709 13:20:19.883183 25874 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:19.806834 25878 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:19.933677 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 121959us
I20260709 13:20:19.889063 25567 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:19.911336 24912 consensus_meta.cc:287] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.801s	user 0.013s	sys 0.000s
I20260709 13:20:19.943892 19581 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:19.944448 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:19.983891 19582 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:19.891952 25818 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:19.944330 25885 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:19.948418 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:19.947661 19583 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 11. (term mismatch)
W20260709 13:20:19.966087 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.990803 19583 pending_rounds.cc:85] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 10
I20260709 13:20:19.991178 19583 pending_rounds.cc:107] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 21.11
I20260709 13:20:19.870436 25732 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:19.970930 19579 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:20:19.946362 25888 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.981189 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:19.984372 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 81769.6us
I20260709 13:20:19.993249 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:19.994194 19580 raft_consensus.cc:2410] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:20:19.990280 19584 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:19.994738 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:19.889874 25687 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.890307 25886 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.125s
I20260709 13:20:19.991483 19583 raft_consensus.cc:2889] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:19.909415 25838 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:20.000236 19584 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:20.001159 19581 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:20.032800 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.034252 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:20.008854 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:20.035130 19507 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:20.037750 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:20.038501 19507 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 17: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:20.041085 19579 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 19: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:19.989811 25892 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:20.041888 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:20.039505 19627 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:20.043628 19584 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:20.039258 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:20.044063 19587 raft_consensus.cc:1240] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:20:20.045223 19580 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:20.047400 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:19.980304 25879 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.048609 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:20.049762 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:19.938788 25712 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.053573 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:20.054265 19657 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:20.055596 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:20.062930 25773 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:20.066375 25857 log.cc:927] Time spent T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.754s	user 0.004s	sys 0.000s
I20260709 13:20:20.065903 25885 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.067400 25885 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:20.068142 25621 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:20.068717 25621 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:19.992166 24912 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.070498 19507 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 21: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:20.051254 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:20.051560 19581 pending_rounds.cc:85] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 10
I20260709 13:20:20.072136 19581 pending_rounds.cc:107] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:20:20.072294 19584 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:20.072432 19581 raft_consensus.cc:2889] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:20.075486 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:20.076066 19657 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:20.076943 25712 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:20.038551 25188 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:20:20.074918 25692 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:20.078583 25692 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:20.079716 25692 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.083323 25838 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Requested vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:20.043529 25886 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:20.084448 25886 raft_consensus.cc:697] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:20.087440 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:20.067965 25587 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.088479 19658 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 21: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:20.075809 19627 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:20.045648 25890 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:20:20.108886 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:20.109747 19660 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 21: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:20.040040 25732 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:20.039505 25877 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:20.111219 19627 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:20.112273 25850 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:20.114085 25889 log.cc:927] Time spent T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:20:20.115702 25879 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:20.117695 25862 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:20.126365 25891 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:20:20.138641 19578 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 20. Ops: []
I20260709 13:20:20.172397 19657 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:20.174916 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:20.180694 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:20.183058 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 71966.8us
I20260709 13:20:20.083568 25730 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:19.996650 25888 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.191509 19658 raft_consensus.cc:2410] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:20:20.188349 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:20.191830 19627 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:20.176580 25808 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.004s	sys 0.008s
I20260709 13:20:20.199731 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:20.200585 19660 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:20.157673 25732 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:20.203933 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:20.164799 25885 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:20.226213 19627 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:20.178207 25877 raft_consensus.cc:697] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:20.226899 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:20.230100 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:20.230742 19578 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
W20260709 13:20:20.202710 25808 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.004s	sys 0.016s
I20260709 13:20:20.193442 25575 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:20.227859 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:20.236564 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:20.238161 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:20.202135 25740 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:20.239754 19660 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:20:20.240224 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:20.202028 25879 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:20.252769 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.207654 25732 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:20.253258 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.253790 25838 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:20.253885 24912 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:20.254473 25838 raft_consensus.cc:697] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:20.255357 25838 consensus_queue.cc:237] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.258072 25567 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:20.259491 25871 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.262589 19627 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:20.244285 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:20.244797 25897 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:20.232064 25808 raft_consensus.cc:697] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:20.247547 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:20.266661 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:20.249847 25861 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:20.251200 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:20.241200 25575 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.252645 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:20.274056 25575 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:20.278038 19661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3318) took 1664 ms. Trace:
I20260709 13:20:20.227669 25731 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:20.198626 25862 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.278471 19661 rpcz_store.cc:276] 0709 13:20:18.613583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.613720 (+   137us) service_pool.cc:224] Handling call
0709 13:20:19.855526 (+1241806us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.863003 (+  7477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.277848 (+414845us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54001ed050. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:20.277980 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2855227264}
I20260709 13:20:20.279037 25877 consensus_queue.cc:237] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.280185 25862 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:20.268676 19508 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:20.110354 25886 consensus_queue.cc:237] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.269580 19551 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:20.268368 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:20.270270 25896 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:20.318290 25896 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:20.319558 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:20.319466 25896 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.242596 25768 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:20.282006 19584 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:20:20.240053 25890 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:20.320988 19584 pending_rounds.cc:85] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 11
I20260709 13:20:20.321290 19584 pending_rounds.cc:107] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:20:20.252792 25879 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.288275 25878 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:20.266932 25579 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:20.284521 19581 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:20.302863 19476 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:20.266537 25562 consensus_queue.cc:1059] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:20:20.301280 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:20.336902 19478 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:20.338152 19579 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:20.302083 25732 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:20.302812 19627 consensus_peers.cc:597] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615): Couldn't send request to peer 068c03c9dcc848e6bf909131b1f83065. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c62f6690c8e840638906e0b59d2ae71d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:20.303547 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:20.343453 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:20.343799 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 77250.3us
I20260709 13:20:20.304929 25852 raft_consensus.cc:3055] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:20.232370 25885 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.268879 25910 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:20.320779 25768 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:20.323333 25872 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.587s	user 0.001s	sys 0.000s
I20260709 13:20:20.324147 25786 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:20.354485 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:20.320758 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:20.358294 19504 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:20.358132 25808 consensus_queue.cc:237] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.358624 25768 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:20.321524 19584 raft_consensus.cc:2889] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:20.323545 25608 raft_consensus.cc:3055] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:20.334194 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.360574 25608 raft_consensus.cc:740] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:20.291678 25871 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:20.287356 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:20.339498 19478 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:20.340123 19476 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:20.266091 25897 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:20.296967 25575 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.344481 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:20:20.364390 19627 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:20.304930 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:20.370242 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 65414us
I20260709 13:20:20.370726 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:20.371003 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:20.371407 20666 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:20.372109 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:20.346949 19553 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:20.354488 20665 raft_consensus.cc:1217] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 22 LEADER]: Deduplicated request from leader. Original: 20.14->[21.15-21.15]   Dedup: 21.15->[]
W20260709 13:20:20.355563 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.335830 25862 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:20.374154 20665 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 22 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:20:20.376577 19508 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:20.376765 19476 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:20.345866 25780 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:20.345669 25589 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:20.388980 19583 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:20:20.390152 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.390393 19583 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:20.392064 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:20.394299 19585 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:20.395313 19476 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:20.346231 25852 raft_consensus.cc:740] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:20.402782 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:20.398087 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:20.406287 19583 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:20.407804 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:20.399765 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:20.400055 25915 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:20.375708 25579 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:20.374814 25770 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:20.346686 25649 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:20:20.411717 19580 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:20:20.414144 19581 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 21: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:20.416404 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:20.382812 25817 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:20.373893 25897 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:20.413066 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:20.380538 25871 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:20.393658 25890 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:20.384083 25780 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:20.411144 25915 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.393843 25188 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:20.419128 19585 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:20.421145 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:20.468089 19656 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:20.412257 25888 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:20.422045 25639 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:20.402578 25726 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:20:20.431619 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 49267.1us
W20260709 13:20:20.435017 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:20.485047 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.485141 19627 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:20.396091 25910 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:20.404392 25862 raft_consensus.cc:697] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:20.469435 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:20.421990 25882 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:20.656365 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:20.659382 25773 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:20.659970 25524 raft_consensus.cc:3055] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:20:20.660539 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 175490us
I20260709 13:20:20.661181 25786 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:20.464859 25780 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:20.402796 25608 consensus_queue.cc:260] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:20.466853 25871 raft_consensus.cc:697] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:20.751753 25871 consensus_queue.cc:237] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:20.469817 25817 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:20.417958 25589 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:20:20.425911 25852 consensus_queue.cc:260] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.756351 25852 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:20.758327 25879 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:20.761999 25906 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:20:20.662427 25869 log.cc:927] Time spent T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:20:20.766817 25862 consensus_queue.cc:237] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:20.771302 25575 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:20.470590 25915 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:20.772692 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.662631 25882 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.774709 25882 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:20.780349 25608 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:20.785997 25909 consensus_queue.cc:1175] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e19c80e9149b4b8d88ae13bde8e43864" responder_term: 14 status { last_received { term: 14 index: 13 } last_committed_idx: 13 last_received_current_leader { term: 14 index: 13 } }
I20260709 13:20:20.788513 25885 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:20.796219 20619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.726135 25579 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.812366 25579 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.815162 25579 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:20.729866 25867 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.816244 25867 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:20.731367 25904 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.375s	user 0.000s	sys 0.001s
I20260709 13:20:20.819103 25867 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:20.858469 25879 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.859090 25879 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:20.862246 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.481666 25726 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.857729 25589 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.811342 25732 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:20.863298 19627 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:20.866074 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 470862us
W20260709 13:20:20.874245 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:20.877516 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.663589 25878 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.826295 25798 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.888206 19476 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:20.676721 25773 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:20.892095 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:20.898186 19627 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:20.894135 25817 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:20.875456 25589 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.862738 25524 raft_consensus.cc:740] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:20.865301 25726 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:20.899185 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 499187us
I20260709 13:20:20.893217 19476 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:20.915354 25817 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:20.881138 25579 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:20.918665 20665 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:20:20.920331 19476 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:20.929275 25524 consensus_queue.cc:260] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.930411 25524 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:20.935209 25850 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:20.920827 19627 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:20.890969 25879 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:20.909547 25885 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:20.949635 25850 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:20.951740 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:20.966595 19584 raft_consensus.cc:2393] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 20: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:20.967643 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:20.968930 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:20.982417 19584 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:20.944392 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:20.879165 25878 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.918221 25575 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:20.654162 25571 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:20.924587 25649 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:20.902607 25798 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.949753 25890 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
W20260709 13:20:21.022100 25859 log.cc:927] Time spent T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 1.740s	user 0.013s	sys 0.011s
I20260709 13:20:20.894506 25621 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:20.994995 25575 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:21.034814 20663 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.048s	sys 0.115s
I20260709 13:20:20.953657 25579 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.070s
W20260709 13:20:21.035351 20663 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.048s	sys 0.116s
I20260709 13:20:21.013042 25850 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:21.026156 25838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.041s	sys 0.116s
W20260709 13:20:21.044984 20618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.033597 25575 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:21.041849 25838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.041s	sys 0.116s
I20260709 13:20:21.003806 25867 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:20:21.018600 25780 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.047801 25621 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:21.050865 25808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.006s	sys 0.017s
I20260709 13:20:21.030922 25890 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:21.058346 25571 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:21.045508 25850 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:21.103188 25808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.006s	sys 0.017s
I20260709 13:20:21.096278 25886 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:21.044843 25916 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:20:21.120296 25886 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.133090 25886 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:21.194387 25890 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:21.203495 25882 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.154462 25878 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:21.211109 25887 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 1.233s	user 0.001s	sys 0.013s
I20260709 13:20:21.214339 25915 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.217700 25915 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:21.218485 25897 consensus_meta.cc:287] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.753s	user 0.011s	sys 0.000s
I20260709 13:20:21.219187 25897 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.221786 25897 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:21.225025 25885 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:21.226361 25882 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.232633 25886 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:21.272197 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.275352 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:20:21.277449 19511 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 2711) took 1895 ms (client timeout 1958 ms). Trace:
W20260709 13:20:21.284444 19511 rpcz_store.cc:269] 0709 13:20:19.382075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.384390 (+  2315us) service_pool.cc:224] Handling call
0709 13:20:21.276638 (+1892248us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b54000fcb54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:21.277127 (+   489us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":799382400}
I20260709 13:20:21.283502 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 2726) took 1277 ms. Trace:
I20260709 13:20:21.296446 19507 rpcz_store.cc:276] 0709 13:20:20.006209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.049501 (+ 43292us) service_pool.cc:224] Handling call
0709 13:20:21.282974 (+1233473us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b54001833d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:21.283328 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45965056}
I20260709 13:20:21.298214 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:21.299988 19580 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:21.303293 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:21.303993 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 555) took 2160 ms. Trace:
I20260709 13:20:21.304620 19580 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 18: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:21.304525 19587 rpcz_store.cc:276] 0709 13:20:19.142915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.143055 (+   140us) service_pool.cc:224] Handling call
0709 13:20:19.143499 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.044481 (+900982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.303142 (+1258661us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b54001fac54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:21.303676 (+   534us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2070641536}
I20260709 13:20:21.306020 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:21.307965 19587 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:21.308298 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:21.315127 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 370645us
I20260709 13:20:21.316267 19587 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:21.332804 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:21.334717 25838 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.335760 25838 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.292932 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:21.342043 25885 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:21.352032 25878 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:21.352460 25875 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:21.353214 25878 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.354945 25890 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.355608 25808 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.355832 25890 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.356757 25878 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.356676 25808 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.353443 25875 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.360152 25808 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.361837 19654 raft_consensus.cc:3055] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:21.362138 25875 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.362453 19654 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:21.363746 25890 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.369522 25871 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:21.370297 25871 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.370833 25871 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:21.364368 19654 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:21.377538 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.169170 25860 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:21.411667 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:21.348484 25768 consensus_meta.cc:287] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.788s	user 0.013s	sys 0.000s
I20260709 13:20:21.420531 20663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59430 (request call id 208) took 1084 ms. Trace:
I20260709 13:20:21.421144 20663 rpcz_store.cc:276] 0709 13:20:20.336140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.337159 (+  1019us) service_pool.cc:224] Handling call
0709 13:20:20.342458 (+  5299us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:20.342824 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.342854 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:20.366341 (+ 23487us) log.cc:844] Serialized 52 byte log entry
0709 13:20:21.038078 (+671737us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:21.038138 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.038234 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.383565 (+345331us) raft_consensus.cc:1685] finished
0709 13:20:21.393209 (+  9644us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.420227 (+ 27018us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":12262,"thread_start_us":627656,"threads_started":1,"wal-append.queue_time_us":722739}
I20260709 13:20:21.426940 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3852) took 1791 ms. Trace:
I20260709 13:20:21.429816 25867 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:21.432158 25850 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:21.128746 25589 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.447093 25926 consensus_queue.cc:1059] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:20:21.448360 25926 consensus_queue.cc:1243] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:20:21.449572 25936 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.427556 19510 rpcz_store.cc:276] 0709 13:20:19.635651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.663572 (+ 27921us) service_pool.cc:224] Handling call
0709 13:20:19.664095 (+   523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.664413 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:19.728156 (+ 63743us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.830875 (+102719us) log.cc:844] Serialized 14 byte log entry
0709 13:20:20.304245 (+473370us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b18003ae400. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:20:21.178494 (+874249us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b18003ae400. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:20:21.295327 (+116833us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b18003ae400. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66a455 00007f6c31752060 00007f6c31764716 00007f6c31775287 00007f6c31775208
0709 13:20:21.426200 (+130873us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.426318 (+   118us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:21.426431 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.426549 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.426739 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8128,"prepare.queue_time_us":19488,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":18730,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":12180,"spinlock_wait_cycles":46707200,"thread_start_us":158414,"threads_started":2,"wal-append.queue_time_us":131720}
I20260709 13:20:21.457258 25894 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:21.457285 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 67780.2us
I20260709 13:20:21.471261 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:21.477020 19654 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:21.450510 25936 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.485095 25936 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.485836 25649 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:21.487913 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 567439us
I20260709 13:20:21.487640 25649 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.489012 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3520) took 1057 ms. Trace:
I20260709 13:20:21.489600 25798 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.489243 19476 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:21.490496 25798 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:21.491274 25798 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.494542 25882 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:21.495443 25882 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.496848 25916 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.497400 25589 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.494614 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2717) took 2090 ms. Trace:
I20260709 13:20:21.498129 25589 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.498329 25894 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:21.498385 19503 rpcz_store.cc:276] 0709 13:20:19.403710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.407003 (+  3293us) service_pool.cc:224] Handling call
0709 13:20:19.407411 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:19.407857 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.407899 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.280207 (+1872308us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b18003b69e0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e63b2a6 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a
0709 13:20:21.299231 (+ 19024us) spinlock_profiling.cc:243] Waited 8.14 ms on lock 0x7b2c00000c88. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:20:21.300426 (+  1195us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.390350 (+ 89924us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:21.390393 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.408262 (+ 17869us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.494172 (+ 85910us) raft_consensus.cc:1685] finished
0709 13:20:21.494200 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.494399 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4093,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":16219,"spinlock_wait_cycles":21950464,"thread_start_us":80293,"threads_started":1,"wal-append.queue_time_us":190187}
I20260709 13:20:21.500455 25589 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.500808 25894 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:21.500913 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 532910us
I20260709 13:20:21.489459 19587 rpcz_store.cc:276] 0709 13:20:20.431511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.317506 (+885995us) service_pool.cc:224] Handling call
0709 13:20:21.318174 (+   668us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.318799 (+   625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.318855 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.319715 (+   860us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.417594 (+ 97879us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:21.417657 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.418687 (+  1030us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.488712 (+ 70025us) raft_consensus.cc:1685] finished
0709 13:20:21.488742 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.488929 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":41559,"threads_started":1,"wal-append.queue_time_us":157634}
I20260709 13:20:21.506645 25780 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.508008 25838 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:21.511252 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.511688 25886 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:21.433465 25793 consensus_queue.cc:1059] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:20:21.515817 25793 raft_consensus.cc:3055] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:21.516345 25793 raft_consensus.cc:740] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:21.522490 25916 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.524642 25730 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:21.525202 25916 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.525987 25768 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.527551 25798 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:21.561242 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:21.565990 19584 consensus_meta.cc:287] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.583s	user 0.000s	sys 0.024s
W20260709 13:20:21.566586 20618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.566565 19584 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:21.551173 25936 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.571627 25936 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.581326 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3521) took 1099 ms. Trace:
I20260709 13:20:21.581604 25793 consensus_queue.cc:260] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:21.581840 19580 rpcz_store.cc:276] 0709 13:20:20.481933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.335255 (+853322us) service_pool.cc:224] Handling call
0709 13:20:21.335769 (+   514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.336278 (+   509us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:21.424672 (+ 88394us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.535073 (+110401us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.580991 (+ 45918us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.581041 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:21.581082 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.581142 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.581262 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52037,"prepare.queue_time_us":163779,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":98861,"thread_start_us":110961,"threads_started":2,"wal-append.queue_time_us":156914}
I20260709 13:20:21.583396 25793 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:21.584906 25773 consensus_meta.cc:287] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.671s	user 0.013s	sys 0.002s
I20260709 13:20:21.585528 25773 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.586905 19654 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:21.587894 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 2763) took 1897 ms. Trace:
I20260709 13:20:21.588294 19654 rpcz_store.cc:276] 0709 13:20:19.690176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.690687 (+   511us) service_pool.cc:224] Handling call
0709 13:20:19.691070 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.361471 (+1670401us) spinlock_profiling.cc:243] Waited 87.7 ms on lock 0x7b54003ccba0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316d1dc0 00007f6c3175c1c0 00007f6c3175d231 00007f6c31759d8f 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c
0709 13:20:21.587407 (+225936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.587737 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201722240}
I20260709 13:20:21.598629 25922 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:21.601874 25730 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:21.602721 25936 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.605485 25850 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.606593 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:21.607213 19584 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:21.607589 19627 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.132:40615 timed out after 1.779s (SENT) [suppressed 11 similar messages]
I20260709 13:20:21.606371 25850 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.609808 25875 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.610363 25875 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.610723 25850 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:21.611043 25768 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.612495 25875 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.613487 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:21.614362 19580 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 26.
I20260709 13:20:21.615721 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:21.616423 19580 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:21.617208 25726 consensus_meta.cc:287] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.005s
I20260709 13:20:21.617726 25726 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:21.620452 25726 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:21.623675 25936 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.624531 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:21.624496 25936 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.625754 25922 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:21.626142 25922 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.626457 25922 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:21.626807 25188 consensus_meta.cc:287] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 1.156s	user 0.011s	sys 0.008s
I20260709 13:20:21.627247 25188 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:21.631269 25936 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.631762 25795 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.632961 25795 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:21.633839 25849 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:20:21.618158 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:21.666175 20665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59442 (request call id 229) took 1268 ms. Trace:
I20260709 13:20:21.666637 20665 rpcz_store.cc:276] 0709 13:20:20.398127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.398762 (+   635us) service_pool.cc:224] Handling call
0709 13:20:21.665727 (+1266965us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400524c54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:21.665927 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1153260928}
I20260709 13:20:21.667263 19583 raft_consensus.cc:2410] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
W20260709 13:20:21.669459 25621 consensus_meta.cc:287] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.006s
I20260709 13:20:21.669821 25890 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.670272 19579 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 19: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:21.602775 25730 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:21.669237 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:21.681217 19584 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:21.671607 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:21.687800 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 155282us
I20260709 13:20:21.656823 25773 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:21.689841 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 197659us
W20260709 13:20:21.693872 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 86366.7us
W20260709 13:20:21.671244 25852 consensus_meta.cc:287] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.914s	user 0.012s	sys 0.008s
I20260709 13:20:21.697993 19579 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:21.700426 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:21.698843 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 73205.8us
I20260709 13:20:21.701210 19580 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:21.702731 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:21.705031 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:21.670543 25890 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.715452 19580 raft_consensus.cc:2393] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 20: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:21.715322 25941 ts_tablet_manager.cc:933] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.717015 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:21.718098 19580 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:20:21.719678 25587 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:21.720228 25890 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.725381 25425 raft_consensus.cc:3055] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:21.725939 25425 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:21.726334 19476 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:21.726962 25425 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.728122 25818 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:21.728680 25818 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.729164 25818 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:21.715335 19581 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:20:21.741941 19510 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:21.742879 19507 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:20:21.703862 25922 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:21.750658 19587 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:21.743331 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:21.763278 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 3514) took 1348 ms. Trace:
I20260709 13:20:21.749123 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3193) took 1800 ms. Trace:
W20260709 13:20:21.753206 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.771489 19511 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:21.745908 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:21.760349 25744 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:21.775599 19512 raft_consensus.cc:2393] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:21.775810 25879 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:21.744822 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:21.776506 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:21.777298 19587 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:21.772110 19581 rpcz_store.cc:276] 0709 13:20:20.415408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.668705 (+1253297us) service_pool.cc:224] Handling call
0709 13:20:21.763219 (+ 94514us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.778491 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:21.778893 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:21.779135 19587 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:21.777213 19505 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:21.733198 25882 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.775611 25744 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.743767 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:21.782905 25744 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.783856 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:21.784538 19508 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:21.786033 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:21.786696 25730 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:20:21.787516 25571 consensus_meta.cc:287] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.676s	user 0.012s	sys 0.000s
I20260709 13:20:21.787447 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:21.744273 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:21.789155 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:21.776396 25879 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.790325 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:21.790462 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:21.791015 19509 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 26.
I20260709 13:20:21.791899 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:21.792740 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:21.745921 25910 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:21.793982 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:21.794090 25910 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:21.796662 25910 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.794628 19584 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:20:21.798398 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:21.799202 19584 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 19: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:21.798179 19581 raft_consensus.cc:2955] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:20:21.800094 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:21.800729 19584 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:21.801184 19585 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:21.729591 25687 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.794098 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:21.791316 19505 raft_consensus.cc:2393] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 14: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:21.806375 19504 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:20:21.806787 19504 pending_rounds.cc:85] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 14
I20260709 13:20:21.807025 19504 pending_rounds.cc:107] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:20:21.807294 19504 raft_consensus.cc:2889] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:21.808908 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:21.811148 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:21.813680 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:21.812294 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 89600.5us
W20260709 13:20:21.817555 20618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.836102 19587 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
W20260709 13:20:21.838287 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.839668 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3195) took 1715 ms. Trace:
I20260709 13:20:21.871340 19587 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:21.754313 25838 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:21.883520 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 47238.4us
I20260709 13:20:21.840164 19582 rpcz_store.cc:276] 0709 13:20:19.984611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.984767 (+   156us) service_pool.cc:224] Handling call
0709 13:20:19.985139 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:19.986873 (+  1734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.986906 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:19.987273 (+   367us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.319587 (+1332314us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b18003fb9e0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa0d1 00007f6c31715a0f
0709 13:20:21.661137 (+341550us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:21.661211 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.687015 (+ 25804us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.687087 (+    72us) raft_consensus.cc:1685] finished
0709 13:20:21.687107 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.700001 (+ 12894us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1304,"raft.queue_time_us":1436,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5205,"spinlock_wait_cycles":10431360,"thread_start_us":257997,"threads_started":1,"wal-append.queue_time_us":1676528}
I20260709 13:20:21.772737 19586 rpcz_store.cc:276] 0709 13:20:19.948220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.949528 (+  1308us) service_pool.cc:224] Handling call
0709 13:20:19.949825 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.950031 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:21.317001 (+1366970us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b1800221320. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c313024bc 00007f6c2e65048b 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66a455 00007f6c351523c7 00007f6c317649a7 00007f6c317740bf
0709 13:20:21.317310 (+   309us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.748496 (+431186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.748566 (+    70us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:21.748644 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.748767 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.748932 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92446,"prepare.queue_time_us":37219,"prepare.run_cpu_time_us":7191,"prepare.run_wall_time_us":17496,"raft.queue_time_us":92617,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":154,"spinlock_wait_cycles":10568448,"thread_start_us":379402,"threads_started":2}
W20260709 13:20:21.887583 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.886541 19505 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:20:21.875023 25575 consensus_meta.cc:287] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.591s	user 0.014s	sys 0.001s
I20260709 13:20:21.892689 19510 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:21.894814 19584 raft_consensus.cc:1240] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:20:21.886802 25793 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:21.907001 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:21.902518 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3527) took 1085 ms. Trace:
I20260709 13:20:21.916373 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:21.917311 19510 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:21.916299 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:21.879787 25871 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.924595 19478 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:20:21.923358 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 197229us
I20260709 13:20:21.926620 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:21.928594 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.928977 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:21.929746 19505 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:21.930079 25687 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.930723 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:21.931384 19505 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:21.932297 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:21.934372 25922 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Requested vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:21.937470 25704 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.938277 25704 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.938958 25818 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.940104 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:21.941115 25704 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:21.915099 25849 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.942066 25849 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.943106 25871 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:21.943730 19661 raft_consensus.cc:1240] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:21.944360 25849 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:21.945708 25793 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:21.946798 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:21.947528 19658 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:21.948457 25793 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:21.948629 25944 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:21.950261 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:21.953094 19659 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:21.926164 25838 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.959067 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60692 (request call id 367) took 1656 ms. Trace:
I20260709 13:20:21.959496 19504 rpcz_store.cc:276] 0709 13:20:20.302510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.358987 (+ 56477us) service_pool.cc:224] Handling call
0709 13:20:20.359284 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.807756 (+1448472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.958734 (+150978us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b540037b9d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:21.958975 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3326654208}
I20260709 13:20:21.960700 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:21.962348 19585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 3518) took 1531 ms (client timeout 1849 ms). Trace:
I20260709 13:20:21.962931 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:21.933390 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:21.961059 19658 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:21.970402 19510 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
W20260709 13:20:21.962823 19585 rpcz_store.cc:269] 0709 13:20:20.430926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.656135 (+225209us) service_pool.cc:224] Handling call
0709 13:20:21.962129 (+1305994us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b5400267854. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:21.962273 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2215858048}
W20260709 13:20:21.960534 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45806us
I20260709 13:20:21.971450 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:21.972198 19585 raft_consensus.cc:2393] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 22: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:21.915191 19578 rpcz_store.cc:276] 0709 13:20:20.807635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.419978 (+612343us) service_pool.cc:224] Handling call
0709 13:20:21.476064 (+ 56086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.476427 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:21.659018 (+182591us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.892284 (+233266us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.892331 (+    47us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:21.892381 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.892458 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.892576 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9613,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":202,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":8907,"thread_start_us":363798,"threads_started":2}
I20260709 13:20:21.921497 25941 tablet_copy_client.cc:323] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Beginning tablet copy session from remote peer at address 127.17.251.131:33295
W20260709 13:20:21.984205 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.921409 25573 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.991460 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:21.991750 25924 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.992033 19508 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:21.987668 19505 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:21.992383 25924 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.993485 19508 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:21.993791 25879 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:21.906378 25575 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:21.988168 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:21.995306 19508 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:22.000366 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 95227.4us
W20260709 13:20:22.003074 25952 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:20:22.004202 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:21.981324 25818 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:22.008677 19652 raft_consensus.cc:1275] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:22.009133 19508 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: []
W20260709 13:20:22.010032 25786 consensus_meta.cc:287] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 1.019s	user 0.013s	sys 0.005s
I20260709 13:20:22.010545 25786 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:22.011363 25786 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.011898 25786 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:22.013674 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 73738us
I20260709 13:20:22.015466 19625 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:22.016644 25704 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:20:22.022071 25951 log.cc:927] Time spent T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:22.022353 19478 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:20:22.026598 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.017148 19625 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:22.030597 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:21.964816 25732 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.032805 19579 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:22.035730 19509 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:22.038260 19504 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:22.038544 19578 raft_consensus.cc:1240] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:22.039984 20618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.996915 25910 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.046483 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:22.048064 19584 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:21.930734 25687 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.072985 19478 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:22.044720 25795 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:22.080899 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.087028 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.087899 19654 raft_consensus.cc:2410] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:20:22.088264 19657 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:22.093650 19586 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:20:22.083505 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:22.070079 25924 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:22.098922 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.089102 25571 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:22.105481 19661 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:20:22.105039 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 88005.5us
I20260709 13:20:22.103992 19627 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:22.107007 19658 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:22.105805 19478 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:22.109030 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.109884 19655 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 19: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:22.114480 19653 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:22.115348 25786 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:22.098691 25704 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:22.107007 19659 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 13.
I20260709 13:20:22.118007 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.080030 25910 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.125262 19652 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 21: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:22.125900 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.130249 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:22.107329 25780 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.108021 25571 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.139385 19625 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:22.145144 25673 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:22.145766 25744 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:22.145892 25673 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.146569 25744 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.148653 25673 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:22.149596 25780 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:22.152245 25780 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:22.153807 19653 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:22.155272 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:22.156844 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:22.157733 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:22.158310 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.159168 19654 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:22.160894 19654 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: [19.9-19.9]
I20260709 13:20:22.161664 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:22.164273 19583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 3513) took 1762 ms (client timeout 1809 ms). Trace:
I20260709 13:20:22.168890 25715 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:22.169800 25715 raft_consensus.cc:697] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:22.159251 19656 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:22.171494 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:22.164911 19583 rpcz_store.cc:269] 0709 13:20:20.401541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.407358 (+  5817us) service_pool.cc:224] Handling call
0709 13:20:22.163987 (+1756629us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400106154. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:22.164197 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2867618560}
I20260709 13:20:22.173723 19503 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:22.174337 19583 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
W20260709 13:20:22.175900 25943 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 13:20:22.143038 25571 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:22.177337 19583 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:22.179037 19583 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:20:22.091635 25732 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.189054 25732 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:22.181815 25770 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:22.190018 25770 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.190567 25770 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:22.190737 25959 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:20:22.185917 19653 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:22.186635 25744 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:22.201988 25838 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:22.204069 19478 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:22.207548 25929 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:22.209532 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.175244 19627 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:22.219311 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.221143 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.222473 25615 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:22.223646 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.225764 25687 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:22.204119 19583 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:22.239104 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:22.241809 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 66744.1us
I20260709 13:20:22.243001 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.217525 25929 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.246519 19653 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:22.245844 25615 raft_consensus.cc:697] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:22.252882 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 113598us
I20260709 13:20:22.255623 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:22.244427 25910 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:22.250368 25929 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:22.263640 19627 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:22.268074 25715 consensus_queue.cc:237] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.270439 25615 consensus_queue.cc:237] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.275341 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:22.277532 25692 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:22.284744 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:22.296067 19582 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:22.271129 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:22.288897 19578 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:22.253404 25886 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:22.299973 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.300278 19583 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:22.304890 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:22.305516 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 47833.2us
I20260709 13:20:22.305716 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:22.305565 19652 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:22.306317 19625 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:22.309537 19582 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:20:22.297962 25692 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:22.323422 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 155433us
I20260709 13:20:22.320971 19578 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:22.313596 25692 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:22.328254 19627 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:22.322069 25886 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:22.330204 25786 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:22.343223 25579 raft_consensus.cc:2764] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:20:22.349947 19625 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:22.355651 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 235842us
I20260709 13:20:22.355726 25578 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:22.356609 25578 raft_consensus.cc:697] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:22.351320 25704 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:20:22.358079 25578 consensus_queue.cc:237] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:22.367034 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.366397 19627 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:22.371908 25910 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.372519 25910 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.373124 19671 tablet_copy_service.cc:140] P e19c80e9149b4b8d88ae13bde8e43864: Received BeginTabletCopySession request for tablet c62f6690c8e840638906e0b59d2ae71d from peer 068c03c9dcc848e6bf909131b1f83065 ({username='slave'} at 127.0.0.1:59942)
I20260709 13:20:22.373669 25730 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:22.373922 19671 tablet_copy_service.cc:161] P e19c80e9149b4b8d88ae13bde8e43864: Beginning new tablet copy session on tablet c62f6690c8e840638906e0b59d2ae71d from peer 068c03c9dcc848e6bf909131b1f83065 at {username='slave'} at 127.0.0.1:59942: session id = 068c03c9dcc848e6bf909131b1f83065-c62f6690c8e840638906e0b59d2ae71d
I20260709 13:20:22.374727 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:22.375324 25910 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:22.375468 20665 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:22.384110 25795 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.384672 25795 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:22.386842 19582 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 13:20:22.387305 19582 pending_rounds.cc:85] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 11
I20260709 13:20:22.387553 19582 pending_rounds.cc:107] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 13:20:22.387789 19582 raft_consensus.cc:2889] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:22.389871 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:22.390079 19409 catalog_manager.cc:5697] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:22.390969 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:22.392496 25948 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:22.389258 19582 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:22.394178 25004 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:22.394629 25730 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:22.396180 25730 consensus_queue.cc:1059] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:22.396663 25425 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:22.397264 25730 raft_consensus.cc:3055] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:22.392313 25571 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.347613 25886 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:22.394645 25004 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:22.394173 19627 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:22.401993 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:22.391942 19409 catalog_manager.cc:5697] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 16 to 20, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 20 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:22.412423 25004 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:22.405577 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 50979.6us
I20260709 13:20:22.407884 20665 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:22.409562 19583 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
W20260709 13:20:22.424235 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 74351.3us
I20260709 13:20:22.427999 19671 tablet_copy_source_session.cc:215] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:20:22.430233 25965 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:20:22.430653 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:22.410828 25730 raft_consensus.cc:740] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:22.441490 25786 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:22.442024 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:22.442260 25786 raft_consensus.cc:697] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:22.368460 25770 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.442750 20666 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:20:22.502182 19476 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:22.514612 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:22.441490 25879 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.510864 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:22.518051 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:20:22.529031 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 103697us
I20260709 13:20:22.525244 25004 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:22.509924 25946 log.cc:927] Time spent T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:20:22.508890 25849 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:22.536934 24912 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:22.537168 20666 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:22.540544 25579 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:22.541728 25879 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.537268 25571 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:22.549896 25673 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:22.550282 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:22.563295 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:22.566298 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:22.569905 25730 consensus_queue.cc:260] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.536151 19625 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:22.572460 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:22.601204 19587 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:22.514223 25732 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:22.545372 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:22.583102 24912 raft_consensus.cc:697] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:22.521344 25922 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.582978 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:22.579799 19578 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:22.599872 19586 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:22.607718 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:22.614174 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:22.614874 19587 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:22.616832 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 71682.2us
I20260709 13:20:22.606647 25004 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:22.532372 25692 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.628486 19578 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: [17.12-18.13]
I20260709 13:20:22.630438 19584 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:22.615994 25879 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:22.634665 24912 consensus_queue.cc:237] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:22.636619 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 221325us
I20260709 13:20:22.623791 25910 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:22.635708 25573 consensus_queue.cc:1059] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:20:22.653211 20618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.590351 25786 consensus_queue.cc:237] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.666510 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:22.619400 25732 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.591143 25886 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.652056 25910 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:22.676295 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.648928 25575 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:22.632180 25922 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.636973 25795 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.640653 25649 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:20:22.671989 25579 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:22.692301 19587 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:22.682597 25910 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:22.700171 19627 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:22.699559 25941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c62f6690c8e840638906e0b59d2ae71d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:20:22.699544 25970 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:20:22.699644 25919 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:20:22.709345 19478 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:22.695130 25425 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.690510 25573 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:20:22.700338 25770 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:22.722622 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:22.688019 25882 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:20:22.700636 25579 raft_consensus.cc:697] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:22.719599 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:20:22.692065 25571 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:20:22.711333 25649 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:22.704422 25934 consensus_queue.cc:1059] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 13:20:22.720803 25573 consensus_queue.cc:1243] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:22.722196 25919 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:22.745479 25579 consensus_queue.cc:237] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.749364 25795 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:22.749461 25770 raft_consensus.cc:3055] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:22.750706 25978 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:22.750699 25770 raft_consensus.cc:740] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:22.751459 25978 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:22.751930 25978 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:22.752117 25770 consensus_queue.cc:260] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.752799 25929 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.739984 25919 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.728214 25425 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.753939 25770 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:22.737265 25649 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:22.755309 25649 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:22.757076 25649 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:22.758039 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 57976.1us
I20260709 13:20:22.759034 19476 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:22.760828 19510 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:20:22.762215 19507 raft_consensus.cc:1240] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 13. Current term is 15. Ops: []
I20260709 13:20:22.762490 25732 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:22.763454 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3214) took 1006 ms. Trace:
I20260709 13:20:22.763504 19658 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:22.763839 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.764622 19653 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:22.765242 19511 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:22.766057 19661 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:20:22.766456 19661 pending_rounds.cc:85] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 9
I20260709 13:20:22.766654 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.767279 24491 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:22.767470 19652 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 23: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:22.763530 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:22.768204 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 48720.8us
I20260709 13:20:22.768362 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.769093 19655 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:22.768913 25894 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:22.753984 25919 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:22.769835 25867 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:22.770213 25817 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:22.770804 25867 consensus_queue.cc:1059] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:22.771030 25817 consensus_queue.cc:1059] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:22.772111 25817 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:22.772462 25817 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:22.772522 25934 raft_consensus.cc:3055] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:22.773068 25934 raft_consensus.cc:740] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:22.767777 24491 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:22.773993 25573 raft_consensus.cc:3055] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:22.774493 25573 raft_consensus.cc:740] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:22.774813 24491 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.775674 25573 consensus_queue.cc:260] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.776932 25573 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:22.777808 25639 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:22.766674 19661 pending_rounds.cc:107] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:20:22.779378 19661 raft_consensus.cc:2889] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:22.779657 25934 consensus_queue.cc:260] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.780952 25934 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:22.782864 25929 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:22.786021 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.786394 25922 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:22.786594 19511 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:20:22.787246 25692 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:22.787683 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.761341 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:22.773439 25817 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:22.780942 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 88066.6us
I20260709 13:20:22.786729 19503 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:22.788525 19510 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:22.764043 19580 rpcz_store.cc:276] 0709 13:20:21.757423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.192663 (+435240us) service_pool.cc:224] Handling call
0709 13:20:22.193057 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.193541 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.193571 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:22.194179 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:20:22.363261 (+169082us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:22.363308 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.363379 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.763262 (+399883us) raft_consensus.cc:1685] finished
0709 13:20:22.763283 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.763399 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1232,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"thread_start_us":168687,"threads_started":1,"wal-append.queue_time_us":321029}
W20260709 13:20:22.801035 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 265007us
I20260709 13:20:22.795192 25715 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:22.817462 19476 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:22.820870 25919 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.821890 25922 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:22.822826 25673 raft_consensus.cc:3055] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:22.823259 25673 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:22.823518 25922 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:22.824285 25673 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.826947 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:22.828429 19661 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:20:22.801309 25817 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:22.828816 19661 pending_rounds.cc:85] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 7
I20260709 13:20:22.832010 25425 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:22.841150 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:22.841671 19625 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:22.859146 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.800776 25692 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:20:22.850457 19511 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:22.849207 25978 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:22.851763 19657 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:20:22.853030 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.853452 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.862563 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.853737 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.854107 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.888784 19652 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 27: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:22.854417 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.854646 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.855326 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:22.855998 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.857373 19476 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:22.858316 19507 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:22.861289 19661 pending_rounds.cc:107] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:20:22.891418 19661 raft_consensus.cc:2889] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:22.895002 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.887951 19505 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
I20260709 13:20:22.902953 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.907127 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.907790 19510 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:22.909025 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.910077 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:22.911764 24912 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.913276 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.914126 19508 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:22.915694 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:22.903204 19551 connection.cc:256] RPC call timeout handler was delayed by -1.8780021380000562s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
I20260709 13:20:22.916292 19505 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 13.
I20260709 13:20:22.916776 25879 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:22.917837 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 76335.1us
I20260709 13:20:22.917210 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.918650 19625 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:22.888696 25673 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:22.922930 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:22.923135 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.923468 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:22.923878 19505 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:20:22.919837 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 62554.6us
I20260709 13:20:22.923506 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.924316 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.924655 19476 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:22.920658 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:22.921448 19551 connection.cc:256] RPC call timeout handler was delayed by -1.0108878060000279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
W20260709 13:20:22.917805 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 148270us
I20260709 13:20:22.923735 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:22.926636 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.926838 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.924942 19655 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:22.928159 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.921661 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.931829 19507 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 17: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:22.935037 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.935398 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:22.927840 24912 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.936406 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:22.934562 25430 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.937074 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.937307 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.940320 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.919299 25770 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:22.943264 19660 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:22.925479 25425 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.947119 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.948771 19652 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 20: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:22.929170 25687 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.945880 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.946549 19511 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
W20260709 13:20:22.947077 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 149561us
I20260709 13:20:22.947710 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.906867 25910 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.940408 25715 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:22.955655 19510 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:22.958819 19478 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:22.966961 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:22.917273 25879 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.968592 19659 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:20:22.974449 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 55882us
I20260709 13:20:22.978868 19625 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:22.975355 19655 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 22: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:22.979177 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.981398 19512 raft_consensus.cc:2410] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 24 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:20:22.986442 24912 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:22.941123 25922 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:20:22.965420 25579 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:22.994858 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:23.000363 19627 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:20:22.982239 25571 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:22.954265 25894 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:20:22.990106 25770 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:22.958887 25425 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:23.010705 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 74376.2us
I20260709 13:20:23.011677 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:22.946103 25430 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:22.969092 25687 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.016283 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:23.016812 25982 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:23.008591 19627 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:23.019989 25786 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:20:23.020918 25977 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 13:20:23.021816 25985 log.cc:927] Time spent T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:20:23.024200 25919 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:22.976596 25639 consensus_queue.cc:1059] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:20:23.033805 25978 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:23.005276 25732 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:23.034986 25986 log.cc:927] Time spent T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:20:23.050873 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 56705.7us
W20260709 13:20:23.051625 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:23.052222 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.001605 25579 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:23.039255 25982 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.046231 19627 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:23.049355 19659 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 12.
W20260709 13:20:23.045061 25984 log.cc:927] Time spent T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:20:23.076193 25639 raft_consensus.cc:3055] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:23.076624 25639 raft_consensus.cc:740] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:23.078045 19509 raft_consensus.cc:2410] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:20:23.079010 25425 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:23.080837 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3349) took 1075 ms. Trace:
I20260709 13:20:23.082108 25639 consensus_queue.cc:260] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.084436 25639 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:23.053653 25770 raft_consensus.cc:697] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:23.060695 25941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59442 (request call id 230) took 1629 ms. Trace:
I20260709 13:20:23.061071 19655 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:23.070099 25982 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:23.060786 25687 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:23.074471 25818 raft_consensus.cc:3055] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:23.075055 25910 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:23.055151 25579 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:23.085042 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 70457.6us
I20260709 13:20:23.087451 19627 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:23.042531 19654 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:23.081236 19660 rpcz_store.cc:276] 0709 13:20:22.005590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.031465 (+ 25875us) service_pool.cc:224] Handling call
0709 13:20:22.542476 (+511011us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b58000e1c98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635eee 0000000000375939 00007f6c366a91e0 00007f6c367720c4 00007f6c36772131 00007f6c36733fc0 00007f6c3671e929 00007f6c3671e3d2 00007f6c2fc95bd4
0709 13:20:22.542707 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.946749 (+404042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.080586 (+133837us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b5400010ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:23.080773 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":924699136}
I20260709 13:20:23.097837 19656 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:23.049209 25879 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:23.103051 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.106786 25978 consensus_queue.cc:1059] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:23.107545 19476 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:23.108075 25990 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.109385 25573 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:23.110136 25871 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:23.110296 25692 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:23.111436 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:23.123713 19476 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:23.114972 25886 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:23.140874 24912 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:23.102730 25818 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:23.144346 19476 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:23.129290 25894 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:23.102771 25615 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:23.131785 25871 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.147087 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:23.096264 25941 rpcz_store.cc:276] 0709 13:20:21.431560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.432247 (+   687us) service_pool.cc:224] Handling call
0709 13:20:21.716328 (+284081us) ts_tablet_manager.cc:934] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
0709 13:20:22.616473 (+900145us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:20:22.852224 (+235751us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:22.852356 (+   132us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:20:23.059778 (+207422us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:20:23.060152 (+   374us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:23.060509 (+   357us) ts_tablet_manager.cc:989] Replica registered.
0709 13:20:23.060574 (+    65us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":10807,"tablet-copy.queue_time_us":226880,"thread_start_us":335236,"threads_started":2}
I20260709 13:20:23.130024 25922 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:20:23.142089 25990 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:23.158481 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.157582 25715 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:23.166051 25886 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.166625 25770 consensus_queue.cc:237] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.168125 25795 raft_consensus.cc:3055] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:23.169446 25575 raft_consensus.cc:3055] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:23.169709 19503 raft_consensus.cc:2410] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
W20260709 13:20:23.170945 20618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.181967 25615 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.169186 25579 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.094455 25924 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:20:23.174088 19627 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:23.174588 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:23.204098 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.206084 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:23.206854 19582 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:23.208865 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:23.189553 20663 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:20:23.209728 19587 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:23.182736 25871 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:23.193729 25849 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.006s	sys 0.003s
I20260709 13:20:23.216552 19586 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: [18.11-20.12]
I20260709 13:20:23.218154 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:23.219406 19583 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:23.194667 25910 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:23.222834 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:23.222769 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:23.198201 25575 raft_consensus.cc:740] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:23.196463 25886 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.222538 19658 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:23.223755 19581 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
W20260709 13:20:23.225006 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 80790.9us
I20260709 13:20:23.225234 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:23.195829 25795 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:23.216174 25849 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.007s	sys 0.003s
I20260709 13:20:23.234447 25849 raft_consensus.cc:697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:23.234611 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:23.234743 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 94602.3us
I20260709 13:20:23.235188 19578 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:23.235648 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:23.235445 25849 consensus_queue.cc:237] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.229290 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:23.201058 25615 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:23.226850 19627 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:23.241743 19580 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:23.217566 25934 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.230202 19476 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:23.243078 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:23.243388 19476 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:23.244009 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:23.246147 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:23.222280 25692 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:23.254212 19478 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:23.251575 19586 raft_consensus.cc:2410] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:20:23.260556 19587 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:23.250028 25786 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:23.270445 19578 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 27.
I20260709 13:20:23.243307 25941 tablet_copy_client.cc:806] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:23.280529 19656 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:23.320930 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:23.318825 19655 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:23.252168 25715 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:23.343608 19584 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:23.349406 19583 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:23.360672 19583 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:23.251992 25867 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:23.268913 25910 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:23.216281 25818 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.374011 19584 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:23.281039 20619 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:23.380749 19583 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:23.280820 25922 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:23.335700 25579 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:23.341172 25990 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:23.368108 25867 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:23.401240 19580 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:23.252305 25934 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:23.394461 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 113509us
I20260709 13:20:23.390880 19583 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:23.409911 19583 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:23.286258 25692 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:23.369215 25786 raft_consensus.cc:697] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:23.412528 19660 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:23.392745 25922 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.414916 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:23.391582 25941 tablet_copy_client.cc:670] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:23.396744 25967 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:23.419180 20663 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:20:23.281267 25795 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.415518 25990 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:23.302114 25575 consensus_queue.cc:260] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.408010 25867 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.430109 19478 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:23.412807 26001 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:20:23.427218 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 354832us
W20260709 13:20:23.438864 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 203295us
I20260709 13:20:23.431807 25730 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:23.431969 25639 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:23.434748 25692 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.435354 25649 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:23.422354 25922 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.444451 19625 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:23.446557 25786 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:23.447781 25849 consensus_queue.cc:1059] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:23.450294 26006 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:23.450834 25882 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:23.451561 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:23.424679 25894 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.454049 25795 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:23.430371 25990 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.463749 19582 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:20:23.471494 20663 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:20:23.444968 25639 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.457898 25649 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:23.506229 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 61876.3us
I20260709 13:20:23.445830 25978 consensus_queue.cc:1059] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:20:23.481407 25425 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:23.478799 25770 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.495860 25639 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:23.505409 26005 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:23.518775 26005 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.519200 26005 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:23.519814 25430 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:23.464226 26001 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.505860 25894 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.525123 25894 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:23.526262 25649 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.528116 25649 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:23.520581 25425 raft_consensus.cc:697] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:23.530635 25425 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.531092 25990 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:23.546180 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:23.556037 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 69785.8us
I20260709 13:20:23.561273 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:23.566238 19653 raft_consensus.cc:2410] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
W20260709 13:20:23.567567 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.569276 19625 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:23.522478 25770 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.571550 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:20:23.552129 25894 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:20:23.559731 25882 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:20:23.599084 25882 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:23.587610 25639 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:23.590401 26003 raft_consensus.cc:3055] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:23.582774 25995 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:23.593885 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.575058 25934 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:23.598891 25867 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.585255 25615 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.553045 25886 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.610704 25639 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:23.611941 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:23.615633 20659 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:23.621950 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 50497.4us
I20260709 13:20:23.622973 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:23.590557 25849 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:23.626731 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:23.629549 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:23.630750 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:23.605120 26003 raft_consensus.cc:740] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:23.615842 25995 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:23.656553 25692 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.658589 25692 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:23.620309 26006 raft_consensus.cc:2764] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader pre-election decision vote started in defunct term 26: won
W20260709 13:20:23.650826 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.635802 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:23.658241 26017 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:23.638681 26012 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:20:23.580765 25982 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.635362 26021 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:20:23.682454 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 89183.1us
I20260709 13:20:23.634366 25795 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:20:23.688360 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:23.688859 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.690827 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:23.643510 25818 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.691453 19505 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:23.641685 25615 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:23.643153 25770 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:23.631484 25882 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:23.639950 26019 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:23.725948 25882 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.726678 25882 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:23.728323 19510 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:23.730394 19512 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:23.735353 19508 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:23.699894 26020 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:23.700606 25692 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:23.701257 26005 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.702833 26003 consensus_queue.cc:260] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.692569 26017 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.705776 25982 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:23.705893 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:23.738358 19505 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:20:23.706542 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:23.706957 26023 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:23.705825 25871 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.707494 26006 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:23.707803 25867 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:23.709211 25922 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.709986 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:23.710774 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:23.693573 25795 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.716449 25849 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:23.719012 25886 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:23.687795 26021 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:23.761293 25578 raft_consensus.cc:3055] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:23.761749 25578 raft_consensus.cc:740] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:23.762784 25578 consensus_queue.cc:260] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:23.764256 25578 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.721733 26001 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:23.726063 26019 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.680159 25967 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:23.705811 19661 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:23.739367 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:23.747732 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:23.750329 20659 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:23.752295 19506 raft_consensus.cc:2410] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:20:23.779923 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:23.738303 26020 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:23.768332 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:23.782680 19509 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:23.782290 19507 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 18: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:23.753331 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:23.754947 25871 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:23.755384 26003 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:23.756170 19654 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:23.783898 19503 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:23.757025 25649 consensus_queue.cc:1059] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:23.746007 26023 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:23.791294 26023 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:23.779891 26019 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:23.802254 25795 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:23.803617 25649 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:23.804112 25649 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:23.784950 19511 raft_consensus.cc:2368] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15.
I20260709 13:20:23.786010 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:23.786599 19478 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:23.814653 25982 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:23.815265 25982 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.816531 19503 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 27.
I20260709 13:20:23.819773 25579 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:23.820003 25922 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:23.820640 25922 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:23.820397 25579 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.821137 25922 raft_consensus.cc:697] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:23.786623 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:23.822691 19656 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 15.
I20260709 13:20:23.786837 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:23.739557 25995 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:23.827523 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 191783us
I20260709 13:20:23.830407 19503 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:23.836545 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:23.836419 19478 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:23.840170 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:23.840894 19582 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:23.841938 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:23.842689 19508 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:23.845508 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:23.848913 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:23.849442 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:23.850523 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:23.851296 19586 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.847330 19478 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:23.868467 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:23.868660 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:23.871526 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:23.871711 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:23.871928 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:23.872805 19509 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:20:23.873991 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:23.761322 26021 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:23.871320 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:23.875474 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:23.876178 19580 raft_consensus.cc:2368] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20.
I20260709 13:20:23.877209 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:23.871309 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:23.787658 26020 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:23.805095 25649 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.880103 19581 raft_consensus.cc:1275] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:23.880406 19579 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:23.888486 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:23.883935 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:23.885866 19478 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:23.889506 19656 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:23.890829 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:23.891423 25579 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:23.891506 19660 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:23.892441 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:23.892553 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:23.893378 20666 raft_consensus.cc:2410] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:20:23.868251 25795 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:23.898001 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:23.898247 25922 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:23.899367 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:23.900490 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:23.901173 19655 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:23.771386 25849 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.885084 19504 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:23.903723 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:23.908766 19660 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:23.904065 19583 raft_consensus.cc:2393] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 20: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:23.909960 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:23.878065 26001 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:23.912293 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:23.913421 19504 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:23.913985 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:23.915760 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:23.919744 19478 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:23.920337 19504 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:23.920987 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:23.925654 19655 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:23.901934 25982 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:23.927256 19656 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:23.928153 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:23.876653 26006 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:20:23.902061 25929 consensus_queue.cc:1059] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.014s
W20260709 13:20:23.930318 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.898049 25795 raft_consensus.cc:697] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:23.927141 19478 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:23.932598 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:23.933729 19581 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:23.923631 25770 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:23.912669 25919 raft_consensus.cc:3055] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:23.937935 25919 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:23.935186 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2786) took 1104 ms. Trace:
I20260709 13:20:23.939489 19653 rpcz_store.cc:276] 0709 13:20:22.824777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.826659 (+  1882us) service_pool.cc:224] Handling call
0709 13:20:23.929170 (+1102511us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54000e83d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:23.929313 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1698026240}
I20260709 13:20:23.941169 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:23.948901 19653 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:23.950507 19653 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:23.947945 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:23.952752 19504 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:23.954226 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:23.955139 19504 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 15.
I20260709 13:20:23.957248 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:23.955714 26023 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:23.960103 26023 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:23.961200 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:23.928794 26001 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:23.962304 25795 consensus_queue.cc:237] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:23.963049 25687 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.928653 25924 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:23.964618 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:24.027261 19655 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:23.966698 19652 raft_consensus.cc:2410] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:20:23.936553 25879 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:23.968941 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:23.971063 20659 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:20:23.978432 19476 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:23.901979 25990 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:20:23.982371 19578 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:23.985518 19657 raft_consensus.cc:2410] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 18 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:20:23.987828 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:23.989468 19586 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:23.991106 19504 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:23.993954 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:24.033125 19656 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:20:24.034148 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:24.035501 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:24.036228 19656 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:23.995191 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:24.025957 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 98890.7us
I20260709 13:20:24.026666 24491 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:24.038385 24491 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.038792 24491 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:24.032058 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.001080 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.031895 20619 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:24.044507 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 56745.9us
I20260709 13:20:24.044559 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:24.045687 19656 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:24.045905 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:24.053568 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:24.054468 19656 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:20:24.057320 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 62262.2us
I20260709 13:20:24.059763 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:24.055676 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 367464us
I20260709 13:20:24.066207 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:24.062640 19627 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:24.068843 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:24.070088 19586 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:20:24.070540 19586 pending_rounds.cc:85] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 12
I20260709 13:20:24.070794 19586 pending_rounds.cc:107] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:20:24.071055 19586 raft_consensus.cc:2889] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:24.071794 25924 raft_consensus.cc:697] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:24.074488 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:24.048645 26024 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:24.078261 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:24.050007 26005 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.080761 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:24.051146 26023 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:24.030164 25687 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.066102 25941 tablet_copy_client.cc:538] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:24.066676 25732 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:24.097411 19506 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:24.075109 25871 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:24.114552 25730 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:20:24.122977 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:24.072000 25886 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.072189 25910 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:24.082940 26024 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.061271 25818 consensus_queue.cc:1048] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:20:24.090428 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:24.073923 26022 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:24.116050 25004 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:20:24.066521 26006 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:20:24.099723 25692 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election won for term 27
W20260709 13:20:24.174567 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 85087us
I20260709 13:20:24.206845 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:24.211216 19627 leader_election.cc:400] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20.
I20260709 13:20:24.211575 19627 leader_election.cc:403] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:20:24.215118 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:24.218837 25004 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:24.126571 25871 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:24.222862 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 244476us
I20260709 13:20:24.226686 19511 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:24.167878 26024 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:24.224522 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:24.228020 19511 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:24.227730 19476 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:24.227361 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 173776us
I20260709 13:20:24.235188 25687 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.115219 26031 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.157s
I20260709 13:20:24.235962 25575 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:24.209889 26019 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:24.238211 26034 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:20:24.238952 26019 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.221064 25922 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:20:24.239990 26033 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:20:24.240105 25922 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:24.240674 25922 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:24.241147 26017 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:24.243592 19661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 2809) took 1239 ms. Trace:
I20260709 13:20:24.243995 19661 rpcz_store.cc:276] 0709 13:20:23.006775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.006986 (+   211us) service_pool.cc:224] Handling call
0709 13:20:23.037813 (+ 30827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.783558 (+745745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.243265 (+459707us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b54000cc454. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:24.243521 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1535811968}
I20260709 13:20:24.245776 26042 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:24.246188 26042 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:24.247112 26042 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.248139 26020 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.250660 26020 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.255529 25922 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.210719 26005 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:24.222469 26023 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:24.266531 19660 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:24.268993 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:24.269811 19578 raft_consensus.cc:2393] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 18: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:24.272439 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:24.221581 25579 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20.
I20260709 13:20:24.167176 25886 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.275490 19657 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:20:24.229410 25871 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:24.228487 25692 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 27 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:24.276994 19578 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:24.209684 26021 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:24.230808 25571 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.232506 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:24.266425 25430 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:24.291049 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 63411.9us
I20260709 13:20:24.329041 19476 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:24.310797 19660 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260709 13:20:24.128168 26001 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.266062 25910 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:20:24.315241 25919 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.315697 25886 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:24.339744 19476 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:24.321148 19504 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:24.292361 26046 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:24.321755 25571 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.322606 25430 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.323678 26021 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:24.324591 19581 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:24.362722 25430 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:24.328428 26020 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:24.325040 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 92630.9us
I20260709 13:20:24.367143 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:24.368845 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:24.371661 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:24.337024 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:24.319901 25922 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.221983 25924 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.309856 26017 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:24.346998 25919 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:24.352821 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.358006 25692 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.360538 25571 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.340474 25879 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:24.376950 19476 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:24.387997 19476 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:24.343084 25818 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:24.364197 26020 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.389235 26020 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:24.389647 25818 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:24.391038 19476 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:24.391882 25818 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:24.392282 25818 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:24.392689 25818 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:24.392554 26017 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:24.377101 25910 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:24.374879 26021 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:24.377507 26046 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:24.394748 26046 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:24.395169 26046 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:24.395931 19476 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:24.385133 26048 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:24.385385 19659 raft_consensus.cc:2410] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:20:24.402907 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:24.405540 26020 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.378880 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:24.412051 26046 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.388602 25571 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:24.420210 25571 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.420681 25571 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:24.384502 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:24.422431 26046 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.423308 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:24.424522 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:24.426551 26020 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.426740 26048 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:24.427474 26020 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:24.428318 26020 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:24.430214 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:24.426592 25879 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:24.432546 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:24.409945 19654 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:20:24.443015 19654 pending_rounds.cc:85] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 12
I20260709 13:20:24.443320 19654 pending_rounds.cc:107] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:20:24.443558 19654 raft_consensus.cc:2889] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:24.448565 24491 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.449131 19655 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 15.
I20260709 13:20:24.451483 19478 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:24.402230 25818 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.466018 19653 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: []
W20260709 13:20:24.467835 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 71972.8us
I20260709 13:20:24.470106 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:20:24.472795 24491 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.482196 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:24.482183 25004 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:24.462913 25882 consensus_meta.cc:287] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.736s	user 0.008s	sys 0.004s
I20260709 13:20:24.484031 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:24.487175 19583 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:24.451926 25575 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.461458 25579 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.457202 25770 raft_consensus.cc:697] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:24.455757 25929 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.478279 26046 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:24.483887 25910 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:24.478000 25573 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:24.507157 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 77024.6us
I20260709 13:20:24.545717 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:24.482106 25886 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:24.495376 26002 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:24.507378 24491 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
W20260709 13:20:24.552140 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.553146 26021 raft_consensus.cc:2764] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:20:24.554122 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:24.561065 19583 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:24.555796 19582 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:24.550520 19409 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 56) took 11215 ms. Trace:
I20260709 13:20:24.554527 25715 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.566164 19478 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:24.484627 25867 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:20:24.494357 25730 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:20:24.549763 25573 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.575317 26017 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:24.557438 26002 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:24.576210 26002 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:24.577205 25573 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.550835 26046 raft_consensus.cc:697] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:24.579571 25639 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.580128 25639 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.580449 26046 consensus_queue.cc:237] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.582499 25639 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.549747 25978 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:24.583307 25978 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:24.584293 25978 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:24.587642 26052 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:20:24.501307 25425 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:20:24.588822 25425 consensus_queue.cc:1243] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:24.593602 26002 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.599731 26002 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.618848 25922 consensus_queue.cc:1059] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:24.620263 25924 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.620774 25924 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.623003 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:24.623416 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:24.623654 19660 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:24.497025 25882 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.625276 19655 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 13:20:24.625509 25882 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.625684 19655 pending_rounds.cc:85] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 14
I20260709 13:20:24.626446 19655 pending_rounds.cc:107] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:20:24.626729 19655 raft_consensus.cc:2889] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:24.623003 25924 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.630090 25770 consensus_queue.cc:237] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.632490 19653 raft_consensus.cc:1275] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:24.633522 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:24.633759 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:24.634861 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:24.635469 19657 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:24.637697 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:24.641508 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.541714 25929 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:24.642709 25795 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.643200 25795 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.644001 25929 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:24.644546 25929 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.645200 25795 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.645833 26001 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.646471 25818 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.646624 26050 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.646355 26001 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.647146 26050 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.632373 19660 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:24.650810 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:24.651574 19652 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:24.652971 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 86903.7us
I20260709 13:20:24.623234 26024 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:24.644956 25929 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.502106 25575 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.657459 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:24.504974 25579 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.657722 19476 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:24.665277 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:24.672369 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 118333us
I20260709 13:20:24.572496 25910 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:24.669647 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:24.680388 20663 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:24.680603 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:24.585556 25978 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:24.682581 19655 raft_consensus.cc:3055] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:24.682991 19655 raft_consensus.cc:740] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:24.684980 20659 raft_consensus.cc:1240] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:24.673750 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:24.674206 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:24.686540 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:24.666059 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:24.688104 19586 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:24.675665 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:24.676169 25882 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:24.692446 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:24.659583 26002 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:24.678647 26050 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.571194 25715 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.736074 26050 consensus_queue.cc:1048] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:24.737099 26002 raft_consensus.cc:697] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:24.738212 26002 consensus_queue.cc:237] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.561797 19409 rpcz_store.cc:276] 0709 13:20:13.282188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.283472 (+  1284us) service_pool.cc:224] Handling call
0709 13:20:24.497060 (+11213588us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:22.996257 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:23.025760 (+ 29503us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:23.025817 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:20:23.025860 (+    43us) tablet.cc:662] Decoding operations
0709 13:20:23.026583 (+   723us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:23.026673 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:23.026704 (+    31us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:20:23.027186 (+   482us) tablet.cc:701] Row locks acquired
0709 13:20:23.027245 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:20:23.027439 (+   194us) write_op.cc:270] Start()
0709 13:20:23.027622 (+   183us) write_op.cc:276] Timestamp: P: 1783603223027369 usec, L: 0
0709 13:20:23.027670 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:20:23.028450 (+   780us) log.cc:844] Serialized 1307 byte log entry
0709 13:20:23.454430 (+425980us) op_driver.cc:464] REPLICATION: finished
0709 13:20:23.572179 (+117749us) write_op.cc:301] APPLY: starting
0709 13:20:23.577791 (+  5612us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:23.627901 (+ 50110us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:23.628056 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:23.630513 (+  2457us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:23.630798 (+   285us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:20:23.630843 (+    45us) write_op.cc:312] APPLY: finished
0709 13:20:23.631246 (+   403us) log.cc:844] Serialized 41 byte log entry
0709 13:20:23.658115 (+ 26869us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:23.658230 (+   115us) write_op.cc:454] Released schema lock
0709 13:20:23.658297 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:23.658789 (+   492us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:23.658824 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5910563,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":96669,"apply.run_cpu_time_us":7430,"apply.run_wall_time_us":101992,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16661,"num_ops":3,"prepare.queue_time_us":234540,"prepare.run_cpu_time_us":12747,"prepare.run_wall_time_us":168070,"raft.queue_time_us":234826,"raft.run_cpu_time_us":37600,"raft.run_wall_time_us":99916,"replication_time_us":402744,"thread_start_us":422109,"threads_started":4,"wal-append.queue_time_us":134844,"wal-append.run_cpu_time_us":46724,"wal-append.run_wall_time_us":1472966}]]}
I20260709 13:20:24.648784 26001 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.696766 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:24.715049 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:24.742405 19583 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:24.743403 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:24.716042 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:24.744380 19586 raft_consensus.cc:2393] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 21: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:24.745152 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:24.745703 19586 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:24.671177 25879 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:24.683964 19655 consensus_queue.cc:260] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:24.550839 25871 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.752367 25871 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:24.753196 19658 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 24: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:24.749763 19655 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:24.757055 26024 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.758903 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:24.725694 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:24.762356 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:24.764128 26001 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:24.764638 26001 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.735112 25922 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:20:24.765089 26001 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:24.766358 25922 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:24.766848 25922 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.767308 25922 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:24.770099 25879 consensus_queue.cc:1059] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:24.770959 25879 consensus_queue.cc:1243] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer 068c03c9dcc848e6bf909131b1f83065 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:24.771590 26022 raft_consensus.cc:3055] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:24.771950 26022 raft_consensus.cc:740] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:24.772760 26022 consensus_queue.cc:260] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:24.773550 19655 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 13:20:24.774008 19655 pending_rounds.cc:85] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 13
I20260709 13:20:24.714386 26048 raft_consensus.cc:2764] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:20:24.774262 19655 pending_rounds.cc:107] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:20:24.777640 19655 raft_consensus.cc:2889] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:24.690444 25990 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:24.780755 26056 log.cc:927] Time spent T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:20:24.671653 25573 consensus_queue.cc:1059] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:20:24.787063 26001 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.713934 25882 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.790238 25882 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:24.793002 25867 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.793689 25867 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.795348 25579 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:24.796087 25867 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.796985 25575 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:24.800024 26001 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.730983 25924 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:24.806028 25924 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.806396 25924 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:24.809464 26001 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.810104 26001 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.813820 26001 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.818928 25929 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.820046 19652 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:24.822242 25941 tablet_bootstrap.cc:492] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065: Bootstrap starting.
I20260709 13:20:24.827658 25929 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.834621 26041 raft_consensus.cc:3055] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:24.835150 26041 raft_consensus.cc:740] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:24.836010 26041 consensus_queue.cc:260] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:24.836854 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.840344 25849 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:24.843240 26042 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:24.847018 25571 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.837309 26041 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:24.854194 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:24.856794 19655 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:24.690968 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:24.725975 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:24.858155 19660 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:24.851959 26020 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:24.869468 19661 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:24.828408 25929 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.871600 19655 raft_consensus.cc:2468] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 16.
I20260709 13:20:24.868052 25924 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:24.874310 20619 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:24.881968 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 192030us
I20260709 13:20:24.883342 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:24.886026 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.891588 26029 raft_consensus.cc:2804] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:24.892342 26029 raft_consensus.cc:697] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 16 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:24.886399 26048 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:20:24.888902 26021 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:24.849592 25571 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:24.893396 26029 consensus_queue.cc:237] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:24.883769 26020 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:24.905973 25910 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:24.944386 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 181121us
I20260709 13:20:24.952137 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:24.954348 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:24.955024 19578 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:24.944473 25795 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:24.956387 25795 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:24.957324 25795 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:24.958868 19584 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:20:24.960266 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:24.965497 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:24.961020 19584 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:24.969815 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:24.975023 19579 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:24.976459 19587 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:24.978914 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3393) took 1207 ms. Trace:
I20260709 13:20:24.979344 19654 rpcz_store.cc:276] 0709 13:20:23.771787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.207923 (+436136us) service_pool.cc:224] Handling call
0709 13:20:24.409502 (+201579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:24.443977 (+ 34475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.978701 (+534724us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54000e79d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:24.978841 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462519552}
I20260709 13:20:24.979609 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:24.952200 25732 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.990592 19578 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
W20260709 13:20:24.994827 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 109199us
W20260709 13:20:24.996127 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:25.000536 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 267209us
I20260709 13:20:25.001302 19476 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:24.942921 25922 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.004935 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:25.006752 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:25.009585 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:25.010416 19656 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:20:25.010506 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:25.011283 19652 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:25.010841 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:25.014652 19654 raft_consensus.cc:2393] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 20: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:25.021049 19654 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:20:25.029161 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:24.993602 26048 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:25.036201 26048 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:25.037125 26048 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.038482 26048 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:24.981315 25882 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.022500 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:25.028041 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:25.040454 19503 raft_consensus.cc:2393] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 20: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:25.028666 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:25.041131 19504 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:25.041570 25882 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:25.043723 19478 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:25.043805 26046 consensus_queue.cc:1059] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:25.044792 26046 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:25.045156 26046 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.030719 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:25.031062 19476 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:25.031322 19660 raft_consensus.cc:1240] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:20:25.032316 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:25.034670 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:25.048067 19578 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:25.048282 19509 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:25.035059 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:25.035724 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:25.046370 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:25.049129 19504 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:20:25.050702 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:25.051311 19578 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:25.052536 19583 raft_consensus.cc:2393] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 21: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:25.054009 19652 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 14.
I20260709 13:20:25.055459 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:25.056031 19578 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:25.057087 19506 raft_consensus.cc:2393] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:25.008162 25673 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:24.991626 25732 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.045507 26046 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:25.063759 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.022297 26045 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:25.067495 19578 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:25.067903 19579 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:20:25.069018 20659 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:25.057220 25867 raft_consensus.cc:3055] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:25.057137 26021 raft_consensus.cc:697] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:25.068878 26042 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:25.057444 26024 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 13:20:25.069128 25929 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:25.060896 25571 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:20:25.090365 19509 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:25.087543 19661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3397) took 1276 ms. Trace:
I20260709 13:20:25.091928 19661 rpcz_store.cc:276] 0709 13:20:23.810713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.245102 (+434389us) service_pool.cc:224] Handling call
0709 13:20:24.245345 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:24.869977 (+624632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.087293 (+217316us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b5400021554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:25.087483 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434406784}
I20260709 13:20:25.077911 25924 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:25.065778 25673 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.072268 25867 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:25.113134 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 55530.5us
I20260709 13:20:25.082036 26042 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.114497 19476 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:25.121057 19476 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:25.122241 25571 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:25.124451 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:25.125660 26041 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:25.128403 25571 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:25.131265 19476 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:25.132573 26079 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:25.133306 26079 raft_consensus.cc:697] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:25.134826 26079 consensus_queue.cc:237] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.135099 26021 consensus_queue.cc:237] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.136853 19476 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:25.155527 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:25.157037 19511 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:25.157745 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:25.159160 19512 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:25.160102 19625 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:25.161645 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:25.162446 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:25.163189 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:25.162562 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:25.164247 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:25.164299 19656 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:25.165153 19653 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 14: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:25.165768 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:25.163712 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:25.166476 19660 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:20:25.166522 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:25.167147 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:25.169004 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:25.172394 19509 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:25.117522 26042 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:25.164520 26063 log.cc:927] Time spent T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:20:25.143689 25929 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:25.200769 25615 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:25.201548 25615 consensus_queue.cc:1243] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:25.186348 19656 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:20:25.202991 19656 pending_rounds.cc:85] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 11
I20260709 13:20:25.203269 19656 pending_rounds.cc:107] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:20:25.203516 19656 raft_consensus.cc:2889] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:25.204442 19625 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:25.169369 26064 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:20:25.150717 25639 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:25.205897 26048 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.206144 25639 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.206614 25639 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:25.206548 26048 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.207719 26022 raft_consensus.cc:3060] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:25.188159 19657 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:20:25.190395 19660 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:20:25.191565 26071 log.cc:927] Time spent T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:20:25.210443 25692 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:20:25.192155 26062 log.cc:927] Time spent T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:20:25.195152 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:25.212078 19653 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:25.213099 25732 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:25.214085 26069 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:25.214406 25732 consensus_queue.cc:1059] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:25.214684 26069 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:25.215451 25786 raft_consensus.cc:3055] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:25.215831 25786 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:25.216961 26069 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:25.216696 25786 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.218161 25786 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:25.220193 25649 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:25.220935 25639 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.201581 25929 raft_consensus.cc:697] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:25.217684 25867 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.222496 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:25.222744 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:25.179044 19503 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:25.190016 19652 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:25.228122 19478 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:25.229525 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:25.227679 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:25.229715 19625 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:25.235405 19583 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:25.244644 19578 pending_rounds.cc:85] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 10
I20260709 13:20:25.245016 19578 pending_rounds.cc:107] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:20:25.245280 19578 raft_consensus.cc:2889] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:25.165859 25818 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:20:25.243510 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:25.231824 19507 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:25.249511 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:25.250155 19583 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:25.254403 24912 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:25.260859 19584 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:25.262156 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:25.262228 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:25.264488 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:25.265744 19583 raft_consensus.cc:2410] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 21 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 13:20:25.266388 19625 leader_election.cc:400] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15.
I20260709 13:20:25.266708 19625 leader_election.cc:403] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:20:25.263574 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:25.233937 25615 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:25.231652 26080 consensus_queue.cc:1175] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e19c80e9149b4b8d88ae13bde8e43864" responder_term: 20 status { last_received { term: 18 index: 12 } last_committed_idx: 12 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:25.260587 26069 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:25.244426 26045 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:25.244176 26001 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:20:25.260357 25849 raft_consensus.cc:2764] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:20:25.260773 25578 consensus_queue.cc:1059] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:20:25.237380 26079 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:25.287484 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:25.267776 26068 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:25.310426 26068 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.271559 26069 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:25.312652 26068 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:25.295609 19627 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:25.296651 19585 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: [17.11-19.12]
I20260709 13:20:25.297762 26046 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.302093 25578 raft_consensus.cc:3055] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:25.268111 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:25.309717 25692 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 14. Current term is 15.
I20260709 13:20:25.274962 26045 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.293272 26029 raft_consensus.cc:3055] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:25.313609 26079 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:25.274822 25639 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:25.292955 26024 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:25.358355 26024 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:25.360869 26024 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:25.361109 25692 consensus_queue.cc:1059] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:25.275276 25929 consensus_queue.cc:237] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.362005 26076 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.362715 25615 raft_consensus.cc:3055] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:25.362560 26076 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.363142 25615 raft_consensus.cc:740] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:25.364048 25615 consensus_queue.cc:260] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:25.364811 26076 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:25.333809 26069 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:25.342208 19585 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21. Ops: []
W20260709 13:20:25.344087 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.269384 26048 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:25.330339 25579 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:25.356873 26046 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:25.353385 26029 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:25.371135 19583 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 24: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:25.353432 19508 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:25.304386 26042 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.385877 19579 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:20:25.404565 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.336257 25849 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:25.408428 19476 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:25.354799 26045 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:25.369165 25578 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:25.424751 25909 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.411211 25849 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.414763 25639 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:25.414239 26068 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:25.441802 26042 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:25.443118 26079 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.444336 26029 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:25.438961 25849 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:25.445572 26029 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:25.446240 25578 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.447347 25578 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:25.450433 25639 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.452693 25639 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:25.435081 25909 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:25.458480 25909 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:25.459648 25673 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:25.462906 25579 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:25.463443 25579 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:25.463871 19586 raft_consensus.cc:2410] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:20:25.468127 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:25.474035 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:25.478206 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 215933us
I20260709 13:20:25.480181 19586 raft_consensus.cc:2393] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 22: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:25.480072 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:25.480775 19581 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:25.481570 19580 raft_consensus.cc:2393] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 20: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:25.481439 19625 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:25.483045 19476 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:25.483650 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 152728us
I20260709 13:20:25.486572 19579 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:25.489324 19586 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: [17.9-18.10]
W20260709 13:20:25.490202 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.492930 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2814) took 1652 ms. Trace:
I20260709 13:20:25.493341 19658 rpcz_store.cc:276] 0709 13:20:23.840656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.402604 (+561948us) service_pool.cc:224] Handling call
0709 13:20:25.492756 (+1090152us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b54002c7ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:25.492877 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":803734912}
I20260709 13:20:25.500430 26045 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.489172 26050 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:25.501915 26092 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:25.492056 25430 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:25.504356 25430 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:25.504742 25430 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:25.506021 19503 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:20:25.496245 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:25.507772 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.501471 19581 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:25.511528 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:25.512238 19476 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:25.515997 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:25.516804 19583 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:25.519740 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:25.519449 19586 raft_consensus.cc:2393] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 21: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:25.521165 19476 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:25.522958 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:25.523236 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:25.523557 19654 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:25.523567 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:25.522517 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:25.515004 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:25.528378 19585 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:20:25.530503 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:25.503363 25579 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.531543 19654 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:25.533919 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:25.532413 19478 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:25.519980 25795 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:25.546648 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 52169.9us
I20260709 13:20:25.519505 26050 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.540000 19625 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:25.527432 26041 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:25.548713 25871 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:20:25.557747 25871 consensus_queue.cc:1243] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:25.559183 25649 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:25.563537 19585 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:25.535317 26042 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:25.533093 26091 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:25.570271 19478 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:25.567427 19476 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:25.575465 19625 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:25.576397 26096 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:25.585692 19625 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:25.521080 25849 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.566871 26069 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:25.562922 26041 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.590194 19476 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:25.590488 19625 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:25.595820 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:25.597293 19625 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:25.597867 19582 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:20:25.550585 25894 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:20:25.599043 19476 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:25.600276 19625 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:25.601482 26104 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:25.577183 26096 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:25.604947 26096 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:25.607311 25430 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.562690 26050 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.574404 26046 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:20:25.598807 25919 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:25.574399 26094 consensus_queue.cc:1059] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:20:25.597043 26042 raft_consensus.cc:697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:25.615381 26094 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:25.616029 26094 raft_consensus.cc:3055] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:25.616350 26094 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:25.616206 26042 consensus_queue.cc:237] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.610669 25894 consensus_queue.cc:1243] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:20:25.599118 25673 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:25.594151 26095 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:25.610817 26002 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:25.589008 26092 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:25.613709 26104 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:25.626098 26104 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:25.626300 26045 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:25.628657 26050 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:25.613976 25430 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:25.635006 25849 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:25.611055 25871 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:25.636627 26080 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:25.637213 26080 raft_consensus.cc:697] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:25.643707 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:25.644577 19654 raft_consensus.cc:2368] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23.
I20260709 13:20:25.640369 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:25.593526 26069 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:25.649287 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:25.596354 26041 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:25.638089 26080 consensus_queue.cc:237] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.655954 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:25.657071 19587 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:25.661391 19653 raft_consensus.cc:1217] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Deduplicated request from leader. Original: 16.9->[17.10-21.12]   Dedup: 17.10->[19.11-21.12]
I20260709 13:20:25.662196 19653 pending_rounds.cc:85] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 10
I20260709 13:20:25.662511 19653 pending_rounds.cc:107] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:20:25.662806 19653 raft_consensus.cc:2889] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:25.664523 19654 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:25.668396 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:25.669255 19660 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:25.671556 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:25.672610 19654 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:25.677812 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:25.678783 19661 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:25.682480 19476 leader_election.cc:400] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23.
I20260709 13:20:25.682821 19476 leader_election.cc:403] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:25.686267 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:25.687424 19655 raft_consensus.cc:2393] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 22: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:25.641937 25673 raft_consensus.cc:697] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:25.653990 26069 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:25.681349 26101 log.cc:927] Time spent T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 13:20:25.704350 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 104202us
I20260709 13:20:25.617257 26094 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.722333 19654 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:25.674250 26076 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:25.649899 26021 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:20:25.703827 19582 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
W20260709 13:20:25.727711 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 126545us
I20260709 13:20:25.686309 25770 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.750283 26068 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:20:25.770829 25867 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:25.778039 25715 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:25.743088 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:25.728099 19625 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:25.686128 25639 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:25.788120 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:25.751979 26094 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:25.728277 25571 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.794282 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:25.766736 25579 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:25.730826 26002 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:20:25.731360 25430 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.068s
W20260709 13:20:25.743940 25849 consensus_queue.cc:1175] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d56df3728fc04e37b2d29a3bcd91d167" responder_term: 19 status { last_received { term: 16 index: 10 } last_committed_idx: 10 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:25.792145 25673 consensus_queue.cc:237] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.698851 25910 consensus_queue.cc:1059] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:20:25.829226 25910 raft_consensus.cc:3055] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:25.829595 25910 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:25.830490 25910 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.792636 25818 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:25.806087 26096 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.792812 25715 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.806954 25571 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.815109 26069 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:25.818815 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.766364 25770 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:25.802561 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 83909.6us
I20260709 13:20:25.835373 25818 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.802224 25639 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.794157 25978 consensus_queue.cc:1059] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
W20260709 13:20:25.840029 20619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:25.845343 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 51971.5us
I20260709 13:20:25.848755 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:25.827138 25430 consensus_queue.cc:1243] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:25.833755 25871 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:25.862790 25910 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:25.803521 19476 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:25.825505 19661 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:25.859748 25919 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:25.851912 25817 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.867057 19551 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:25.828313 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 100307us
I20260709 13:20:25.888304 19625 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:25.866585 25818 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:25.885414 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:20:25.886811 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 83421.8us
I20260709 13:20:25.895386 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:25.863533 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:25.865888 25786 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.891083 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:25.891806 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:25.902454 20665 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:25.903448 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:25.861284 26106 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:20:25.898626 19655 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:20:25.937542 19655 pending_rounds.cc:85] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 9
I20260709 13:20:25.938032 19655 pending_rounds.cc:107] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:20:25.938347 19655 raft_consensus.cc:2889] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:25.899154 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.884497 19654 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:25.900326 20659 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:25.896323 19476 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:25.934070 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 45846.2us
I20260709 13:20:25.859390 25715 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.936060 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:25.940971 19625 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:25.934875 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 50579.5us
W20260709 13:20:25.947743 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51525.3us
I20260709 13:20:25.948056 24912 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:25.948678 24912 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:25.899953 26110 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:25.889596 26068 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:25.950085 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:25.905294 25871 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:25.935837 26076 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:25.893147 25578 raft_consensus.cc:3055] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:25.952849 24912 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.892930 25919 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.963207 20665 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:25.932657 25990 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:25.998361 25990 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.936887 26092 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:25.968425 25430 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:25.969499 25922 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:25.939500 25978 consensus_queue.cc:1059] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:20:25.405397 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:25.978876 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 75476.8us
I20260709 13:20:26.021806 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:26.023211 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:26.023983 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:25.982928 19625 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:26.024297 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:25.884819 26041 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.890376 26104 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.893684 25817 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:25.933152 25786 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.092478 19506 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:25.959173 26021 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:25.976466 25615 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:26.024659 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:26.093575 19655 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:26.023998 19654 raft_consensus.cc:2393] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 21: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:26.079641 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:26.078900 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:26.087150 19660 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:26.095211 19509 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:25.995271 25578 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:26.088069 19504 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:26.099365 26124 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:26.101438 19510 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:25.965081 25924 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:20:26.111259 19657 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:26.112039 19653 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:20:26.115864 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.096306 26080 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:26.180529 26102 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:20:26.193171 25817 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:26.193790 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.198395 25990 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.183713 26096 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:26.183965 26069 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.188633 25770 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.186230 26080 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.206693 25639 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.215942 25715 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:26.217983 26111 log.cc:927] Time spent T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:20:26.218891 25818 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:26.219563 26117 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:20:26.221261 25818 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.223126 26080 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.227349 26104 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:26.227799 19406 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48852 (request call id 176) took 44434 ms (client timeout 15000 ms). Trace:
I20260709 13:20:26.228672 26041 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.181522 25871 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.232174 25786 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:26.201488 25578 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.279747 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 3942) took 1047 ms. Trace:
I20260709 13:20:26.280189 19503 rpcz_store.cc:276] 0709 13:20:25.232476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.232654 (+   178us) service_pool.cc:224] Handling call
0709 13:20:26.279530 (+1046876us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54000744d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:26.279680 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558375680}
I20260709 13:20:26.276319 25578 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:26.251382 19406 rpcz_store.cc:269] 0709 13:19:41.767719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.788481 (+ 20762us) service_pool.cc:224] Handling call
0709 13:19:42.287276 (+498795us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b54002ec7d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c4090 00007f6c31762f3a 00007f6c375191cc 00007f6c3761737e 00007f6c35ad82a4 00007f6c35ad8232 00007f6c35ad8161 00007f6c35ad80dc 00007f6c35ad7392 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:26.190569 (+43903293us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:14.368253 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:14.611511 (+243258us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:14.614084 (+  2573us) write_op.cc:435] Acquired schema lock
0709 13:20:14.615255 (+  1171us) tablet.cc:662] Decoding operations
0709 13:20:14.735102 (+119847us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:14.738997 (+  3895us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:14.741461 (+  2464us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:20:14.963174 (+221713us) tablet.cc:701] Row locks acquired
0709 13:20:14.963222 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:20:14.989695 (+ 26473us) write_op.cc:270] Start()
0709 13:20:15.002921 (+ 13226us) write_op.cc:276] Timestamp: P: 1783603214980935 usec, L: 0
0709 13:20:15.018143 (+ 15222us) op_driver.cc:348] REPLICATION: starting
0709 13:20:15.119470 (+101327us) log.cc:844] Serialized 935 byte log entry
0709 13:20:15.819777 (+700307us) op_driver.cc:464] REPLICATION: finished
0709 13:20:15.958007 (+138230us) write_op.cc:301] APPLY: starting
0709 13:20:15.999498 (+ 41491us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:16.141979 (+142481us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:16.147400 (+  5421us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:16.203797 (+ 56397us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:16.204031 (+   234us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:20:16.204089 (+    58us) write_op.cc:312] APPLY: finished
0709 13:20:16.204333 (+   244us) log.cc:844] Serialized 33 byte log entry
0709 13:20:16.204533 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:16.204628 (+    95us) write_op.cc:454] Released schema lock
0709 13:20:16.204668 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:16.205139 (+   471us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:16.205184 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":648956,"reported_tablets":57,"spinlock_wait_cycles":26066176,"child_traces":[["op",{"apply.queue_time_us":124565,"apply.run_cpu_time_us":7597,"apply.run_wall_time_us":247141,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12483,"num_ops":2,"prepare.queue_time_us":347654,"prepare.run_cpu_time_us":40941,"prepare.run_wall_time_us":1036829,"raft.queue_time_us":191741,"raft.run_cpu_time_us":12382,"raft.run_wall_time_us":170947,"replication_time_us":776892,"thread_start_us":391488,"threads_started":4,"wal-append.queue_time_us":222535,"wal-append.run_cpu_time_us":19149,"wal-append.run_wall_time_us":1837166}]]}
I20260709 13:20:26.286203 26002 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23.
I20260709 13:20:26.289486 25909 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:26.292220 19658 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:26.294776 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:26.295624 19657 raft_consensus.cc:2393] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 22: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:26.296402 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:26.296959 19657 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:26.297936 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:26.298216 19659 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:26.298564 19655 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:26.299320 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:26.299424 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:26.299944 19659 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:26.300549 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:26.301088 19655 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:26.302098 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:26.302706 19657 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:26.303443 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:26.304744 26129 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:26.314224 24491 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.314687 24491 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.316490 19657 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:26.316574 24491 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.317020 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:26.329020 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.332933 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.335922 26131 log.cc:927] Time spent T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:20:26.338500 19655 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:20:26.338940 19655 pending_rounds.cc:85] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 10
I20260709 13:20:26.339150 19655 pending_rounds.cc:107] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:20:26.339406 19655 raft_consensus.cc:2889] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:26.339854 19655 pending_rounds.cc:107] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:20:26.342909 19655 raft_consensus.cc:2889] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:26.346164 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:26.352051 19476 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:26.356328 19476 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:26.357957 25818 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:26.360436 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:26.360736 25770 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:26.361114 25770 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.361295 26068 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:26.361482 25770 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:26.361771 26068 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.348914 25573 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.365067 26068 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:26.370386 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:26.362506 25639 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:26.401911 25818 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:26.433467 25639 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.440816 25941 tablet_bootstrap.cc:492] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:26.409482 25817 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:20:26.447152 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 28 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:26.452265 26119 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.425s	user 0.002s	sys 0.000s
I20260709 13:20:26.444352 25639 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:26.440498 25922 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:26.457357 25922 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:26.468061 25649 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.398113 25573 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.462025 25922 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:26.469579 25649 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.477990 25649 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.480901 25673 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.468353 25818 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:26.481546 25673 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.487011 19659 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:26.489209 19476 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:26.491185 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:26.494110 25818 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.495422 25894 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:26.495946 25894 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:26.496760 25894 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.500658 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:26.504122 25673 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.514119 19659 raft_consensus.cc:2410] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:20:26.516155 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:26.519874 19659 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:26.518604 25941 tablet_bootstrap.cc:492] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065: Bootstrap complete.
I20260709 13:20:26.522239 19476 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:26.528753 26113 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.420s	user 0.002s	sys 0.000s
I20260709 13:20:26.513367 26068 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.533701 26076 raft_consensus.cc:697] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:26.534816 26076 consensus_queue.cc:237] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:26.538189 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.538081 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 514173us
I20260709 13:20:26.539335 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:26.531105 25990 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:26.547695 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3317) took 1036 ms. Trace:
I20260709 13:20:26.521198 25770 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.561033 26110 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.561697 26110 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.562780 24491 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:26.563373 24491 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:26.564214 26110 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.550590 26120 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:26.565685 25818 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:26.566665 25818 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:26.567871 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 620215us
I20260709 13:20:26.554136 25941 ts_tablet_manager.cc:1403] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065: Time spent bootstrapping tablet: real 1.732s	user 0.066s	sys 0.027s
I20260709 13:20:26.561934 20661 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:20:26.574806 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3323) took 1059 ms. Trace:
I20260709 13:20:26.552318 25990 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.579455 24491 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:20:26.581485 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 598662us
I20260709 13:20:26.583252 19625 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:26.586026 25430 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:26.562816 26023 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:26.586947 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:26.577569 26074 raft_consensus.cc:2764] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:20:26.589319 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:26.590068 19661 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:26.569463 25818 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.570132 25573 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.577919 26120 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:26.577865 25894 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.606652 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:26.581707 25990 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:26.594988 19476 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:26.578308 19583 rpcz_store.cc:276] 0709 13:20:25.515226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.517514 (+  2288us) service_pool.cc:224] Handling call
0709 13:20:25.517912 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:25.529725 (+ 11813us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:25.955844 (+426119us) log.cc:844] Serialized 14 byte log entry
0709 13:20:26.573882 (+618038us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:26.573941 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:26.573984 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.574626 (+   642us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.574753 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":883691,"prepare.queue_time_us":423346,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":425904,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":11218,"thread_start_us":151492,"threads_started":2,"wal-append.queue_time_us":219966}
I20260709 13:20:26.619189 19659 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:20:26.621843 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.623680 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:26.624497 19580 raft_consensus.cc:3060] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:26.626868 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:26.618888 24491 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:20:26.593760 26042 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.631903 19478 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:26.633145 19661 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:20:26.635159 19582 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
W20260709 13:20:26.636422 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.636826 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 53692.5us
I20260709 13:20:26.637506 19625 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:26.638020 24491 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:26.640450 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:26.641955 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:26.642616 20665 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:26.645584 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:26.646421 19582 raft_consensus.cc:2393] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 18: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:26.648794 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:26.649420 19583 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:26.679442 19580 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:26.683542 24491 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:26.691830 24491 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:26.704483 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 54409.9us
I20260709 13:20:26.746657 19582 raft_consensus.cc:3055] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:26.747171 19582 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:26.639174 25673 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:26.752758 19582 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.758670 19582 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:26.755425 24491 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:26.756773 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 119329us
I20260709 13:20:26.762468 19625 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:26.756819 19585 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:26.758244 19578 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:26.616773 26120 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.771692 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:26.631137 25867 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.123s
I20260709 13:20:26.650470 25579 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:26.778254 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:26.782198 24491 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:26.782547 24491 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:26.782859 24491 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:26.638774 25817 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.128s
W20260709 13:20:26.785317 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 136198us
W20260709 13:20:26.768409 26115 log.cc:927] Time spent T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:20:26.752946 26092 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.632457 25894 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.758162 25673 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.642925 26042 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.796355 19582 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:26.769106 25430 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:26.750262 26002 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:20:26.766144 25573 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.807765 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:26.813063 19584 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:26.771703 25818 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.774849 26048 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:26.816236 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 53888.3us
W20260709 13:20:26.788571 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 249284us
I20260709 13:20:26.793777 26021 raft_consensus.cc:697] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:26.840811 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:26.808337 25673 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:26.841457 19582 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:26.821478 25692 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:26.824224 26068 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.851455 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:26.851692 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:26.838943 26144 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:26.847823 26145 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:26.849370 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:26.850625 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:26.853096 25578 consensus_queue.cc:1059] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:26.853350 19581 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:20:26.820158 19578 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:26.856189 19586 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:26.862923 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:26.807472 26092 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.844079 26104 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.825973 25639 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.858912 24491 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:26.827039 25573 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.834188 25818 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.916234 25639 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.899905 26104 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.917294 25818 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.869519 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:26.860268 19582 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:26.918941 26104 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:26.919143 25573 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.919983 25919 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.920673 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:26.921926 19506 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:26.922691 19506 raft_consensus.cc:606] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:26.925004 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:26.925952 19582 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 23: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:26.926345 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:26.867431 19625 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:26.875697 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:26.876994 24491 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:26.876914 26150 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.877766 19407 catalog_manager.cc:5697] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:26.877938 26021 consensus_queue.cc:237] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:26.880339 26148 log.cc:927] Time spent T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:20:26.880633 26141 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:26.881098 26142 consensus_queue.cc:1059] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:20:26.882122 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:26.861940 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:26.884232 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
W20260709 13:20:26.888274 26109 log.cc:927] Time spent T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 1.090s	user 0.004s	sys 0.001s
W20260709 13:20:26.898037 26138 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:20:26.836426 26048 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:26.854864 25770 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.865006 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:26.903247 26146 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:26.904397 26120 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.904911 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 28 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:26.907353 25430 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.978853 19578 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 27.
I20260709 13:20:26.912256 26092 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:26.862505 26144 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.913766 25941 raft_consensus.cc:359] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:26.861505 26076 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:26.915473 25894 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.926946 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:26.982401 19582 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:26.927112 19585 raft_consensus.cc:2393] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 20: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:26.983675 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:26.984630 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:26.927781 19506 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
W20260709 13:20:26.929257 19658 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 3440) took 1419 ms (client timeout 1595 ms). Trace:
I20260709 13:20:26.985399 19506 raft_consensus.cc:606] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
W20260709 13:20:26.985481 19658 rpcz_store.cc:269] 0709 13:20:25.509461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.509610 (+   149us) service_pool.cc:224] Handling call
0709 13:20:26.929107 (+1419497us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b54002170d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:26.929203 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1749987712}
I20260709 13:20:26.947209 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:26.986920 19587 raft_consensus.cc:1275] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:26.987118 19586 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:26.929445 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 158287us
I20260709 13:20:26.866639 26145 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:26.969321 25639 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.964694 19583 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:26.965234 19584 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
W20260709 13:20:26.974879 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 109969us
I20260709 13:20:26.953320 26104 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:26.910235 26042 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.980016 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:26.981189 26146 consensus_queue.cc:1243] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:26.990684 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:26.968489 19407 catalog_manager.cc:5697] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 16 to 19, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 19 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:27.013249 19585 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:27.000999 19583 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:27.014597 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:27.015385 19583 raft_consensus.cc:2410] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:20:27.003151 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:27.004701 19578 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
W20260709 13:20:26.951496 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 84185.4us
I20260709 13:20:27.016630 19578 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:27.005329 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:27.020081 19582 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 23: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:27.007174 19581 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:27.025471 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:27.027153 26110 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:27.029026 25571 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:26.986541 25941 raft_consensus.cc:740] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Initialized, Role: LEARNER
I20260709 13:20:26.988619 26074 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:27.030896 19407 catalog_manager.cc:5697] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 17 to 19, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 19 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:27.069164 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:27.071453 19584 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:27.084125 19506 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:27.086757 19578 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:27.089469 19583 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:27.099004 19506 pending_rounds.cc:85] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 13
I20260709 13:20:27.099360 19506 pending_rounds.cc:107] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 13:20:27.099903 19506 raft_consensus.cc:2889] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:27.099298 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:27.105084 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:27.105916 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:27.106395 19512 pending_rounds.cc:85] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 10
I20260709 13:20:27.106752 19512 pending_rounds.cc:107] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:20:27.106721 19511 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:27.107319 19512 raft_consensus.cc:2889] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:27.108359 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:27.109421 19652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3450) took 1466 ms. Trace:
I20260709 13:20:27.001016 25639 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.112897 19505 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 16: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:27.113157 19504 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:27.115276 19582 raft_consensus.cc:3055] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:27.115682 19582 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:26.982582 25430 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.121472 19509 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:20:26.551069 19579 rpcz_store.cc:276] 0709 13:20:25.511165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.512331 (+  1166us) service_pool.cc:224] Handling call
0709 13:20:25.512643 (+   312us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:25.519094 (+  6451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:25.519129 (+    35us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:25.533934 (+ 14805us) log.cc:844] Serialized 78 byte log entry
0709 13:20:25.717805 (+183871us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:26.105475 (+387670us) log.cc:844] Serialized 14 byte log entry
0709 13:20:26.547326 (+441851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.547432 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:26.547472 (+    40us) raft_consensus.cc:1685] finished
0709 13:20:26.547487 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.547635 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":739398,"prepare.queue_time_us":389368,"prepare.run_cpu_time_us":9128,"prepare.run_wall_time_us":92506,"raft.queue_time_us":451098,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":10408,"thread_start_us":180811,"threads_started":1,"wal-append.queue_time_us":217413}
I20260709 13:20:27.123662 19579 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:20:27.124720 19579 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:26.950702 26150 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.113677 19586 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:27.112582 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:27.130074 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:27.130412 19510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:27.130998 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:27.131238 19510 raft_consensus.cc:606] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:27.131570 19584 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:27.131887 19508 pending_rounds.cc:85] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 8
I20260709 13:20:27.132277 19508 pending_rounds.cc:107] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:20:27.132529 19508 raft_consensus.cc:2889] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:27.119486 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:27.133373 19504 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:27.121488 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:27.029064 26020 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:27.118746 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:27.129427 19585 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:27.135356 19658 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:27.109848 19652 rpcz_store.cc:276] 0709 13:20:25.642902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.643028 (+   126us) service_pool.cc:224] Handling call
0709 13:20:25.643412 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:25.643785 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:25.643813 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:25.652342 (+  8529us) log.cc:844] Serialized 26 byte log entry
0709 13:20:25.783426 (+131084us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:25.803031 (+ 19605us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.853219 (+ 50188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.853330 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:26.887380 (+1034050us) spinlock_profiling.cc:243] Waited 5.28 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:20:27.032007 (+144627us) raft_consensus.cc:1685] finished
0709 13:20:27.109234 (+ 77227us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.109372 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56127,"prepare.queue_time_us":23009,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":60861,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":1718,"spinlock_wait_cycles":12133632,"thread_start_us":93320,"threads_started":1,"wal-append.queue_time_us":107837}
I20260709 13:20:27.126732 19407 catalog_manager.cc:5697] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 17 to 21, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 21 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:27.135977 19582 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.131779 19510 raft_consensus.cc:614] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:27.137115 19582 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:27.140723 26154 log.cc:927] Time spent T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:20:27.142870 26145 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:27.143522 26145 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:27.144021 26145 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.146026 25941 consensus_queue.cc:260] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:27.149814 26125 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.120s
I20260709 13:20:27.154081 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:27.155061 19509 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:20:27.156159 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.160589 19511 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:27.162770 19505 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:27.164882 19510 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:27.159264 19625 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:27.029599 26023 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.101s
I20260709 13:20:27.119902 25571 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.179390 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:27.118014 25578 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:20:27.215276 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 56101.2us
I20260709 13:20:27.217342 19625 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:27.239539 19627 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:27.239005 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:27.262512 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:27.263172 19509 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
W20260709 13:20:27.198047 26109 log.cc:927] Time spent T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:20:27.240641 19582 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:27.272085 19407 catalog_manager.cc:5697] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
W20260709 13:20:27.278935 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.282352 19585 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:20:27.283548 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:27.284934 19585 raft_consensus.cc:2410] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:20:27.286983 19584 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:27.288617 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:27.197642 26107 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:27.159942 26020 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.291471 19585 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:27.291934 19584 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:27.238655 25732 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:27.243114 25990 consensus_meta.cc:287] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.611s	user 0.005s	sys 0.005s
I20260709 13:20:27.297083 19407 catalog_manager.cc:5697] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 10 to 15, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 15 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:27.264958 26106 raft_consensus.cc:3055] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:20:27.294750 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 110693us
I20260709 13:20:27.266515 25982 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:27.272017 25575 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:27.214473 25578 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.193454 25571 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.309727 26107 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.326496 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:27.254835 25615 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:20:27.338369 19407 catalog_manager.cc:5697] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 11 to 15, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 15 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:27.349957 19509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:27.350630 19509 raft_consensus.cc:606] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:27.350999 19509 raft_consensus.cc:614] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:27.330988 25982 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.328279 26145 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:27.332830 26162 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.317008 26106 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:27.357293 19509 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:27.360608 19509 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:27.362326 19509 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:27.352057 25673 consensus_meta.cc:287] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.500s	user 0.011s	sys 0.000s
I20260709 13:20:27.326097 25990 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.357921 25982 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:27.397434 26161 log.cc:927] Time spent T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:20:27.400188 26147 log.cc:927] Time spent T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:20:27.382097 25673 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.401803 19407 catalog_manager.cc:5697] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 15 to 18, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 18 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:27.403367 25673 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:27.397435 25941 ts_tablet_manager.cc:1434] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065: Time spent starting tablet: real 0.812s	user 0.019s	sys 0.015s
W20260709 13:20:27.403966 25941 ts_tablet_manager.cc:1467] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065: Tablet startup took 825ms
I20260709 13:20:27.404142 25639 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:27.366411 26143 raft_consensus.cc:2764] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:20:27.403389 19407 catalog_manager.cc:5697] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 14 to 16, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 16 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:27.412429 19507 raft_consensus.cc:2468] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:27.424916 19407 catalog_manager.cc:5697] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:27.369659 26162 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.437922 19407 catalog_manager.cc:5697] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 12 to 13, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 13 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
W20260709 13:20:27.440467 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 175115us
I20260709 13:20:27.430150 25430 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:27.441498 25615 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:27.457201 25615 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.458381 25578 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:27.459311 25615 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:27.443267 26156 log.cc:927] Time spent T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 13:20:27.442759 19627 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:27.460119 25990 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:27.460992 26107 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:27.461256 19627 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:27.461544 26107 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:27.462301 25430 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:27.462369 19627 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:27.462850 25430 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.463227 25430 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:27.463673 19627 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:27.404317 25941 ts_tablet_manager.cc:1469] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065: Trace:
0709 13:20:21.431560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.432247 (+   687us) service_pool.cc:224] Handling call
0709 13:20:21.716328 (+284081us) ts_tablet_manager.cc:934] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
0709 13:20:22.616473 (+900145us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:20:22.852224 (+235751us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:22.852356 (+   132us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:20:23.059778 (+207422us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:20:23.060152 (+   374us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:23.060509 (+   357us) ts_tablet_manager.cc:989] Replica registered.
0709 13:20:23.060574 (+    65us) inbound_call.cc:177] Queueing success response
0709 13:20:23.587301 (+526727us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b18003fca60. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
0709 13:20:24.821791 (+1234490us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:20:26.585018 (+1763227us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:20:26.604595 (+ 19577us) tablet_replica.cc:261] Starting instrumentation
0709 13:20:26.605800 (+  1205us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":10807,"mutex_wait_us":12018,"raft.queue_time_us":130876,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":16470,"spinlock_wait_cycles":8545024,"tablet-copy.queue_time_us":226880,"tablet-download-pool.queue_time_us":52114,"tablet-download-pool.run_cpu_time_us":1425,"tablet-download-pool.run_wall_time_us":462960,"thread_start_us":485839,"threads_started":3}
I20260709 13:20:27.445747 25732 consensus_queue.cc:1059] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:27.465034 26094 raft_consensus.cc:2804] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:27.465543 26094 raft_consensus.cc:697] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:27.465499 25732 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:27.466874 26164 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:20:27.431066 26150 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:27.467046 26094 consensus_queue.cc:237] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.454661 25871 raft_consensus.cc:3055] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:27.467969 25871 raft_consensus.cc:740] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:27.435777 26163 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:27.468907 25871 consensus_queue.cc:260] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.469410 26163 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.470535 19671 tablet_copy_service.cc:342] P e19c80e9149b4b8d88ae13bde8e43864: Request end of tablet copy session 068c03c9dcc848e6bf909131b1f83065-c62f6690c8e840638906e0b59d2ae71d received from {username='slave'} at 127.0.0.1:59942
I20260709 13:20:27.471028 19671 tablet_copy_service.cc:434] P e19c80e9149b4b8d88ae13bde8e43864: ending tablet copy session 068c03c9dcc848e6bf909131b1f83065-c62f6690c8e840638906e0b59d2ae71d on tablet c62f6690c8e840638906e0b59d2ae71d with peer 068c03c9dcc848e6bf909131b1f83065
I20260709 13:20:27.465739 26104 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:27.473588 25982 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.476435 20661 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:27.456152 26020 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:27.473786 25578 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:20:27.473979 19407 catalog_manager.cc:5697] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 17 to 19, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 19 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:27.474350 26104 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.481014 19407 catalog_manager.cc:5697] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 15 to 17, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 17 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:27.481704 26048 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:27.482295 19512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:27.482882 19512 raft_consensus.cc:606] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:27.482481 19407 catalog_manager.cc:5697] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 13 to 16, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 16 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:27.483230 19512 raft_consensus.cc:614] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:27.455533 26162 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:27.483891 19407 catalog_manager.cc:5697] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 11 to 16, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 16 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:27.489954 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:27.490845 19584 raft_consensus.cc:2393] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:27.491827 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:27.490701 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:27.492784 19585 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:27.493849 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:27.494592 19585 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:27.474851 25871 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:27.500861 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:27.489349 19407 catalog_manager.cc:5697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 13 to 15, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 15 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:27.481900 26104 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.522066 19407 catalog_manager.cc:5697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 13 to 14, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 14 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:27.506742 25786 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:27.516722 25615 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:27.519169 25982 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:27.520957 26107 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.594549 26107 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.595088 25571 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:27.525074 19627 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:27.592881 25849 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:27.595996 25849 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:27.596758 26107 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:27.529425 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:27.597151 26144 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:27.599731 26107 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:27.600239 26107 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:27.600617 26107 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:27.603777 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.604533 26163 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:27.591317 26104 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:27.607950 25430 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.609194 26107 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.610414 25430 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:27.611258 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 87699us
I20260709 13:20:27.593879 19657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:20:27.614213 19657 raft_consensus.cc:606] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:27.614656 19657 raft_consensus.cc:614] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:27.618978 26107 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:27.620319 19625 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:27.622826 25673 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.623371 25673 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.623886 19625 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:27.625224 25578 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:27.625792 25578 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:27.626549 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:27.627323 19578 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:27.628201 26104 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:27.628386 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:27.628852 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:27.629115 19578 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:20:27.630036 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:27.629784 25578 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.630710 19581 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:20:27.632836 25910 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
W20260709 13:20:27.634128 19551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.013s	sys 0.036s
W20260709 13:20:27.634446 19551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.013s	sys 0.036s
I20260709 13:20:27.636366 19511 raft_consensus.cc:1217] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Deduplicated request from leader. Original: 16.10->[18.11-21.12]   Dedup: 18.11->[21.12-21.12]
I20260709 13:20:27.636898 19511 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: [18.11-21.12]
I20260709 13:20:27.636818 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:27.637116 19627 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:27.637775 19512 raft_consensus.cc:2410] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:20:27.638021 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:27.642951 19407 catalog_manager.cc:5697] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 12 to 14, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 14 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:27.628762 26104 raft_consensus.cc:697] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:27.559729 25615 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:27.625393 25673 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:27.658357 19407 catalog_manager.cc:5697] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 14 to 15, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 15 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:27.663264 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.674178 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:27.675004 26163 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:27.559476 25786 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:27.680583 19625 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:27.679778 19407 catalog_manager.cc:5697] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 9 to 19. New cstate: current_term: 19 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:27.649703 26179 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:27.659219 25615 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:27.658711 26144 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:20:27.653195 26021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.018s	sys 0.039s
I20260709 13:20:27.685411 19407 catalog_manager.cc:5697] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:27.679073 19578 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:27.680001 25732 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:27.687574 26179 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.698860 26179 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:27.696487 26095 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:27.699309 25732 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.688789 25910 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:27.707767 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:27.708631 19584 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:27.709838 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:27.712172 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:27.716406 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3328) took 1013 ms. Trace:
I20260709 13:20:27.716956 19580 rpcz_store.cc:276] 0709 13:20:26.702688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.702841 (+   153us) service_pool.cc:224] Handling call
0709 13:20:26.703217 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.789930 (+ 86713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:26.789959 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:26.790000 (+    41us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:26.790031 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.716062 (+926031us) spinlock_profiling.cc:243] Waited 86.5 ms on lock 0x7b540011dfd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:27.716126 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.716325 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198935424}
I20260709 13:20:27.720805 26162 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:20:27.729030 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.597146 25849 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:27.697220 26021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.019s	sys 0.040s
I20260709 13:20:27.692816 25982 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:27.776288 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 574) took 1019 ms. Trace:
I20260709 13:20:27.795554 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:27.802595 19587 rpcz_store.cc:276] 0709 13:20:26.756572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.757587 (+  1015us) service_pool.cc:224] Handling call
0709 13:20:26.781323 (+ 23736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.987274 (+205951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.775943 (+788669us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54001fac54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:27.776208 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473244928}
I20260709 13:20:27.797792 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:27.678831 26120 consensus_queue.cc:1059] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:20:27.803364 19582 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:27.821704 19584 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:27.832297 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:27.833168 19654 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:27.835919 19407 catalog_manager.cc:5697] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 13 to 17, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 17 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:27.839752 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:27.840610 19653 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 21: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:20:27.845654 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 122006us
I20260709 13:20:27.862368 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:27.869092 19476 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.131:33295 timed out after 1.595s (SENT) [suppressed 4 similar messages]
I20260709 13:20:27.791409 25692 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.803892 26107 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:27.839723 25849 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:27.839030 25430 consensus_queue.cc:1175] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2cfd02601ea44976833027665abc93bf" responder_term: 21 status { last_received { term: 21 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 21 index: 12 } }
I20260709 13:20:27.861954 26144 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.802024 26104 consensus_queue.cc:237] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.863749 26124 consensus_queue.cc:1048] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:20:27.898110 26124 consensus_queue.cc:1243] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:27.900405 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:27.901815 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:27.882525 19654 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:27.871258 26157 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.890547 25692 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.903434 26157 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.905287 25692 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:27.889950 19658 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:20:27.891219 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:27.906867 26179 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.894935 26076 consensus_queue.cc:1059] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:27.908743 19653 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:20:27.909124 26076 raft_consensus.cc:3055] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:27.897159 26144 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:27.909560 26076 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:27.910553 26076 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.911589 26144 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:27.911767 26076 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:27.878011 26021 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:27.914216 26021 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.914682 26021 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:27.906123 25786 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:27.807821 26095 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:27.921667 26095 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:27.919528 26179 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:27.927472 26157 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:27.904534 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:27.909375 19656 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:27.933327 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:27.934159 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:27.943929 19656 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:27.945709 26092 consensus_queue.cc:1175] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d56df3728fc04e37b2d29a3bcd91d167" responder_term: 22 status { last_received { term: 20 index: 12 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: [18.11-21.12]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:27.947814 25732 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:27.953001 19660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3481) took 1505 ms. Trace:
I20260709 13:20:27.962891 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:27.890974 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:27.969762 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:27.975616 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:27.998435 19504 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:27.993140 19578 pending_rounds.cc:85] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 10
I20260709 13:20:27.999558 19578 pending_rounds.cc:107] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:20:27.994673 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:27.999801 19578 raft_consensus.cc:2889] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:27.995610 19507 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:20:27.995280 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:27.953486 19660 rpcz_store.cc:276] 0709 13:20:26.447496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.531508 (+ 84012us) service_pool.cc:224] Handling call
0709 13:20:26.531791 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:26.617760 (+ 85969us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:26.643714 (+ 25954us) log.cc:844] Serialized 14 byte log entry
0709 13:20:27.483610 (+839896us) spinlock_profiling.cc:243] Waited 7.85 ms on lock 0x7b1800273be0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa23a 00007f6c31764a2a
0709 13:20:27.672232 (+188622us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:27.672730 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:20:27.672858 (+   128us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:27.672891 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.672972 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:27.952678 (+279706us) raft_consensus.cc:1685] finished
0709 13:20:27.952773 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.952931 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":224788,"prepare.queue_time_us":28106,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":100235,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":13488,"spinlock_wait_cycles":18062208,"thread_start_us":178557,"threads_started":1,"wal-append.queue_time_us":1305552}
I20260709 13:20:28.005604 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:28.037634 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 357117us
I20260709 13:20:28.038439 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:28.020448 19503 raft_consensus.cc:1275] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:28.019369 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:27.960614 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:28.042452 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:27.877562 26048 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.122s
I20260709 13:20:28.036727 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:28.046136 19508 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 22: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:28.012738 19656 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:28.048053 19658 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:28.050055 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:28.046507 19660 raft_consensus.cc:2393] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 22: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:28.052372 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:28.058259 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:28.079677 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:28.025075 25910 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.093969 19656 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:28.104174 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:28.104916 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:28.107930 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:28.085196 19551 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:28.108306 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:28.082427 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:28.109140 19584 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:28.109678 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:28.117610 26020 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:28.120174 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:27.973497 26107 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.125833 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:28.122231 19627 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:28.053560 26162 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:28.110351 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:28.126554 19660 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:28.128422 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:28.132752 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:28.127997 19584 raft_consensus.cc:2468] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:20:28.110759 26120 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.060443 20661 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:20:28.082603 25578 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.140933 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:28.126294 26176 consensus_queue.cc:1059] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:20:28.145293 26094 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:28.145989 26094 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.132913 19654 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 14.
I20260709 13:20:28.131325 25732 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:28.148977 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:28.152570 19654 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:28.132134 26020 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:28.156028 19654 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:20:28.132364 26144 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:28.169449 19654 raft_consensus.cc:1275] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:28.149919 25578 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.176095 25578 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:28.147982 26095 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:28.169708 26160 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:28.079743 26174 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
W20260709 13:20:28.148913 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 279847us
I20260709 13:20:28.116583 25910 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.165958 25732 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.172849 26144 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.191087 25879 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:20:28.193994 26186 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:20:28.194535 25615 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.195780 26021 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:28.189232 25871 consensus_meta.cc:287] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.682s	user 0.011s	sys 0.000s
I20260709 13:20:28.141386 26120 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.164904 19660 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:28.189983 19654 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 13:20:28.203989 19478 connection.cc:256] RPC call timeout handler was delayed by -1.0486857900000359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
I20260709 13:20:28.219619 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:28.220131 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:28.189359 25578 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:28.186676 26162 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:28.220620 19654 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:20:28.221506 19652 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:20:28.223615 19660 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:28.228156 19652 pending_rounds.cc:85] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 11
I20260709 13:20:28.228497 19652 pending_rounds.cc:107] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:20:28.228745 19652 raft_consensus.cc:2889] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:28.231336 24912 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:28.185297 26095 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.232183 19660 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:28.209143 26176 raft_consensus.cc:3055] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:28.205163 25879 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:28.200309 26160 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:28.226806 26157 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.216497 26125 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:20:28.239763 25578 raft_consensus.cc:697] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:28.240764 26176 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:28.256592 26176 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.257264 26021 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:28.258074 26107 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:28.259202 26187 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:20:28.248301 26094 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:28.263338 25615 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:28.270905 19580 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:28.282768 26160 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:28.283762 26120 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:28.285790 26089 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:28.286615 26089 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:28.282848 25910 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:28.287761 26089 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:28.288931 25879 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.290275 25879 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:28.293001 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:28.300557 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.296495 25982 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:28.303999 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:28.304824 19660 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:28.306062 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:28.305992 19656 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:28.258054 26176 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:28.307508 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:28.249974 26157 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.319909 19654 pending_rounds.cc:85] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 12
I20260709 13:20:28.320230 19654 pending_rounds.cc:107] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:20:28.320475 19654 raft_consensus.cc:2889] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:28.308473 26120 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:28.317029 26021 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:28.338315 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3960) took 1206 ms. Trace:
I20260709 13:20:28.338912 19510 rpcz_store.cc:276] 0709 13:20:27.132260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.150449 (+ 18189us) service_pool.cc:224] Handling call
0709 13:20:27.150886 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:27.166290 (+ 15404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:28.337943 (+1171653us) spinlock_profiling.cc:243] Waited 8.63 ms on lock 0x7b54001ef0d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:28.338226 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19858176}
W20260709 13:20:28.348659 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.318188 26162 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.328716 26021 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.384734 19553 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:20:28.351145 26125 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:28.390646 19661 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:28.357342 25732 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:28.385926 26021 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:28.331382 26120 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.397667 19583 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:20:28.385689 26076 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.389508 26020 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.358879 26162 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.327152 25578 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:28.405803 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 270639us
I20260709 13:20:28.412223 19627 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:28.396323 26110 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:28.330243 26106 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.417199 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:28.418510 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:28.426848 19580 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:28.418876 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:28.419571 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:28.428483 19586 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:20:28.398929 26144 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:28.399577 25910 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:28.420280 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:28.426566 19627 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:28.403192 26095 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:28.433569 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:28.394059 26125 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.423004 26110 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:28.451136 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:28.435245 25849 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:28.434109 25910 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.414536 26020 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:28.450639 25692 raft_consensus.cc:2804] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:28.410635 26076 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:28.440523 26195 consensus_queue.cc:1059] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:20:28.499645 25910 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:28.471891 19586 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
W20260709 13:20:28.532018 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 96603.6us
W20260709 13:20:28.534152 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.512256 26157 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:28.537264 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 316063us
I20260709 13:20:28.517321 25579 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.543278 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:28.546721 24912 raft_consensus.cc:697] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:28.547351 19660 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 18.
I20260709 13:20:28.520779 26174 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:28.543889 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 323813us
I20260709 13:20:28.562541 19476 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:28.527516 26200 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:28.572927 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:28.575872 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:28.535355 25849 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:28.578039 26200 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:28.548974 26196 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:28.568977 25579 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:28.581532 26094 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:28.549614 26110 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.588096 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:28.587680 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:28.590250 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:28.610743 19586 raft_consensus.cc:1275] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:20:28.572853 24912 consensus_queue.cc:237] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.650295 19580 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:28.650592 19584 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:28.638690 19505 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:20:28.653556 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:28.655658 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:28.656903 19585 raft_consensus.cc:2410] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
W20260709 13:20:28.660841 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 52152.4us
W20260709 13:20:28.599587 26199 log.cc:927] Time spent T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:20:28.626986 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 65102.4us
I20260709 13:20:28.606948 26076 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:28.599999 26144 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.613641 25692 raft_consensus.cc:697] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:28.679626 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:28.691114 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:28.691781 19509 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:28.603533 26020 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:28.648288 26094 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:28.699205 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:28.687043 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:28.687193 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:28.571954 26174 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.706681 19511 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:28.688326 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:28.690097 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:28.706176 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:28.709107 19504 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:28.689678 19627 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:28.693996 19510 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 18: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:28.685585 19579 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:28.668932 26120 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:28.669943 26107 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:28.724576 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 44716.1us
I20260709 13:20:28.726001 19476 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:28.710155 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:28.714339 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:28.716219 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:28.728044 19508 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 14.
I20260709 13:20:28.728358 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:28.687686 26048 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:28.688848 25673 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:28.717553 25849 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.740815 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:28.750849 19581 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:28.757790 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:28.759804 19652 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:28.761480 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:28.762461 19659 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:28.763705 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:28.764631 19580 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:28.769083 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:28.770958 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:28.700531 26110 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:28.701294 26094 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.758430 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:28.776582 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:28.780208 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:28.786878 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 124561us
I20260709 13:20:28.722564 26020 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:28.790639 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:28.736482 25871 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:28.679100 26202 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.114s
I20260709 13:20:28.624852 26196 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.693181 26144 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.738180 26143 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:28.732841 25578 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:28.772948 19511 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:28.733359 26162 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:28.752169 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:28.734467 26120 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:28.736848 26125 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:28.779562 25732 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:28.823917 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:28.830330 19478 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:28.799067 26020 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:28.831607 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 105054us
I20260709 13:20:28.773885 26042 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:20:28.837893 19652 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:20:28.739605 26107 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.812779 25871 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:28.848004 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 77186.6us
I20260709 13:20:28.818869 25924 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:28.773839 26104 consensus_queue.cc:1048] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.051s
W20260709 13:20:28.854393 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.856484 19476 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:28.851334 24912 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:28.732411 26208 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.112s
I20260709 13:20:28.824697 26163 raft_consensus.cc:3055] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:28.861203 26020 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:28.863591 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:28.865760 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:28.869295 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:28.893725 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 63444.8us
I20260709 13:20:28.828344 26217 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:28.950212 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 175234us
I20260709 13:20:28.950383 19478 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:28.826905 25578 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:28.850176 25879 consensus_meta.cc:287] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.001s
I20260709 13:20:28.899290 24912 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:20:28.900266 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.869755 25732 raft_consensus.cc:697] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:28.862720 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:28.859608 26125 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:28.941507 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:28.818189 26216 consensus_queue.cc:1059] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:20:28.945585 19659 raft_consensus.cc:2410] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
W20260709 13:20:28.945741 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.979455 19578 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:28.893071 25924 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.878796 25871 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:28.969210 19478 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:28.974017 24912 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:28.935614 26199 log.cc:927] Time spent T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:20:28.976056 19627 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:28.961443 25578 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:28.830986 26143 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.955870 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:28.990139 19506 raft_consensus.cc:2393] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 19: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:28.853231 26120 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.994154 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:29.006536 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 50765.3us
I20260709 13:20:29.006888 19508 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 18: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:28.935621 26163 raft_consensus.cc:740] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:28.996445 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:28.968518 26121 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:28.813625 25692 consensus_queue.cc:237] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:28.999866 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:28.944168 26222 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:28.895052 25571 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.092s
W20260709 13:20:28.979981 26215 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.326s	user 0.002s	sys 0.000s
I20260709 13:20:28.997515 19580 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:29.008888 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:29.001811 19478 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.011641 26208 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:28.995239 25924 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:29.013455 25732 consensus_queue.cc:237] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:29.014751 26207 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:20:28.978171 26157 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:20:29.008738 24912 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.016918 26146 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:29.028857 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:28.994275 25579 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:29.012974 26219 log.cc:927] Time spent T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:20:28.977288 26230 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:28.994009 26200 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:28.994180 25879 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:20:29.018811 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:29.015725 26125 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:29.004959 25922 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:29.026983 26121 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:29.025571 26222 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.056694 19478 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.020701 25673 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:29.065788 26196 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:29.022419 26217 consensus_queue.cc:1059] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:20:29.066471 26144 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.066411 25571 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:29.053543 26174 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.067679 26107 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:29.070390 19478 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.044915 26221 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:29.047206 26029 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:20:29.075527 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 177705us
I20260709 13:20:29.103667 26029 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:29.104086 26029 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:29.078604 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 106726us
I20260709 13:20:29.049201 26146 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:29.065815 26234 log.cc:927] Time spent T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:20:29.106092 26146 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:29.090485 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.108915 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.109596 19508 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:29.091555 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3498) took 1219 ms. Trace:
I20260709 13:20:29.110617 19655 rpcz_store.cc:276] 0709 13:20:27.872010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.872234 (+   224us) service_pool.cc:224] Handling call
0709 13:20:27.872568 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:28.199641 (+327073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:28.199675 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:28.216021 (+ 16346us) log.cc:844] Serialized 26 byte log entry
0709 13:20:28.625141 (+409120us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:28.625191 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:28.625286 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:29.091294 (+466008us) raft_consensus.cc:1685] finished
0709 13:20:29.091317 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.091488 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":46485,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":116,"thread_start_us":705660,"threads_started":2,"wal-append.queue_time_us":443215}
I20260709 13:20:29.091905 26221 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.059022 25922 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:29.094506 26218 log.cc:927] Time spent T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:20:29.096522 26205 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:29.098904 26048 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.100360 25649 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:20:29.102582 26120 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.068830 26222 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:29.105880 19625 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:29.055145 25786 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.036s
W20260709 13:20:29.153365 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 47596.6us
I20260709 13:20:29.158438 19625 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:29.160586 19625 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:29.147607 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 97288.7us
I20260709 13:20:29.069010 26125 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.149343 26048 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.178476 26121 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:29.179253 26125 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.179870 26048 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.180015 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.162505 26095 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:29.165861 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:29.170524 26176 consensus_meta.cc:287] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.856s	user 0.013s	sys 0.000s
I20260709 13:20:29.183736 26094 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.184501 19583 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:20:29.184902 19583 pending_rounds.cc:85] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 9
I20260709 13:20:29.185105 19583 pending_rounds.cc:107] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:20:29.185350 19583 raft_consensus.cc:2889] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:29.185503 26239 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:29.119016 25922 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:29.186587 26094 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:29.172639 25673 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.182754 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:29.193336 26240 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:29.193964 19580 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 23.
I20260709 13:20:29.194820 26205 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:29.195393 20631 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
W20260709 13:20:29.195801 26021 consensus_meta.cc:287] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.789s	user 0.010s	sys 0.000s
I20260709 13:20:29.089454 25571 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:29.118587 26221 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:29.196857 26231 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:29.197017 26232 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:20:29.197199 26226 log.cc:927] Time spent T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 13:20:29.202194 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 111827us
W20260709 13:20:29.206272 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 45783.2us
I20260709 13:20:29.210157 26196 raft_consensus.cc:3055] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:29.211366 25571 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:29.212008 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:29.252420 19580 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
W20260709 13:20:29.213006 25910 consensus_meta.cc:287] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.671s	user 0.010s	sys 0.000s
I20260709 13:20:29.148806 25649 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:29.215772 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:29.261083 19582 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:29.219823 19625 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:29.202564 26176 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.201473 25692 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:29.259996 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:29.265033 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.264161 19627 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:29.265597 19505 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:29.216373 26231 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:29.268002 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.199571 25922 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.218813 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.219584 26196 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:29.256357 25978 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.273121 19627 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:29.216143 26232 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:29.289178 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 184678us
I20260709 13:20:29.306697 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:29.291663 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 389048us
I20260709 13:20:29.204852 26021 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.311467 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:29.302796 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 83428.2us
I20260709 13:20:29.306939 19504 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:29.307423 19476 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:29.262167 25649 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:29.294587 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.310006 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:29.310302 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 91550us
I20260709 13:20:29.315768 19509 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:29.314599 19505 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:29.266604 26202 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.270866 26231 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:29.315846 19655 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:29.317464 19506 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:29.316262 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:29.319564 19508 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:29.321476 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:29.266655 25692 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:29.313982 19625 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:29.322598 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.285825 26094 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.250880 26020 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.260313 25871 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.327636 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.291606 26195 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:29.337102 19582 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:29.350415 19478 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.338760 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:29.350944 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:29.262590 25910 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:29.338757 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:29.358440 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.331954 19625 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:29.343959 19503 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:29.309564 26232 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:29.315325 25430 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:29.321288 25673 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:29.269181 26176 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.316602 26048 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:29.320853 26125 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.317086 26110 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:29.354935 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:29.355212 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:29.328469 25692 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:29.368920 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.377056 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.369838 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.377852 19504 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:29.345093 25732 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:29.327316 26143 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.341917 26195 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:29.312781 25978 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.374403 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.381538 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.365052 26107 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:29.367336 26120 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.327020 26202 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.354158 26196 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:29.391219 26236 log.cc:927] Time spent T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:20:29.391206 26243 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:29.391093 26206 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:20:29.374505 26092 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:29.391448 26242 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.418506 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3371) took 1021 ms. Trace:
I20260709 13:20:29.418843 26242 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.418978 19583 rpcz_store.cc:276] 0709 13:20:28.415804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.417734 (+  1930us) service_pool.cc:224] Handling call
0709 13:20:28.418340 (+   606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.185807 (+767467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.418232 (+232425us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b5400246b54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:29.418439 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1761295104}
I20260709 13:20:29.392001 26246 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.421185 26246 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.423418 26246 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.425460 25871 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:29.426611 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.389110 26110 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.425450 26239 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:29.428740 26110 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.404331 26237 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:20:29.371917 26216 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:29.373744 25673 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:29.344518 26094 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:29.440676 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 82888.5us
I20260709 13:20:29.432731 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:29.442623 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:29.443331 19583 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:29.372162 25430 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:29.439445 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:29.445386 19660 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:29.387161 26195 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:29.378504 26247 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:29.421409 26242 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.470822 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:29.389534 26125 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.441425 19476 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:29.413424 26202 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:29.461956 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:29.404343 26244 log.cc:927] Time spent T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:20:29.457043 25430 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:29.430645 26223 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:29.417676 26249 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:20:29.447741 25673 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:29.465071 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 89326.8us
I20260709 13:20:29.411590 26020 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.478865 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.506264 19512 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:29.416567 26143 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.480626 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:29.508565 19582 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:29.461593 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:29.509645 19661 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:29.405599 26255 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:29.440217 26107 raft_consensus.cc:697] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:29.388801 26048 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.442083 26029 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:29.490262 26021 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.491449 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.521704 19625 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:29.566509 19505 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:29.492292 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.425511 26221 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:29.394345 25571 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:20:29.496887 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.415439 26146 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.458845 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:29.601816 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:29.602195 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 154838us
W20260709 13:20:29.501709 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.471921 26096 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:29.504709 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.447132 26216 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:29.570145 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 128782us
I20260709 13:20:29.519601 19583 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
W20260709 13:20:29.591478 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 241133us
I20260709 13:20:29.485713 26247 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:29.496580 26223 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.512266 25649 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.404085 26120 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.604657 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.606367 19503 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 22: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:20:29.607021 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 85431.3us
I20260709 13:20:29.613894 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.495322 26232 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.617417 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:29.600921 26210 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:29.613435 26076 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:29.623610 19625 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:29.593839 19655 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:29.618938 19579 raft_consensus.cc:2393] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:29.616255 25922 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.632899 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.565630 26143 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.646827 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.619329 26223 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:29.645702 19511 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:20:29.647364 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:29.648247 19508 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:29.648476 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.631171 25571 consensus_queue.cc:1059] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:20:29.650110 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.656442 19658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 2858) took 1256 ms. Trace:
I20260709 13:20:29.629705 26255 raft_consensus.cc:2764] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:20:29.660645 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:29.668231 26217 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:29.665791 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:29.668932 26163 consensus_queue.cc:260] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.669461 26242 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:29.669692 26020 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:29.670182 26163 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:29.670387 26020 raft_consensus.cc:697] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:29.671363 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.671494 26020 consensus_queue.cc:237] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.672353 26242 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:29.654465 26179 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:20:29.650795 25732 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.674374 26176 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.650931 25995 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.650602 26110 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:29.675532 26110 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:29.675953 26110 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:29.676407 26231 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:29.624191 26106 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:29.634806 25578 consensus_meta.cc:287] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.607s	user 0.012s	sys 0.000s
I20260709 13:20:29.664204 19658 rpcz_store.cc:276] 0709 13:20:28.399923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.400084 (+   161us) service_pool.cc:224] Handling call
0709 13:20:28.414074 (+ 13990us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:28.429908 (+ 15834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:28.429943 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:28.434948 (+  5005us) log.cc:844] Serialized 26 byte log entry
0709 13:20:29.439898 (+1004950us) spinlock_profiling.cc:243] Waited 8.24 ms on lock 0x7b18003d3240. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa0d1 00007f6c31715a0f
0709 13:20:29.461436 (+ 21538us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:29.461475 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.461557 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:29.656132 (+194575us) raft_consensus.cc:1685] finished
0709 13:20:29.656154 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.656381 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58149,"raft.queue_time_us":18227,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":11657,"spinlock_wait_cycles":18958080,"thread_start_us":21338,"threads_started":1,"wal-append.queue_time_us":1176962}
I20260709 13:20:29.673753 26203 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:29.675060 25995 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:29.629246 26021 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:29.629778 26210 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.687721 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:29.675069 26252 log.cc:927] Time spent T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:20:29.681142 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:29.630247 26253 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:29.631125 26076 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:29.650393 26258 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:20:29.632634 26248 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.627490 26237 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:20:29.648944 25615 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:29.659283 26146 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:29.740099 26146 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:29.740389 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:29.740634 26146 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.741219 19582 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 24: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:29.674383 25732 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.742776 26146 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:29.679952 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.743404 25732 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:29.743887 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 64150.1us
I20260709 13:20:29.744382 26048 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.691015 26210 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:29.744647 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.706964 26253 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:29.746619 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.747591 26217 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:29.748256 26217 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:29.749318 26232 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.749390 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:29.750397 26217 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:29.750792 26217 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.751133 26217 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:29.743788 26021 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:29.754683 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 3656) took 1167 ms. Trace:
I20260709 13:20:29.754765 26120 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.755389 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:29.755908 26029 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.756794 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.755208 19581 rpcz_store.cc:276] 0709 13:20:28.586906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.589735 (+  2829us) service_pool.cc:224] Handling call
0709 13:20:29.754485 (+1164750us) spinlock_profiling.cc:243] Waited 96.4 ms on lock 0x7b54003d0ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:29.754601 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221746432}
I20260709 13:20:29.758571 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.759737 26238 raft_consensus.cc:3055] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:29.760269 26238 raft_consensus.cc:740] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:29.761246 26238 consensus_queue.cc:260] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.652966 25649 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 28 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.630883 26205 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:20:29.707861 19503 raft_consensus.cc:2393] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 19: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:29.684666 26203 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.770965 26203 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:29.771919 26213 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.988s	user 0.000s	sys 0.011s
I20260709 13:20:29.773092 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 2857) took 1454 ms. Trace:
I20260709 13:20:29.681052 25910 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:29.769069 26021 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:29.773452 19654 rpcz_store.cc:276] 0709 13:20:28.319206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.319337 (+   131us) service_pool.cc:224] Handling call
0709 13:20:28.319718 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:28.321130 (+  1412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:28.321175 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:28.322974 (+  1799us) log.cc:844] Serialized 26 byte log entry
0709 13:20:28.571622 (+248648us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:28.571677 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:28.576557 (+  4880us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:29.771373 (+1194816us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:20:29.772769 (+  1396us) raft_consensus.cc:1685] finished
0709 13:20:29.772798 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.773028 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23554304,"thread_start_us":248253,"threads_started":1,"wal-append.queue_time_us":383476}
I20260709 13:20:29.683470 26247 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.775583 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.776850 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.701660 25571 raft_consensus.cc:3055] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:29.729904 26125 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.730522 25579 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:29.733494 26216 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:29.739253 25995 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:29.746294 26253 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.762275 26221 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.650899 25978 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:29.683458 26249 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:20:29.665740 26107 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.765579 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:29.766263 19505 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:29.717036 26076 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:29.767536 26238 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:29.778600 19478 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.780534 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:29.763453 26248 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.815968 26248 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.816618 19511 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:29.769541 26048 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:20:29.805732 26222 consensus_meta.cc:287] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.002s
I20260709 13:20:29.778065 26176 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:29.817732 25692 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.818056 26222 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.818938 26237 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:29.819494 26237 raft_consensus.cc:697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:29.819953 25692 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:29.820150 19507 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 21. Ops: []
I20260709 13:20:29.820344 26237 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.821169 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:29.821781 19512 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:20:29.822291 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 43768.9us
W20260709 13:20:29.798149 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.778486 26094 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:29.780069 25571 raft_consensus.cc:740] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:29.780308 26095 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:29.806072 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.829109 26095 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.829931 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.831458 19505 raft_consensus.cc:1240] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:20:29.832057 26095 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:29.807507 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:29.798656 25924 consensus_meta.cc:287] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.753s	user 0.011s	sys 0.000s
I20260709 13:20:29.810177 26231 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:29.789355 25649 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:20:29.811365 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.811753 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:29.818303 26176 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.685825 25578 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.823971 19478 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.819963 26222 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.839476 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:29.805673 26253 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:29.841893 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:29.877646 19661 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:29.878539 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:29.802608 26089 consensus_queue.cc:1175] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2cfd02601ea44976833027665abc93bf" responder_term: 21 status { last_received { term: 21 index: 12 } last_committed_idx: 10 last_received_current_leader { term: 21 index: 12 } }
I20260709 13:20:29.851917 19581 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:29.789569 26227 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:20:29.788815 26195 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.853827 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:29.859143 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:29.875017 19656 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:29.870994 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3661) took 1198 ms. Trace:
I20260709 13:20:29.874255 26144 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:29.880597 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 56723us
I20260709 13:20:29.903151 19478 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.881369 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:29.840461 26094 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:29.808204 25673 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.875540 26176 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:29.893092 26229 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:29.876483 19659 raft_consensus.cc:2410] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:20:29.900641 19585 rpcz_store.cc:276] 0709 13:20:28.672796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.672955 (+   159us) service_pool.cc:224] Handling call
0709 13:20:28.694787 (+ 21832us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:28.695081 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:29.762978 (+1067897us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b180045c880. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c313024bc 00007f6c2e65048b 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66a455 00007f6c351523c7 00007f6c317649a7 00007f6c317740bf
0709 13:20:29.763115 (+   137us) log.cc:844] Serialized 14 byte log entry
0709 13:20:29.870434 (+107319us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:29.870527 (+    93us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:29.870602 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.870701 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.870862 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2355,"prepare.queue_time_us":38871,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":9718,"raft.queue_time_us":112,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":2702,"spinlock_wait_cycles":8207104,"thread_start_us":201392,"threads_started":2}
I20260709 13:20:29.906651 19478 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.908267 26248 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:29.909773 26195 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:29.910292 26217 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.850963 25924 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.882416 26107 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:29.883574 26222 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:29.917060 19512 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:29.902127 19581 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 24.
I20260709 13:20:29.929838 19656 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:29.929738 25649 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:29.949229 26076 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.950088 25649 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:29.950732 25649 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:29.930258 26269 log.cc:927] Time spent T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:20:29.933768 26229 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.912923 26110 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.933856 26020 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.957231 26020 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.958489 26110 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.935089 26210 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.959391 26020 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.943040 19504 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:20:29.950891 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.960819 26210 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.962769 19509 raft_consensus.cc:1240] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:20:29.943768 19478 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.914291 26249 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:29.969727 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:29.969043 20631 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:20:29.973750 26076 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:29.978097 19652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2864) took 1189 ms (client timeout 1562 ms). Trace:
I20260709 13:20:29.978911 19660 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:29.979746 26195 consensus_queue.cc:1059] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:29.978612 19652 rpcz_store.cc:269] 0709 13:20:28.788918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.790233 (+  1315us) service_pool.cc:224] Handling call
0709 13:20:29.977878 (+1187645us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b540039a654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:29.978015 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92245248}
I20260709 13:20:29.961838 26247 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:20:29.986799 19512 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 27. Current term is 28. Ops: []
I20260709 13:20:29.987797 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:29.988670 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:29.970386 26253 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:29.989677 19512 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:29.907181 26144 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.918766 26094 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.999293 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:29.981659 26195 raft_consensus.cc:3055] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:30.003026 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:29.962656 26107 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:29.993466 26237 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:30.010015 26153 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:30.018206 20666 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:20:30.018676 26270 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 27.14, Next index: 15, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:20:30.046694 26270 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:20:30.047053 26094 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:30.019225 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3665) took 1045 ms. Trace:
I20260709 13:20:30.047082 26270 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:30.020787 25673 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:29.995759 25430 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.048225 19578 rpcz_store.cc:276] 0709 13:20:28.973313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.973472 (+   159us) service_pool.cc:224] Handling call
0709 13:20:28.973781 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:28.988664 (+ 14883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.018919 (+1030255us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b5400106654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:30.019149 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11915648}
I20260709 13:20:30.048965 26270 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.049474 25871 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:30.004786 25982 consensus_queue.cc:1059] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:20:30.050498 25430 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:30.050750 25982 raft_consensus.cc:3055] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:30.051748 19657 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:30.005491 26195 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:30.020841 26254 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.403s	user 0.000s	sys 0.001s
W20260709 13:20:30.034754 26276 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:20:30.000507 26227 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:20:30.056480 26153 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 24 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:30.058629 26096 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:30.061287 26096 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:30.051177 25982 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:30.068532 26195 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.070868 25649 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.072129 25982 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.084149 26143 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:30.085086 19653 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:30.085944 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:30.086970 25849 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.087002 19512 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:30.087489 25849 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:30.088601 26245 log.cc:927] Time spent T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.795s	user 0.003s	sys 0.000s
I20260709 13:20:30.073804 26163 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:30.090250 26163 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.092304 26163 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:30.092813 26163 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.070884 26153 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:30.084012 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:30.095592 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:30.031734 26107 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:30.094102 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:30.098177 19504 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:30.075337 25924 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:30.100634 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:30.101123 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:30.106655 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:30.076551 25982 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:30.093268 26163 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.093282 26144 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:30.081511 25578 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:30.112116 26193 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:30.112464 26076 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:30.113931 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:30.118225 19659 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:30.118855 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:30.119571 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:30.120267 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:30.122862 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:30.122884 19661 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:20:30.124150 19625 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:30.125572 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:30.126468 19656 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:30.128583 19578 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:30.128890 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:30.130702 19653 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:30.131923 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:30.108394 26143 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:30.132522 20666 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:30.133272 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:30.136137 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:30.133930 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:30.138052 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:30.141201 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:30.144503 19584 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24. Ops: [21.16-23.17]
I20260709 13:20:30.132452 26144 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.147336 26144 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.148497 19579 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:20:30.152937 19627 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:30.156980 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:30.164793 19582 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:30.165658 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:30.122413 26092 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.161790 20666 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:20:30.172719 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:30.158001 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:30.158068 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:30.168776 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:30.159919 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.174437 19583 raft_consensus.cc:2410] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:20:30.174680 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:30.175333 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:30.175807 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:30.175968 19583 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:30.177126 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:30.177840 19581 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:30.110198 26249 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:20:30.188544 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:30.189308 19656 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:30.191824 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:30.192883 19659 raft_consensus.cc:2410] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:20:30.198972 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:30.199651 19659 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:20:30.202311 19582 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:30.203720 19583 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:30.205668 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:30.207873 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.208184 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:30.209632 19582 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:20:30.149595 26144 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:30.164678 26143 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:30.195468 26266 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:30.319418 26266 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:30.320011 26266 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:30.322206 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:30.195573 26092 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.327476 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:30.329315 26143 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.334075 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:30.334815 19655 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:20:30.132084 26095 consensus_queue.cc:1059] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:20:30.152172 25978 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:30.302263 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 3990) took 1280 ms. Trace:
I20260709 13:20:30.115254 26203 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:30.158116 26107 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:30.304260 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 133086us
I20260709 13:20:30.156097 26202 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.157397 25615 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:30.305043 19578 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: [21.10-21.10]
I20260709 13:20:30.207439 26272 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.107s
I20260709 13:20:30.307928 19512 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 22: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:20:30.311635 26223 consensus_meta.cc:287] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.000s
I20260709 13:20:30.338719 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:30.339129 19653 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:30.340550 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:30.359514 19510 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:30.359622 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:30.360458 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.344580 19656 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
W20260709 13:20:30.345994 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.362597 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:30.347775 19581 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:30.348585 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:30.352118 19583 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:20:30.338092 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:30.350347 19506 rpcz_store.cc:276] 0709 13:20:29.022918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.023270 (+   352us) service_pool.cc:224] Handling call
0709 13:20:29.023640 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.327214 (+303574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.302000 (+974786us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54002aadd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:30.302197 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675371392}
I20260709 13:20:30.366004 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:30.364329 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:30.368630 19658 raft_consensus.cc:2368] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21.
I20260709 13:20:30.364396 19659 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:30.367453 19583 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:30.371739 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:30.372627 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:30.372944 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:30.364686 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:30.374378 19581 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:30.377122 19581 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:30.382014 19581 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:30.384121 19581 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:20:30.365890 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:30.391026 19581 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:20:30.391845 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:30.392513 19578 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:30.353974 26107 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.364799 25978 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:30.356927 25615 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:30.395954 25692 consensus_queue.cc:1059] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:20:30.407506 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:30.368242 25786 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:30.378456 26092 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:30.416950 19661 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:30.418462 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:30.419625 20666 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:20:30.425897 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:30.412968 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:30.427003 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:30.428650 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:30.432760 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:30.440917 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:30.442425 19510 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:30.405344 26107 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:30.361265 26202 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.419289 25615 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:30.457854 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:30.458815 19657 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:30.460280 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:30.461993 20619 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:30.368422 26223 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.488910 19504 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:30.490859 25692 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:30.444265 26231 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:30.509850 19584 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:20:30.463646 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:30.468428 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:30.511816 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:30.513034 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:30.465143 19578 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:30.514379 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:30.515205 19578 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:30.438997 25786 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.518457 19581 raft_consensus.cc:2393] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:30.478420 25849 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:30.449062 26089 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.063s
I20260709 13:20:30.495983 26124 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:30.523684 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:30.506910 26163 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:30.530408 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:30.534731 26176 consensus_meta.cc:287] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.004s
I20260709 13:20:30.547451 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2815) took 1255 ms. Trace:
I20260709 13:20:30.551147 19507 rpcz_store.cc:276] 0709 13:20:29.291937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.292673 (+   736us) service_pool.cc:224] Handling call
0709 13:20:29.292993 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.820534 (+527541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.540328 (+719794us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b54002085d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:30.547392 (+  7064us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1211957632}
I20260709 13:20:30.536677 26089 raft_consensus.cc:3055] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:30.516652 25978 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:30.561139 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 99263.6us
I20260709 13:20:30.552102 19583 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:30.568049 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:30.555050 26089 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:30.571412 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:30.572258 19510 raft_consensus.cc:2393] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:30.564031 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:30.576216 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:30.579977 19507 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:30.552989 26096 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.591400 19657 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:30.554180 26176 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.616550 19583 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:30.612048 19627 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:30.588770 26029 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:20:30.596318 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 101124us
W20260709 13:20:30.617379 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 131648us
I20260709 13:20:30.622696 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:30.618811 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 504964us
I20260709 13:20:30.579262 26106 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:30.625563 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:30.627789 26289 log.cc:927] Time spent T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:20:30.634258 19627 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:30.636976 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:30.616683 26202 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:30.612617 26095 consensus_queue.cc:1059] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:20:30.594664 25849 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:20:30.643435 19627 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:30.643652 19553 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:30.644479 26143 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:30.645048 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:30.645269 25575 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:30.640594 25871 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:30.646535 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:30.666931 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:30.668947 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:30.650831 26176 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:30.646944 26144 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:30.669961 26144 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.670377 26144 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:30.632364 26089 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:30.674163 26249 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:30.678586 26144 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.638844 26104 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:20:30.654747 26296 consensus_queue.cc:1059] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:30.633456 26221 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:30.688467 26221 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:30.657989 19476 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:30.663832 19553 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:30.664374 26242 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:30.689461 26076 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:30.689966 26076 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:30.690173 25578 raft_consensus.cc:3055] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:30.690411 26076 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:30.690579 25578 raft_consensus.cc:740] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:30.691521 25578 consensus_queue.cc:260] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.618873 26260 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:20:30.692895 25578 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:30.653264 26266 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.632443 25430 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:30.694516 26295 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:30.695221 26266 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:30.697584 26096 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:30.697587 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:30.699101 19660 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 15: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:30.700099 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:30.700642 19660 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:30.679409 26229 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:30.682571 26094 raft_consensus.cc:3055] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:30.701465 26094 raft_consensus.cc:740] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:30.702306 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:30.702638 26094 consensus_queue.cc:260] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.704087 19478 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:30.704175 26094 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:30.665290 26143 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.642789 26223 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:30.666013 26202 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:30.688897 26221 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:30.707291 26143 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:30.680563 26268 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.891s	user 0.003s	sys 0.004s
I20260709 13:20:30.708966 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4005) took 1062 ms. Trace:
I20260709 13:20:30.638319 26203 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:30.713773 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 50022.7us
I20260709 13:20:30.721055 19580 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:30.709324 19508 rpcz_store.cc:276] 0709 13:20:29.646983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.667211 (+ 20228us) service_pool.cc:224] Handling call
0709 13:20:29.679504 (+ 12293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:29.679681 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:29.679724 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:29.680141 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:20:29.785632 (+105491us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:29.785692 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.785790 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:30.679994 (+894204us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:20:30.708657 (+ 28663us) raft_consensus.cc:1685] finished
0709 13:20:30.708679 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.708901 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13059456,"thread_start_us":105175,"threads_started":1,"wal-append.queue_time_us":99640}
W20260709 13:20:30.712805 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 43915.3us
I20260709 13:20:30.713698 19507 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:30.725946 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:30.727573 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:30.728935 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:30.730404 19580 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:30.711426 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:30.736452 26223 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:30.736768 25615 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.691543 26144 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:30.770043 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:30.780296 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 91111.1us
I20260709 13:20:30.750388 26110 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:30.732991 26042 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:20:30.753655 26296 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:30.786696 19587 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:30.753945 25649 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:30.719987 26120 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:30.788757 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:30.781556 26176 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:30.791152 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:30.811407 26217 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:30.812942 26176 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:30.814716 26176 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.781253 26223 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:30.816921 26223 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:30.813181 19581 raft_consensus.cc:2393] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:30.818315 26237 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:30.818687 26237 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:30.814730 26107 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.819542 26237 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:30.820222 19653 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 17: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:30.820816 26237 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:30.821792 26221 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:30.822276 20661 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 24 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:30.823237 26107 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:30.825444 19653 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:30.828917 25615 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:30.792704 19583 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:30.688855 25982 consensus_meta.cc:287] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.002s
W20260709 13:20:30.773167 26302 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:20:30.753948 26163 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:30.779525 26157 raft_consensus.cc:3055] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:30.823279 26195 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:30.805572 26303 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:30.831154 19653 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: [19.9-21.10]
I20260709 13:20:30.837018 19627 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:30.792115 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 134217us
I20260709 13:20:30.781996 26294 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:30.793663 26110 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:30.812683 19580 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:30.841552 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:30.844132 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 62562.5us
I20260709 13:20:30.782142 25673 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:30.782223 26242 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:20:30.907142 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 195776us
I20260709 13:20:30.917088 19476 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:30.838114 19551 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:30.790481 19660 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
W20260709 13:20:30.942796 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 104796us
I20260709 13:20:30.942992 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:30.943711 19660 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:30.924479 19587 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:30.945642 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:30.946453 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:30.947139 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:30.947769 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:30.948462 19587 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:30.945333 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:30.847970 26120 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.930630 19653 raft_consensus.cc:1240] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:20:30.951648 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:30.908303 26163 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:30.912358 26157 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:30.841240 26221 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:30.953188 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 116254us
I20260709 13:20:30.952243 19653 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:30.957340 19627 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:30.958139 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.958593 19627 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:30.931938 26110 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:30.966586 19657 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:30.977422 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:30.974542 19660 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:31.009270 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:30.931449 26303 raft_consensus.cc:697] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:30.949287 26217 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:30.962777 26096 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:30.956496 26242 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:30.957000 26163 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:31.021579 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 78794.5us
I20260709 13:20:30.962756 26095 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.962182 26229 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:31.033334 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:30.950838 26144 consensus_queue.cc:1059] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 13:20:31.013692 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:31.081280 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 164301us
I20260709 13:20:31.147071 19587 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:31.147979 19476 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:31.077674 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 119183us
I20260709 13:20:31.149097 19627 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:31.146972 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 67079.8us
I20260709 13:20:31.011793 26221 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:31.018256 25615 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:31.157303 19653 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:20:31.034147 26253 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:31.171023 19653 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:31.161252 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:31.159613 26305 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:31.162515 19627 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:30.962580 26120 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.086432 26217 raft_consensus.cc:697] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:31.181743 19627 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:31.149111 25673 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:31.191083 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:31.187177 19653 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:31.209981 19653 raft_consensus.cc:1240] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:31.220754 19627 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:31.175123 26229 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:31.191599 26305 consensus_queue.cc:1059] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:20:31.198933 26107 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:31.239018 26242 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.208446 26260 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:31.245326 26089 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:31.245427 26120 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:31.250675 25578 consensus_meta.cc:287] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.018s
I20260709 13:20:31.146314 26303 consensus_queue.cc:237] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.252113 20666 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:20:31.179672 25615 raft_consensus.cc:697] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:31.255100 25615 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.255654 26146 raft_consensus.cc:3055] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:31.256065 26146 raft_consensus.cc:740] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:31.256824 26146 consensus_queue.cc:260] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.064471 26157 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:31.261929 19658 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 3528) took 1420 ms (client timeout 1595 ms). Trace:
W20260709 13:20:31.262478 19658 rpcz_store.cc:269] 0709 13:20:29.841158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.841320 (+   162us) service_pool.cc:224] Handling call
0709 13:20:31.257893 (+1416573us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b54002170d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:31.261840 (+  3947us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1066408320}
I20260709 13:20:31.187737 26223 raft_consensus.cc:3055] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:31.166385 26295 consensus_queue.cc:1059] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:20:31.130741 26095 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.267356 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 4025) took 1179 ms. Trace:
W20260709 13:20:31.267191 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 321919us
I20260709 13:20:31.174300 25649 consensus_queue.cc:1059] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
W20260709 13:20:31.280887 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:31.272984 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 52787.2us
I20260709 13:20:31.277168 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:31.276686 19512 rpcz_store.cc:276] 0709 13:20:30.088234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.093843 (+  5609us) service_pool.cc:224] Handling call
0709 13:20:31.267143 (+1173300us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540003d4d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:31.267292 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479162112}
I20260709 13:20:31.284433 19627 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:31.286867 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 127667us
I20260709 13:20:31.288110 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:31.289695 19478 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:31.293141 19587 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:20:31.258594 26229 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:31.291589 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:31.308988 19655 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:31.309850 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:31.312098 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:31.317281 19660 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 17: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:31.272119 26223 raft_consensus.cc:740] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:31.314673 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:31.287061 26266 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:31.318516 26144 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:31.322211 26266 raft_consensus.cc:697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:31.322583 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:31.322692 26144 raft_consensus.cc:697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:20:31.307747 26076 consensus_meta.cc:287] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.617s	user 0.011s	sys 0.000s
I20260709 13:20:31.323167 26266 consensus_queue.cc:237] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.323659 26144 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.325754 26221 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:31.326224 26221 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:31.326647 26221 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:31.326910 26309 log.cc:927] Time spent T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:20:31.237114 25571 consensus_queue.cc:260] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.334651 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:31.323182 19660 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:20:31.321221 19551 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:31.321359 19627 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:31.308069 26143 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:31.301560 26229 raft_consensus.cc:3060] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:31.296186 26157 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.304909 26272 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:31.314225 26094 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:31.344909 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:31.347201 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 187873us
I20260709 13:20:31.319432 26120 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:31.342324 19654 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:20:31.354215 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.370107 19476 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:31.296831 26092 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:20:31.372418 19476 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:31.340972 26146 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:31.334956 26216 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:31.388311 19476 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:31.323602 26076 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.330104 26296 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:20:31.348080 25578 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:31.334813 26153 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 13:20:31.368858 26260 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:31.369180 26106 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.400214 26312 consensus_queue.cc:1059] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:31.392146 26143 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:31.329869 25673 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.389279 26120 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:31.415172 19627 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:31.404434 26299 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
W20260709 13:20:31.422128 26301 log.cc:927] Time spent T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 13:20:31.405191 26260 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:31.435536 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:31.436167 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.437752 26092 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:31.438525 26092 raft_consensus.cc:697] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:31.438692 26243 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:31.439389 26243 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:31.439733 26092 consensus_queue.cc:237] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.442719 26076 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:31.445652 26089 consensus_queue.cc:1059] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:31.449743 26260 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:31.450673 26308 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:20:31.452778 19661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3545) took 1036 ms. Trace:
I20260709 13:20:31.453227 19661 rpcz_store.cc:276] 0709 13:20:30.416100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.824919 (+408819us) service_pool.cc:224] Handling call
0709 13:20:30.825225 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:30.825593 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:30.825932 (+   339us) log.cc:844] Serialized 14 byte log entry
0709 13:20:31.075622 (+249690us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:31.076337 (+   715us) log.cc:844] Serialized 26 byte log entry
0709 13:20:31.076526 (+   189us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:31.076577 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.076676 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:31.452458 (+375782us) raft_consensus.cc:1685] finished
0709 13:20:31.452489 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.452702 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31547,"prepare.queue_time_us":832,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":17571,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":116807,"thread_start_us":249198,"threads_started":1,"wal-append.queue_time_us":514662}
I20260709 13:20:31.394228 26216 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:31.462765 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 142790us
W20260709 13:20:31.464684 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:31.453126 26306 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:20:31.389719 26223 consensus_queue.cc:260] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.408017 26106 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.343703 26217 consensus_queue.cc:237] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:31.454525 26313 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:31.460489 26314 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:31.488792 26314 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:31.489550 26314 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:31.495784 26216 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:31.496811 26229 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.499260 26229 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:31.483808 26195 consensus_meta.cc:287] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.001s
I20260709 13:20:31.502524 26223 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:31.483808 26237 consensus_meta.cc:287] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.663s	user 0.014s	sys 0.010s
I20260709 13:20:31.503726 26110 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:31.504710 26316 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:20:31.482399 26095 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:31.506605 26260 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:31.508569 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 171163us
I20260709 13:20:31.509961 19652 raft_consensus.cc:2410] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:20:31.522248 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:31.524305 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:31.526187 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:31.527009 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:31.527770 19507 raft_consensus.cc:2410] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:20:31.529150 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:31.551849 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 230979us
I20260709 13:20:31.528116 26020 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:31.567653 19661 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:31.570704 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:31.571657 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:31.573598 19507 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:31.576114 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:31.559029 19583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.000s	sys 0.007s
W20260709 13:20:31.584163 19583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.000s	sys 0.007s
I20260709 13:20:31.518810 20661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59430 (request call id 229) took 1523 ms. Trace:
I20260709 13:20:31.591073 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:31.593547 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:31.594156 19503 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 16. (term mismatch)
I20260709 13:20:31.594511 19503 pending_rounds.cc:85] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 15
I20260709 13:20:31.594724 19503 pending_rounds.cc:107] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 13:20:31.594972 19503 raft_consensus.cc:2889] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:31.594820 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 202424us
I20260709 13:20:31.602330 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:31.558950 26176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.002s	sys 0.005s
I20260709 13:20:31.576603 26020 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.611110 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:31.611631 26176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.002s	sys 0.006s
I20260709 13:20:31.592020 26216 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:20:31.631702 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:31.588598 26304 consensus_queue.cc:1059] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:20:31.622419 26143 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:31.636958 19585 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:31.614444 26020 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:31.613154 26303 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:31.652735 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:31.575362 26120 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.656435 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:31.632627 26313 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:31.615134 26163 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.674178 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:31.674929 19510 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:31.619343 26237 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:20:31.593228 20661 rpcz_store.cc:276] 0709 13:20:29.994829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.997314 (+  2485us) service_pool.cc:224] Handling call
0709 13:20:30.025810 (+ 28496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.822737 (+796927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.507407 (+684670us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b5400599054. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:31.517708 (+ 10301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1831226624}
W20260709 13:20:31.690687 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 317695us
I20260709 13:20:31.685912 26107 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:31.683538 26327 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:31.665562 26176 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:20:31.665266 26303 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.766228 26326 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:31.766841 26326 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.769115 26326 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:31.770987 26196 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:31.774238 26320 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:20:31.769379 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3538) took 1356 ms. Trace:
I20260709 13:20:31.778429 19659 rpcz_store.cc:276] 0709 13:20:30.413437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.413595 (+   158us) service_pool.cc:224] Handling call
0709 13:20:31.013118 (+599523us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:31.013544 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.013571 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:31.081138 (+ 67567us) log.cc:844] Serialized 52 byte log entry
0709 13:20:31.290349 (+209211us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:31.306185 (+ 15836us) log.cc:844] Serialized 14 byte log entry
0709 13:20:31.306418 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.306505 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:31.504094 (+197589us) spinlock_profiling.cc:243] Waited 54.9 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:20:31.679872 (+175778us) raft_consensus.cc:1685] finished
0709 13:20:31.685580 (+  5708us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.769132 (+ 83552us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b5400020dd0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:31.769299 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24833,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":48,"raft.queue_time_us":8573,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":30115,"spinlock_wait_cycles":1504122112,"thread_start_us":113921,"threads_started":1,"wal-append.queue_time_us":241826}
W20260709 13:20:31.915151 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 261333us
I20260709 13:20:31.919692 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3387) took 1788 ms. Trace:
W20260709 13:20:31.922282 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 368043us
I20260709 13:20:31.946235 19579 rpcz_store.cc:276] 0709 13:20:30.131525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.131643 (+   118us) service_pool.cc:224] Handling call
0709 13:20:30.131927 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.148865 (+ 16938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.918851 (+1769986us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b5400302d54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:31.919420 (+   569us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37250944}
I20260709 13:20:31.947809 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:31.931049 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3406) took 1215 ms. Trace:
W20260709 13:20:31.935340 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.939553 19653 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:20:31.949828 19653 pending_rounds.cc:85] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 12
I20260709 13:20:31.950328 19653 pending_rounds.cc:107] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:20:31.950841 19653 raft_consensus.cc:2889] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:31.952827 19476 leader_election.cc:336] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Timed out: RequestConsensusVote RPC to 127.17.251.131:33295 timed out after 1.595s (SENT)
I20260709 13:20:31.939878 19652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 3543) took 1524 ms. Trace:
I20260709 13:20:31.956450 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:31.956974 19652 rpcz_store.cc:276] 0709 13:20:30.415413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.418142 (+  2729us) service_pool.cc:224] Handling call
0709 13:20:31.939179 (+1521037us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001eb254. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:31.939558 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2491635456}
I20260709 13:20:31.959095 20661 raft_consensus.cc:2393] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 19: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:20:31.947988 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:31.945139 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:31.948912 19585 rpcz_store.cc:276] 0709 13:20:30.715402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.716633 (+  1231us) service_pool.cc:224] Handling call
0709 13:20:30.779094 (+ 62461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:31.652176 (+873082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.930333 (+278157us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b540011e9d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:31.930818 (+   485us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1972430720}
I20260709 13:20:31.963989 19587 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:31.965008 20661 raft_consensus.cc:1240] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:31.965113 25575 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.966292 25575 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.966979 19476 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:31.970808 25575 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:31.971632 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:31.973445 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:31.786224 26110 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:31.784129 26221 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:31.859416 26243 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:31.764266 26260 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:31.871320 26270 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:31.860743 26294 raft_consensus.cc:3055] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:32.116084 26294 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:32.118007 26328 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:32.117910 26294 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.119303 26294 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:31.867100 26303 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:31.702740 26305 consensus_queue.cc:1059] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:20:32.133181 25871 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:32.133827 26348 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:32.134359 25871 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:32.134900 26348 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:31.868047 26310 log.cc:927] Time spent T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.525s	user 0.000s	sys 0.002s
I20260709 13:20:31.794986 26313 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.141032 19581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3714) took 1223 ms. Trace:
I20260709 13:20:32.141503 19581 rpcz_store.cc:276] 0709 13:20:30.917865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.922468 (+  4603us) service_pool.cc:224] Handling call
0709 13:20:30.922837 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:30.923229 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:30.923269 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:30.930285 (+  7016us) log.cc:844] Serialized 26 byte log entry
0709 13:20:31.083694 (+153409us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:31.083751 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.083847 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:31.867369 (+783522us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:20:32.140421 (+273052us) raft_consensus.cc:1685] finished
0709 13:20:32.140464 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.140810 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13533,"raft.queue_time_us":86,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":14295,"spinlock_wait_cycles":8914688,"thread_start_us":153073,"threads_started":1,"wal-append.queue_time_us":364851}
I20260709 13:20:31.820420 26314 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:31.815490 26315 log.cc:927] Time spent T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:20:31.855381 26318 log.cc:927] Time spent T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:20:31.782409 26327 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:31.769366 26334 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:31.760198 26335 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:31.973490 19579 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:32.036309 26349 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:31.755419 26143 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.037861 26247 consensus_queue.cc:1059] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:32.041501 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:32.045776 26144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.003s	sys 0.007s
I20260709 13:20:32.046002 26304 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:32.047453 25571 raft_consensus.cc:3060] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:32.149212 26227 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.050910 26217 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:32.170969 26227 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:32.149991 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 55949.9us
I20260709 13:20:32.174023 26348 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:32.162249 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:32.100869 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 64309.3us
W20260709 13:20:32.106590 19583 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.013s	sys 0.009s
I20260709 13:20:32.107882 26110 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:32.151450 19654 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:32.120111 26248 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:32.121138 26342 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:31.878966 26300 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.702s	user 0.001s	sys 0.001s
I20260709 13:20:32.150300 26327 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.107s
I20260709 13:20:32.151206 26334 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.145695 25871 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:32.123733 26333 consensus_queue.cc:1059] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:32.258574 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:32.259258 26333 raft_consensus.cc:3055] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:32.259599 19579 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:32.259953 26333 raft_consensus.cc:740] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:32.260782 19584 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:32.262473 19504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4039) took 1769 ms. Trace:
I20260709 13:20:32.124402 26263 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:32.263983 26263 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.264710 26263 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:32.263073 19504 rpcz_store.cc:276] 0709 13:20:30.493182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.493765 (+   583us) service_pool.cc:224] Handling call
0709 13:20:30.494192 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:30.615434 (+121242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:30.615485 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:30.633834 (+ 18349us) log.cc:844] Serialized 26 byte log entry
0709 13:20:30.962845 (+329011us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:30.962915 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.963019 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:31.878224 (+915205us) spinlock_profiling.cc:243] Waited 9.23 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:20:32.261735 (+383511us) raft_consensus.cc:1685] finished
0709 13:20:32.261784 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.262222 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2286,"raft.queue_time_us":18658,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6481,"spinlock_wait_cycles":21223680,"thread_start_us":430799,"threads_started":2,"wal-append.queue_time_us":429320}
W20260709 13:20:32.269798 26296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.010s	sys 0.017s
W20260709 13:20:32.270342 26296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.010s	sys 0.017s
I20260709 13:20:32.271941 26221 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.272851 26249 consensus_queue.cc:1059] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.089s
I20260709 13:20:32.274778 26163 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.181578 26350 consensus_queue.cc:1059] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.099s
I20260709 13:20:32.278240 26125 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:32.279253 26248 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.263590 26334 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.125946 19652 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:20:32.127396 19661 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:32.101338 19653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 2892) took 1149 ms. Trace:
I20260709 13:20:32.283028 26247 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:32.283478 26303 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:32.283603 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.283629 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:32.123835 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 150650us
I20260709 13:20:32.284369 26303 consensus_queue.cc:1243] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 23.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:32.285116 26303 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:20:32.137836 26312 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.004s	sys 0.025s
W20260709 13:20:32.285887 26312 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.004s	sys 0.026s
I20260709 13:20:32.283783 19653 rpcz_store.cc:276] 0709 13:20:30.931914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.218188 (+286274us) service_pool.cc:224] Handling call
0709 13:20:31.219241 (+  1053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:31.951948 (+732707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.052681 (+100733us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b5400023ad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:32.081341 (+ 28660us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1652979456}
I20260709 13:20:32.152098 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3715) took 1226 ms. Trace:
I20260709 13:20:32.158869 19587 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:32.118927 26328 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:32.161710 26144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.003s	sys 0.007s
I20260709 13:20:32.172727 19658 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:32.153678 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2889) took 1043 ms. Trace:
I20260709 13:20:32.189337 26227 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:32.255673 19583 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.020s	sys 0.015s
I20260709 13:20:32.255939 19580 raft_consensus.cc:2468] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
W20260709 13:20:32.256027 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 56075.7us
I20260709 13:20:32.294246 19655 rpcz_store.cc:276] 0709 13:20:30.931111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.160895 (+229784us) service_pool.cc:224] Handling call
0709 13:20:31.974595 (+813700us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540032a5d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:31.974842 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305248640}
I20260709 13:20:32.285599 19652 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23. Ops: []
W20260709 13:20:32.295329 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 320650us
I20260709 13:20:32.281526 26342 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:32.304906 26248 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.307262 26328 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.159248 26324 raft_consensus.cc:3055] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:32.308251 19652 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:32.308521 26324 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:32.299261 26312 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:32.153724 26311 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:32.152236 26335 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.311313 26312 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.311441 26311 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.312144 19579 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:32.162371 26304 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:32.314296 26304 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.279353 26350 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:32.317920 26350 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:32.154197 26336 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.318936 26336 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.319269 26350 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.321065 26350 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:32.163933 26305 raft_consensus.cc:3055] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:32.162719 26323 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.197s
I20260709 13:20:32.291806 26333 consensus_queue.cc:260] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:32.327208 25871 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.285568 26303 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:32.329424 26303 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:32.331185 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 72912.1us
I20260709 13:20:32.332435 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:32.295730 26092 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.000s	sys 0.022s
W20260709 13:20:32.333391 26092 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.000s	sys 0.022s
I20260709 13:20:32.322363 26335 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.337994 26110 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:32.338352 26335 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:32.339125 26335 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.310408 26324 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.342695 26312 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.342973 26324 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:32.304937 26342 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:32.346053 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:32.288067 19578 rpcz_store.cc:276] 0709 13:20:30.925349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.925935 (+   586us) service_pool.cc:224] Handling call
0709 13:20:30.951680 (+ 25745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.168360 (+216680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.168414 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:31.169086 (+   672us) log.cc:844] Serialized 26 byte log entry
0709 13:20:31.562070 (+392984us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:31.690762 (+128692us) log.cc:844] Serialized 14 byte log entry
0709 13:20:32.110962 (+420200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.111111 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:32.151501 (+ 40390us) raft_consensus.cc:1685] finished
0709 13:20:32.151535 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.151833 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11262,"prepare.queue_time_us":265646,"prepare.run_wall_time_us":889,"raft.queue_time_us":178745,"raft.run_cpu_time_us":915,"raft.run_wall_time_us":140215,"spinlock_wait_cycles":380438272,"thread_start_us":1145283,"threads_started":4,"wal-append.queue_time_us":532776}
I20260709 13:20:32.347829 19656 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 28.
I20260709 13:20:32.348567 25732 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.349463 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3713) took 1436 ms. Trace:
I20260709 13:20:32.349929 19583 rpcz_store.cc:276] 0709 13:20:30.913936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.914119 (+   183us) service_pool.cc:224] Handling call
0709 13:20:30.914581 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:30.915057 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:30.915354 (+   297us) log.cc:844] Serialized 14 byte log entry
0709 13:20:32.345345 (+1429991us) log.cc:844] Serialized 14 byte log entry
0709 13:20:32.345889 (+   544us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:32.346680 (+   791us) log.cc:844] Serialized 26 byte log entry
0709 13:20:32.346856 (+   176us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:32.347131 (+   275us) log.cc:844] Serialized 14 byte log entry
0709 13:20:32.347309 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.347451 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:32.349207 (+  1756us) raft_consensus.cc:1685] finished
0709 13:20:32.349225 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.349399 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":603935,"prepare.run_cpu_time_us":227,"prepare.run_wall_time_us":231,"raft.queue_time_us":69930,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":28580,"thread_start_us":1383592,"threads_started":2,"wal-append.queue_time_us":701536}
I20260709 13:20:32.352587 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.331305 26303 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:32.349118 25732 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.155920 26349 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.349133 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:32.358032 26349 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.358563 20665 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:32.359369 26349 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:32.328747 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.359880 19511 raft_consensus.cc:1275] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 14. (term mismatch)
I20260709 13:20:32.360347 19511 pending_rounds.cc:85] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 13
I20260709 13:20:32.360702 19511 pending_rounds.cc:107] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 13:20:32.361023 19511 raft_consensus.cc:2889] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:32.365855 25673 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.365996 26153 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.366199 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:32.317420 26304 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.310456 19654 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:32.325984 26305 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:32.360460 19587 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:32.154129 26203 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:32.373467 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 65392.2us
I20260709 13:20:32.328114 25871 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.328699 26333 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:32.402163 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.408875 19627 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:32.367264 26336 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.412817 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.370540 26092 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:32.384390 26335 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.424211 25571 consensus_queue.cc:1059] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:32.427325 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.366493 25673 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.366703 26153 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:32.425879 25575 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:32.439947 19627 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:32.443146 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.448043 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:32.451071 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.451625 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.441761 25575 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.456981 26358 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:32.458096 26358 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.458711 26294 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:32.459388 26294 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.461028 26358 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.461580 26294 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.464323 26153 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:32.482576 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 46975us
I20260709 13:20:32.486711 26358 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:32.487514 26358 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.487874 26237 consensus_queue.cc:1059] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:32.489221 26237 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:32.489809 26334 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:32.490419 26323 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:32.490981 26334 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.492336 26314 raft_consensus.cc:3055] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:32.498293 26314 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:32.489840 26358 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.462162 26270 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:32.461867 26296 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:32.509681 26296 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.510210 26296 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:32.511441 25871 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:32.462608 26223 consensus_meta.cc:287] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.945s	user 0.011s	sys 0.010s
I20260709 13:20:32.466503 25575 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:32.518795 26314 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.520118 26314 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:32.506071 26020 consensus_meta.cc:287] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.839s	user 0.014s	sys 0.004s
I20260709 13:20:32.462005 26351 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:32.522032 26351 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:32.521921 26020 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.522486 26351 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:32.524200 26020 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.525192 19578 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:32.506716 19583 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
W20260709 13:20:32.526674 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 194460us
I20260709 13:20:32.472559 26335 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:32.529704 26270 raft_consensus.cc:697] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:32.530192 26335 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.531066 26270 consensus_queue.cc:237] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.532663 26335 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:32.462152 26157 consensus_meta.cc:287] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 1.103s	user 0.008s	sys 0.011s
I20260709 13:20:32.534502 26357 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.444600 26092 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.444450 26263 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.462528 26216 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:32.533676 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:32.507047 26106 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:32.434695 26203 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.465138 25673 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.503688 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.494318 26338 raft_consensus.cc:2804] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:32.543704 26263 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:32.534997 26357 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.552474 26092 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:32.554785 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:32.557323 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.561757 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.491272 26237 raft_consensus.cc:3055] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:32.583267 26237 raft_consensus.cc:740] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:32.585150 19653 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 18.
I20260709 13:20:32.586989 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.587205 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:32.587993 19653 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:32.588584 26370 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:32.589133 26370 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.589587 26370 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:32.588598 26237 consensus_queue.cc:260] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.591840 26237 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:32.598172 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:32.598731 25673 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:32.607014 26303 consensus_queue.cc:1059] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:32.608268 19654 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:32.608666 26303 raft_consensus.cc:3055] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:32.609107 26303 raft_consensus.cc:740] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:32.609201 26203 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:32.605948 19655 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:32.620332 26110 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.621102 26110 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.621703 26363 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.621769 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:32.600932 26370 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:32.609760 19659 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:32.574404 25575 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.610262 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.564613 26334 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:32.589231 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.613428 26346 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.614254 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.614873 26020 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:32.615746 26223 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:32.616533 26358 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:32.617547 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:32.618132 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:32.580333 26338 raft_consensus.cc:697] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:32.622953 26348 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.622709 26363 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.643021 26248 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:32.645327 25673 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:32.668883 19509 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 19.
I20260709 13:20:32.646603 25649 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:32.647228 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.648075 19503 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 13:20:32.650449 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:32.652233 19507 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:32.653455 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:32.655407 19508 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:32.639881 19653 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:32.670750 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:32.671140 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.637795 26327 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
W20260709 13:20:32.674656 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.646312 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:32.637540 26336 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:20:32.682319 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 60725.1us
I20260709 13:20:32.678709 19507 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:32.678547 19503 pending_rounds.cc:85] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 12
I20260709 13:20:32.685411 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.686519 19652 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:32.688079 19655 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:32.687845 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.638331 26163 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:32.691026 19503 pending_rounds.cc:107] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:20:32.696907 19503 raft_consensus.cc:2889] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:32.703054 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 85630.8us
I20260709 13:20:32.704365 19478 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:32.688035 26336 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.698014 19512 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:20:32.720372 25649 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.721603 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.718299 26110 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.722229 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:32.721906 26342 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:32.722908 26334 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.724694 19583 raft_consensus.cc:1240] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:32.724880 26363 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:32.725780 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 52704.5us
I20260709 13:20:32.725912 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.743970 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.743818 19507 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.744529 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.744921 19507 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:32.745139 19580 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:32.745591 19627 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:20:32.746173 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.746742 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.747431 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.747970 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:32.748431 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:32.748740 19585 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:32.749554 26270 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:32.750258 26370 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.750965 26334 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.709470 26358 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.726681 25575 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:32.726751 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.672853 26346 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.688689 26223 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.727458 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.721799 26163 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.698256 26203 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:32.690759 26020 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.762642 26020 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.763136 26346 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.688938 26348 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.763803 26203 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.765046 26348 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.766176 26203 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:32.702523 26303 consensus_queue.cc:260] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.710594 26336 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:32.721771 25673 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.732299 24912 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.718225 26338 consensus_queue.cc:237] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.775667 25786 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:32.733675 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:32.706085 26248 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.777278 25673 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.778061 19583 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:32.778139 26248 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:32.778950 19658 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2898) took 1468 ms (client timeout 1832 ms). Trace:
W20260709 13:20:32.779142 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 68978.5us
W20260709 13:20:32.779405 19658 rpcz_store.cc:269] 0709 13:20:31.310373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.311624 (+  1251us) service_pool.cc:224] Handling call
0709 13:20:32.778732 (+1467108us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54003f3c54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:32.778892 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":979322624}
I20260709 13:20:32.780614 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.780819 26348 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:32.781275 26348 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:32.768198 26223 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.781786 26348 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:32.779234 26163 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.770838 25649 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.739529 19476 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:32.780644 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:32.790050 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 50615.8us
I20260709 13:20:32.790587 26163 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:32.791011 26163 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:32.791391 26163 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:32.739717 26296 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:32.791409 26304 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:32.794131 26304 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.794505 26304 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:32.794931 26296 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:32.795820 26296 raft_consensus.cc:3055] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:32.796241 26296 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:32.741532 19656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 3539) took 2327 ms (client timeout 2122 ms). Trace:
I20260709 13:20:32.684671 26351 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:32.797785 19656 rpcz_store.cc:269] 0709 13:20:30.413963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.414089 (+   126us) service_pool.cc:224] Handling call
0709 13:20:32.741258 (+2327169us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b540032b4d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:32.741422 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4349587328}
I20260709 13:20:32.799183 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:32.754288 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.755470 19627 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:32.799574 26351 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.754905 19509 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
W20260709 13:20:32.800153 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 44767.5us
I20260709 13:20:32.801111 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.801999 26272 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:32.802304 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.803160 19656 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:32.803915 26354 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.649s	user 0.002s	sys 0.000s
W20260709 13:20:32.757699 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 53397.2us
I20260709 13:20:32.757371 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:32.753417 26334 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.770002 26303 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:32.772102 24912 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.809763 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.773721 19578 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:32.738050 25571 consensus_queue.cc:1059] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:32.739357 26321 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:32.799228 26342 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:32.802423 26272 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.781427 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.748039 19580 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:32.778159 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:32.743003 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:32.773033 26358 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.827932 19581 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:32.833557 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:32.830339 19652 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:32.818123 19478 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:32.819233 19508 raft_consensus.cc:2393] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 17: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:32.819684 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:32.819399 26305 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.808167 19505 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:20:32.822057 19661 raft_consensus.cc:2410] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:20:32.842633 19656 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 25.
I20260709 13:20:32.838639 19512 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:32.844696 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:32.845114 24912 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.847141 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.848053 19659 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:20:32.850301 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.851472 19658 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 21: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:32.840216 19478 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:32.856854 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.858819 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.856997 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:32.862317 19659 raft_consensus.cc:2393] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 21: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:32.862728 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:32.862900 26305 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:32.826387 26342 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:32.864073 24912 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:32.864921 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:32.831172 26272 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:32.866640 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.863317 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:32.869053 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:32.869927 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 77200us
I20260709 13:20:32.797348 26296 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.881722 19652 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 25.
I20260709 13:20:32.882398 26296 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:32.855927 26242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.264s	user 0.022s	sys 0.031s
I20260709 13:20:32.848848 25649 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:32.886986 19585 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:32.884419 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:32.874962 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.889182 19658 raft_consensus.cc:2368] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20.
I20260709 13:20:32.875263 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.875660 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.876256 19659 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:32.856796 26196 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.872323 25571 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:20:32.880566 26336 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.906462 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.883251 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.881704 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.854400 26248 consensus_queue.cc:1059] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.020s
W20260709 13:20:32.891304 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.891601 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:32.896164 26304 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.898120 26203 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:32.912915 19587 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
W20260709 13:20:32.900875 26242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.454s	user 0.023s	sys 0.032s
I20260709 13:20:32.890528 19578 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:32.903952 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.864144 26358 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:32.893922 19476 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.131:33295 timed out after 2.122s (SENT) [suppressed 2 similar messages]
I20260709 13:20:32.900444 25871 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:32.906111 24912 consensus_queue.cc:1059] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
W20260709 13:20:32.917047 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.918185 26048 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:32.902588 25649 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:32.924731 19579 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 23: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:32.925805 26321 raft_consensus.cc:3055] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:32.926223 26321 raft_consensus.cc:740] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:32.926486 19585 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:32.927734 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.928683 19585 raft_consensus.cc:2410] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:20:32.886752 26346 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:20:32.930178 24912 raft_consensus.cc:3055] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:32.933080 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:32.934494 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 50213.2us
I20260709 13:20:32.935197 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:32.935269 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:32.937148 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.942520 19656 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 28: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:32.944114 19656 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:32.938069 25571 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.945722 25871 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.927220 26321 consensus_queue.cc:260] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.947316 26321 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:32.948220 25871 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:32.951476 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:32.933851 24912 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:32.951900 19656 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 24. Current term is 25. Ops: [22.12-24.13]
I20260709 13:20:32.945644 25571 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.952538 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.937777 26358 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.906937 26348 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.954958 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:32.955806 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 61918.5us
I20260709 13:20:32.929745 25649 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:32.927228 26336 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:32.959347 19659 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 25.
I20260709 13:20:32.964171 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:32.966138 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.966816 19585 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:32.967643 19506 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 15.
I20260709 13:20:32.966986 19476 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:32.918838 26196 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:32.953356 26346 consensus_queue.cc:1243] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:32.969519 19476 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:32.972432 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:32.973214 19506 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:32.976025 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:32.984345 19658 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:32.977185 26303 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:32.931959 26203 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:32.988767 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:32.989050 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.990830 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:32.991523 19585 raft_consensus.cc:2368] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20.
I20260709 13:20:32.976737 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:32.972990 26340 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:32.996814 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:33.000527 19504 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:33.002135 19578 raft_consensus.cc:2393] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:33.006181 25571 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:33.007164 26076 raft_consensus.cc:3055] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:33.007594 26076 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:33.008426 26076 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.010231 26143 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:33.010732 26143 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:33.010969 26362 log.cc:927] Time spent T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.852s	user 0.002s	sys 0.000s
I20260709 13:20:33.011155 26143 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:33.013171 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3398) took 2860 ms. Trace:
I20260709 13:20:33.014008 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:33.013561 19586 rpcz_store.cc:276] 0709 13:20:30.152578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.209235 (+ 56657us) service_pool.cc:224] Handling call
0709 13:20:30.209564 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:30.351623 (+142059us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:30.351656 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:30.357584 (+  5928us) log.cc:844] Serialized 26 byte log entry
0709 13:20:31.924459 (+1566875us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b18003bbae0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa0d1 00007f6c31715a0f
0709 13:20:32.111744 (+187285us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:32.253633 (+141889us) log.cc:844] Serialized 14 byte log entry
0709 13:20:32.277820 (+ 24187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.277956 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:33.010338 (+732382us) spinlock_profiling.cc:243] Waited 95.2 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:20:33.012760 (+  2422us) raft_consensus.cc:1685] finished
0709 13:20:33.012783 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.012965 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":525686,"prepare.queue_time_us":170291,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":75,"raft.queue_time_us":170099,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":92197,"spinlock_wait_cycles":221709312,"thread_start_us":132509,"threads_started":1,"wal-append.queue_time_us":1790004}
I20260709 13:20:33.016613 26203 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:32.965652 26048 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:20:33.018559 19627 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:33.019692 26304 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:33.019950 19627 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:33.002014 26303 consensus_queue.cc:1059] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:20:33.021000 26338 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:33.021157 25786 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:33.021654 25786 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:33.021654 26338 raft_consensus.cc:697] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:33.022215 25786 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:33.022524 19652 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:20:33.022987 26338 consensus_queue.cc:237] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.024646 26248 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:33.025059 26248 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:33.025676 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:33.017351 26203 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:33.014268 19580 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:33.027022 19510 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 15: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:33.027345 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:33.028846 19658 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:32.997395 26223 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:33.036114 26223 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:33.036604 26223 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:33.038448 19625 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:33.038254 25786 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.039336 25871 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:20:33.040350 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 117342us
I20260709 13:20:33.040604 25786 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:33.042210 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:33.043148 19506 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:33.043349 26303 raft_consensus.cc:3055] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:33.043797 26303 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:33.044059 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:33.045444 19506 raft_consensus.cc:2393] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 22: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:33.025940 26248 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.047102 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:33.047287 26248 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:33.047789 19506 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:33.035399 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:33.044916 26303 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.030747 19586 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:20:32.981269 26163 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.044188 24912 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.031523 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:33.054319 19661 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:33.060166 19660 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:33.062407 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:33.063308 19506 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:33.061221 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:33.060943 19512 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:33.070029 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:33.085335 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:33.031875 26348 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:33.079625 24912 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:33.082074 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:33.069211 26303 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:33.084352 19661 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:33.029990 26203 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:33.089273 19658 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 23: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:33.091799 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:33.075139 26020 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:33.095479 26020 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:33.096566 26020 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.092123 26203 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:33.102170 26358 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:33.103751 26042 raft_consensus.cc:3055] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:33.104193 26042 raft_consensus.cc:740] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:33.104539 26311 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:33.105093 26042 consensus_queue.cc:260] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.107746 26042 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:33.112804 19578 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:33.115103 19578 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:33.116969 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4030) took 2978 ms. Trace:
I20260709 13:20:33.117429 19511 rpcz_store.cc:276] 0709 13:20:30.138362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.138497 (+   135us) service_pool.cc:224] Handling call
0709 13:20:30.144556 (+  6059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:32.361545 (+2216989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.116707 (+755162us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b540012f554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:33.116893 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5093490944}
I20260709 13:20:33.118625 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:33.118696 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:33.119486 19511 raft_consensus.cc:2393] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 19: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:33.070298 25871 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:33.120003 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:33.120211 25871 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:33.121536 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:33.095667 26388 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:20:33.121281 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:33.120324 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:33.129146 19509 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:33.122851 25871 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:33.134817 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:33.137099 19580 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:20:33.124445 26048 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:33.141149 19511 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 28: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:33.141037 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:33.144753 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:33.148458 19503 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:33.160233 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:33.170161 19506 raft_consensus.cc:2410] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:20:33.143687 26048 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:33.181633 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:33.183312 19503 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:33.188217 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:33.198547 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:33.193961 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:33.198650 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:33.201916 19504 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:33.180461 26305 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:33.200947 19587 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:33.186731 26048 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:33.198523 26238 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:33.190418 26348 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:33.210522 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:33.214746 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:33.189224 26334 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:20:33.200241 26196 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:33.209381 26266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.697s	user 0.012s	sys 0.027s
I20260709 13:20:33.189337 26143 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.242398 19586 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:20:33.246560 26392 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 13:20:33.247756 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.249653 26336 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:33.250207 26336 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:33.250588 26336 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:33.255820 26390 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:20:33.213860 26348 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:33.212769 26238 raft_consensus.cc:697] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:33.257578 26342 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.258512 19587 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:33.260414 26143 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:33.260600 19578 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24. Ops: []
W20260709 13:20:33.280639 19657 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 3549) took 2835 ms (client timeout 1746 ms). Trace:
W20260709 13:20:33.281085 19657 rpcz_store.cc:269] 0709 13:20:30.444882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.638106 (+193224us) service_pool.cc:224] Handling call
0709 13:20:33.280268 (+2642162us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54002184d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:33.280454 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552908032}
I20260709 13:20:33.283614 19506 raft_consensus.cc:2410] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:20:33.213027 26305 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.286800 26342 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:33.260692 26266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.867s	user 0.013s	sys 0.027s
I20260709 13:20:33.213312 26358 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:20:33.288797 19656 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:33.288792 19504 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:33.267373 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:33.325382 19508 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:33.334621 19510 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:33.330595 19625 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:33.338241 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.339455 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:33.342509 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.287813 26305 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:33.345219 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.336452 26358 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.253224 26203 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:33.347697 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.335819 26163 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:33.348547 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.349681 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:33.352592 19652 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:33.348193 26196 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:33.261646 26348 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:33.366197 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.266860 26238 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.341537 25649 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.367107 19510 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:33.348188 26336 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.263654 26223 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:33.374938 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 149333us
I20260709 13:20:33.355279 26272 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.393589 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:33.397730 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:33.397732 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 82758.9us
I20260709 13:20:33.399454 19625 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
W20260709 13:20:33.375878 26120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.221s	user 0.011s	sys 0.024s
I20260709 13:20:33.354322 26358 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.400477 19585 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:33.410416 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:33.414091 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:33.414515 19478 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:33.414983 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:33.415925 19478 leader_election.cc:400] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20.
I20260709 13:20:33.416215 19478 leader_election.cc:403] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:33.416291 26048 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.417374 26196 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:33.417798 26196 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:33.418186 26196 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:33.418871 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:33.420578 26395 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:20:33.421495 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:33.424034 26358 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:33.424923 26305 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:33.425346 26305 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:33.425741 26305 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:33.428202 24912 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:20:33.412010 26120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.296s	user 0.012s	sys 0.025s
I20260709 13:20:33.430910 25649 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:33.432896 26272 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:33.433945 19655 raft_consensus.cc:2368] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20.
I20260709 13:20:33.435503 26223 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:33.436635 26203 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:33.438500 26089 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:33.418797 26048 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:33.440554 26336 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:33.442656 26356 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 1.275s	user 0.000s	sys 0.004s
I20260709 13:20:33.444658 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:33.446626 24912 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20.
W20260709 13:20:33.451983 26360 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 1.287s	user 0.006s	sys 0.000s
I20260709 13:20:33.458257 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3722) took 2028 ms. Trace:
I20260709 13:20:33.457916 26305 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.458642 19582 rpcz_store.cc:276] 0709 13:20:31.429602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.430769 (+  1167us) service_pool.cc:224] Handling call
0709 13:20:31.432295 (+  1526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.625073 (+192778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.625119 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:31.632563 (+  7444us) log.cc:844] Serialized 26 byte log entry
0709 13:20:32.107500 (+474937us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:32.411423 (+303923us) log.cc:844] Serialized 14 byte log entry
0709 13:20:32.449516 (+ 38093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.456301 (+  6785us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:33.451382 (+995081us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:20:33.457771 (+  6389us) raft_consensus.cc:1685] finished
0709 13:20:33.457873 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.458082 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122406,"prepare.queue_time_us":76767,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":7015,"raft.queue_time_us":51484,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":13753,"spinlock_wait_cycles":34552192,"thread_start_us":892750,"threads_started":3,"wal-append.queue_time_us":531563}
I20260709 13:20:33.460826 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:33.410488 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:33.461529 19659 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
W20260709 13:20:33.466655 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.468191 19476 leader_election.cc:400] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20.
I20260709 13:20:33.469303 19476 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:33.471225 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 60821.7us
I20260709 13:20:33.472054 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:33.473841 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:33.474517 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:33.474891 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:33.476254 24912 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:33.480650 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:33.487291 19625 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:33.533207 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51098.8us
I20260709 13:20:33.535486 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:33.545890 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 65320.2us
I20260709 13:20:33.477540 25649 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:33.579804 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:33.485440 26351 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:33.486310 26334 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:33.531952 26248 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:33.474207 26327 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:33.462872 26196 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:33.593907 19659 raft_consensus.cc:1240] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:33.603003 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:33.603796 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:33.580384 26305 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:33.485221 26270 consensus_queue.cc:1048] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.103s
I20260709 13:20:33.611439 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:33.601696 25786 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:33.625679 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:33.627005 19659 raft_consensus.cc:2393] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 22: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:33.627702 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:33.628342 19653 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:33.629468 24912 consensus_queue.cc:1059] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:33.631237 19510 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:33.613451 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:33.635994 19658 raft_consensus.cc:2376] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20. Re-sending same reply.
I20260709 13:20:33.637240 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:33.587167 26351 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:33.638140 19510 raft_consensus.cc:2393] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 17: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:33.639007 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:33.647830 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:33.647194 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3411) took 1674 ms. Trace:
I20260709 13:20:33.649123 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:33.638573 26336 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:33.648880 19584 rpcz_store.cc:276] 0709 13:20:31.972641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.972874 (+   233us) service_pool.cc:224] Handling call
0709 13:20:32.260395 (+287521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:32.261256 (+   861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.645647 (+1384391us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b5400303250. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:33.647118 (+  1471us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659946240}
I20260709 13:20:33.649786 19653 raft_consensus.cc:2376] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 28. Re-sending same reply.
I20260709 13:20:33.643611 26348 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.655177 26401 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:33.655283 26348 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:33.656646 26361 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 1.550s	user 0.009s	sys 0.005s
I20260709 13:20:33.653884 26163 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:33.658183 26163 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:33.626364 26089 consensus_queue.cc:1059] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:20:33.640600 26351 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:33.609871 26296 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:20:33.661798 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:33.662168 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 50814.4us
I20260709 13:20:33.662459 19582 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
W20260709 13:20:33.663823 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 184976us
I20260709 13:20:33.664822 19625 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:33.636746 26248 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:20:33.647390 26327 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:33.669051 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:33.663103 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:33.673502 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:33.663897 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3746) took 1047 ms. Trace:
I20260709 13:20:33.678464 26048 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:33.679108 19584 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:33.680929 19584 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:33.683519 26357 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:33.611872 25649 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.689693 19510 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:33.668689 26348 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:33.678695 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 199864us
I20260709 13:20:33.669325 26334 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:33.700379 19582 raft_consensus.cc:1240] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
W20260709 13:20:33.687141 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 57181.8us
I20260709 13:20:33.689240 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:33.685771 26295 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 13:20:33.669457 26203 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:33.668205 26327 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:33.677173 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:33.675141 26238 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:33.691303 19625 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:33.695202 26048 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:33.702376 19476 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:33.710328 26196 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:33.726585 26096 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:33.712713 25649 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:33.728737 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:33.715234 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:33.720067 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:33.729962 19506 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:20:33.721383 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 2917) took 1106 ms. Trace:
I20260709 13:20:33.731384 19655 rpcz_store.cc:276] 0709 13:20:32.614880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.802022 (+187142us) service_pool.cc:224] Handling call
0709 13:20:33.721160 (+919138us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b5400122fd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:33.721324 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1450861440}
I20260709 13:20:33.724231 26357 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.736646 25732 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:33.736931 26357 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.738260 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:33.739055 19511 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 24: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:33.739957 26336 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:33.740130 19511 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:20:33.740250 26357 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:33.741036 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2870) took 1084 ms. Trace:
I20260709 13:20:33.741405 19511 rpcz_store.cc:276] 0709 13:20:32.656841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.739601 (+1082760us) service_pool.cc:224] Handling call
0709 13:20:33.739926 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:33.740739 (+   813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.740975 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:33.730947 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:33.743820 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 66754.1us
I20260709 13:20:33.744515 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:33.748426 26294 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:33.748860 26294 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:33.718360 26203 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:33.750234 26203 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:33.751312 19657 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:33.753733 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 2880) took 1091 ms. Trace:
I20260709 13:20:33.754129 19505 rpcz_store.cc:276] 0709 13:20:32.661917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.748055 (+ 86138us) service_pool.cc:224] Handling call
0709 13:20:33.753529 (+1005474us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b5400403154. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:33.753655 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135799168}
I20260709 13:20:33.754845 19655 raft_consensus.cc:1240] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:33.755451 19505 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:33.756598 19505 raft_consensus.cc:1240] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:33.756985 19506 raft_consensus.cc:1240] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 13:20:33.758754 19587 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: [21.10-21.10]
I20260709 13:20:33.758900 26351 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.761044 26351 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:33.721809 26334 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:33.763820 26334 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:33.721371 26327 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:33.764632 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:33.766218 19652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3589) took 1055 ms. Trace:
I20260709 13:20:33.767123 19652 rpcz_store.cc:276] 0709 13:20:32.711260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.023340 (+312080us) service_pool.cc:224] Handling call
0709 13:20:33.023626 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.353089 (+329463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.766001 (+412912us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54001eb254. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:33.766164 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":756146048}
I20260709 13:20:33.757587 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2871) took 1100 ms. Trace:
I20260709 13:20:33.768788 19506 rpcz_store.cc:276] 0709 13:20:32.657256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.745280 (+1088024us) service_pool.cc:224] Handling call
0709 13:20:33.756769 (+ 11489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:33.757339 (+   570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.757515 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:33.722225 26163 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:33.771373 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:33.757586 19505 raft_consensus.cc:1240] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: []
W20260709 13:20:33.746567 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 44326.9us
I20260709 13:20:33.777521 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:33.779140 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:33.783552 24912 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.784044 24912 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.785233 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:33.787019 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:33.779790 26294 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.780726 26401 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:33.782994 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:33.776608 26357 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:33.814014 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:33.831212 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:33.814004 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:33.834857 19505 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:33.832901 19657 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:33.780339 26336 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:33.780871 26348 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:33.830257 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:33.845661 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4048) took 1058 ms. Trace:
I20260709 13:20:33.846606 19511 rpcz_store.cc:276] 0709 13:20:32.786746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.776213 (+989467us) service_pool.cc:224] Handling call
0709 13:20:33.841783 (+ 65570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.845319 (+  3536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:33.845345 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:33.845395 (+    50us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:33.845430 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.845487 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.845588 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:33.848600 24912 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:33.782150 26163 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:33.805751 25575 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:33.832144 26294 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:33.855232 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:33.835501 26357 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:33.781998 26334 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:20:33.856518 19506 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:33.870853 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 2885) took 1036 ms. Trace:
I20260709 13:20:33.871486 19509 rpcz_store.cc:276] 0709 13:20:32.834424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.121248 (+286824us) service_pool.cc:224] Handling call
0709 13:20:33.870603 (+749355us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b54002a2bd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:33.870766 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15915776}
I20260709 13:20:33.853032 26143 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:33.859038 26348 raft_consensus.cc:697] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:33.868569 26357 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:33.884873 19581 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:33.888631 19506 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:20:33.890638 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.860123 25575 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.893826 19505 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 14. (term mismatch)
I20260709 13:20:33.894276 19505 pending_rounds.cc:85] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 13
I20260709 13:20:33.894546 19505 pending_rounds.cc:107] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 13:20:33.894757 19505 raft_consensus.cc:2889] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:33.897086 26222 raft_consensus.cc:3055] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:33.897428 26227 raft_consensus.cc:3055] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:33.897899 26227 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:33.898727 26227 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.899976 26227 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:33.905481 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 2881) took 1243 ms. Trace:
I20260709 13:20:33.906031 19512 rpcz_store.cc:276] 0709 13:20:32.662523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.844403 (+181880us) service_pool.cc:224] Handling call
0709 13:20:33.905269 (+1060866us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400402754. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:33.905379 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495754496}
I20260709 13:20:33.907398 19512 pending_rounds.cc:85] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 9
I20260709 13:20:33.907656 19512 pending_rounds.cc:107] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 21.10
I20260709 13:20:33.907878 19512 raft_consensus.cc:2889] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:33.910307 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3751) took 1102 ms. Trace:
I20260709 13:20:33.910732 19586 rpcz_store.cc:276] 0709 13:20:32.808253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.244230 (+435977us) service_pool.cc:224] Handling call
0709 13:20:33.465798 (+221568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.466022 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:33.466060 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:33.466117 (+    57us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:33.466161 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.466236 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.910119 (+443883us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b5400107a50. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:33.910241 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":508830976}
I20260709 13:20:33.914413 26327 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.915699 25575 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:33.897584 26222 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:33.916725 26327 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:33.917474 26222 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.918877 26222 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:33.922310 19510 raft_consensus.cc:1217] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Deduplicated request from leader. Original: 16.10->[18.11-22.13]   Dedup: 18.11->[21.12-22.13]
I20260709 13:20:33.922883 19510 pending_rounds.cc:85] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 11
I20260709 13:20:33.923131 19510 pending_rounds.cc:107] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:20:33.923368 19510 raft_consensus.cc:2889] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:33.926153 19506 pending_rounds.cc:85] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 9
I20260709 13:20:33.926541 19506 pending_rounds.cc:107] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 21.10
I20260709 13:20:33.926786 19506 raft_consensus.cc:2889] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:33.882228 26203 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.931630 26203 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:33.932250 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3736) took 1442 ms. Trace:
I20260709 13:20:33.932678 19578 rpcz_store.cc:276] 0709 13:20:32.489478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.115810 (+626332us) service_pool.cc:224] Handling call
0709 13:20:33.116076 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.279420 (+163344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.931991 (+652571us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54002283d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:33.932191 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331957504}
I20260709 13:20:33.885824 26143 raft_consensus.cc:697] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:33.958391 25575 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:33.959278 25575 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.960747 19409 catalog_manager.cc:5697] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:33.962317 20665 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 19 LEARNER]: Advancing to term 21
I20260709 13:20:33.963178 19409 catalog_manager.cc:5697] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:33.978477 19625 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:33.979506 19625 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:33.980587 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.981266 24912 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.981801 24912 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:33.675648 19580 rpcz_store.cc:276] 0709 13:20:32.616609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.210593 (+593984us) service_pool.cc:224] Handling call
0709 13:20:33.227200 (+ 16607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.269876 (+ 42676us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:33.467982 (+198106us) log.cc:844] Serialized 14 byte log entry
0709 13:20:33.663508 (+195526us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:33.663569 (+    61us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:33.663619 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.663697 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.663827 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":129725,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":2482,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":8365,"thread_start_us":327255,"threads_started":2}
I20260709 13:20:33.965121 19409 catalog_manager.cc:5697] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 15 to 18, leader changed from 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 18 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:20:33.988813 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.946585 26196 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.011543 19478 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:34.015743 26295 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:34.016279 26295 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:34.016775 26295 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:33.955994 26203 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.023468 26203 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.034986 26412 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:20:34.035898 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:34.036074 25575 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:34.036497 19505 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:34.038419 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:34.039507 20665 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 21 LEARNER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:34.040210 26203 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:34.047302 25579 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:34.048645 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:34.051671 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:34.052502 19580 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:34.054242 24912 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:34.056211 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:34.057825 19653 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:34.062213 26143 consensus_queue.cc:237] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.065994 26348 consensus_queue.cc:237] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.081671 26196 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.083300 26294 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:34.084771 26196 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:34.013381 26222 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:20:34.086127 26412 consensus_queue.cc:1059] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:34.004153 25871 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:34.087373 26323 raft_consensus.cc:3055] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:34.087718 25871 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.087838 26323 raft_consensus.cc:740] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:34.088450 25871 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:34.089025 26323 consensus_queue.cc:260] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.090480 26323 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:34.035290 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 50704.5us
I20260709 13:20:34.092747 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:34.093601 26412 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:34.094054 26412 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.094385 26412 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:34.095762 25732 consensus_queue.cc:1059] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:34.097012 25732 consensus_queue.cc:1059] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:34.097920 26270 consensus_queue.cc:1059] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:34.098220 26338 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:34.099116 26096 raft_consensus.cc:3055] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:34.099661 26096 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:34.099761 25786 raft_consensus.cc:3055] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:34.100201 25786 raft_consensus.cc:740] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:34.100591 26096 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.099148 26270 raft_consensus.cc:3055] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:34.084895 24912 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:34.104130 24912 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:34.105237 24912 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.106530 24912 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:34.110834 19505 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:34.120313 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:34.101074 25786 consensus_queue.cc:260] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.131785 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:34.132450 19505 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 28.
I20260709 13:20:34.135059 19625 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:34.189940 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 54975.4us
I20260709 13:20:34.190975 19625 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:34.192131 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4055) took 1363 ms. Trace:
I20260709 13:20:34.192569 19507 rpcz_store.cc:276] 0709 13:20:32.788798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.762220 (+973422us) service_pool.cc:224] Handling call
0709 13:20:33.762515 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.762743 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:33.877481 (+114738us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.138537 (+261056us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.151589 (+ 13052us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:34.151675 (+    86us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:34.151743 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.151838 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.152015 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":255372,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":1499,"spinlock_wait_cycles":87715072,"thread_start_us":272728,"threads_started":2}
I20260709 13:20:34.123302 26089 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.133385 26042 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:34.122395 26222 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:34.122352 26270 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:34.139147 26096 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:34.202335 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:34.130887 25575 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.067s
I20260709 13:20:34.195061 26203 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:34.136837 26338 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:20:34.148043 26196 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.222496 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:34.221868 25786 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:34.196503 26042 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.204203 26305 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.215909 26336 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:20:34.243360 26042 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:34.252558 25732 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:20:34.253041 25732 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.253371 25732 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:20:34.226136 26196 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.256008 26196 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:34.257491 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.256943 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:34.259531 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:34.199818 26089 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.204314 26222 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:34.282692 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3582) took 1644 ms. Trace:
I20260709 13:20:34.283322 19656 rpcz_store.cc:276] 0709 13:20:32.637934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.954139 (+316205us) service_pool.cc:224] Handling call
0709 13:20:32.963449 (+  9310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.289230 (+325781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.282309 (+993079us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b5400020654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:34.282570 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":747730688}
I20260709 13:20:34.256924 26042 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.306725 19508 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:34.244357 26357 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:34.319353 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 128462us
I20260709 13:20:34.324970 19505 raft_consensus.cc:2368] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 22. Current term is 23.
I20260709 13:20:34.258270 26305 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:34.351259 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 249085us
I20260709 13:20:34.328712 26412 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.326612 26295 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.306869 26270 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.353880 26430 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:34.377458 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:34.375007 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:34.379556 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:34.387781 19654 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:34.405728 20661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:34.395165 26430 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:34.410122 26419 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:20:34.413968 19476 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:34.373375 26042 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:34.379645 26432 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.374570 26433 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:34.422297 26432 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:34.423560 26423 log.cc:927] Time spent T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:20:34.424253 26420 log.cc:927] Time spent T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:20:34.425836 26426 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:20:34.446842 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:34.448350 19504 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
W20260709 13:20:34.448908 19504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 4076) took 1180 ms (client timeout 1558 ms). Trace:
W20260709 13:20:34.449234 19504 rpcz_store.cc:269] 0709 13:20:33.268044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.335268 (+ 67224us) service_pool.cc:224] Handling call
0709 13:20:34.446698 (+1111430us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635e9c 00007f6c2e635a5b 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:20:34.448852 (+  2154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7118464}
I20260709 13:20:34.408274 26435 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
W20260709 13:20:34.423585 26421 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:20:34.452282 26203 raft_consensus.cc:697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:34.460541 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:34.448284 26042 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.461428 19504 raft_consensus.cc:2410] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
W20260709 13:20:34.461458 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.448156 26270 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:34.477212 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:34.475347 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:20:34.456936 25575 raft_consensus.cc:493] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:34.476984 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:34.480137 26089 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:34.490658 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:34.491323 19504 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:34.489923 20663 raft_consensus.cc:2368] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20.
I20260709 13:20:34.489284 26042 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:34.496074 26432 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:34.496598 26042 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:34.497774 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2896) took 1095 ms. Trace:
I20260709 13:20:34.498827 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4067) took 1423 ms. Trace:
I20260709 13:20:34.499398 19511 rpcz_store.cc:276] 0709 13:20:33.075816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.847786 (+771970us) service_pool.cc:224] Handling call
0709 13:20:33.936554 (+ 88768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.936759 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:34.138358 (+201599us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.457340 (+318982us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:34.457400 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:34.457449 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.457522 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.498600 (+ 41078us) spinlock_profiling.cc:243] Waited 69.7 ms on lock 0x7b54001842d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:34.498746 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7746,"prepare.queue_time_us":81843,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":111426,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":15693,"spinlock_wait_cycles":161968896,"thread_start_us":433104,"threads_started":3,"wal-append.queue_time_us":195251}
I20260709 13:20:34.503746 19504 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:20:34.504101 26295 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:34.510247 19625 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:34.483906 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:34.508288 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3730) took 2020 ms. Trace:
W20260709 13:20:34.508876 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 94997us
I20260709 13:20:34.512260 19585 rpcz_store.cc:276] 0709 13:20:32.487776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.106338 (+618562us) service_pool.cc:224] Handling call
0709 13:20:33.106676 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.413022 (+306346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.507970 (+1094948us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54001fb654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:34.508211 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675255040}
I20260709 13:20:34.512630 19476 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:34.512641 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2899) took 1108 ms. Trace:
I20260709 13:20:34.498214 19509 rpcz_store.cc:276] 0709 13:20:33.401923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.872741 (+470818us) service_pool.cc:224] Handling call
0709 13:20:33.873280 (+   539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:33.874488 (+  1208us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:33.874518 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:33.876955 (+  2437us) log.cc:844] Serialized 26 byte log entry
0709 13:20:34.141964 (+265009us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:34.142003 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.142078 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:34.497498 (+355420us) raft_consensus.cc:1685] finished
0709 13:20:34.497522 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.497713 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":707,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"thread_start_us":247611,"threads_started":1,"wal-append.queue_time_us":451151}
I20260709 13:20:34.514218 19512 rpcz_store.cc:276] 0709 13:20:33.404051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.906866 (+502815us) service_pool.cc:224] Handling call
0709 13:20:33.907225 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:33.908563 (+  1338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:33.908592 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:33.909017 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:20:34.133713 (+224696us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:34.133749 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.133830 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:34.512418 (+378588us) raft_consensus.cc:1685] finished
0709 13:20:34.512438 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.512578 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":224291,"threads_started":1,"wal-append.queue_time_us":348332}
I20260709 13:20:34.519927 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:34.484694 26357 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:34.516347 26422 log.cc:927] Time spent T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
W20260709 13:20:34.516440 26425 log.cc:927] Time spent T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:20:34.513731 25786 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:34.527683 26438 log.cc:927] Time spent T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:34.527930 26089 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:34.535723 26089 raft_consensus.cc:697] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:34.536547 25732 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.536829 26089 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.528458 26440 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:34.539465 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:34.539835 19654 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 20.
I20260709 13:20:34.523277 19627 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:34.532277 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.532449 26439 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.539939 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:34.518188 26432 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:34.533470 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:34.534373 26449 log.cc:927] Time spent T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:20:34.534801 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.446159 26433 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:34.546416 19504 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:34.547737 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:34.547891 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:34.548697 19504 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:34.544180 19476 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:34.542608 26446 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:34.549698 25579 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:34.549986 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:34.550297 25579 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.550839 19661 raft_consensus.cc:2410] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:20:34.550678 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:34.548730 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:34.460167 26435 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:34.549732 26096 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:34.554682 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:34.554847 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:34.555256 26446 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:34.555490 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:34.542955 26323 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:34.556059 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:34.566679 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:34.539357 26238 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:20:34.567397 19657 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:34.542033 25732 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:34.562355 19652 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:20:34.563335 19504 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:34.565225 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:34.566781 19658 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:34.559653 19625 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:34.515421 25575 raft_consensus.cc:515] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:34.567894 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2898) took 1164 ms. Trace:
I20260709 13:20:34.571215 20665 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:34.573951 19652 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:34.569199 26217 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:34.567955 26125 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.542924 26432 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:34.576577 19625 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:34.575148 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2902) took 1168 ms. Trace:
I20260709 13:20:34.579087 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:34.582170 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:34.583094 26125 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.593731 19511 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:20:34.592887 19510 rpcz_store.cc:276] 0709 13:20:33.406542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.921675 (+515133us) service_pool.cc:224] Handling call
0709 13:20:33.922099 (+   424us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:33.937670 (+ 15571us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:34.228719 (+291049us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.375431 (+146712us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:34.380062 (+  4631us) log.cc:844] Serialized 52 byte log entry
0709 13:20:34.380238 (+   176us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:34.380552 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.522442 (+141890us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.571943 (+ 49501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.574759 (+  2816us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:34.574839 (+    80us) raft_consensus.cc:1685] finished
0709 13:20:34.574867 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.575088 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50324,"prepare.queue_time_us":89788,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":119,"raft.queue_time_us":218393,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":6035,"thread_start_us":508381,"threads_started":3,"wal-append.queue_time_us":205381}
I20260709 13:20:34.595232 26125 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:34.534878 25786 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.595841 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:34.596443 19510 raft_consensus.cc:3060] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:34.597355 25786 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:34.585749 26433 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:34.586526 26357 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:20:34.595563 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:34.598807 26357 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 28 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:34.599762 26357 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 27.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.586964 19653 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 13:20:34.601554 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.572708 19506 rpcz_store.cc:276] 0709 13:20:33.403432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.889433 (+486001us) service_pool.cc:224] Handling call
0709 13:20:33.925935 (+ 36502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:33.927366 (+  1431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:33.927400 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:33.928042 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 13:20:34.228274 (+300232us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:34.228318 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.228386 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:34.567654 (+339268us) raft_consensus.cc:1685] finished
0709 13:20:34.567680 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.567830 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":299823,"threads_started":1,"wal-append.queue_time_us":398632}
I20260709 13:20:34.602866 25732 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:34.602977 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:34.603411 25732 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.603973 25732 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:34.604287 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:34.604727 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.604934 19506 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 25.
I20260709 13:20:34.607409 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:34.609208 19506 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:34.608423 19625 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:34.610677 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:34.611510 26270 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:34.612176 26270 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.613096 26270 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:34.612447 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:34.614976 19510 raft_consensus.cc:2468] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 20.
I20260709 13:20:34.615142 19506 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:34.616396 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:34.616695 19506 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:34.618149 19506 raft_consensus.cc:606] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:34.612500 25732 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.619140 19506 raft_consensus.cc:614] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:34.621353 25732 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:34.631073 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:34.542548 26439 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.635717 19653 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:34.560497 26143 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:34.632990 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 54234.8us
I20260709 13:20:34.634240 19506 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:34.617295 19510 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:20:34.564023 26348 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:34.642009 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4056) took 1777 ms. Trace:
I20260709 13:20:34.643088 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:34.575906 26217 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:34.651062 19504 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:34.588764 26401 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:34.633194 26432 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.651917 19660 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:34.580271 26096 raft_consensus.cc:2764] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:20:34.632433 26323 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.634469 26125 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:34.661968 19510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:34.665486 19510 raft_consensus.cc:606] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
W20260709 13:20:34.662863 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 121072us
I20260709 13:20:34.666332 19476 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:34.543313 26203 consensus_queue.cc:237] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.644366 19503 rpcz_store.cc:276] 0709 13:20:32.868077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.772267 (+904190us) service_pool.cc:224] Handling call
0709 13:20:33.781783 (+  9516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.787786 (+  6003us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:33.882978 (+ 95192us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.476007 (+593029us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.633759 (+157752us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:34.633859 (+   100us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:34.641778 (+  7919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.641849 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.641966 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39348,"prepare.queue_time_us":234552,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":2628,"raft.queue_time_us":184324,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":174,"spinlock_wait_cycles":16922496,"thread_start_us":706840,"threads_started":4,"wal-append.queue_time_us":399992}
I20260709 13:20:34.667696 19510 raft_consensus.cc:614] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:34.670003 19504 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:34.656131 26217 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:34.671239 19476 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:34.677937 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 426150us
I20260709 13:20:34.683084 19504 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:34.646513 26143 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.658471 26348 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.666005 26323 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:34.690860 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 71324.1us
I20260709 13:20:34.770293 26076 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:34.692662 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 49894.4us
I20260709 13:20:34.800941 19509 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:34.822186 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:34.902272 19584 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 28.
I20260709 13:20:34.903445 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:34.903920 25786 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.904811 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:34.870808 20619 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:34.906332 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:34.904755 25786 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.802073 25579 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:34.802175 26305 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:34.705338 26445 consensus_queue.cc:1059] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.182s
I20260709 13:20:34.821415 26350 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.823472 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:34.941200 19585 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:20:34.798194 26435 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:34.821856 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:34.943477 19578 raft_consensus.cc:2393] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 22: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:34.767305 19510 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:20:34.708181 19504 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:34.784343 26450 consensus_queue.cc:1059] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.122s
I20260709 13:20:34.821489 19587 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:34.875052 26143 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:34.798050 25575 leader_election.cc:290] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:34.948356 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:34.948381 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:34.949795 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:34.823189 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:34.951246 19580 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:34.951575 26445 raft_consensus.cc:3055] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:34.951984 26445 raft_consensus.cc:740] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:34.948415 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:34.953683 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:34.955291 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:34.866530 19507 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:20:34.918728 26335 consensus_queue.cc:1059] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 13:20:34.958214 26143 raft_consensus.cc:3055] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:34.958585 26143 raft_consensus.cc:740] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:34.877722 26323 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:34.822865 19579 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:34.672319 26342 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:34.833334 26222 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:34.967756 19580 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:34.879472 26430 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:34.836563 19512 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:20:34.754347 26440 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.770551 19506 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:34.882257 26455 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.882687 26363 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:34.884217 26336 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:34.886211 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:34.886708 26196 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.887856 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:34.889688 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:34.975811 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:34.891858 26348 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:34.685681 26295 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:34.739439 19658 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:20:34.892442 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:34.892951 26447 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.894263 26144 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:34.747757 19476 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:34.802750 26338 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:34.840195 19657 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:34.797456 26270 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.989010 26270 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:34.919987 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:34.990168 19584 raft_consensus.cc:2393] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 23: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:20:34.921268 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 248542us
I20260709 13:20:34.991161 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:34.991714 19584 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:20:34.685400 26401 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.917794 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:34.993294 26401 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.980118 26440 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.996119 26401 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:34.923097 26370 raft_consensus.cc:2804] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:34.979868 26143 consensus_queue.cc:260] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:34.955621 26439 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:34.854672 19508 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 4075) took 1587 ms (client timeout 1625 ms). Trace:
I20260709 13:20:34.956070 25786 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:34.956169 26450 consensus_queue.cc:1243] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:20:34.957082 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:34.922081 26459 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:34.923333 26272 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.957479 26412 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:34.854763 25871 consensus_meta.cc:287] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.766s	user 0.011s	sys 0.003s
I20260709 13:20:34.960148 19578 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:35.010491 19625 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:34.946089 26350 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.843590 26217 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.968865 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:34.963644 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:20:34.976536 19579 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:34.977336 19586 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:34.976262 19582 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:20:34.959419 25579 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:34.982301 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:34.983459 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 235811us
I20260709 13:20:34.953078 26445 consensus_queue.cc:260] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.067107 19581 raft_consensus.cc:2393] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 22: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:34.985190 26430 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:34.985795 26144 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.986603 26447 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.989713 26363 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:34.996383 26440 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:34.997164 26370 raft_consensus.cc:697] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 20 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:34.859639 26432 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:34.677977 26125 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.193s
I20260709 13:20:35.000250 19512 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:34.979820 26336 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:35.049552 19508 rpcz_store.cc:269] 0709 13:20:33.267719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.339011 (+ 71292us) service_pool.cc:224] Handling call
0709 13:20:34.256786 (+917775us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b5800002a98. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:20:34.854438 (+597652us) spinlock_profiling.cc:243] Waited 47.3 ms on lock 0x7b5400260554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:34.854592 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117285504}
W20260709 13:20:35.045393 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.052675 19625 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:35.054059 19587 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:35.096132 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 43618.4us
I20260709 13:20:35.096910 19625 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:35.091889 26125 raft_consensus.cc:3055] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:35.097564 26125 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:35.073895 25579 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.098786 19625 leader_election.cc:400] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 22. Current term is 23.
I20260709 13:20:35.098521 26125 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.099521 26435 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:35.099936 26125 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:35.100236 25579 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:35.100749 26454 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:35.100911 25579 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:35.003355 19510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:35.102169 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:35.059803 19476 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:35.102914 19512 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:20:35.103390 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 43657.1us
I20260709 13:20:35.104223 26447 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.104734 26440 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:35.056727 25871 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.064589 19585 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:35.106765 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.107622 25871 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:35.108242 26238 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.109124 26350 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:35.070652 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 107155us
I20260709 13:20:35.109608 26217 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:35.111027 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.052338 26401 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:35.100234 25692 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:35.112514 26401 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:35.113051 26401 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:35.049597 26459 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:35.113106 26370 consensus_queue.cc:237] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:35.113852 26459 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:35.116053 26336 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.112551 25692 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.117260 25692 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:35.055382 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.069795 26272 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.117955 19506 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:34.980333 26455 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.119787 26272 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:35.120131 19506 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:35.099944 26435 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.121423 26435 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:35.121601 26455 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.025779 26270 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:35.122550 26270 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.125108 26270 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:35.054967 25575 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:35.125735 26445 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:35.125869 25575 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.126317 25575 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:35.126631 19584 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 29.
I20260709 13:20:35.082049 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:34.981712 26196 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.086586 26432 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:35.092306 19660 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:35.105803 19476 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:35.130445 26196 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:35.068377 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d39387ed0c44978cdb2b736f9c1ccf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.130669 26350 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:35.099138 19625 leader_election.cc:403] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:35.107537 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.132551 19509 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:35.132637 26042 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.133213 26042 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.108781 26238 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.135775 26456 raft_consensus.cc:1064] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
W20260709 13:20:35.136261 26456 raft_consensus.cc:1068] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Unable to promote non-voter 068c03c9dcc848e6bf909131b1f83065: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:20:35.136276 26042 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.137259 26238 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.074471 26439 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:35.137989 26432 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:20:35.141083 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:35.141894 19509 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:35.144431 26144 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.144778 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:35.138738 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 221096us
I20260709 13:20:34.982968 26338 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:34.938756 26203 consensus_queue.cc:1059] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
W20260709 13:20:35.152251 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 46549.5us
I20260709 13:20:35.155510 19476 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:35.102358 19510 raft_consensus.cc:606] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:35.139504 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:34.967090 19627 leader_election.cc:400] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Vote denied by peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615) with higher term. Message: Invalid argument: T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20.
I20260709 13:20:35.145432 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.146595 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:35.156873 19585 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:35.157143 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 195602us
I20260709 13:20:35.156684 19510 raft_consensus.cc:614] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:35.158075 19627 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:35.158402 19504 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:35.161234 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.161794 19508 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:35.167002 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.167974 19580 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:35.173967 19509 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:35.173568 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4086) took 1181 ms. Trace:
I20260709 13:20:35.174844 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:35.180354 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:20:35.182699 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:35.186206 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.177173 19503 rpcz_store.cc:276] 0709 13:20:33.992067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.667583 (+675516us) service_pool.cc:224] Handling call
0709 13:20:34.680527 (+ 12944us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:34.894151 (+213624us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:34.894749 (+   598us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.978928 (+ 84179us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:34.980649 (+  1721us) log.cc:844] Serialized 26 byte log entry
0709 13:20:34.981217 (+   568us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:35.025552 (+ 44335us) log.cc:844] Serialized 14 byte log entry
0709 13:20:35.050585 (+ 25033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.151487 (+100902us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b540012f554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:35.151536 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:35.173354 (+ 21818us) raft_consensus.cc:1685] finished
0709 13:20:35.173379 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.173511 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34316,"prepare.queue_time_us":2937,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":2928,"raft.queue_time_us":25313,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":23611,"spinlock_wait_cycles":500542208,"thread_start_us":83685,"threads_started":1,"wal-append.queue_time_us":200501}
I20260709 13:20:35.193471 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.195214 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.208935 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:35.210762 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.210093 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:35.190806 26439 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.216961 26439 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.222205 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:35.222574 26439 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.217700 25786 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:35.223317 25786 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:35.223455 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.223802 25786 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:35.224112 19661 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 25.
I20260709 13:20:35.218248 26203 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:35.225726 25579 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:35.219708 19627 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:35.227336 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.228001 19653 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:35.220433 26272 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:35.229825 26272 raft_consensus.cc:697] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:35.230959 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.230863 26272 consensus_queue.cc:237] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.231621 19660 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:35.229178 19586 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:20:35.235530 26196 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:35.235734 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.236608 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.237604 19654 raft_consensus.cc:2410] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:20:35.237977 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:35.238310 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 94551.5us
I20260709 13:20:35.241504 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:35.211997 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:35.246740 19655 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:35.243223 19583 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:35.175586 26042 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:35.245393 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.150575 26448 consensus_queue.cc:1059] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
W20260709 13:20:35.245683 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 133960us
I20260709 13:20:35.175705 26144 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:35.252132 19661 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:35.267719 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.243582 19476 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:35.190903 26456 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:35.270394 19512 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 26.
I20260709 13:20:35.268687 19656 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:35.210217 26217 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:35.267035 19478 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:35.286890 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:35.256786 19585 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:35.292587 19585 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:35.296809 19512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:35.184111 26455 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.088s
I20260709 13:20:35.302843 19512 raft_consensus.cc:606] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
W20260709 13:20:35.272522 26311 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.019s	sys 0.034s
I20260709 13:20:35.306416 19512 raft_consensus.cc:614] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:35.251847 26042 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:35.299424 19476 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:35.311125 19585 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:35.266903 26331 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:35.314842 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.311017 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:35.318109 19654 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 25.
I20260709 13:20:35.272583 26144 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:35.286237 26217 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:35.310094 26447 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:35.295300 26456 raft_consensus.cc:697] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:35.310295 26042 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:35.316016 26357 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:20:35.331097 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 117756us
W20260709 13:20:35.313903 26311 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.019s	sys 0.035s
W20260709 13:20:35.323566 26468 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 13:20:35.331208 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.319989 26342 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:35.323014 26443 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.325456 26222 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:35.324491 26144 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:35.343400 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:35.332463 26217 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:35.354097 19578 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:35.332213 26439 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:35.335562 26447 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.335827 26473 consensus_queue.cc:1059] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:20:35.335371 26446 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:35.372572 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:35.383361 19512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:35.369783 26443 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.442260 25575 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.381358 26447 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:35.352124 26342 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.386827 26439 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.440222 25692 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.375902 26336 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:20:35.399628 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:35.528679 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.450549 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2915) took 1025 ms. Trace:
I20260709 13:20:35.428076 26456 consensus_queue.cc:237] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.356786 26222 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.538800 26222 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:35.424588 26446 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.541497 26447 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.543408 26446 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:35.543627 26447 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.424227 26357 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.486068 26455 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.544598 26455 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.544477 26357 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.546871 26336 raft_consensus.cc:697] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:35.547061 26455 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.490180 26477 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:35.472437 26217 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:35.548003 26477 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.547921 26336 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.549495 26217 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:35.469373 26144 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.550210 26477 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.551292 26432 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 22. Current term is 23.
I20260709 13:20:35.551546 19659 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 25: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:35.421975 26412 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:35.500363 19587 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:35.552596 25692 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:35.552363 26412 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.523245 26342 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:35.552968 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.554325 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.554713 26412 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.330360 26338 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.555482 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:35.453857 26203 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:35.556607 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:35.526297 19583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 3450) took 2104 ms (client timeout 1653 ms). Trace:
W20260709 13:20:35.557209 19583 rpcz_store.cc:269] 0709 13:20:33.397196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.444405 (+ 47209us) service_pool.cc:224] Handling call
0709 13:20:35.501702 (+2057297us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b5400247554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:35.501823 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4134987520}
I20260709 13:20:35.545233 26042 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.558660 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.559844 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.560145 26042 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.560434 19583 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:35.521242 26335 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:35.561657 19652 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:35.561983 19579 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: [20.11-21.12]
I20260709 13:20:35.562186 26335 raft_consensus.cc:697] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:35.422416 26363 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.548465 26357 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.529646 19505 rpcz_store.cc:276] 0709 13:20:34.425469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.898377 (+472908us) service_pool.cc:224] Handling call
0709 13:20:34.898766 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:34.899159 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:34.899196 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:34.899713 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:20:35.057241 (+157528us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:35.057317 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.057448 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:35.450301 (+392853us) raft_consensus.cc:1685] finished
0709 13:20:35.450324 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.450483 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16585,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":6229,"thread_start_us":156889,"threads_started":1,"wal-append.queue_time_us":191188}
I20260709 13:20:35.551762 26144 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:35.506036 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 133549us
I20260709 13:20:35.556267 26203 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:35.563326 26335 consensus_queue.cc:237] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.521663 26433 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:35.550228 19578 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:35.566064 26433 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:35.566740 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.561422 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.567395 19658 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:35.568137 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.568717 19583 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:35.568908 19654 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:20:35.568722 26433 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:35.571835 19654 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26. Ops: []
I20260709 13:20:35.572039 19506 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26. Ops: []
I20260709 13:20:35.569589 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.572971 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.573311 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.574077 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.574509 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.573770 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:35.565680 26203 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:35.575428 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.575721 19583 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:35.576092 19503 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:35.578167 19507 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26. Ops: []
I20260709 13:20:35.581312 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:35.565027 26222 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.582428 26204 raft_consensus.cc:3055] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:35.582914 26204 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:35.583604 26363 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:35.583947 26222 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.584506 19583 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:35.585705 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.588027 19503 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:35.590706 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.591217 26439 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.591418 19658 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:35.591962 26439 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:35.592545 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:35.592476 26439 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.593520 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.594959 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:35.595738 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.596539 19655 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:35.596966 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.597275 19654 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:35.598428 26222 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.599593 25575 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:35.599992 19506 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:35.591156 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.601540 19505 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 24: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:35.588032 19478 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:35.604707 26440 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:35.605185 26440 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.605746 26440 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:35.610812 19508 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:35.611961 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:35.613788 26331 raft_consensus.cc:3055] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:35.614248 26331 raft_consensus.cc:740] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:35.616547 26096 raft_consensus.cc:3055] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:35.616969 26096 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:35.617813 26440 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.615218 26331 consensus_queue.cc:260] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:35.622107 26459 consensus_meta.cc:287] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.508s	user 0.006s	sys 0.006s
I20260709 13:20:35.584007 26204 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.623896 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.624176 26204 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:35.624990 26227 consensus_queue.cc:1175] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2cfd02601ea44976833027665abc93bf" responder_term: 20 status { last_received { term: 17 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 19. Current term is 20. Ops: [19.12-19.12]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:35.629654 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.629782 26459 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.631031 19586 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:20:35.631227 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.631882 19578 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:35.632414 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.632680 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:35.633322 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.634021 26412 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:35.634311 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.634402 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.635362 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.635712 26331 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:35.636071 19508 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
W20260709 13:20:35.636956 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.637578 26357 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:35.642675 26435 consensus_meta.cc:287] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 13:20:35.638892 25786 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:35.644933 26401 consensus_meta.cc:287] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 13:20:35.645561 26401 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.646399 25786 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:35.639381 26338 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:35.654090 19504 raft_consensus.cc:1240] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:35.655297 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.655925 19504 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:35.656536 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.656790 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:35.635601 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:35.646735 19587 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:35.640595 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:35.658053 19584 raft_consensus.cc:2410] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 25 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
W20260709 13:20:35.640816 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.658560 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.647464 26412 raft_consensus.cc:697] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:35.660302 19584 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:35.660742 26412 consensus_queue.cc:237] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.658612 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.641464 26357 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.643241 26435 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.648322 19512 raft_consensus.cc:606] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:35.647837 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.649201 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.671945 19512 raft_consensus.cc:614] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:35.649981 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:35.650313 26443 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.651567 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.652060 26439 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:35.663789 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 51933.8us
I20260709 13:20:35.599035 26222 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:35.640190 26445 consensus_meta.cc:287] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.003s
I20260709 13:20:35.647784 26401 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.632745 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.688514 19578 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:35.664008 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:35.680989 19625 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:35.674712 26342 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.691992 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.670928 25871 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.696637 19653 raft_consensus.cc:2393] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:35.683692 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:35.698230 19508 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:35.677950 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:35.684919 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.693783 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:35.685958 19551 connection.cc:256] RPC call timeout handler was delayed by -1.0764946560000226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
I20260709 13:20:35.696328 26196 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:35.703591 26196 raft_consensus.cc:697] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:35.704247 25871 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.704537 26196 consensus_queue.cc:237] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.705265 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:35.709825 19511 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:35.674813 26096 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.706204 26440 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.710806 19478 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:35.706496 25871 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:35.680401 26125 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.712764 19582 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:35.673192 26473 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.028s
I20260709 13:20:35.714107 25575 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:20:35.715854 26473 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:35.716387 26473 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:35.688743 26143 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:35.718070 19510 raft_consensus.cc:2393] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 23: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:35.720626 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:35.729008 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:35.719112 19625 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:35.687429 25786 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:20:35.731345 25871 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:35.731514 26076 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:35.731849 25871 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:35.732255 25871 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:35.732106 26076 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.714632 26448 consensus_queue.cc:1059] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:20:35.733829 26435 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:35.726872 26125 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.732328 26222 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.736769 19582 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:35.737356 19625 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:35.738197 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:35.714823 26443 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:35.744516 19625 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:35.748073 19582 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 28. Current term is 29. Ops: []
I20260709 13:20:35.750340 19625 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:20:35.725374 25692 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.752748 19478 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:35.774724 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:35.741271 26440 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:35.742655 25786 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:35.768184 19625 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:35.790021 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:35.746829 25575 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:35.717355 26473 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:35.755211 26222 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:35.760334 26432 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:35.790130 26481 log.cc:927] Time spent T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:20:35.760740 26443 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:35.812711 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.814733 19579 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:20:35.789448 26445 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:35.789753 26440 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.790735 25579 raft_consensus.cc:3055] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:35.746187 26203 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:20:35.789525 25732 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:35.789875 25786 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:35.843024 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.793064 26266 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:35.778673 25692 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.850085 19582 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:35.801015 26222 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:35.791872 25575 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:35.840629 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 143778us
I20260709 13:20:35.850875 26440 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:35.905192 20619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.861236 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.804255 26439 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:20:35.860194 19478 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:35.813984 26432 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:35.852444 25579 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:35.906648 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 46572.4us
I20260709 13:20:35.800957 26227 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:20:35.908278 20618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.900347 26222 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:35.909580 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.920226 19582 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:35.858872 26473 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:35.910678 19655 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:20:35.913013 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 132213us
I20260709 13:20:35.910140 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:35.952826 19581 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:35.949087 19511 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 25.
I20260709 13:20:35.856578 26076 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.905695 25732 raft_consensus.cc:697] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:35.921206 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:35.921519 19478 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:35.964234 19582 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:35.926028 26478 log.cc:927] Time spent T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 13:20:35.912639 25575 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.931083 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:35.913295 26445 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:20:35.935613 26480 log.cc:927] Time spent T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:20:35.938323 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.969025 19508 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 25.
I20260709 13:20:35.938899 25692 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:35.943816 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.921681 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:35.872445 25786 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:35.917124 25579 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.914062 26432 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:35.915141 26227 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.939467 26342 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:35.980089 19503 raft_consensus.cc:2393] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 26: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:35.979450 19625 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:35.965840 26439 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:35.996281 19505 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 13:20:36.016950 19625 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:35.966365 26370 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 13:20:36.023850 19503 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:36.011346 26440 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:35.995270 26227 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:36.012054 25579 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:35.981714 26272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.018s	sys 0.023s
I20260709 13:20:35.952132 26443 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.017464 19505 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:20:36.019204 19625 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:35.968552 26445 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:36.031875 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:36.038143 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.032560 19505 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:20:35.965729 25871 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.014930 26439 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:36.030372 26272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.019s	sys 0.024s
I20260709 13:20:36.040935 26338 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:36.030494 26445 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:36.051709 26487 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:20:36.056597 26222 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:36.057996 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.057327 19625 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:36.030326 26454 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:36.025405 26495 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:36.006037 25732 consensus_queue.cc:237] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:36.059623 26439 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:36.074290 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:36.024106 26266 raft_consensus.cc:697] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:36.073902 25692 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:36.075205 26454 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:36.060647 26338 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.079975 19504 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:36.063686 26499 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:36.071590 26495 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:36.086103 19508 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:20:36.095434 19581 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:36.089742 26338 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:36.096750 19478 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:36.097693 26443 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:36.098168 26443 raft_consensus.cc:697] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:36.098994 26443 consensus_queue.cc:237] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.093645 26499 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.100400 26454 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.102032 26499 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:36.083752 25692 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.123404 19625 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:36.128068 26490 log.cc:927] Time spent T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:20:36.130957 26222 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:36.131788 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:36.133391 26125 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:36.135130 26266 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.137784 19583 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 25.
I20260709 13:20:36.073764 26196 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:20:36.137313 26357 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:36.148084 19581 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:36.163796 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:36.164537 19504 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:36.152237 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:36.168555 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:36.169483 19585 raft_consensus.cc:2410] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:20:36.095907 26495 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:36.139170 25692 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:36.149924 26499 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:36.184273 26357 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:36.195369 19652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 3616) took 1016 ms. Trace:
I20260709 13:20:36.195828 19652 rpcz_store.cc:276] 0709 13:20:35.179389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.181086 (+  1697us) service_pool.cc:224] Handling call
0709 13:20:36.195200 (+1014114us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b5400120554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:36.195308 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780263168}
I20260709 13:20:36.193331 19478 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:36.206048 26430 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:36.206537 26430 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.189488 26499 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.207294 26499 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:36.208648 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:36.209280 19587 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:36.214884 25871 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:36.215904 26440 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:36.206882 26430 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:36.249382 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.187728 26446 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:36.197468 26357 raft_consensus.cc:697] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:36.278177 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:36.279073 26042 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:20:36.305194 19551 leader_election.cc:400] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20.
I20260709 13:20:36.305636 19551 leader_election.cc:403] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:36.306783 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:36.263175 25871 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:20:36.314059 26494 log.cc:927] Time spent T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:20:36.333719 26497 log.cc:927] Time spent T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
W20260709 13:20:36.335708 26496 log.cc:927] Time spent T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
W20260709 13:20:36.338472 26502 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 13:20:36.339589 26484 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
W20260709 13:20:36.341065 26506 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:20:36.285177 26042 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:36.370134 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 63452.3us
I20260709 13:20:36.371763 19551 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:36.369396 19587 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
W20260709 13:20:36.372575 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 74960.6us
I20260709 13:20:36.377487 19504 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:36.370180 19582 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:36.391007 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:36.395092 19625 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:36.318467 26401 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 19. Current term is 20.
I20260709 13:20:36.373725 19478 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:36.399940 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:36.276424 26446 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.403553 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:36.401465 19476 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:36.402699 19478 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:36.353955 26456 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:36.405992 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:36.406638 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:36.413879 19653 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:36.406914 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:36.420045 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:36.420877 19661 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:36.421927 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:36.424254 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:36.426682 19654 raft_consensus.cc:1240] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:36.428212 19652 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:36.419135 26204 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:36.402468 26125 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:36.408526 26450 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.416553 26447 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:36.411484 26448 raft_consensus.cc:2804] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:36.409281 26348 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:36.354959 25871 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.435153 19660 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:36.354100 26357 consensus_queue.cc:237] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.504841 19652 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:36.456391 26435 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.419541 26311 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:36.434028 26042 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 28.15, Last appended by leader: 15, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:36.531364 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.533964 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:36.548287 19654 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:36.505014 26448 raft_consensus.cc:697] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:36.539014 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.538827 19582 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:36.514783 26222 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:36.460021 26450 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:36.541419 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3792) took 1038 ms. Trace:
I20260709 13:20:36.572834 19579 rpcz_store.cc:276] 0709 13:20:35.502595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.701795 (+199200us) service_pool.cc:224] Handling call
0709 13:20:35.703523 (+  1728us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:35.851369 (+147846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.541076 (+689707us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54001fb654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:36.541339 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252428672}
I20260709 13:20:36.541989 26459 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:36.459726 26401 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:20:36.532225 26435 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.506120 26439 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:36.549182 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 147840us
W20260709 13:20:36.542936 26507 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:20:36.560367 26042 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:20:36.583231 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:36.584815 25871 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:36.562248 26448 consensus_queue.cc:237] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.587164 26435 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:36.588789 26338 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.589429 19657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:20:36.590965 26495 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:36.569473 26227 consensus_meta.cc:287] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.001s
W20260709 13:20:36.573493 25575 consensus_meta.cc:287] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.595s	user 0.013s	sys 0.001s
W20260709 13:20:36.567037 26518 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:20:36.566906 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 838121us
I20260709 13:20:36.600210 19627 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:36.602353 19627 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:20:36.608768 19627 leader_election.cc:304] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
W20260709 13:20:36.577433 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 158905us
I20260709 13:20:36.580199 19476 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:36.581558 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:36.620496 19654 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:36.615475 26522 consensus_queue.cc:1059] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
W20260709 13:20:36.566203 26509 log.cc:927] Time spent T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:20:36.547962 26204 raft_consensus.cc:697] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:36.594769 19659 raft_consensus.cc:2393] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 24: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:20:36.617758 26473 consensus_meta.cc:287] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.653s	user 0.008s	sys 0.002s
I20260709 13:20:36.614630 26435 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 29 FOLLOWER]: Leader election won for term 29
W20260709 13:20:36.616358 26432 consensus_meta.cc:287] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.599s	user 0.011s	sys 0.000s
I20260709 13:20:36.617589 26446 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:36.643719 26445 consensus_meta.cc:287] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.002s
I20260709 13:20:36.615626 25732 raft_consensus.cc:2749] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:36.613525 26521 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:36.625138 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:36.636461 25692 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.637236 26519 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
W20260709 13:20:36.639078 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 58969.6us
W20260709 13:20:36.641156 25786 consensus_meta.cc:287] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.001s
I20260709 13:20:36.641511 26432 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.614326 25871 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:36.646327 26514 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:20:36.646607 26495 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:36.709513 19660 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:36.646946 26520 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:36.608582 25575 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.648151 26204 consensus_queue.cc:237] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.627593 26448 consensus_queue.cc:1059] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.082s
I20260709 13:20:36.649773 26525 raft_consensus.cc:3055] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:36.651765 26338 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:36.654541 26450 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:36.656657 26439 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:36.656481 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:36.629904 26459 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:20:36.626283 25579 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:20:36.699069 26435 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 29 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:36.600203 26227 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.771555 26125 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:36.772190 26125 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.731017 26519 raft_consensus.cc:1064] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
W20260709 13:20:36.669430 26517 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:20:36.689638 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:36.660581 19661 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:36.675186 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:36.698406 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:36.776010 19582 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:36.776489 19587 raft_consensus.cc:2410] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 26 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:20:36.706044 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:36.706923 19579 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:20:36.703235 19653 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 26.
I20260709 13:20:36.653232 26499 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.779331 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:36.780526 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 74543.5us
I20260709 13:20:36.781474 20663 raft_consensus.cc:2410] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 26 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:20:36.781565 19476 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:36.729063 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4122) took 1079 ms. Trace:
I20260709 13:20:36.715945 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35102 (request call id 608) took 1133 ms. Trace:
I20260709 13:20:36.782831 19583 rpcz_store.cc:276] 0709 13:20:35.582996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.585405 (+  2409us) service_pool.cc:224] Handling call
0709 13:20:36.715730 (+1130325us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b54001fa754. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:36.715870 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268083584}
I20260709 13:20:36.758144 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:36.766675 26311 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.788157 26499 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:36.788460 26311 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:36.769107 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.789404 26435 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.790822 26311 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:36.795415 19476 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:36.797036 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:36.795490 19507 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:20:36.800024 19653 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:36.802939 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:36.804248 19509 raft_consensus.cc:2393] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:36.769802 26076 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:36.729084 25692 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:36.815647 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:36.770339 26270 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:36.721886 26096 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:36.707993 26524 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:36.773536 26227 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:36.664067 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:36.703688 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 78626.6us
I20260709 13:20:36.778635 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:36.779273 19657 raft_consensus.cc:606] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:36.823140 19657 raft_consensus.cc:614] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:20:36.783957 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 75269.4us
I20260709 13:20:36.823573 19627 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:36.783603 19508 rpcz_store.cc:276] 0709 13:20:35.666240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.969748 (+303508us) service_pool.cc:224] Handling call
0709 13:20:35.970097 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:36.095038 (+124941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.728672 (+633634us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400208ad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:36.728981 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266158336}
I20260709 13:20:36.824662 19587 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:36.817883 26270 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:36.775019 26525 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:36.716481 26432 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:36.787533 25575 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:36.787843 26439 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:36.842013 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:36.806772 19503 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:20:36.835865 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
W20260709 13:20:36.711872 26483 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.806s	user 0.005s	sys 0.001s
I20260709 13:20:36.815186 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:36.843708 19653 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:36.784627 19656 raft_consensus.cc:2368] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23.
I20260709 13:20:36.708058 25786 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.784598 19660 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:36.721331 26357 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.831431 19654 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:36.831979 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:36.826572 20631 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:20:36.850952 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:36.833523 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:36.703120 26521 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.726960 26495 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:36.815070 26342 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.817504 26523 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:36.837492 26270 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.822232 26125 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:36.834229 25579 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:36.817836 26440 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:36.702270 26445 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.704715 26513 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:36.814421 19582 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:36.842907 19476 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:36.852290 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:36.853245 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:36.880323 19508 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:36.847699 26439 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.880352 19507 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:36.861166 19653 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:36.861995 19512 raft_consensus.cc:2393] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 22: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:36.830996 26433 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.866413 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:36.818161 26076 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.868366 19587 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:36.868808 26447 raft_consensus.cc:697] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:36.878122 19658 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:36.853689 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:36.880511 19478 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:36.894969 19478 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:36.894203 19505 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:36.833258 26520 consensus_queue.cc:1059] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:20:36.863844 26227 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:20:36.891809 26430 consensus_meta.cc:287] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.632s	user 0.012s	sys 0.000s
I20260709 13:20:36.926277 26430 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.926643 26401 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:36.927026 26401 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:36.927829 26401 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.928507 26430 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:36.869748 26533 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:36.886296 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 59863.1us
I20260709 13:20:36.914546 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:36.835796 26222 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:20:36.928999 26401 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:36.855993 26443 consensus_queue.cc:1059] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:20:36.878662 26454 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:36.907063 19627 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:36.909355 19511 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:36.865898 26143 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.911820 19512 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:20:36.915508 26447 consensus_queue.cc:237] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.917636 26521 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:36.886767 25579 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.918499 26491 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:36.844705 26524 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.922236 26520 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:36.968299 26520 raft_consensus.cc:697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:36.968461 19654 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:36.922617 26459 consensus_queue.cc:1059] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:36.924045 26519 consensus_queue.cc:237] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:36.871604 25732 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:20:36.886219 26439 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:36.873571 26495 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.872850 26357 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.880977 26523 raft_consensus.cc:697] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:36.968570 26529 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:20:36.929447 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 80156.5us
I20260709 13:20:36.964721 26454 raft_consensus.cc:697] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:36.933424 19658 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:36.905534 19508 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 25.
I20260709 13:20:36.935312 19507 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:36.894215 26522 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:36.991109 26522 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:36.991506 26522 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:36.991546 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:36.888708 26311 raft_consensus.cc:2764] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:20:36.992787 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:36.940227 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3460) took 2050 ms. Trace:
I20260709 13:20:36.993453 19507 raft_consensus.cc:2368] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22.
I20260709 13:20:36.929957 26270 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:36.931137 26440 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:36.875334 26342 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.932300 26456 raft_consensus.cc:2764] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:20:36.896703 26436 consensus_queue.cc:1059] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:20:36.966760 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:37.020526 19653 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 21: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:36.908424 25692 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:20:37.021757 26342 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:37.022460 26440 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:36.907142 26125 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:20:37.023365 26440 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:36.972617 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:37.025132 19654 raft_consensus.cc:2368] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23.
I20260709 13:20:36.896941 26433 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:36.957801 26448 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:36.933007 26499 consensus_queue.cc:1059] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:20:36.925777 26227 raft_consensus.cc:3055] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:37.067369 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:36.967324 26266 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:20:36.982977 26540 consensus_queue.cc:1059] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:36.985495 26445 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:36.987622 19510 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:36.880964 26348 raft_consensus.cc:2764] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election decision vote started in defunct term 22: won
I20260709 13:20:36.965073 26491 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:20:37.313180 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 418279us
I20260709 13:20:36.995780 26076 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:36.996006 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:36.997427 26495 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:36.998993 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:37.320583 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:36.999751 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:37.322218 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:37.323725 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:37.324499 19583 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:37.000468 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:37.001143 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:37.326196 19581 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:37.001884 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:37.002660 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:37.330046 19578 raft_consensus.cc:3060] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:37.002807 26357 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:36.990156 26446 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:20:36.960475 26143 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.006268 25786 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:37.352476 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:36.993669 19580 rpcz_store.cc:276] 0709 13:20:34.890279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.168794 (+278515us) service_pool.cc:224] Handling call
0709 13:20:35.169276 (+   482us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:35.177052 (+  7776us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.177087 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:35.215739 (+ 38652us) log.cc:844] Serialized 52 byte log entry
0709 13:20:35.712602 (+496863us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:35.712664 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.712756 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:36.711551 (+998795us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b2400099b48. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e4f39c4 00007f6c2e4f1acb 00007f6c2e6acdc9 00007f6c2e6aca55 00007f6c2e6ac09d 00007f6c312de10e 00007f6c312f588c 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221
0709 13:20:36.929420 (+217869us) raft_consensus.cc:1685] finished
0709 13:20:36.929446 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.940153 (+ 10707us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":23574,"spinlock_wait_cycles":12185472,"thread_start_us":416879,"threads_started":1,"wal-append.queue_time_us":532144}
I20260709 13:20:37.007047 26524 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:37.008057 26511 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.374783 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:36.991559 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:37.375561 19506 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:37.376201 19627 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:37.376816 19508 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:37.011405 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:37.012836 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:36.945091 26533 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:37.021785 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:37.378681 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:37.035930 19654 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:37.379468 19587 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 24: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:36.953662 19505 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:37.032835 26125 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.014436 26222 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.973261 26520 consensus_queue.cc:237] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.082643 26454 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:37.179837 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 336982us
I20260709 13:20:37.174546 20665 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:20:37.179244 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.187968 26525 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.085812 26342 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.179584 25579 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:37.182791 26433 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:37.199087 19655 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 29 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 28. Current term is 29. Ops: []
I20260709 13:20:37.320374 26439 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.200193 19660 raft_consensus.cc:1275] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:37.180573 26196 raft_consensus.cc:3055] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:37.067601 26227 raft_consensus.cc:740] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:37.182283 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:37.202653 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 235344us
I20260709 13:20:37.144805 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:37.138085 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4121) took 1488 ms. Trace:
I20260709 13:20:37.410705 19511 rpcz_store.cc:276] 0709 13:20:35.649352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.953751 (+304399us) service_pool.cc:224] Handling call
0709 13:20:36.286667 (+332916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:36.949128 (+662461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:37.136810 (+187682us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b54002a9ed4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:37.137760 (+   950us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54002a9ed0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:37.137994 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2134116864}
W20260709 13:20:37.244901 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.298218 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:37.417726 19503 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:37.418772 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:37.419903 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:37.298972 19659 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26. Ops: [25.13-25.13]
I20260709 13:20:37.298297 19661 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 13:20:37.422814 19661 pending_rounds.cc:85] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 10
I20260709 13:20:37.423072 19661 pending_rounds.cc:107] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:20:37.423291 19661 raft_consensus.cc:2889] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:36.994148 26523 consensus_queue.cc:237] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.315272 19652 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:37.203778 26543 raft_consensus.cc:3055] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:20:37.313728 26549 log.cc:927] Time spent T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:20:37.344112 19581 raft_consensus.cc:2468] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:37.327773 26536 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.333690 26459 raft_consensus.cc:3055] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:37.318990 26491 raft_consensus.cc:3060] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:37.427220 26543 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:37.355645 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:37.380939 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:37.389916 26125 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.446156 19579 raft_consensus.cc:2368] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22.
I20260709 13:20:37.445966 26543 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.334218 26042 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.446007 19580 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 16.
I20260709 13:20:37.447602 26042 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.408758 26196 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:37.409225 26342 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.450250 19508 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:20:37.451128 26542 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:20:37.451465 19582 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:37.453061 26143 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:37.454056 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:37.454902 19660 raft_consensus.cc:2393] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 17: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:37.384533 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:37.388568 19583 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:37.456099 19584 raft_consensus.cc:2368] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 22. Current term is 23.
I20260709 13:20:37.390754 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:37.456794 19587 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
W20260709 13:20:37.447660 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:37.457675 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:37.458055 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.458210 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:37.460098 19652 raft_consensus.cc:1240] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 13:20:37.461229 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:37.461921 19659 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:37.449311 26196 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.447599 26125 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:37.463384 26196 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:37.468983 26227 consensus_queue.cc:260] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:37.470819 26227 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:37.472199 26555 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.390851 19476 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:37.399032 19506 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:20:37.437541 26459 raft_consensus.cc:740] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:37.406112 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:37.478910 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 72898.6us
I20260709 13:20:37.478372 26459 consensus_queue.cc:260] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.480295 26459 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:37.481175 26096 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:37.425660 19507 raft_consensus.cc:1275] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:20:37.482007 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 98205.1us
I20260709 13:20:37.426554 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:37.482921 19654 raft_consensus.cc:1240] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:20:37.484280 19627 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:37.395740 19409 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 57) took 12586 ms (client timeout 15000 ms). Trace:
I20260709 13:20:37.485920 19509 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 26: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:37.399580 26272 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:37.426258 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:37.447068 26543 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:37.499948 19625 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:37.501116 19625 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:37.453855 26143 consensus_queue.cc:1059] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:37.381134 19578 raft_consensus.cc:2468] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:37.473235 26499 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.473944 25871 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.474411 25786 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.474654 19582 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 25.
I20260709 13:20:37.427752 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:37.522859 19581 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:37.430447 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:37.486876 19627 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:37.490305 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 99534.2us
I20260709 13:20:37.398116 26222 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:37.470957 26401 consensus_meta.cc:287] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.001s
I20260709 13:20:37.488797 19478 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:20:37.526321 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 127249us
I20260709 13:20:37.506500 26521 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:37.511731 26554 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:37.428550 26547 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.525359 19476 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:37.527772 19478 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:37.528213 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:37.393947 26511 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.547533 19476 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:37.538540 19478 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:37.535430 19625 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:37.536435 26521 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
W20260709 13:20:37.545982 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 59172.1us
I20260709 13:20:37.550208 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:37.572685 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:37.553023 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:37.524538 25692 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:37.539731 26204 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:37.591257 26204 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.591638 26204 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:37.539249 26544 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:37.525038 25871 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.594030 26521 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.595875 25871 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:37.572840 26446 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:37.597229 26494 log.cc:927] Time spent T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:20:37.598995 26439 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:37.599646 26439 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:37.580588 26524 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:37.602034 26524 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:37.602398 26524 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:37.606609 26511 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:37.607095 26266 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:37.607522 26266 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.577991 26096 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:37.607914 26266 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:37.609551 26272 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:20:37.484931 19409 rpcz_store.cc:269] 0709 13:20:24.753456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.753711 (+   255us) service_pool.cc:224] Handling call
0709 13:20:25.090741 (+337030us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b5400002210. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e6360b2 00007f6c375afa89 00007f6c37547da6 00007f6c37519088 00007f6c3761737e 00007f6c35ad82a4 00007f6c35ad8232 00007f6c35ad8161 00007f6c35ad80dc
0709 13:20:37.339357 (+12248616us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:34.379903 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:34.535778 (+155875us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:34.535832 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:20:34.535866 (+    34us) tablet.cc:662] Decoding operations
0709 13:20:34.536534 (+   668us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:34.536618 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:34.536646 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:20:34.537140 (+   494us) tablet.cc:701] Row locks acquired
0709 13:20:34.537191 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:20:34.537357 (+   166us) write_op.cc:270] Start()
0709 13:20:34.537531 (+   174us) write_op.cc:276] Timestamp: P: 1783603234537292 usec, L: 0
0709 13:20:34.537568 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:20:34.538269 (+   701us) log.cc:844] Serialized 1307 byte log entry
0709 13:20:34.885328 (+347059us) op_driver.cc:464] REPLICATION: finished
0709 13:20:35.208534 (+323206us) write_op.cc:301] APPLY: starting
0709 13:20:35.217494 (+  8960us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:35.220500 (+  3006us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:35.220631 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:35.475308 (+254677us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:35.475710 (+   402us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:20:35.475799 (+    89us) write_op.cc:312] APPLY: finished
0709 13:20:35.476241 (+   442us) log.cc:844] Serialized 41 byte log entry
0709 13:20:35.479393 (+  3152us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:35.479527 (+   134us) write_op.cc:454] Released schema lock
0709 13:20:35.479607 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:35.480210 (+   603us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:35.480254 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1229580,"reported_tablets":6,"spinlock_wait_cycles":32184704,"child_traces":[["op",{"apply.queue_time_us":245010,"apply.run_cpu_time_us":9663,"apply.run_wall_time_us":310255,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16661,"num_ops":3,"prepare.queue_time_us":252530,"prepare.run_cpu_time_us":36023,"prepare.run_wall_time_us":299474,"raft.queue_time_us":114276,"raft.run_cpu_time_us":65623,"raft.run_wall_time_us":193747,"replication_time_us":347596,"thread_start_us":623199,"threads_started":4,"wal-append.queue_time_us":208174,"wal-append.run_cpu_time_us":7191,"wal-append.run_wall_time_us":1731771}]]}
I20260709 13:20:37.572644 26450 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:37.611322 26450 raft_consensus.cc:697] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:37.612098 26533 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:37.552064 26440 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:37.612322 26450 consensus_queue.cc:237] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.613250 26440 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:37.578464 19625 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:37.537333 26547 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.614210 26440 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.614825 25692 raft_consensus.cc:697] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:37.615702 26547 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:37.615759 25692 consensus_queue.cc:237] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.617798 19504 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26. Ops: [25.13-25.13]
I20260709 13:20:37.621944 19625 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:37.582090 19627 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:37.585135 26222 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:37.483796 26536 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:37.527199 25786 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.501969 26555 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:37.590397 26522 consensus_meta.cc:287] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.598s	user 0.017s	sys 0.000s
I20260709 13:20:37.532053 26540 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.663293 26540 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.530402 26143 consensus_queue.cc:1243] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 24.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 13:20:37.666438 26546 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.212s	user 0.003s	sys 0.000s
I20260709 13:20:37.666234 26522 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.668531 26522 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:37.525206 26499 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.669234 19512 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:37.660090 26544 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:37.669934 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:37.670688 26499 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:37.662683 25786 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:37.665557 26540 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:37.670650 26544 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:37.673228 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.675045 26557 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.670778 19586 raft_consensus.cc:2368] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22.
I20260709 13:20:37.644881 26512 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:20:37.677793 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 139332us
W20260709 13:20:37.682771 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 135324us
I20260709 13:20:37.685410 19476 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:37.678277 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 56500.9us
I20260709 13:20:37.698387 26519 consensus_queue.cc:1059] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
W20260709 13:20:37.679085 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 97080.3us
I20260709 13:20:37.648571 25732 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:20:37.692323 19586 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:20:37.683355 26540 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:37.703397 19627 leader_election.cc:400] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22.
I20260709 13:20:37.684815 26446 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:37.703716 19627 leader_election.cc:403] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:20:37.704103 19586 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:20:37.696388 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 123714us
I20260709 13:20:37.704551 19586 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:37.687889 26448 raft_consensus.cc:2804] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:37.710458 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:37.709455 19586 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.717072 19586 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:37.689975 26227 consensus_queue.cc:1059] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:20:37.706468 26512 raft_consensus.cc:697] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:37.719780 19476 leader_election.cc:400] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23.
I20260709 13:20:37.677981 26491 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:37.712528 26454 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.675617 26557 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.727200 19627 leader_election.cc:400] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 22. Current term is 23.
I20260709 13:20:37.728223 19627 leader_election.cc:403] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:20:37.730868 26499 consensus_queue.cc:1048] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:37.724493 25871 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22.
I20260709 13:20:37.732353 26448 raft_consensus.cc:697] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:37.735817 26448 consensus_queue.cc:237] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.739930 19507 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 28 index: 15. Preceding OpId from leader: term: 29 index: 15. (term mismatch)
I20260709 13:20:37.740409 19507 pending_rounds.cc:85] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 14
I20260709 13:20:37.740645 19507 pending_rounds.cc:107] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 28.15
I20260709 13:20:37.740887 19507 raft_consensus.cc:2889] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:37.741271 19503 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:37.741894 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:37.714898 26222 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:37.743148 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:37.744253 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:37.744899 19507 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:20:37.747331 19627 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:37.747910 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:37.748435 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:37.749233 19506 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
W20260709 13:20:37.753849 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 43488.7us
I20260709 13:20:37.754618 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:37.747742 25692 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 22. Current term is 23.
I20260709 13:20:37.747210 25871 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.758605 25871 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.761785 19625 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:37.762652 26522 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:37.763151 25871 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:37.763692 25871 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:37.750433 26513 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:20:37.748886 26499 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:20:37.751864 26544 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:37.757011 26554 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:37.761364 26459 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:37.767027 26554 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.767493 26554 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:37.767783 26042 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:37.769308 26557 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:37.764046 25871 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.770252 26555 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:37.771773 26512 consensus_queue.cc:237] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.756418 26565 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:37.776490 26203 raft_consensus.cc:3055] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:37.776731 26491 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:37.776948 26203 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:37.777827 26561 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:20:37.747023 26454 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:37.770661 26550 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 13:20:37.771274 26536 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:37.785007 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 59022.6us
I20260709 13:20:37.787861 19476 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:37.771792 26342 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:37.759918 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:37.792277 26203 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.797183 26203 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:37.797504 26562 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:37.798362 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:37.810322 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 50475.9us
I20260709 13:20:37.811651 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:37.819504 26548 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:37.824633 26266 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.825575 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:37.826429 26562 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:37.782486 25871 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:37.827466 26562 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.803557 19476 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:37.769129 26524 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:37.837328 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.836948 26554 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.837765 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:37.844456 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:37.853864 19505 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:37.856176 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:37.846910 26445 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:37.845893 26348 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:37.865940 26454 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:37.869010 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:37.870007 19503 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 24.
I20260709 13:20:37.871042 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:37.874150 19503 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:37.874624 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:37.875358 19510 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 25: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:37.876137 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:37.876735 19510 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 25: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:20:37.879303 19477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.880892 19582 raft_consensus.cc:3055] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:20:37.881315 19582 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:37.885025 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:37.887101 20663 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 21 LEARNER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:37.888971 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:37.889667 19512 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:37.890722 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:37.890930 19625 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:37.891764 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3647) took 1278 ms. Trace:
I20260709 13:20:37.892131 19655 rpcz_store.cc:276] 0709 13:20:36.613928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.614084 (+   156us) service_pool.cc:224] Handling call
0709 13:20:36.614418 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:37.405477 (+791059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:37.891560 (+486083us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b540032b4d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:37.891710 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1343942528}
I20260709 13:20:37.894069 26524 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:37.845870 26554 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:37.852594 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:37.853179 26559 raft_consensus.cc:2764] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:37.895570 19583 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:37.897867 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:37.897470 26204 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.898459 19579 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
W20260709 13:20:37.901146 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.901974 19503 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 25.
I20260709 13:20:37.873481 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:37.872269 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:37.909464 19581 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 25.
I20260709 13:20:37.910331 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:37.915251 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:37.916033 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:37.916177 19654 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:37.916638 19658 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:37.916812 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:37.917377 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.917760 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:37.918242 19512 raft_consensus.cc:2393] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 18: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:37.918748 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:37.919531 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:37.919850 19656 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:37.920576 26270 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:20:37.920827 19627 leader_election.cc:400] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22.
I20260709 13:20:37.921229 19627 leader_election.cc:403] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:37.921950 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:37.922192 26554 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:37.922700 19505 raft_consensus.cc:2393] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 25: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:37.923003 25579 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:20:37.889482 26266 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:37.917431 19661 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:37.922647 26554 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.877393 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:37.926630 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:37.917652 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:37.933241 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:37.934079 19661 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 26: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:37.934928 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:37.935577 19659 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:37.856674 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:37.934113 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:37.937871 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:37.939005 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:37.940073 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:37.945528 19653 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 25: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:37.943468 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:37.906616 19582 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:37.958858 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:37.961083 19581 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:37.962234 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:37.963797 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:37.964705 19581 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:37.960428 19658 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:37.966990 26204 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:37.976432 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 119850us
I20260709 13:20:37.976658 19660 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:20:37.977421 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:37.955087 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:37.967399 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:37.980786 19652 raft_consensus.cc:2393] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:20:37.931928 26529 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:20:37.860719 26560 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:37.969878 20619 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:37.984297 19661 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:37.985376 19503 raft_consensus.cc:1275] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:20:37.986209 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:37.965739 26523 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.006s	sys 0.011s
I20260709 13:20:38.000340 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:37.952087 26348 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:38.008806 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:37.944197 26554 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:38.009078 19654 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:38.010818 19585 raft_consensus.cc:2468] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 25.
W20260709 13:20:38.011828 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:38.018638 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.021598 20631 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:20:37.983677 26433 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:38.003677 26523 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.006s	sys 0.012s
I20260709 13:20:38.000625 26448 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:38.033330 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:37.952438 26266 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:20:38.008666 26536 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:38.044047 19581 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:38.019367 26559 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:38.016865 26538 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:38.020221 26548 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:38.050467 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:38.051981 19551 leader_election.cc:400] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22.
I20260709 13:20:38.052238 19551 leader_election.cc:403] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:20:38.045089 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:38.053402 26569 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
W20260709 13:20:38.055488 19612 heartbeater.cc:646] Failed to heartbeat to 127.17.251.190:33289 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.251.190:33289 timed out after 15.000s (SENT)
I20260709 13:20:38.061110 26445 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:38.062713 26540 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:38.066596 26560 consensus_queue.cc:1059] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:38.106113 26540 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:38.106644 26560 raft_consensus.cc:3055] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:38.106770 26540 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:38.068061 26143 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.107676 26143 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.007916 26454 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:20:38.110898 26454 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:38.111253 26454 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:38.112166 26454 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.076234 26519 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22.
I20260709 13:20:38.077510 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:38.116000 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:20:38.077800 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.044409 26536 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.082401 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:38.123417 19585 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:38.084107 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:38.075481 25871 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:38.086788 26561 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:20:38.032274 26473 raft_consensus.cc:2804] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:38.046837 26565 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:38.121263 19586 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 14. (term mismatch)
I20260709 13:20:38.113411 26454 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:38.046087 26348 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:38.125047 19657 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 22: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:38.046415 26448 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:38.107146 26560 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:38.117019 26076 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:38.123013 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:38.127722 26519 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:38.039398 26557 consensus_queue.cc:1059] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 13:20:38.130752 19653 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26. Ops: [22.12-25.13]
I20260709 13:20:38.086126 26538 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.124346 26270 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.131742 19586 pending_rounds.cc:85] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 13
I20260709 13:20:38.158942 19586 pending_rounds.cc:107] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 24.14
I20260709 13:20:38.159265 19586 raft_consensus.cc:2889] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:38.159884 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3806) took 1155 ms. Trace:
I20260709 13:20:38.160161 19586 rpcz_store.cc:276] 0709 13:20:37.004353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.703680 (+699327us) service_pool.cc:224] Handling call
0709 13:20:37.703987 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.159668 (+455681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.159833 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:38.149091 25871 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:38.161288 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:38.133512 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:38.135108 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 30 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:38.161813 19586 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:38.137069 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:38.162748 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:38.163841 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:38.140362 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:38.109860 26143 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:38.124097 26536 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:38.146548 19581 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:20:38.168789 25579 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22.
I20260709 13:20:38.126564 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:38.138137 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.139353 19627 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:38.169535 19585 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:38.170796 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:38.171859 25871 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:38.172225 25871 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:38.165149 19586 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:38.172544 25871 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:38.124965 26548 consensus_queue.cc:1059] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:20:38.179939 19581 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 18.
I20260709 13:20:38.143463 26473 raft_consensus.cc:697] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 25 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:38.183084 26143 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 22.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
W20260709 13:20:38.186153 26577 log.cc:927] Time spent T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:20:38.187086 26572 log.cc:927] Time spent T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:20:38.172066 26270 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.190339 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:38.191480 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:38.192523 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:38.193189 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:38.129820 26559 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:20:38.194574 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:38.195381 19578 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 22: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:38.196170 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:38.195833 26448 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.196872 26548 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:38.197434 26548 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:38.193248 19586 raft_consensus.cc:2410] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:20:38.170200 26519 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.200150 19578 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:38.203537 19627 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:38.206290 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:38.207954 19580 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:38.208513 26512 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:38.210561 26559 raft_consensus.cc:3055] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:38.210695 26547 raft_consensus.cc:3055] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:38.211045 26559 raft_consensus.cc:740] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:38.211129 26547 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:38.212028 26559 consensus_queue.cc:260] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.213267 26559 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:38.213066 26560 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.212028 26401 raft_consensus.cc:3055] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:20:38.214154 26401 raft_consensus.cc:740] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:38.214335 26560 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:38.214978 26401 consensus_queue.cc:260] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.215950 26401 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:38.173589 26436 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:38.217914 26436 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.218257 26436 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:38.218752 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:38.219555 26196 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:38.219925 26196 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.220250 26196 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:38.222052 26473 consensus_queue.cc:237] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:38.222880 25871 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.228441 19585 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 25.
I20260709 13:20:38.208526 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3820) took 1024 ms. Trace:
I20260709 13:20:38.230597 19580 rpcz_store.cc:276] 0709 13:20:37.184309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.207370 (+1023061us) service_pool.cc:224] Handling call
0709 13:20:38.207642 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.208268 (+   626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.208472 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:38.234244 26512 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:38.235909 19580 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:38.181124 26076 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.239674 26076 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:38.240301 26554 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.244287 26538 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:38.246176 19627 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:38.246469 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:38.246949 26548 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:38.247071 25575 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:38.247530 26548 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:38.248951 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:38.249239 26548 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:38.263854 26540 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.264851 26548 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:38.265492 19658 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:38.225292 26519 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:38.266889 26196 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.269037 26196 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:38.269874 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:38.253712 19660 raft_consensus.cc:1240] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 13:20:38.270511 19584 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:20:38.247694 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:38.277096 26554 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:38.265784 26548 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.10, Last appended by leader: 10, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.206272 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:38.278788 26548 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:38.279124 26342 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:38.279701 26342 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.259636 26536 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:38.291817 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 306245us
I20260709 13:20:38.293083 19476 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:38.294369 19476 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:38.294433 26536 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 26 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:38.295598 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:38.296777 19476 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:38.298231 25871 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:38.299345 26521 consensus_queue.cc:1059] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:38.299589 25575 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:38.300101 26521 consensus_queue.cc:1243] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:20:38.301096 26521 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:20:38.301177 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 51419.2us
I20260709 13:20:38.301887 26519 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.303295 26357 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:38.303994 26357 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:20:38.304266 26540 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:38.304605 26357 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:38.304833 26540 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:38.305200 26357 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.305788 26357 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:38.306036 26204 raft_consensus.cc:3055] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:38.306571 26204 raft_consensus.cc:740] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:38.307389 26204 consensus_queue.cc:260] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.308573 26204 raft_consensus.cc:3060] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:38.310030 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:38.305576 26540 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.310633 19507 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:38.310966 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3818) took 1127 ms. Trace:
I20260709 13:20:38.314049 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:38.316680 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:38.317360 19508 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 24
W20260709 13:20:38.319242 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.314757 19504 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
W20260709 13:20:38.320427 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 183471us
I20260709 13:20:38.327335 19655 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:38.329139 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:38.312036 19579 rpcz_store.cc:276] 0709 13:20:37.183585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.899104 (+715519us) service_pool.cc:224] Handling call
0709 13:20:37.899395 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:37.899563 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:37.994526 (+ 94963us) log.cc:844] Serialized 14 byte log entry
0709 13:20:38.310598 (+316072us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:38.310655 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:38.310699 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.310787 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:38.310921 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2212,"prepare.queue_time_us":178443,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":65487,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":408128,"threads_started":3,"wal-append.queue_time_us":193490}
I20260709 13:20:38.334218 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3507) took 1019 ms. Trace:
I20260709 13:20:38.334750 19509 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:38.331357 19478 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:20:38.336381 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 192540us
W20260709 13:20:38.338176 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.301455 26521 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:38.354149 26521 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:38.340849 19551 leader_election.cc:400] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23.
I20260709 13:20:38.355309 19478 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:38.355347 19551 leader_election.cc:403] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:20:38.342837 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.304569 26519 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:38.357810 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:38.343935 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 46371.9us
I20260709 13:20:38.367048 19507 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:38.340751 19580 rpcz_store.cc:276] 0709 13:20:37.314890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.235249 (+920359us) service_pool.cc:224] Handling call
0709 13:20:38.235569 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.332644 (+ 97075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.334150 (+  1506us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:38.312052 26459 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:38.336032 26436 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.380764 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:38.336081 26439 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:38.381068 19505 raft_consensus.cc:1275] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:38.348959 26342 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:38.352097 26525 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:38.352550 19503 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:20:38.382652 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:38.383841 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:38.320111 26348 raft_consensus.cc:493] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:38.378001 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 30 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:38.378983 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:38.347419 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:38.395223 19579 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:20:38.386942 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 49100.4us
I20260709 13:20:38.388203 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:38.387478 19505 raft_consensus.cc:1240] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26. Ops: [25.13-25.13]
I20260709 13:20:38.380527 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:38.397975 19509 raft_consensus.cc:2393] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 25: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:38.400103 19580 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:38.403324 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 48105.5us
I20260709 13:20:38.405241 19478 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:38.408175 19476 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:38.415012 19478 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:38.416801 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:38.420109 19508 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:20:38.372119 19584 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:38.421752 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 3817) took 1238 ms. Trace:
I20260709 13:20:38.422173 19584 rpcz_store.cc:276] 0709 13:20:37.183332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.456693 (+273361us) service_pool.cc:224] Handling call
0709 13:20:38.245556 (+788863us) spinlock_profiling.cc:243] Waited 9.65 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:20:38.421692 (+176136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22192512}
I20260709 13:20:38.382311 26524 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:38.432271 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:38.433187 19584 raft_consensus.cc:2368] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21.
I20260709 13:20:38.434406 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:38.435014 19584 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:38.438781 26555 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:38.439594 26555 consensus_queue.cc:1243] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer d56df3728fc04e37b2d29a3bcd91d167 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:38.439433 19625 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:38.442437 25871 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:38.442988 25871 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.443403 25871 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:38.445959 26196 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.446702 26196 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.447311 26436 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:38.401855 26227 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:20:38.450834 26196 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:38.383245 26439 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.453985 26439 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:38.459105 26540 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:38.460011 26540 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:38.410959 26445 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:38.410429 26348 raft_consensus.cc:515] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:38.400449 26519 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:38.428896 26559 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23.
I20260709 13:20:38.428400 26538 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.058s
W20260709 13:20:38.462059 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.466135 25871 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.489728 19584 raft_consensus.cc:2468] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
W20260709 13:20:38.500022 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 85085.5us
I20260709 13:20:38.520596 19584 raft_consensus.cc:1240] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:38.524950 25871 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:38.461588 26540 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:20:38.522629 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3517) took 1089 ms. Trace:
I20260709 13:20:38.482419 26443 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:38.508793 26342 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:38.534127 26586 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:20:38.520407 26585 consensus_queue.cc:1059] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:20:38.513546 26524 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:38.530804 19584 rpcz_store.cc:276] 0709 13:20:37.433525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.519989 (+1086464us) service_pool.cc:224] Handling call
0709 13:20:38.520395 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.522292 (+  1897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.522556 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:38.536790 26524 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.472728 26548 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 13:20:38.467147 26357 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.528559 26076 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:38.539413 26495 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.008s	sys 0.034s
I20260709 13:20:38.532040 26519 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:38.543169 26445 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:20:38.567687 20665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59442 (request call id 251) took 1564 ms. Trace:
W20260709 13:20:38.563357 26495 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.008s	sys 0.034s
I20260709 13:20:38.574257 19511 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 14. (term mismatch)
I20260709 13:20:38.574877 19511 pending_rounds.cc:85] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 13
I20260709 13:20:38.575181 19511 pending_rounds.cc:107] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 13:20:38.575482 19511 raft_consensus.cc:2889] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:38.588411 26357 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:38.618747 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.568475 20665 rpcz_store.cc:276] 0709 13:20:37.000834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.000996 (+   162us) service_pool.cc:224] Handling call
0709 13:20:37.001279 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:37.390682 (+389403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.565116 (+1174434us) spinlock_profiling.cc:243] Waited 86.4 ms on lock 0x7b54004e16d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:38.565383 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198630272}
I20260709 13:20:38.532816 26557 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:20:38.647933 25871 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:38.567109 26519 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.504606 19579 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 26.
I20260709 13:20:38.676465 19627 leader_election.cc:400] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21.
I20260709 13:20:38.676956 19627 leader_election.cc:403] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:20:38.677596 25871 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:38.678637 19627 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:38.649345 26560 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:38.702256 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 614) took 1243 ms. Trace:
I20260709 13:20:38.703055 19579 rpcz_store.cc:276] 0709 13:20:37.458694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.700266 (+1241572us) service_pool.cc:224] Handling call
0709 13:20:38.701223 (+   957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.701778 (+   555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:38.701819 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:38.701880 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:38.701931 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.702010 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:38.702174 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:38.686893 19580 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:20:38.706086 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35102 (request call id 615) took 1247 ms. Trace:
W20260709 13:20:38.664121 26432 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.010s	sys 0.014s
W20260709 13:20:38.722950 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 314873us
I20260709 13:20:38.706800 19579 rpcz_store.cc:276] 0709 13:20:37.459002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.704996 (+1245994us) service_pool.cc:224] Handling call
0709 13:20:38.705449 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.705686 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:38.705796 (+   110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:38.705842 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:38.705877 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.705931 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:38.706036 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:38.721294 25871 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21.
W20260709 13:20:38.732273 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.743984 19627 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:38.745785 25871 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:38.746387 25871 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:38.751861 19580 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:20:38.693992 26196 raft_consensus.cc:2804] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:20:38.719771 26582 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:20:38.733493 26538 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:38.693743 26204 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:38.774997 25871 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:38.736037 26432 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.010s	sys 0.014s
I20260709 13:20:38.780575 20631 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
W20260709 13:20:38.800439 26473 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.057s	sys 0.055s
I20260709 13:20:38.801733 25575 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.751200 26536 consensus_queue.cc:1048] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
W20260709 13:20:38.827308 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.833312 25575 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.817132 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:38.834666 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 54231.3us
W20260709 13:20:38.806593 26520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.330s	user 0.146s	sys 0.117s
I20260709 13:20:38.838231 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3824) took 1402 ms. Trace:
I20260709 13:20:38.837575 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3516) took 1424 ms. Trace:
I20260709 13:20:38.836203 26433 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:20:38.836261 26520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.359s	user 0.146s	sys 0.117s
I20260709 13:20:38.853080 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:38.839426 19584 rpcz_store.cc:276] 0709 13:20:37.436083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.537226 (+1101143us) service_pool.cc:224] Handling call
0709 13:20:38.670312 (+133086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.672938 (+  2626us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:38.719548 (+ 46610us) log.cc:844] Serialized 14 byte log entry
0709 13:20:38.837834 (+118286us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:38.837881 (+    47us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:38.837956 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.838061 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:38.838172 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3895,"prepare.queue_time_us":76143,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":3340,"thread_start_us":95572,"threads_started":1}
I20260709 13:20:38.854104 19508 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:20:38.841647 19578 rpcz_store.cc:276] 0709 13:20:37.413495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.287013 (+873518us) service_pool.cc:224] Handling call
0709 13:20:38.287263 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.287812 (+   549us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:38.663560 (+375748us) log.cc:844] Serialized 14 byte log entry
0709 13:20:38.837114 (+173554us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:38.837171 (+    57us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:38.837219 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.837294 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:38.837505 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47554,"prepare.queue_time_us":138597,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":4774,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":160,"thread_start_us":401790,"threads_started":2}
I20260709 13:20:38.856216 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:38.799798 26196 raft_consensus.cc:697] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:38.803164 25692 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:38.833389 26473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.061s	sys 0.059s
I20260709 13:20:38.858134 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:38.865957 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:38.870285 19578 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:38.873907 25575 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:38.875965 19508 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 26.
I20260709 13:20:38.877724 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:38.868602 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:38.809645 26439 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:38.873878 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 126090us
I20260709 13:20:38.888222 26439 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:38.820885 26204 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:38.891502 26204 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:38.885143 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:38.892953 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3815) took 1710 ms. Trace:
I20260709 13:20:38.895397 19584 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:20:38.893417 19578 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:38.895314 19504 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 21: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:38.895674 19583 rpcz_store.cc:276] 0709 13:20:37.182705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.896272 (+713567us) service_pool.cc:224] Handling call
0709 13:20:37.896584 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:37.896941 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:38.002479 (+105538us) log.cc:844] Serialized 14 byte log entry
0709 13:20:38.646613 (+644134us) log.cc:844] Serialized 14 byte log entry
0709 13:20:38.646752 (+   139us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:38.647656 (+   904us) log.cc:844] Serialized 26 byte log entry
0709 13:20:38.647820 (+   164us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:38.648129 (+   309us) log.cc:844] Serialized 14 byte log entry
0709 13:20:38.648333 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.648505 (+   172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:38.892675 (+244170us) raft_consensus.cc:1685] finished
0709 13:20:38.892707 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:38.892881 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68864,"prepare.queue_time_us":315879,"prepare.run_cpu_time_us":146,"prepare.run_wall_time_us":151,"raft.queue_time_us":10595,"raft.run_cpu_time_us":496,"raft.run_wall_time_us":81015,"thread_start_us":659619,"threads_started":4,"wal-append.queue_time_us":145386}
I20260709 13:20:38.913029 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3527) took 1001 ms. Trace:
I20260709 13:20:38.913653 19580 rpcz_store.cc:276] 0709 13:20:37.911537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.884602 (+973065us) service_pool.cc:224] Handling call
0709 13:20:38.911238 (+ 26636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.911704 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:38.911748 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:38.912640 (+   892us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:38.912696 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.912783 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:38.912947 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:38.922144 19584 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:38.923026 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3825) took 1010 ms. Trace:
I20260709 13:20:38.923419 19584 rpcz_store.cc:276] 0709 13:20:37.912307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.896189 (+983882us) service_pool.cc:224] Handling call
0709 13:20:38.921950 (+ 25761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.922746 (+   796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.922966 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:38.925014 19584 raft_consensus.cc:1275] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:20:38.925320 19551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.002s	sys 0.019s
W20260709 13:20:38.926913 19551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.003s	sys 0.019s
W20260709 13:20:38.925457 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 88558.2us
W20260709 13:20:38.927325 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 504059us
I20260709 13:20:38.930370 19583 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
I20260709 13:20:38.931162 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3827) took 1018 ms. Trace:
I20260709 13:20:38.931550 19583 rpcz_store.cc:276] 0709 13:20:37.912756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.910135 (+997379us) service_pool.cc:224] Handling call
0709 13:20:38.929991 (+ 19856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.930881 (+   890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.931097 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:38.932818 19508 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:20:38.935802 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3821) took 1751 ms. Trace:
I20260709 13:20:38.936275 19585 rpcz_store.cc:276] 0709 13:20:37.184617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.229771 (+1045154us) service_pool.cc:224] Handling call
0709 13:20:38.230088 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.230599 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:38.309996 (+ 79397us) log.cc:844] Serialized 14 byte log entry
0709 13:20:38.935444 (+625448us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:38.935507 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:38.935553 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.935624 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:38.935744 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4015,"prepare.queue_time_us":142404,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":7129,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"thread_start_us":558552,"threads_started":2,"wal-append.queue_time_us":583648}
I20260709 13:20:38.938434 19585 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:38.872257 25692 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.941524 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:38.942400 19508 raft_consensus.cc:2393] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 19: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:38.944751 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:38.946556 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:38.947278 19508 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:38.931411 26589 log.cc:927] Time spent T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:20:38.954998 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:38.957463 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:38.958264 19659 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:38.957847 26196 consensus_queue.cc:237] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.962975 25692 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:38.963773 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:38.966003 26596 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:20:38.965759 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:38.969583 19583 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:38.972172 19508 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
W20260709 13:20:38.973583 26521 consensus_meta.cc:287] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.593s	user 0.008s	sys 0.005s
I20260709 13:20:38.983055 26521 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:38.944788 26525 consensus_meta.cc:287] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.000s
I20260709 13:20:38.987033 26342 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.987699 26342 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:38.989362 19506 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:20:38.989753 19506 pending_rounds.cc:85] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 11
I20260709 13:20:38.989984 19506 pending_rounds.cc:107] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 20.12
W20260709 13:20:38.974516 26590 log.cc:927] Time spent T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:20:38.979393 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:38.980443 19507 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:38.980628 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:38.975204 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:38.990214 19506 raft_consensus.cc:2889] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:38.965456 26599 log.cc:927] Time spent T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:20:38.957538 26519 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:38.944972 26520 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:20:39.011144 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:39.027611 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:39.017719 19584 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 24: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:38.997118 19661 raft_consensus.cc:1240] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:20:39.031919 19583 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:39.033097 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:39.033994 19652 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:39.034089 19583 raft_consensus.cc:2410] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 27 because replica has last-logged OpId of term: 25 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:20:38.991551 26611 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:39.041854 19656 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:39.044062 19660 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26. Ops: [25.13-25.13]
I20260709 13:20:39.043985 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:38.997368 26521 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:39.047240 19583 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:20:39.046291 26597 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:20:39.050271 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3828) took 1087 ms. Trace:
I20260709 13:20:39.050726 19580 rpcz_store.cc:276] 0709 13:20:37.964333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.915005 (+950672us) service_pool.cc:224] Handling call
0709 13:20:38.935659 (+ 20654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:38.950789 (+ 15130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:38.950826 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:38.968994 (+ 18168us) log.cc:844] Serialized 26 byte log entry
0709 13:20:39.033131 (+ 64137us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:39.033175 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:39.033253 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:39.050056 (+ 16803us) raft_consensus.cc:1685] finished
0709 13:20:39.050077 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:39.050212 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4303,"raft.queue_time_us":9747,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":10844,"thread_start_us":35589,"threads_started":1,"wal-append.queue_time_us":66449}
I20260709 13:20:39.060384 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:39.091133 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.045781 26611 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:39.094888 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.095800 26611 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:39.100014 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:39.100893 19661 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 25: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:39.045425 26614 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
W20260709 13:20:39.135800 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 75507.7us
I20260709 13:20:39.136722 19551 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:39.136875 19583 raft_consensus.cc:1275] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:20:39.138674 26609 log.cc:927] Time spent T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:20:39.139951 19583 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:20:39.142302 19583 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:39.142983 19580 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21. Ops: [18.12-20.13]
I20260709 13:20:39.136801 26519 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:20:39.144481 19583 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
W20260709 13:20:39.145031 26613 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:20:39.146013 19655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 3657) took 1231 ms. Trace:
I20260709 13:20:39.146427 19655 rpcz_store.cc:276] 0709 13:20:37.914107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.917401 (+  3294us) service_pool.cc:224] Handling call
0709 13:20:39.145845 (+1228444us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54001ecb54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:39.145953 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":766722304}
W20260709 13:20:39.150285 26615 log.cc:927] Time spent T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:20:39.154994 26612 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:39.155169 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3512) took 1781 ms. Trace:
I20260709 13:20:39.155529 26612 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:39.155357 19580 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:20:39.155644 19586 rpcz_store.cc:276] 0709 13:20:37.373987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.279413 (+905426us) service_pool.cc:224] Handling call
0709 13:20:38.279800 (+   387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:38.280441 (+   641us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:38.332082 (+ 51641us) log.cc:844] Serialized 14 byte log entry
0709 13:20:38.709200 (+377118us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:38.710049 (+   849us) log.cc:844] Serialized 52 byte log entry
0709 13:20:38.710258 (+   209us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:38.749988 (+ 39730us) log.cc:844] Serialized 14 byte log entry
0709 13:20:38.767227 (+ 17239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.767329 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:39.154883 (+387554us) raft_consensus.cc:1685] finished
0709 13:20:39.154904 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:39.155101 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85437,"prepare.queue_time_us":140455,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":117892,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":30883,"spinlock_wait_cycles":46866176,"thread_start_us":273705,"threads_started":1,"wal-append.queue_time_us":380603}
I20260709 13:20:39.159428 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:39.160166 19655 raft_consensus.cc:2393] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:39.160478 19658 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:20:39.161070 19655 raft_consensus.cc:1240] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:39.153324 26076 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:39.170997 19658 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:20:39.156085 26612 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:39.172698 19658 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:39.172168 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:39.172274 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:39.144456 26586 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:39.176690 19586 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:39.181088 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:39.180987 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:39.182734 19658 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:39.187143 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:39.187875 19509 raft_consensus.cc:3060] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:39.185897 26614 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.182209 26076 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:39.190120 26614 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.190789 26076 raft_consensus.cc:697] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:39.191668 26076 consensus_queue.cc:237] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.192325 26614 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:39.177562 26401 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:20:39.197803 19578 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:39.177795 26519 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:20:39.174224 26557 consensus_queue.cc:1059] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:20:39.201165 26557 raft_consensus.cc:3055] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:39.201534 26557 raft_consensus.cc:740] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:39.202380 26557 consensus_queue.cc:260] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.203567 26557 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:39.204680 26270 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:39.212675 26525 consensus_queue.cc:1059] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:39.213536 26525 consensus_queue.cc:1243] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 24.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:20:39.214079 26525 consensus_queue.cc:1059] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:39.214763 26525 consensus_queue.cc:1243] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:39.217145 19509 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:39.242092 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:39.214298 26612 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:39.256297 26562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.375s	user 0.009s	sys 0.015s
I20260709 13:20:39.262665 19658 raft_consensus.cc:2468] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:20:39.266067 26525 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:39.273325 19551 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:39.273897 26525 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.234748 26521 raft_consensus.cc:3055] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:39.273016 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:39.234921 26439 raft_consensus.cc:3055] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:39.281140 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:39.272576 26562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.391s	user 0.009s	sys 0.016s
I20260709 13:20:39.296425 26562 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:39.297318 26562 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:39.298132 19503 raft_consensus.cc:1240] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26. Ops: [25.13-25.13]
I20260709 13:20:39.274403 26565 raft_consensus.cc:2804] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:39.299412 26565 raft_consensus.cc:697] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:39.300333 26565 consensus_queue.cc:237] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.276093 26448 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.302029 26448 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.302700 26562 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:39.304169 26448 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:39.307185 26348 leader_election.cc:290] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:39.307324 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:39.308527 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:39.309207 19658 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:39.309698 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:39.310415 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:39.311115 19658 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:20:39.312426 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:39.276319 26521 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:39.314338 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3842) took 1180 ms. Trace:
I20260709 13:20:39.314636 26521 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.315825 19476 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:39.316684 26562 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:39.317195 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:39.317502 26562 raft_consensus.cc:697] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:39.317829 19583 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:39.314704 19585 rpcz_store.cc:276] 0709 13:20:38.134309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.939272 (+804963us) service_pool.cc:224] Handling call
0709 13:20:38.939569 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:38.953581 (+ 14012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:38.954427 (+   846us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:38.975617 (+ 21190us) log.cc:844] Serialized 26 byte log entry
0709 13:20:39.164859 (+189242us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:39.176582 (+ 11723us) log.cc:844] Serialized 14 byte log entry
0709 13:20:39.176793 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:39.176860 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:39.314109 (+137249us) raft_consensus.cc:1685] finished
0709 13:20:39.314130 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:39.314284 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13614,"prepare.queue_time_us":13009,"raft.queue_time_us":18026,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":10778,"spinlock_wait_cycles":4761856,"thread_start_us":132057,"threads_started":1,"wal-append.queue_time_us":212041}
I20260709 13:20:39.322754 19585 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:39.322644 19478 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:39.324817 26456 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:39.325336 26456 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.325706 26456 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:39.325901 26443 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:39.326975 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:39.325706 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b49831037b480f8eda4069cf653878" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:39.328523 26338 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:39.328917 26338 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.329241 26338 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:39.329200 26432 consensus_queue.cc:1048] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:39.330224 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:39.330760 19653 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:39.333825 26270 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:39.223483 26204 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:20:39.338574 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:39.339169 19553 leader_election.cc:304] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:39.340291 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:39.342713 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:39.324714 19478 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:39.226310 26524 consensus_queue.cc:1059] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:20:39.345101 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:39.348948 19653 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:39.350558 25579 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:20:39.351260 26629 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:20:39.351317 19476 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:39.351891 19653 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:20:39.353004 25579 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:39.353211 19653 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:39.353837 25575 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:39.355803 19658 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:39.315915 26521 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:39.377386 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 52760.7us
I20260709 13:20:39.379519 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:39.368160 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.281250 26439 raft_consensus.cc:740] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:39.398507 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:39.348048 26447 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:39.347748 26598 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:39.347910 26519 raft_consensus.cc:2749] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:39.349124 26076 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:39.400287 19509 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:20:39.398286 19478 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:39.347350 26586 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:39.399418 19503 raft_consensus.cc:2368] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21.
I20260709 13:20:39.373399 26401 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:39.357527 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:39.428640 26447 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.432611 19655 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:39.433684 25692 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.434342 26338 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.435318 26076 consensus_queue.cc:1059] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:39.438551 26525 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:39.439751 26612 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:39.457901 26633 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:39.442929 26439 consensus_queue.cc:260] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.398372 26588 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:39.458823 26439 raft_consensus.cc:3060] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:39.459398 19580 raft_consensus.cc:2410] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:20:39.444097 26519 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.461226 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:39.462272 19587 raft_consensus.cc:2410] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:20:39.461916 26519 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:39.462740 19587 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 3816) took 2279 ms (client timeout 2371 ms). Trace:
I20260709 13:20:39.445079 26357 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:39.463143 19587 rpcz_store.cc:269] 0709 13:20:37.183041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.457569 (+274528us) service_pool.cc:224] Handling call
0709 13:20:38.269544 (+811975us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e635a22 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:20:39.461022 (+1191478us) spinlock_profiling.cc:243] Waited 42.9 ms on lock 0x7b5800047798. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635e9c 00007f6c2e635a5b 00007f6c3754ec09 00007f6c366a8ee0 00007f6c367720ab 00007f6c36772131 00007f6c367200a0 00007f6c3671f984 00007f6c2fc9a6d4 00007f6c2fc9a662
0709 13:20:39.462680 (+  1658us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117558400}
I20260709 13:20:39.464184 26519 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:39.463907 26357 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.457376 19653 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:39.466089 26357 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:39.399433 26348 consensus_queue.cc:1059] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:20:39.381999 26440 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:39.355428 26454 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.091s
I20260709 13:20:39.395452 26523 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:39.318692 26562 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.454169 25692 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:39.455790 26447 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:39.456545 26338 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:39.457717 26547 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.469327 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:39.519968 26547 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:39.468428 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 120115us
I20260709 13:20:39.526427 19627 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:39.484390 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:39.530699 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:39.452281 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 54071.9us
I20260709 13:20:39.533087 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:39.533851 26512 consensus_queue.cc:1059] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:39.534070 26632 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:39.534698 26632 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.535125 26632 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:39.535804 26512 raft_consensus.cc:3055] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:39.536197 26512 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:39.450284 26096 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:39.539816 26096 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:39.540629 26096 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.541800 26096 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:39.451133 26524 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:20:39.472129 26450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.680s	user 0.010s	sys 0.014s
I20260709 13:20:39.483330 26357 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:39.498183 26621 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:20:39.557984 19661 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 17: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:39.504827 26456 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.402580 26597 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.083s
W20260709 13:20:39.544365 19657 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 3663) took 1628 ms (client timeout 1621 ms). Trace:
W20260709 13:20:39.560165 19657 rpcz_store.cc:269] 0709 13:20:37.915892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.918512 (+  2620us) service_pool.cc:224] Handling call
0709 13:20:39.544050 (+1625538us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54001239d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:39.544274 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472728960}
W20260709 13:20:39.546648 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 195408us
I20260709 13:20:39.547500 19659 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:20:39.566215 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:39.567873 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:39.569077 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:39.571055 19657 raft_consensus.cc:1240] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
W20260709 13:20:39.547706 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:39.549012 19625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:39.552793 19627 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.251.130:36471 timed out after 2.371s (SENT) [suppressed 4 similar messages]
I20260709 13:20:39.556156 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:39.553265 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 154166us
I20260709 13:20:39.576792 19508 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
W20260709 13:20:39.578394 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.563882 19653 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 13:20:39.549875 26450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.758s	user 0.011s	sys 0.015s
I20260709 13:20:39.579509 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:39.580612 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:39.582213 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:39.591403 25871 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.591965 19625 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:39.591962 25871 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.593003 25579 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.593655 25579 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.595484 19655 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 23. Current term is 24. Ops: []
W20260709 13:20:39.596911 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.557547 26633 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:39.486850 26440 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.603694 19512 raft_consensus.cc:1240] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:20:39.605785 25579 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:39.537075 26512 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.584913 26544 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:39.573638 26524 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:39.556876 26525 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:20:39.559602 26357 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.607547 26203 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:39.608932 26533 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.615710 19625 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:39.618201 26565 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.613230 26633 raft_consensus.cc:697] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:39.599349 26454 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.600174 26495 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.560424 26204 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:20:39.572968 26523 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:20:39.629695 25579 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:39.634136 26648 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:39.635689 19579 raft_consensus.cc:1275] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:20:39.621426 25871 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:39.638258 19579 pending_rounds.cc:85] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 9
W20260709 13:20:39.608397 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 52683.2us
I20260709 13:20:39.638616 19579 pending_rounds.cc:107] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:20:39.638954 19579 raft_consensus.cc:2889] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:39.640640 19579 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:39.625742 26544 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.643880 26544 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:39.644704 19653 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:39.646272 25579 raft_consensus.cc:697] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:39.647116 25579 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.10, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.648268 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3844) took 1290 ms. Trace:
I20260709 13:20:39.648653 19584 rpcz_store.cc:276] 0709 13:20:38.357506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.035245 (+677739us) service_pool.cc:224] Handling call
0709 13:20:39.036228 (+   983us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:39.037162 (+   934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:39.037208 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:39.037978 (+   770us) log.cc:844] Serialized 26 byte log entry
0709 13:20:39.260473 (+222495us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:39.286583 (+ 26110us) log.cc:844] Serialized 14 byte log entry
0709 13:20:39.287624 (+  1041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:39.289464 (+  1840us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:39.648039 (+358575us) raft_consensus.cc:1685] finished
0709 13:20:39.648066 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:39.648204 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8081,"prepare.queue_time_us":21244,"raft.queue_time_us":7366,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":2028,"spinlock_wait_cycles":13454592,"thread_start_us":222091,"threads_started":1,"wal-append.queue_time_us":242966}
I20260709 13:20:39.626428 26525 consensus_queue.cc:1243] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer 2cfd02601ea44976833027665abc93bf log is divergent from this leader: its last log entry 25.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:20:39.620388 26614 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:20:39.637167 26512 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:39.659068 19655 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:20:39.663707 26574 log.cc:927] Time spent T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 1.769s	user 0.004s	sys 0.003s
I20260709 13:20:39.665227 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3826) took 1752 ms. Trace:
I20260709 13:20:39.665654 19578 rpcz_store.cc:276] 0709 13:20:37.912543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.897182 (+984639us) service_pool.cc:224] Handling call
0709 13:20:38.897585 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:39.198341 (+300756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:39.664977 (+466636us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b5400267d54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:39.665167 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":689928960}
I20260709 13:20:39.669104 19586 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:39.651942 26338 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.637475 26533 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.683135 26639 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:39.682912 26523 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:39.646700 26565 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.646615 26454 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.646883 26495 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.692003 19508 raft_consensus.cc:2410] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:20:39.693812 25692 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:39.693552 26639 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.683957 26633 consensus_queue.cc:237] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.695160 26357 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:39.695859 26639 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:39.696014 26456 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:39.702550 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 149787us
I20260709 13:20:39.712257 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:39.713100 19579 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:39.713572 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:39.715745 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:39.715960 19578 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:20:39.716372 20665 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 16.
I20260709 13:20:39.717864 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:39.719317 19627 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:39.718385 19583 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:39.697300 26647 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:39.681695 26338 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.737171 19586 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:20:39.706986 26584 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:39.733182 26513 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:39.681006 26524 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.742415 26649 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:20:39.764545 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4198) took 1472 ms. Trace:
I20260709 13:20:39.765956 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:39.766233 19506 rpcz_store.cc:276] 0709 13:20:38.291641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.312193 (+ 20552us) service_pool.cc:224] Handling call
0709 13:20:38.312501 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.994034 (+681533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:39.764211 (+770177us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b54001cff54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:39.764456 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1555692288}
I20260709 13:20:39.751863 26584 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:39.782634 19507 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 25.
I20260709 13:20:39.760967 26513 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:39.783522 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 134208us
I20260709 13:20:39.784164 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:39.783880 26548 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:39.786546 19506 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 23: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:39.786754 26548 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.787618 26338 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:39.787918 26456 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:39.788470 26456 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.789777 19505 raft_consensus.cc:2410] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:20:39.787672 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:39.792414 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:39.772234 26440 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:39.797508 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:39.782420 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 143447us
I20260709 13:20:39.798996 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:39.790122 26513 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:39.788957 26548 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:39.747908 26647 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:39.802922 26645 log.cc:927] Time spent T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:20:39.807116 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:39.816900 19506 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:20:39.767400 26632 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.830296 26439 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 13:20:39.832273 26632 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:39.793296 26614 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:39.833160 26456 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:39.833252 26614 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.812392 19586 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:39.806409 26401 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:39.826874 26495 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:39.826416 26584 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:39.828646 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:39.829537 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:39.814935 19583 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:20:39.848395 19511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4201) took 1532 ms. Trace:
I20260709 13:20:39.836540 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:39.845662 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:39.974215 19511 rpcz_store.cc:276] 0709 13:20:38.316011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.318359 (+  2348us) service_pool.cc:224] Handling call
0709 13:20:38.318591 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.576091 (+257500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:39.848056 (+1271965us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b540003eb54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:39.848316 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":586646784}
I20260709 13:20:39.251829 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:39.975591 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:39.842232 19581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60808 (request call id 3529) took 1930 ms (client timeout 2071 ms). Trace:
I20260709 13:20:39.997638 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:20:39.997582 19581 rpcz_store.cc:269] 0709 13:20:37.912071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.083818 (+171747us) service_pool.cc:224] Handling call
0709 13:20:39.841833 (+1758015us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b54001fb154. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:39.842146 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51197312}
I20260709 13:20:39.950481 26143 raft_consensus.cc:3055] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:39.978700 19584 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:39.976270 19585 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:39.976293 19511 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 17.
W20260709 13:20:39.964435 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 163698us
I20260709 13:20:39.974880 19658 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:20:39.983127 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:40.006688 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:39.853958 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:39.876695 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:39.800122 26565 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:39.980633 26432 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:39.852756 26592 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 1.010s	user 0.003s	sys 0.000s
W20260709 13:20:39.838500 26652 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:20:39.851121 26640 log.cc:927] Time spent T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.198s	user 0.001s	sys 0.002s
I20260709 13:20:40.021729 26650 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.030588 26650 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:40.032074 19659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 3009) took 1053 ms. Trace:
I20260709 13:20:40.032505 19659 rpcz_store.cc:276] 0709 13:20:38.978903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.979049 (+   146us) service_pool.cc:224] Handling call
0709 13:20:39.545035 (+565986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:39.564350 (+ 19315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.031842 (+467492us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b54001239d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:40.032009 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1300721536}
I20260709 13:20:40.033020 26650 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:39.989756 26533 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:40.035120 26653 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.035727 26653 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.039984 19583 pending_rounds.cc:85] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 11
I20260709 13:20:40.040354 19583 pending_rounds.cc:107] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:20:40.040601 19583 raft_consensus.cc:2889] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:40.042052 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:40.041908 26657 consensus_queue.cc:1059] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:20:39.993176 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 185607us
I20260709 13:20:40.014536 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:40.044062 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:40.044551 19511 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:40.045810 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:39.860884 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:40.014370 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:40.036119 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 2965) took 1054 ms. Trace:
I20260709 13:20:40.043366 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:40.037271 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:40.048763 19503 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:20:40.048949 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:40.047824 19512 rpcz_store.cc:276] 0709 13:20:38.981980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.982146 (+   166us) service_pool.cc:224] Handling call
0709 13:20:38.982538 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:39.604148 (+621610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.035826 (+431678us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b54000fc654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:40.036057 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1421513600}
I20260709 13:20:40.003635 26143 raft_consensus.cc:740] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:40.052039 20666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59444 (request call id 243) took 1715 ms. Trace:
W20260709 13:20:40.052194 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 54659.5us
I20260709 13:20:40.052618 26143 consensus_queue.cc:260] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.053960 26143 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:39.981930 26401 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:20:40.061658 19581 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 22: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:40.029838 26342 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:40.009047 26633 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.052457 20666 rpcz_store.cc:276] 0709 13:20:38.336335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.336515 (+   180us) service_pool.cc:224] Handling call
0709 13:20:38.346601 (+ 10086us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:38.346977 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:38.347019 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:38.348203 (+  1184us) log.cc:844] Serialized 572 byte log entry
0709 13:20:38.668100 (+319897us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:38.668153 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.668244 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:39.851722 (+1183478us) spinlock_profiling.cc:243] Waited 9.72 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:20:40.044704 (+192982us) raft_consensus.cc:1685] finished
0709 13:20:40.044725 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:40.051957 (+  7232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22361344,"thread_start_us":319578,"threads_started":1,"wal-append.queue_time_us":470534}
I20260709 13:20:40.072870 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:40.074469 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:40.074994 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:40.077991 26633 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:40.084789 19511 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:20:40.084640 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:40.086954 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:40.089341 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 45347.1us
I20260709 13:20:40.067519 26548 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:40.092509 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:40.093410 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.846942 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:40.094632 19656 raft_consensus.cc:2393] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 23: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:40.101697 19584 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:40.104991 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:40.108455 19586 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24. Ops: [21.14-23.15]
I20260709 13:20:40.140082 19478 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:40.113479 26653 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:40.104862 26342 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:40.022676 26432 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.155383 26432 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:40.122246 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.161473 19584 pending_rounds.cc:85] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 12
I20260709 13:20:40.162009 19584 pending_rounds.cc:107] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 25.13
I20260709 13:20:40.162276 19584 raft_consensus.cc:2889] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:40.093357 26548 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.125495 19476 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:40.136960 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:40.144642 19586 pending_rounds.cc:85] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 11
I20260709 13:20:40.166129 19586 pending_rounds.cc:107] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 13:20:40.166435 19586 raft_consensus.cc:2889] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:40.147600 26523 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:40.169589 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 44171.9us
I20260709 13:20:40.163362 19503 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:40.133915 26614 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:40.114521 26639 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:20:40.133605 26643 consensus_queue.cc:1059] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:20:40.168711 26548 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:40.167876 26432 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.176920 26525 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:40.165169 26342 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.177362 26523 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.248771 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:40.249630 19578 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
W20260709 13:20:40.239681 26661 log.cc:927] Time spent T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:20:40.182860 26607 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:20:40.207991 26432 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.261408 26653 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:40.264561 26598 raft_consensus.cc:3055] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:40.264839 26523 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:40.264982 26598 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:40.265930 26598 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.269205 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 2967) took 1256 ms. Trace:
I20260709 13:20:40.269600 19507 rpcz_store.cc:276] 0709 13:20:39.013238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.014026 (+   788us) service_pool.cc:224] Handling call
0709 13:20:40.269052 (+1255026us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b5400183dd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:40.269151 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731834240}
I20260709 13:20:40.272007 19507 raft_consensus.cc:1275] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:20:40.272087 26548 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.243757 26513 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:40.277326 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:40.253063 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 73720.5us
I20260709 13:20:40.267208 26598 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:40.282176 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:40.285272 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:40.286000 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:40.287101 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:40.286046 19652 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:40.293926 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:40.295609 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:40.298429 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:40.305190 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:40.306638 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:40.307941 19583 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:40.307963 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:40.302150 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:40.314813 26671 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.315572 26671 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.320472 19659 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:20:40.320578 19476 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:40.326697 26548 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:40.334811 26432 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:40.335678 19578 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:20:40.336509 26342 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:40.307164 26587 raft_consensus.cc:3055] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:20:40.342730 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:40.314574 26639 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.318789 26473 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:40.313764 26547 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:40.355181 26547 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:40.356655 26668 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:20:40.322924 26538 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.340104 26643 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.352329 26473 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:40.360186 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:40.402143 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:40.347532 26342 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:20:40.358503 26669 log.cc:927] Time spent T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:20:40.345101 26587 raft_consensus.cc:740] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:40.409309 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:40.409560 19658 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:20:40.443627 19658 pending_rounds.cc:85] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 12
I20260709 13:20:40.444002 19658 pending_rounds.cc:107] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:20:40.444327 19658 raft_consensus.cc:2889] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:40.407676 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 44452.4us
W20260709 13:20:40.447803 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 209175us
I20260709 13:20:40.357965 26547 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:40.426201 19510 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:20:40.405411 26473 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:40.459853 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:40.409036 26342 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:40.353564 26639 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.476127 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:40.491684 19509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4212) took 1095 ms. Trace:
I20260709 13:20:40.491878 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:40.492848 19581 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:40.492290 19509 rpcz_store.cc:276] 0709 13:20:39.396748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.232153 (+835405us) service_pool.cc:224] Handling call
0709 13:20:40.242742 (+ 10589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:40.242989 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:20:40.243266 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 13:20:40.491324 (+248058us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:40.491379 (+    55us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:40.491430 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.491496 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:40.491623 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50425,"prepare.queue_time_us":1353,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":102287,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":11936,"thread_start_us":240800,"threads_started":2,"wal-append.queue_time_us":191192}
I20260709 13:20:40.405243 26538 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.407366 26643 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:40.473202 26342 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:40.490389 26547 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.532852 26607 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:20:40.538494 19509 raft_consensus.cc:1275] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
W20260709 13:20:40.540665 26674 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
W20260709 13:20:40.550324 26675 log.cc:927] Time spent T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:20:40.359203 26548 raft_consensus.cc:2955] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 11 to 14, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:40.555346 19625 leader_election.cc:400] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21.
W20260709 13:20:40.561077 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.523082 26513 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:20:40.570111 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 123225us
I20260709 13:20:40.526193 26671 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:40.565056 26673 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:20:40.563970 26522 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.503773 26587 consensus_queue.cc:260] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.620337 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:40.642252 26538 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:40.556264 26547 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.645187 26547 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:40.557929 26632 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:20:40.652995 19657 raft_consensus.cc:1275] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:40.619508 26459 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:40.605477 26513 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:20:40.657502 19478 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:40.618708 26536 consensus_queue.cc:1048] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 13:20:40.619128 26522 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.619740 26671 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:20:40.659391 26587 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:40.660878 26459 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:40.654809 26520 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.686550 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:40.690825 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:40.691723 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 134312us
I20260709 13:20:40.677734 26671 consensus_queue.cc:1243] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:20:40.726578 19582 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:40.727164 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:40.692639 19654 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
W20260709 13:20:40.681437 26143 consensus_meta.cc:287] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.004s
I20260709 13:20:40.698598 19625 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:40.691287 26203 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:40.703876 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:40.692744 26520 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.714995 26454 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:40.716594 26681 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:20:40.717056 26680 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.718631 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 4213) took 1318 ms. Trace:
I20260709 13:20:40.750553 19508 rpcz_store.cc:276] 0709 13:20:39.400428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.581993 (+181565us) service_pool.cc:224] Handling call
0709 13:20:40.718358 (+1136365us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400208ad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:40.718561 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250304896}
I20260709 13:20:40.719519 26643 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:20:40.719696 19504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 2956) took 2343 ms (client timeout 2322 ms). Trace:
I20260709 13:20:40.692091 26666 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:40.679508 26688 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:40.734877 19587 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:40.746141 19582 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 14. (term mismatch)
I20260709 13:20:40.760951 19582 pending_rounds.cc:85] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 13
I20260709 13:20:40.748500 25579 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:40.761580 19582 pending_rounds.cc:107] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 25.14
W20260709 13:20:40.749367 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 50892.8us
I20260709 13:20:40.751683 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:40.758482 19504 rpcz_store.cc:269] 0709 13:20:38.376098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.378692 (+  2594us) service_pool.cc:224] Handling call
0709 13:20:40.719389 (+2340697us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54001ef5d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:40.719571 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1143360384}
I20260709 13:20:40.747077 19658 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 24. Current term is 25. Ops: [22.12-24.13]
I20260709 13:20:40.761951 19582 raft_consensus.cc:2889] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:40.763363 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:40.729758 26639 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:40.766681 25579 consensus_queue.cc:1048] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:40.764295 19582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3814) took 3581 ms. Trace:
I20260709 13:20:40.772946 19582 rpcz_store.cc:276] 0709 13:20:37.182431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.880412 (+697981us) service_pool.cc:224] Handling call
0709 13:20:37.880748 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:40.726022 (+2845274us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b580065c3d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316b60aa 00007f6c31738447 00007f6c31750fe7 00007f6c317527de 00007f6c3175cb49 00007f6c3175d416 00007f6c31759d8f 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4
0709 13:20:40.763994 (+ 37972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.764242 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3112612224}
I20260709 13:20:40.777801 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:40.778779 19587 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 25.
I20260709 13:20:40.771950 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:40.782994 25579 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:40.783386 25579 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.783682 25579 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:40.768694 26311 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 26 current term: 26 is higher.
I20260709 13:20:40.792280 19625 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:40.793167 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 88010.2us
I20260709 13:20:40.795810 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:40.799772 19654 pending_rounds.cc:85] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 11
I20260709 13:20:40.801113 19654 pending_rounds.cc:107] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:20:40.801976 19654 raft_consensus.cc:2889] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:40.805145 19476 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:40.758682 26203 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:40.808559 19625 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:40.804108 25579 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.761912 26680 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.767323 26666 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:40.819731 26342 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.811156 20666 raft_consensus.cc:2955] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 11 to 14, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:20:40.796077 26676 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:20:40.842832 26708 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:40.843137 19625 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:40.843561 26708 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.849473 25579 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:40.886029 26697 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:40.886857 26697 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.888922 26647 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:40.889762 26687 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:40.890389 26687 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.890818 26687 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:40.893877 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:20:40.894274 26683 log.cc:927] Time spent T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:20:40.896900 19478 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:40.898070 26203 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:40.898516 26705 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:40.897897 26639 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:40.824047 26632 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:40.901456 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:40.901753 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 47303.6us
I20260709 13:20:40.865682 26454 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:40.850863 26671 consensus_queue.cc:1059] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:20:40.900003 26697 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:40.964047 26454 raft_consensus.cc:697] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:40.970428 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 65016.2us
I20260709 13:20:40.970891 26707 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:40.974169 26342 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:40.954097 26522 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:40.974946 26473 consensus_meta.cc:287] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.003s
W20260709 13:20:40.975098 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 67347.5us
I20260709 13:20:40.975373 26643 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:20:40.975117 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 73751us
I20260709 13:20:41.000291 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:40.977913 26703 log.cc:927] Time spent T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.068s	user 0.003s	sys 0.000s
I20260709 13:20:41.012723 26459 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:40.986615 26520 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.002372 26473 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:41.021064 26473 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.004626 26711 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:20:41.022663 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:41.021947 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:41.025800 20665 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:41.028674 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:41.029016 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:41.030517 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:40.988786 26697 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.056545 26697 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:41.053572 26687 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.059199 26697 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:41.059719 19511 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 17.
I20260709 13:20:41.032361 26522 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:20:41.051395 26694 log.cc:927] Time spent T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 13:20:41.052647 19478 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.062511 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4233) took 1291 ms. Trace:
I20260709 13:20:41.062973 19510 rpcz_store.cc:276] 0709 13:20:39.771724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.450703 (+678979us) service_pool.cc:224] Handling call
0709 13:20:40.455535 (+  4832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:40.471973 (+ 16438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:40.472009 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:40.485766 (+ 13757us) log.cc:844] Serialized 26 byte log entry
0709 13:20:40.733072 (+247306us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:40.733691 (+   619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.733771 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:41.062272 (+328501us) raft_consensus.cc:1685] finished
0709 13:20:41.062294 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:41.062452 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6449,"raft.queue_time_us":94764,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":204916,"threads_started":1,"wal-append.queue_time_us":261835}
I20260709 13:20:41.065371 19508 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:20:41.059194 26520 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:20:41.066802 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:41.066962 26520 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.067046 26643 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.067521 26520 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.067678 26643 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.070230 26562 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:41.070655 26562 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:41.071498 26562 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.072793 26562 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:41.073199 19510 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:20:41.073974 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:41.076203 26520 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.044293 26666 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.050923 26454 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.003032 26708 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:41.056949 26459 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:41.065769 26548 consensus_meta.cc:287] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.004s
W20260709 13:20:41.059921 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.061167 26680 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.077590 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:41.100190 19504 raft_consensus.cc:2393] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 25: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:20:41.078219 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.079434 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:41.100937 19507 raft_consensus.cc:1275] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 15. (term mismatch)
I20260709 13:20:41.052796 26698 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:41.102419 26708 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:41.102957 26708 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.101409 19506 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:41.101438 19507 pending_rounds.cc:85] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 14
I20260709 13:20:41.105489 19507 pending_rounds.cc:107] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 23.15
I20260709 13:20:41.105721 19507 raft_consensus.cc:2889] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:41.100215 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50822 (request call id 4203) took 1743 ms. Trace:
I20260709 13:20:41.106663 19505 rpcz_store.cc:276] 0709 13:20:39.357159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.357274 (+   115us) service_pool.cc:224] Handling call
0709 13:20:41.099896 (+1742622us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b5400207bd4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:41.100134 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779250432}
I20260709 13:20:41.107403 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.107677 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:41.108196 19653 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 17: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:41.081707 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:41.108845 19511 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:41.083189 20665 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:41.084914 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:41.036537 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.109855 19510 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:41.111418 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:41.112108 26203 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.114807 26203 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.116597 26710 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:41.117060 26203 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:41.024690 26633 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:41.094103 26522 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:41.114257 25579 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:41.118849 25579 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:41.092947 19478 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.122947 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.123812 19658 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:41.124372 19510 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
W20260709 13:20:41.111637 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 112999us
I20260709 13:20:41.120240 26584 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:41.128554 19478 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.130900 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.134775 19478 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.136615 26447 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:41.140568 26447 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.140767 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:41.141675 19656 raft_consensus.cc:2368] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23.
I20260709 13:20:41.140995 26447 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:41.146214 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.147310 19653 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 26.
I20260709 13:20:41.150993 26447 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.153395 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.161552 19511 raft_consensus.cc:1240] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:20:41.135852 26680 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:41.129587 26203 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:41.166208 26680 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:41.166491 26203 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.168190 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.168972 26203 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:41.126811 26687 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.133841 26643 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.172202 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.187322 19659 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:41.133524 26633 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:41.172892 19506 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:41.178185 26708 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:41.178728 26513 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:41.181777 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:41.183542 26710 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:41.171850 19478 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.184938 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4210) took 1806 ms. Trace:
I20260709 13:20:41.213552 19512 rpcz_store.cc:276] 0709 13:20:39.378376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.146155 (+767779us) service_pool.cc:224] Handling call
0709 13:20:40.173641 (+ 27486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:40.242121 (+ 68480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:40.242158 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:40.242209 (+    51us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:40.242261 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.184665 (+942404us) spinlock_profiling.cc:243] Waited 68.2 ms on lock 0x7b540012f554. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:41.184723 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:41.184874 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156962688}
I20260709 13:20:41.215567 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:41.222833 26632 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:41.223268 26632 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:41.223629 26632 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:41.221886 19627 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:41.192420 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:41.205842 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:41.241952 19511 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 26.
W20260709 13:20:41.243564 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 72024.2us
I20260709 13:20:41.243817 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.244367 19478 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.153475 26447 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.244885 26445 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:41.245261 26708 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:41.254885 19478 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.256527 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.254572 26203 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:20:41.254829 26450 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:41.257660 26447 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:20:41.260360 26658 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 1.177s	user 0.003s	sys 0.008s
I20260709 13:20:41.263500 19478 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.273604 26687 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:41.261440 26439 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:41.262897 26607 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:20:41.272187 26433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.430s	user 0.010s	sys 0.017s
I20260709 13:20:41.265545 26447 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:41.307520 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 80416.1us
I20260709 13:20:41.273758 19478 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.300261 26445 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:41.354148 19657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 3026) took 1379 ms. Trace:
I20260709 13:20:41.418838 19657 rpcz_store.cc:276] 0709 13:20:39.974956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.975097 (+   141us) service_pool.cc:224] Handling call
0709 13:20:39.975423 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:40.653509 (+678086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.353860 (+700351us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54002c79d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:41.354076 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1557217664}
W20260709 13:20:41.374221 26664 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 1.239s	user 0.000s	sys 0.004s
I20260709 13:20:41.385031 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:41.390019 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.396793 19581 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:41.400588 19505 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:20:41.423060 19658 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:41.405386 26606 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:20:41.408182 26665 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 1.168s	user 0.004s	sys 0.001s
W20260709 13:20:41.409096 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 226809us
W20260709 13:20:41.411185 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 324678us
W20260709 13:20:41.305730 26433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.464s	user 0.010s	sys 0.017s
I20260709 13:20:41.411845 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:41.437716 19625 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:41.316226 26447 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:41.317008 19627 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:41.439376 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 122512us
W20260709 13:20:41.413937 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 140268us
I20260709 13:20:41.417877 26538 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:20:41.417220 26662 log.cc:927] Time spent T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 1.284s	user 0.003s	sys 0.000s
I20260709 13:20:41.412129 26633 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:41.402297 19661 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59942 (request call id 586) took 1934 ms (client timeout 2187 ms). Trace:
W20260709 13:20:41.448292 19661 rpcz_store.cc:269] 0709 13:20:39.468350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.469013 (+   663us) service_pool.cc:224] Handling call
0709 13:20:41.402000 (+1932987us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b5400122ad4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:41.402215 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82677120}
I20260709 13:20:41.442096 19478 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.450531 19585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3547) took 1432 ms. Trace:
I20260709 13:20:41.451112 19585 rpcz_store.cc:276] 0709 13:20:40.018030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.018521 (+   491us) service_pool.cc:224] Handling call
0709 13:20:40.018801 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:40.018972 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:40.018991 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:40.049730 (+ 30739us) log.cc:844] Serialized 26 byte log entry
0709 13:20:40.109659 (+ 59929us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:40.109721 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.109817 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:41.405399 (+1295582us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:20:41.450098 (+ 44699us) raft_consensus.cc:1685] finished
0709 13:20:41.450131 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:41.450454 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3075328,"thread_start_us":59552,"threads_started":1,"wal-append.queue_time_us":132965}
I20260709 13:20:41.437198 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:41.444995 19658 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 25.
I20260709 13:20:41.457147 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:41.457962 20665 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 18: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:41.459172 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:41.465421 26454 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:41.468714 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3565) took 1150 ms. Trace:
I20260709 13:20:41.440320 26433 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 26 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:41.470036 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:41.435673 26606 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.464735 26445 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:41.454216 26633 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:41.469192 19586 rpcz_store.cc:276] 0709 13:20:40.318414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.318680 (+   266us) service_pool.cc:224] Handling call
0709 13:20:40.318977 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:40.319183 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:40.336824 (+ 17641us) log.cc:844] Serialized 14 byte log entry
0709 13:20:40.497434 (+160610us) log.cc:844] Serialized 14 byte log entry
0709 13:20:41.460864 (+963430us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b18002bc1e0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e5e7c0a 00007f6c37d27219 00007f6c2e66fa40 00007f6c2e66a4e4 00007f6c2e66a455 00007f6c31752060 00007f6c31764716 00007f6c31775287 00007f6c31775208
0709 13:20:41.461314 (+   450us) log.cc:844] Serialized 14 byte log entry
0709 13:20:41.461554 (+   240us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:41.461632 (+    78us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:41.461699 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.461808 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:41.468650 (+  6842us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":945242,"prepare.queue_time_us":26150,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":2336,"raft.queue_time_us":978386,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":13330,"spinlock_wait_cycles":17604608,"thread_start_us":160050,"threads_started":1,"wal-append.queue_time_us":265824}
I20260709 13:20:41.464306 26717 raft_consensus.cc:2764] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:20:41.481918 26445 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.469887 26586 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.481769 26454 raft_consensus.cc:697] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:41.501206 26584 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.501736 26454 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:41.501983 26584 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.502528 26311 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:41.503043 26311 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.504446 26584 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:41.484656 26727 log.cc:927] Time spent T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:20:41.485001 26499 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:41.505769 26587 raft_consensus.cc:493] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:41.506116 26597 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.506345 26587 raft_consensus.cc:515] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:41.506583 26597 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.508410 26597 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.508600 26587 leader_election.cc:290] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:41.508901 26597 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:41.509122 26587 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.485287 26513 consensus_queue.cc:1059] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:20:41.447048 26699 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:20:41.468520 26708 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:41.491132 19579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60800 (request call id 3873) took 1779 ms. Trace:
I20260709 13:20:41.528448 19579 rpcz_store.cc:276] 0709 13:20:39.711386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.713957 (+  2571us) service_pool.cc:224] Handling call
0709 13:20:39.714289 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:39.733908 (+ 19619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:39.733962 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:39.745345 (+ 11383us) log.cc:844] Serialized 26 byte log entry
0709 13:20:39.993351 (+248006us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:39.993411 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:39.993505 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:41.416692 (+1423187us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:20:41.486902 (+ 70210us) raft_consensus.cc:1685] finished
0709 13:20:41.486938 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:41.491029 (+  4091us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4467,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":15270,"spinlock_wait_cycles":62096768,"thread_start_us":216666,"threads_started":1,"wal-append.queue_time_us":333643}
I20260709 13:20:41.501114 26707 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:41.510313 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:41.483676 26728 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:20:41.505056 26311 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:41.516018 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.468887 26632 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.482262 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.509364 26597 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.510475 26445 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:41.539094 26606 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.542188 26536 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:41.543442 26632 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:41.545260 26513 raft_consensus.cc:3055] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:41.545714 26513 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:41.526991 26708 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:41.546550 26513 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.547147 26708 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:41.547814 26513 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:41.520203 26586 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.550675 19625 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:41.551563 26586 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.552186 25579 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:20:41.536731 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 58861.8us
W20260709 13:20:41.599867 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 73817.2us
I20260709 13:20:41.509569 26587 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:41.606338 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 53625.6us
I20260709 13:20:41.608086 19476 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:41.597483 26728 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:41.598707 26357 raft_consensus.cc:3055] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:41.618292 19476 leader_election.cc:400] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23.
I20260709 13:20:41.623241 19476 leader_election.cc:403] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:20:41.624343 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:41.618285 26728 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.619948 26649 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:41.632537 26445 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.635865 26587 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.628372 26728 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:41.640122 19503 raft_consensus.cc:1217] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Deduplicated request from leader. Original: 16.10->[17.11-20.13]   Dedup: 17.11->[18.12-20.13]
I20260709 13:20:41.640750 19503 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21. Ops: [17.11-20.13]
I20260709 13:20:41.633857 26597 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.608094 26499 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:20:41.627041 26521 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23.
I20260709 13:20:41.644428 26633 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.636106 26445 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.652858 19503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4211) took 2272 ms. Trace:
I20260709 13:20:41.653544 19503 rpcz_store.cc:276] 0709 13:20:39.380421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.172945 (+792524us) service_pool.cc:224] Handling call
0709 13:20:40.721138 (+548193us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:41.639929 (+918791us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b5400196f20. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c316d1dc0 00007f6c3175c1c0 00007f6c3175d231 00007f6c31759d8f 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c
0709 13:20:41.641096 (+  1167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.652567 (+ 11471us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54001ef5d0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:41.652771 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290630912}
I20260709 13:20:41.657492 19476 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.624835 26357 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:41.628296 26649 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.665993 26649 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:41.667732 19507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4226) took 2115 ms. Trace:
I20260709 13:20:41.668186 19507 rpcz_store.cc:276] 0709 13:20:39.551950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.272754 (+720804us) service_pool.cc:224] Handling call
0709 13:20:41.100477 (+827723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:41.106161 (+  5684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.667507 (+561346us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b5400207bd0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c317598ad 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:41.667665 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1902983424}
I20260709 13:20:41.661404 26521 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:41.670346 26521 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.670830 26521 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:20:41.673029 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 457553us
I20260709 13:20:41.673724 26585 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:41.672469 26728 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:41.674710 26702 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.767s	user 0.001s	sys 0.003s
I20260709 13:20:41.675397 26548 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:41.675855 26548 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.676048 26728 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:41.676302 26548 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:41.680171 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.673103 26459 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.682018 26459 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.682858 26560 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:41.683472 26560 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.684295 26459 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.685693 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:41.674388 26585 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.686465 26525 raft_consensus.cc:3055] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:41.686923 26525 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:41.687647 26440 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:41.687762 26585 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.688249 26440 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.687877 26525 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.688781 26440 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:41.689282 26525 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:41.689782 26076 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:41.690567 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:41.693367 26125 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:41.610379 26433 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:41.697932 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.699589 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:41.710757 19586 raft_consensus.cc:2410] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:20:41.688580 26585 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:41.700805 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:41.701537 19661 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 24. Current term is 25. Ops: [22.12-24.13]
I20260709 13:20:41.701920 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.712702 19657 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:41.713398 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:41.702775 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:41.703933 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:41.714561 19587 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:41.715669 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:41.704603 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:41.718257 19578 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 24: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:41.704739 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:41.700273 19659 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:20:41.712051 19585 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:20:41.720563 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:41.721249 19585 raft_consensus.cc:2368] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
I20260709 13:20:41.717128 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:41.722430 19582 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:41.723620 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:41.725940 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:41.726832 19581 raft_consensus.cc:2410] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
W20260709 13:20:41.717056 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 161323us
I20260709 13:20:41.726963 19580 raft_consensus.cc:2410] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 27 because replica has last-logged OpId of term: 25 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 12.
I20260709 13:20:41.729379 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:41.697366 26311 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:41.733538 19579 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 11. (term mismatch)
I20260709 13:20:41.743925 19579 pending_rounds.cc:85] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 10
I20260709 13:20:41.744256 19579 pending_rounds.cc:107] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 21.11
I20260709 13:20:41.744611 19579 raft_consensus.cc:2889] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:41.746109 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:41.746894 19579 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:41.748162 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:41.750506 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:41.737125 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:41.754051 19582 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:41.755185 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:41.749550 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:41.756611 19579 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 26.
I20260709 13:20:41.757776 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:41.758519 19579 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 17.
I20260709 13:20:41.759557 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:41.760600 19579 raft_consensus.cc:2410] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 27 because replica has last-logged OpId of term: 25 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 12.
I20260709 13:20:41.807183 19587 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:41.806978 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:41.725421 26076 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.725553 26125 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.808346 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:41.813355 19587 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:41.725198 26688 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.806607 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:41.816105 19509 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:41.811270 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:41.812374 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 83549.6us
I20260709 13:20:41.818944 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.744737 26342 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.820037 19506 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 23: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:41.825558 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.827849 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.807963 26499 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.829025 26125 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.833585 19587 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 25.
I20260709 13:20:41.661216 26445 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:41.789547 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:41.847491 19582 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:41.815552 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:41.744078 26584 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:41.814155 26560 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.853096 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:41.856967 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.766110 26143 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.761315 26311 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.863956 26311 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.811353 26076 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.858258 26357 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.866000 26447 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.867144 26357 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:41.867514 19504 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:41.762033 26440 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.815858 26519 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:20:41.876432 25579 raft_consensus.cc:697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:41.875010 19625 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:41.829464 26499 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.848860 26587 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:41.673678 26708 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.848718 26598 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:41.733373 26585 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.881431 25579 consensus_queue.cc:237] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.875837 26565 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:41.891173 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.829905 26342 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.818248 26688 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.899619 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:41.884909 26436 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:41.910351 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:41.911322 19659 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:41.915103 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:41.919790 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.876340 26143 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:41.947991 26143 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:41.885710 26584 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.951152 26584 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.953552 26708 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:41.877954 26649 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:41.956336 26649 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.966079 19503 raft_consensus.cc:2368] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
I20260709 13:20:41.967816 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:41.968645 26342 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.969475 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:41.970222 19510 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:41.970944 19407 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48840 (request call id 169) took 38956 ms (client timeout 15000 ms). Trace:
I20260709 13:20:41.974613 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.975135 19573 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eb38e2ac9064d3286fe2f20aeb2381c with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 13)) from {username='slave'} at 127.0.0.1:45038
I20260709 13:20:41.975629 19653 raft_consensus.cc:2410] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:20:41.977022 26633 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:41.981704 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:41.982810 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:41.983349 19504 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:20:41.983588 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.984089 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:41.984272 19652 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:41.984705 19504 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 17.
I20260709 13:20:41.985189 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.930123 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.985983 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556595dcbb8644d2a073cbc04a679832" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.985522 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:41.938621 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:41.989017 19655 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:41.935999 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:41.985843 19652 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:20:41.993517 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:41.995268 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.995390 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.997835 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.999331 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:41.999997 19661 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:41.886533 26632 consensus_queue.cc:1048] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 13:20:41.901424 26447 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:42.021343 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:42.002740 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:42.005383 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:41.926048 26436 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:41.925459 26598 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:42.002795 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:42.039232 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:42.040674 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:41.971338 19407 rpcz_store.cc:269] 0709 13:20:03.014318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.020168 (+  5850us) service_pool.cc:224] Handling call
0709 13:20:41.970730 (+38950562us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:28.381990 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:28.382765 (+   775us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:28.382816 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:20:28.382842 (+    26us) tablet.cc:662] Decoding operations
0709 13:20:28.600672 (+217830us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:28.600759 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:28.600803 (+    44us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:20:28.603783 (+  2980us) tablet.cc:701] Row locks acquired
0709 13:20:28.603816 (+    33us) write_op.cc:260] PREPARE: finished
0709 13:20:28.604052 (+   236us) write_op.cc:270] Start()
0709 13:20:28.604229 (+   177us) write_op.cc:276] Timestamp: P: 1783603228603969 usec, L: 0
0709 13:20:28.604262 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:20:28.663333 (+ 59071us) log.cc:844] Serialized 8756 byte log entry
0709 13:20:29.623612 (+960279us) op_driver.cc:464] REPLICATION: finished
0709 13:20:29.794685 (+171073us) write_op.cc:301] APPLY: starting
0709 13:20:29.801273 (+  6588us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:30.072751 (+271478us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:30.072848 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:30.794910 (+722062us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:31.016486 (+221576us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:20:31.062772 (+ 46286us) write_op.cc:312] APPLY: finished
0709 13:20:31.275597 (+212825us) log.cc:844] Serialized 196 byte log entry
0709 13:20:31.528269 (+252672us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:31.575736 (+ 47467us) write_op.cc:454] Released schema lock
0709 13:20:31.594750 (+ 19014us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:31.635325 (+ 40575us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:31.638004 (+  2679us) write_op.cc:454] Released schema lock
0709 13:20:31.819670 (+181666us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b180023d220. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e66d3f3 00007f6c2e66f7c1 00007f6c2e66f779 00007f6c2e66f709 00007f6c2e66f6d1 00007f6c2e66e9cd 000000000038f354 000000000038f199 00007f6c2e65083a
Metrics: {"mutex_wait_us":1447869,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":139998,"apply.run_cpu_time_us":58738,"apply.run_wall_time_us":1825176,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96043,"num_ops":22,"prepare.queue_time_us":424003,"prepare.run_cpu_time_us":20791,"prepare.run_wall_time_us":445420,"raft.queue_time_us":180618,"raft.run_cpu_time_us":22817,"raft.run_wall_time_us":267424,"replication_time_us":988673,"spinlock_wait_cycles":8822912,"thread_start_us":815170,"threads_started":5,"wal-append.queue_time_us":555176,"wal-append.run_cpu_time_us":15146,"wal-append.run_wall_time_us":2542835}]]}
W20260709 13:20:42.011945 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.926471 26565 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:42.030562 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:42.031342 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:42.057449 19504 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 29.
I20260709 13:20:42.020509 19653 raft_consensus.cc:2955] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 11 to 14, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:42.059237 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:42.061182 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:42.061669 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:41.992877 26584 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:42.002348 26519 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:42.053702 19655 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:41.986465 26440 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:42.062623 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:42.060352 19659 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:20:42.045737 19510 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:20:42.073133 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:42.074178 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.038005 26436 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:42.030037 26736 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:42.092777 19504 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 23. Current term is 25. Ops: []
I20260709 13:20:42.038456 26598 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:42.069890 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:42.117280 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 47504.9us
I20260709 13:20:42.120347 19551 leader_election.cc:304] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:42.124577 19661 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:42.130225 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:42.130857 20666 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:20:42.106702 19510 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:20:42.135821 19510 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:42.128494 26598 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:42.084022 26519 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.132128 26076 raft_consensus.cc:2749] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:42.150030 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:42.074975 26584 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.131896 26143 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:42.169037 26143 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.161738 26728 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 13:20:42.170275 26499 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:42.175179 26521 consensus_meta.cc:287] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.003s
I20260709 13:20:42.175647 26521 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.178428 19509 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 27: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:42.149117 26565 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:42.181818 26565 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.182256 26565 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:42.133401 26736 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.163003 26311 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:42.184432 26311 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:42.169421 26143 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:42.163823 26735 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:20:42.168365 26688 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:42.191733 26548 consensus_meta.cc:287] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.515s	user 0.005s	sys 0.004s
I20260709 13:20:42.192137 26548 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.197072 26459 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.197430 26125 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.197654 26459 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.198019 26125 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.185284 26311 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.10, Last appended by leader: 10, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.203361 26598 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.197412 26587 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:42.214165 19510 raft_consensus.cc:1275] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:42.222857 26521 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:42.236541 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 357355us
I20260709 13:20:42.259737 26076 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:42.275446 19625 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:42.278246 25579 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:42.263803 26584 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:42.278786 25579 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:42.295840 25579 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:42.291527 26519 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:42.291941 26737 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:42.293853 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:42.294379 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:42.265766 26560 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:42.298113 26076 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.304128 26076 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:42.304471 26436 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.305115 26560 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:42.305747 26525 consensus_meta.cc:287] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.002s
I20260709 13:20:42.307631 26560 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:42.309120 26585 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:42.309966 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:42.316025 19586 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 13:20:42.324628 25579 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.314055 26707 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:42.326056 26752 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:42.354032 26598 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:42.300529 26737 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.364542 26565 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.355846 26752 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:42.378108 26740 log.cc:927] Time spent T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.218s	user 0.000s	sys 0.002s
I20260709 13:20:42.378350 26736 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:42.380980 26732 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.319s	user 0.004s	sys 0.000s
I20260709 13:20:42.384512 26752 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:42.412959 19397 catalog_manager.cc:5028] TS 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): tablet 6eb38e2ac9064d3286fe2f20aeb2381c (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
W20260709 13:20:42.431504 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.432955 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:42.434510 19578 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:42.448467 19478 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:42.464833 19476 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:42.470407 19403 catalog_manager.cc:5697] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.473531 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:42.474821 19579 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 25.
I20260709 13:20:42.474865 19403 catalog_manager.cc:5697] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.476366 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:42.477550 19579 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:42.479424 19476 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:42.461215 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:42.486464 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:42.490662 19581 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:42.495604 19584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3557) took 2389 ms. Trace:
I20260709 13:20:42.500547 26586 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.501715 26586 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.502357 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:42.504073 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:42.505064 26586 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:42.496459 19584 rpcz_store.cc:276] 0709 13:20:40.106485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.141215 (+ 34730us) service_pool.cc:224] Handling call
0709 13:20:40.141582 (+   367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:40.163886 (+ 22304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:40.163924 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:40.164580 (+   656us) log.cc:844] Serialized 52 byte log entry
0709 13:20:41.383139 (+1218559us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b1800049a80. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa0d1 00007f6c31715a0f
0709 13:20:41.813294 (+430155us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:41.813338 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.813403 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:42.376958 (+563555us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:20:42.494857 (+117899us) raft_consensus.cc:1685] finished
0709 13:20:42.494923 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.495317 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1835,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8313,"spinlock_wait_cycles":54103808,"thread_start_us":429944,"threads_started":1,"wal-append.queue_time_us":1827499}
I20260709 13:20:42.512210 19654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56816 (request call id 3738) took 1716 ms. Trace:
I20260709 13:20:42.519887 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:42.516206 19580 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:42.505537 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:42.515954 26445 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:42.506527 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:42.513217 26440 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:42.522145 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:42.554072 26436 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:42.510130 26357 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.549710 26445 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:42.367321 26565 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:42.578370 26598 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:20:42.578732 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 59221.4us
I20260709 13:20:42.580206 26598 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:42.580332 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:42.580870 26598 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:42.581759 19627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.584033 19582 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:20:42.584250 26459 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:42.585067 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:42.586159 19660 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 25.
I20260709 13:20:42.586498 26357 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.523427 26204 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 13:20:42.592782 19579 raft_consensus.cc:2410] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 27 because replica has last-logged OpId of term: 25 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 12.
I20260709 13:20:42.599613 26587 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:42.538247 19654 rpcz_store.cc:276] 0709 13:20:40.795407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.798653 (+  3246us) service_pool.cc:224] Handling call
0709 13:20:40.799500 (+   847us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:40.803093 (+  3593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:40.803144 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:40.809033 (+  5889us) log.cc:844] Serialized 52 byte log entry
0709 13:20:41.678953 (+869920us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b180003f9a0. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e64fe07 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c312f420b 00007f6c312f9d23 00007f6c312fa0d1 00007f6c31715a0f
0709 13:20:42.012939 (+333986us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:42.012981 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.013070 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:42.377445 (+364375us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c312f586e 00007f6c312f4bb6 00007f6c312f47d8 00007f6c312fe221 00007f6c312fe1d9 00007f6c312fe169
0709 13:20:42.497889 (+120444us) raft_consensus.cc:1685] finished
0709 13:20:42.497936 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.511968 (+ 14032us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3850,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":14101,"spinlock_wait_cycles":27219456,"thread_start_us":333793,"threads_started":1,"wal-append.queue_time_us":1335223}
I20260709 13:20:42.571960 26445 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:42.581420 26598 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:42.608309 19653 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 27: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:42.350277 26707 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.622306 26357 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:42.515589 19403 catalog_manager.cc:5697] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 15 to 23. New cstate: current_term: 23 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:42.646217 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 66203.2us
I20260709 13:20:42.647370 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:42.650148 26707 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:42.650336 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:42.651186 26707 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:42.651854 19658 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 25: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:42.652204 26707 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.653729 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:42.653939 19627 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:20:42.654369 19581 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
W20260709 13:20:42.655871 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 64973us
I20260709 13:20:42.656004 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:42.656205 26196 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:42.656960 19652 raft_consensus.cc:2393] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 25: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:42.658043 26536 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:20:42.658394 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:42.659361 19655 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:42.660075 26125 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:42.612500 26440 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 25 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:42.663059 26440 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.667819 26737 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:42.669009 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:42.670964 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:42.672816 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:42.674574 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:42.678042 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 230128us
I20260709 13:20:42.682673 19625 leader_election.cc:400] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
I20260709 13:20:42.706368 19625 leader_election.cc:403] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:20:42.680598 19403 catalog_manager.cc:5697] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 19 to 24. New cstate: current_term: 24 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.719770 19578 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:42.633811 26432 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:42.735486 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:42.739082 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:42.750031 26196 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:42.750896 26196 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.753285 26196 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:42.753819 26125 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:42.754051 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:42.756443 26143 consensus_meta.cc:287] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.570s	user 0.008s	sys 0.012s
I20260709 13:20:42.750150 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:42.756520 26125 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.754566 19403 catalog_manager.cc:5697] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 15 to 18, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 18 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:42.759205 26125 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:42.757144 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:42.759676 19403 catalog_manager.cc:5697] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 14 to 21. New cstate: current_term: 21 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:42.763319 19509 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 13:20:42.763495 19587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3598) took 1018 ms. Trace:
I20260709 13:20:42.764067 19587 rpcz_store.cc:276] 0709 13:20:41.744670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.512715 (+768045us) service_pool.cc:224] Handling call
0709 13:20:42.513354 (+   639us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:42.570260 (+ 56906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:42.570291 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:42.590430 (+ 20139us) log.cc:844] Serialized 52 byte log entry
0709 13:20:42.694056 (+103626us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:42.694114 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.694215 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:42.763121 (+ 68906us) raft_consensus.cc:1685] finished
0709 13:20:42.763150 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.763329 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":249,"raft.queue_time_us":18911,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":208,"thread_start_us":81571,"threads_started":1,"wal-append.queue_time_us":156170}
W20260709 13:20:42.765166 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 117999us
I20260709 13:20:42.766594 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:42.768617 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:42.779968 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:42.780964 19503 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
W20260709 13:20:42.781973 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 51061.4us
I20260709 13:20:42.782423 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:42.782949 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:42.783779 19478 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:42.783913 19505 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
I20260709 13:20:42.785570 26767 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:42.733057 26586 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:42.785221 26432 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:42.790323 26432 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:42.785243 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 54691us
I20260709 13:20:42.792609 25579 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:42.796530 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:42.798557 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:42.801129 26459 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:42.812881 26125 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:42.793601 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:42.822124 26707 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:42.723498 26737 consensus_queue.cc:1059] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.099s
I20260709 13:20:42.829212 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:42.830497 19586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3596) took 1032 ms. Trace:
I20260709 13:20:42.830777 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:42.830914 19586 rpcz_store.cc:276] 0709 13:20:41.742558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.317077 (+574519us) service_pool.cc:224] Handling call
0709 13:20:42.317405 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:42.317756 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:42.509429 (+191673us) log.cc:844] Serialized 14 byte log entry
0709 13:20:42.686565 (+177136us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:42.692302 (+  5737us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:42.720277 (+ 27975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.735987 (+ 15710us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.775007 (+ 39020us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5235,"prepare.queue_time_us":30041,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":64940,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":28769,"thread_start_us":53677,"threads_started":1,"wal-append.queue_time_us":217758}
I20260709 13:20:42.833051 26548 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:42.835327 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:42.835747 19580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3578) took 1099 ms. Trace:
I20260709 13:20:42.836288 19580 rpcz_store.cc:276] 0709 13:20:41.736337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.166656 (+430319us) service_pool.cc:224] Handling call
0709 13:20:42.167046 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:42.563907 (+396861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.835420 (+271513us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b5400107a54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:42.835675 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":732943744}
I20260709 13:20:42.836983 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:42.838215 20665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59430 (request call id 251) took 1379 ms (client timeout 1607 ms). Trace:
W20260709 13:20:42.838701 20665 rpcz_store.cc:269] 0709 13:20:41.458847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.458954 (+   107us) service_pool.cc:224] Handling call
0709 13:20:42.837805 (+1378851us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b5400599054. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:42.838011 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504260352}
I20260709 13:20:42.841146 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:42.842449 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:42.832100 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:42.820354 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:42.857538 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 176114us
I20260709 13:20:42.757112 26143 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:42.859297 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 65958.6us
I20260709 13:20:42.869753 19580 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:42.862608 26311 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:20:42.868793 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:42.872136 26311 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:42.875283 26311 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:20:42.875803 26768 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:42.876294 26768 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.876658 26768 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:42.884061 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:42.871119 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:42.882205 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:42.888052 19655 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 25.
I20260709 13:20:42.892196 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:42.905063 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:42.863071 26707 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
I20260709 13:20:42.922119 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:42.927043 19511 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 27: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:42.924379 19478 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:42.922665 19508 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 25.
I20260709 13:20:42.925724 25575 raft_consensus.cc:3055] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:42.932973 25575 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:42.933128 19510 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 25.
I20260709 13:20:42.926003 26125 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:42.945971 19583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60808 (request call id 3593) took 1077 ms. Trace:
I20260709 13:20:42.943020 19587 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 24: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:42.761484 19403 catalog_manager.cc:5697] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 11 to 16, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 16 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:42.971688 26699 raft_consensus.cc:2764] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:20:42.962224 26737 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:42.958287 19583 rpcz_store.cc:276] 0709 13:20:41.741577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.308356 (+566779us) service_pool.cc:224] Handling call
0709 13:20:42.308682 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:42.308885 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:42.309166 (+   281us) log.cc:844] Serialized 14 byte log entry
0709 13:20:42.707295 (+398129us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:42.721477 (+ 14182us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:42.731285 (+  9808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.740228 (+  8943us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.818448 (+ 78220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7597,"prepare.queue_time_us":808,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":3598,"raft.queue_time_us":77854,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":18127,"thread_start_us":282492,"threads_started":1,"wal-append.queue_time_us":437353}
I20260709 13:20:42.982501 25575 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:42.991215 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 186404us
W20260709 13:20:42.993386 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 268328us
I20260709 13:20:43.004151 26445 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.004652 26311 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.006745 26445 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.007344 26311 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 30 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:43.009891 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 105584us
I20260709 13:20:43.012876 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:43.017877 26699 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.018518 25575 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:43.007428 26439 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:43.019428 19509 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:43.019767 26439 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:43.020159 26439 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:43.020416 26143 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.025101 19504 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:20:43.036319 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.046753 19627 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:43.018579 26699 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.061661 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:43.034317 26737 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:43.065919 19476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.042s	sys 0.119s
W20260709 13:20:43.070353 19476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.042s	sys 0.119s
W20260709 13:20:43.070639 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 577625us
I20260709 13:20:43.077468 26266 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:43.078172 26266 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:43.078722 26266 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:43.079597 19627 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:43.080303 26707 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:43.081744 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4267) took 1307 ms. Trace:
I20260709 13:20:43.082116 19506 rpcz_store.cc:276] 0709 13:20:41.752646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.821823 (+ 69177us) service_pool.cc:224] Handling call
0709 13:20:41.854092 (+ 32269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:42.593763 (+739671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:42.605280 (+ 11517us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:42.687839 (+ 82559us) log.cc:844] Serialized 26 byte log entry
0709 13:20:42.963940 (+276101us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:42.963986 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.967594 (+  3608us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.048229 (+ 80635us) raft_consensus.cc:1685] finished
0709 13:20:43.048259 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.059926 (+ 11667us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":595151,"raft.queue_time_us":656064,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":248,"thread_start_us":316865,"threads_started":2,"wal-append.queue_time_us":316109}
I20260709 13:20:43.082965 26598 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.084014 19627 leader_election.cc:400] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
I20260709 13:20:43.084307 19627 leader_election.cc:403] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:20:43.085233 26598 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.086122 26513 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
I20260709 13:20:43.087167 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:43.088132 26436 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:20:43.089121 19581 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:43.070098 26445 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:43.099118 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:43.102921 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:43.101341 19627 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:43.107975 26342 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:43.110728 26342 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:43.111245 26342 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:43.115473 26439 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.115934 26737 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:43.117717 26439 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.121829 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:43.127161 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 114416us
I20260709 13:20:43.088966 26454 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:20:43.047555 19403 catalog_manager.cc:5697] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 21 to 23, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 23 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:43.142588 19476 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:43.137533 26737 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:43.146332 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:43.147091 19476 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:43.147442 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 51103.6us
I20260709 13:20:43.139968 26311 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:20:43.149570 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 293701us
I20260709 13:20:43.155095 26688 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:20:43.163625 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 69631.4us
I20260709 13:20:43.151278 26311 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.173593 26778 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:43.174458 26778 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:43.175668 26778 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.167470 26688 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:43.177793 26447 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:43.178267 26447 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.178659 26447 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:43.178773 26688 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.183851 19657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 3047) took 1118 ms. Trace:
I20260709 13:20:43.184425 26311 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:43.184365 19657 rpcz_store.cc:276] 0709 13:20:42.065317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.068658 (+  3341us) service_pool.cc:224] Handling call
0709 13:20:42.068993 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:42.084618 (+ 15625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:42.084667 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:42.512969 (+428302us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b180008b900. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37535de1 00007f6c375425b1 00007f6c2e63b2a6 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a
0709 13:20:42.868126 (+355157us) spinlock_profiling.cc:243] Waited 8.37 ms on lock 0x7b2c0002b1b8. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c30053a11 00007f6c30063372 00007f6c31795a01 00007f6c3175a43a 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2
0709 13:20:42.875032 (+  6906us) log.cc:844] Serialized 26 byte log entry
0709 13:20:43.073511 (+198479us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:43.073548 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.094354 (+ 20806us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.183450 (+ 89096us) raft_consensus.cc:1685] finished
0709 13:20:43.183475 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.183676 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21592,"raft.queue_time_us":22045,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":8444,"spinlock_wait_cycles":21992576,"thread_start_us":196318,"threads_started":1,"wal-append.queue_time_us":270326}
I20260709 13:20:43.187397 26699 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:43.189985 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:43.190393 19507 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:43.199877 19512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50822 (request call id 4261) took 1461 ms. Trace:
I20260709 13:20:43.200376 19512 rpcz_store.cc:276] 0709 13:20:41.738213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.738373 (+   160us) service_pool.cc:224] Handling call
0709 13:20:41.807490 (+ 69117us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:42.688702 (+881212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:42.700907 (+ 12205us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:42.832923 (+132016us) log.cc:844] Serialized 26 byte log entry
0709 13:20:43.049832 (+216909us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:43.049880 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.059847 (+  9967us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.199447 (+139600us) raft_consensus.cc:1685] finished
0709 13:20:43.199476 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.199687 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":643672,"raft.queue_time_us":703110,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"thread_start_us":335153,"threads_started":2,"wal-append.queue_time_us":303426}
I20260709 13:20:43.205607 19655 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:43.214478 26598 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:43.216727 26125 consensus_queue.cc:1048] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:43.217377 19551 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:43.218405 26143 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:43.228015 26598 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:43.228770 26598 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.239362 26447 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.243880 26266 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.244342 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:43.245563 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:43.246052 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 81056.2us
I20260709 13:20:43.247277 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:43.247923 19507 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:43.252130 26768 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:43.262728 26440 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:43.263614 26440 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.264407 26598 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.265472 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:20:43.269094 26445 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:43.274061 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:43.274266 25579 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:43.267369 25575 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:43.275667 19507 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:43.278348 26311 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.281962 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:43.282823 19510 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:43.284320 26311 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.279054 20619 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:43.255712 26548 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:43.303642 25575 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.308866 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:43.310631 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:43.314574 26720 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:43.314994 19654 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 13:20:43.315342 26311 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:43.191282 19403 catalog_manager.cc:5697] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.319401 26266 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:43.327172 19504 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:20:43.276467 26447 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.337778 25575 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:43.348189 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 82840.6us
I20260709 13:20:43.354313 19627 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:43.301280 26548 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:43.357224 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 77801.8us
I20260709 13:20:43.359397 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:43.369156 19657 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:43.364871 26447 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.377390 19507 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 26. Current term is 27. Ops: []
I20260709 13:20:43.371188 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:43.375772 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:43.365018 26598 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:43.359288 26311 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:43.383443 26737 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:20:43.400348 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 56237.1us
I20260709 13:20:43.382887 26143 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:43.403779 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:43.404477 19654 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:43.405714 26447 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.406277 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:20:43.408218 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 133310us
I20260709 13:20:43.409201 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:43.418241 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:43.423930 26614 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:43.406986 19403 catalog_manager.cc:5697] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 18 to 24, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 24 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:43.424615 26614 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.425922 19403 catalog_manager.cc:5697] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 15 to 17, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 17 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:43.426971 26614 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.427814 26768 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:43.428491 26720 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:20:43.391124 26311 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.430617 26586 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:43.406459 26342 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.434326 19655 raft_consensus.cc:2393] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 17: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:43.434366 19403 catalog_manager.cc:5697] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:43.437464 19654 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 26.
I20260709 13:20:43.392020 26598 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.450706 19551 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:20:43.456393 19627 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:43.479229 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 76134.6us
W20260709 13:20:43.489874 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 63290.3us
I20260709 13:20:43.476847 26586 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:43.486289 26614 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:43.488389 26548 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:43.502393 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 46100.5us
I20260709 13:20:43.490056 26440 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:43.504995 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 56740.1us
I20260709 13:20:43.497015 26586 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:43.510669 26342 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.509968 19403 catalog_manager.cc:5697] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 14 to 16, leader changed from 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 16 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.509107 19478 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:43.514065 26793 log.cc:927] Time spent T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:20:43.515273 26536 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:20:43.503166 26778 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:20:43.515805 26536 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:43.517388 26203 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:43.516670 19403 catalog_manager.cc:5697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 13 to 20, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 20 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.508885 26707 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:20:43.518234 26707 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:43.516984 26536 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:43.519249 26707 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.520370 26707 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:43.519881 19403 catalog_manager.cc:5697] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: config changed from index -1 to 11, term changed from 16 to 19, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New cstate: current_term: 19 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:20:43.522104 19403 catalog_manager.cc:5697] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 18 to 23, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 23 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.523926 19403 catalog_manager.cc:5697] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 19 to 24, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 24 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.519220 26536 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:43.498433 26614 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting leader election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:43.528081 26311 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.499058 26768 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:20:43.529141 26778 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:43.536206 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:43.536581 26801 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:43.536370 26778 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:43.539587 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:43.539361 26778 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.540614 26778 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:43.544708 26791 log.cc:927] Time spent T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:20:43.529713 26447 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.554286 19403 catalog_manager.cc:5697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 15 to 20, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 20 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:43.556351 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 56037.7us
I20260709 13:20:43.533305 26614 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:43.561074 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:43.560281 26311 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:43.557737 26548 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:43.567296 26143 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:43.548926 26454 consensus_queue.cc:1059] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:20:43.567389 26311 raft_consensus.cc:697] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:43.575213 26454 raft_consensus.cc:3055] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:43.563449 26203 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:20:43.575585 26311 consensus_queue.cc:237] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.570536 26768 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:20:43.580423 26447 raft_consensus.cc:3055] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:43.580821 26447 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:43.581800 26447 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.567266 26796 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 13:20:43.573364 26143 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:43.575605 26454 raft_consensus.cc:740] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:43.565959 26598 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.588658 26143 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:43.588534 26801 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:43.594895 26513 consensus_queue.cc:1059] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:20:43.592418 26548 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.603649 26548 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.604192 26513 raft_consensus.cc:3055] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:43.604624 26513 raft_consensus.cc:740] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:43.605758 19578 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:43.605505 26513 consensus_queue.cc:260] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.607113 26513 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:43.607448 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:43.608881 26548 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.609243 26454 consensus_queue.cc:260] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.574095 19403 catalog_manager.cc:5697] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 14 to 21. New cstate: current_term: 21 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.610620 26454 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:43.611817 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:43.612392 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:43.611780 19403 catalog_manager.cc:5697] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 10 to 15, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 15 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.599455 26801 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:43.614540 19581 raft_consensus.cc:1240] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:43.614610 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:43.614979 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:43.615762 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:43.616500 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:43.618752 19478 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:43.605590 26586 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.620215 26801 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.630522 19584 raft_consensus.cc:2393] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 25: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:43.630936 19585 raft_consensus.cc:2368] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
I20260709 13:20:43.631335 26801 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:43.632143 26125 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.630636 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:43.635210 19476 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:43.635355 19587 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:43.643491 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:43.595752 26778 consensus_queue.cc:1059] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:20:43.600634 26447 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:43.645777 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:43.642491 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 48204.1us
I20260709 13:20:43.646900 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:43.650581 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:43.657932 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:43.658394 26803 log.cc:927] Time spent T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:20:43.660130 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:43.632763 26125 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.667371 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:43.668320 19657 raft_consensus.cc:2410] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:20:43.669764 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 51106.2us
I20260709 13:20:43.642410 26737 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:20:43.671837 26586 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.649446 26768 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:20:43.663909 26767 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:43.674814 26439 raft_consensus.cc:3055] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:43.675227 26439 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:43.676100 26439 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.680969 19478 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:43.683171 26125 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.656744 26311 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:43.686163 19403 catalog_manager.cc:5697] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 16 to 17, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 17 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:43.688341 19403 catalog_manager.cc:5697] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 12 to 20, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 20 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.690083 26439 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:43.694154 26799 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:43.694761 26311 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:43.695343 26311 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.697657 19506 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Rejecting Update request from peer 068c03c9dcc848e6bf909131b1f83065 for earlier term 26. Current term is 27. Ops: [26.19-26.19]
I20260709 13:20:43.699167 26143 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.699970 26767 raft_consensus.cc:697] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:43.716573 26767 consensus_queue.cc:237] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.717285 26143 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.702121 19582 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 30 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 29. Current term is 30. Ops: []
I20260709 13:20:43.694555 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:43.709194 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 62412.1us
I20260709 13:20:43.697427 26311 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:43.735162 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 45250.4us
I20260709 13:20:43.739415 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:43.745820 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 51350.1us
W20260709 13:20:43.753917 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.727746 26432 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:43.711566 19403 catalog_manager.cc:5697] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 16 to 19, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 19 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:43.755081 19625 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:43.766556 19654 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:20:43.770920 26432 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.779161 19403 catalog_manager.cc:5697] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 15 to 19, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 19 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:43.790151 19478 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:43.793325 26799 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:20:43.755541 26311 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:43.794014 26266 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:43.794672 26311 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.757861 26536 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:43.770058 19625 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:43.758991 26801 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:43.814200 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 44254.9us
W20260709 13:20:43.811617 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 72330.8us
I20260709 13:20:43.837319 19625 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:43.745939 26614 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:43.770147 26436 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:43.767799 26125 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:43.808195 26432 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:43.858609 26778 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.821656 26311 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.865945 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:43.866681 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:43.885099 19660 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:43.867787 19510 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 13:20:43.854287 26266 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:43.870707 26548 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:43.876389 19505 raft_consensus.cc:1240] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:43.877285 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:43.827526 26445 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.891981 26445 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.887641 26266 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.894053 26266 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:43.894346 26445 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:43.897253 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:43.883926 26811 log.cc:927] Time spent T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:20:43.781193 19403 catalog_manager.cc:5697] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 10 to 21, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 21 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:43.886144 25579 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:43.890275 19508 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:43.891001 26778 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:43.884433 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:43.878391 26436 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:43.906293 19506 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:20:43.909353 25579 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:43.910204 26707 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.910706 25579 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.910776 26707 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:43.915351 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 123202us
I20260709 13:20:43.854450 26536 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:43.919159 26125 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:43.927347 26445 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.938786 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:43.912632 26436 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:43.912495 26432 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.927932 26445 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.947453 26432 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.948639 26445 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.927937 26778 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:43.970479 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:43.902328 26548 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:43.974561 26614 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:43.976022 26707 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:43.976501 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:43.977547 19584 raft_consensus.cc:2368] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18.
I20260709 13:20:43.978658 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:43.936602 26439 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:20:43.980165 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:43.981559 26536 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.982067 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:43.983664 19583 pending_rounds.cc:85] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 12
I20260709 13:20:43.983951 19583 pending_rounds.cc:107] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:20:43.983098 19403 catalog_manager.cc:5697] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 12 to 19, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 19 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:43.984234 19583 raft_consensus.cc:2889] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:43.986042 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 101698us
I20260709 13:20:43.986824 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:43.981355 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:43.988101 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:43.989085 19581 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:20:43.990056 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:43.989573 26432 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:43.992053 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:43.992419 19579 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:43.994156 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:43.994719 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:43.976523 26440 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:20:43.975323 26548 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:43.985291 19403 catalog_manager.cc:5697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 12 to 20. New cstate: current_term: 20 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:44.000434 19584 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:20:44.001219 19403 catalog_manager.cc:5697] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 14 to 16, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 16 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:44.006690 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.009478 26125 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:44.009644 26614 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:44.010963 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:44.012130 19508 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 24 index: 11. (index mismatch)
I20260709 13:20:44.012157 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:44.013017 19512 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:44.015133 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:20:44.021925 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 62517us
I20260709 13:20:44.030190 20663 raft_consensus.cc:2410] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:20:44.034538 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:44.034426 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:44.036195 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.037590 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.042128 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.043056 19625 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:44.052670 25579 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:44.045514 19625 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:44.053107 25579 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:44.053535 25579 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:44.051911 26439 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:44.054831 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.054971 26439 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:44.055644 19508 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:44.058055 19653 raft_consensus.cc:2393] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 27: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:44.059964 20665 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 27.
W20260709 13:20:44.042659 19478 connection.cc:256] RPC call timeout handler was delayed by -1.0723121369999262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
I20260709 13:20:44.060636 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:44.060791 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:44.061666 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:44.061959 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.063390 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.063908 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.065238 19654 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:44.039975 26203 consensus_queue.cc:1059] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:20:44.065889 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:44.047609 26436 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.066578 25692 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:44.040254 26125 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:44.035502 26311 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:44.068702 19657 raft_consensus.cc:3060] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:44.073251 19508 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 26: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:44.070228 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.081310 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.082880 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.078039 19653 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:44.068181 26436 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:44.085378 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:44.085590 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:44.085961 19655 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:44.084707 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.087268 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.089167 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.088299 19653 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
I20260709 13:20:44.095829 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.100838 26143 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:44.101416 26143 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.103768 26143 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:44.075776 26737 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:44.093665 19506 raft_consensus.cc:2955] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 11 to 14, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:44.068158 26125 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.108836 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.114915 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:44.117913 19657 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:44.121440 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:44.121887 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 46503.1us
I20260709 13:20:44.122896 19478 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:44.088284 26598 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:44.124423 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.126478 25575 raft_consensus.cc:3055] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:44.126904 19478 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:44.126942 25575 raft_consensus.cc:740] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:44.140779 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.097162 26586 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.142113 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:44.142730 19505 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:44.083571 26311 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.145004 19478 leader_election.cc:400] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18.
I20260709 13:20:44.145424 19478 leader_election.cc:403] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:20:44.152084 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:44.151214 19478 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:44.152899 19504 raft_consensus.cc:2393] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 27: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:44.156555 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.158860 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.160748 26311 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:44.161405 26816 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:44.145087 26598 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.162406 25575 consensus_queue.cc:260] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.093768 19403 catalog_manager.cc:5697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 14 to 18, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 18 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:44.119300 26737 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.174412 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:44.172842 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.184916 25575 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:44.143314 26440 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:44.186499 19478 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:44.188989 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57956.8us
I20260709 13:20:44.191089 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:44.197188 19658 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:44.202323 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:20:44.205209 19655 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:20:44.186760 26445 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:44.209409 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.210347 25692 raft_consensus.cc:697] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:44.213526 25579 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.216753 19657 raft_consensus.cc:1240] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:44.187606 26143 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:44.218744 19627 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:44.219523 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.220928 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:44.251797 19658 raft_consensus.cc:2393] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 25: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:44.148662 26586 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.222407 25692 consensus_queue.cc:237] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.250990 26203 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:44.222139 26342 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:20:44.206326 26799 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:44.216531 26801 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:20:44.280211 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:44.288468 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 69847.5us
I20260709 13:20:44.289367 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:44.293020 26586 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:44.293819 26825 log.cc:927] Time spent T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:20:44.296383 26814 log.cc:927] Time spent T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:20:44.221719 26768 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 13:20:44.210558 26454 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:20:44.314656 19507 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 25.
I20260709 13:20:44.316171 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.317788 19505 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:20:44.280593 26707 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:44.321728 25575 consensus_queue.cc:1059] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:44.322000 19627 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:44.167635 19403 catalog_manager.cc:5697] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 14 to 16, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 16 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:44.326944 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:44.317219 26203 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:44.255295 26143 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.343608 26830 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:44.344259 26827 raft_consensus.cc:3055] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:44.316170 26311 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:44.350121 19627 leader_election.cc:400] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
I20260709 13:20:44.369208 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:44.352020 26796 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:44.359043 19403 catalog_manager.cc:5697] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 12 to 19, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 19 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:44.323338 26548 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:44.326347 26598 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:44.367671 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:44.357041 26266 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.372972 19627 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:44.372373 25692 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:44.368482 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:44.381596 26598 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:44.382551 26513 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:44.383103 26513 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:44.387732 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:44.367388 26827 raft_consensus.cc:740] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:44.392889 19653 raft_consensus.cc:2368] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23.
I20260709 13:20:44.392915 26826 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:44.371243 26311 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.399909 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.401239 26311 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:44.402241 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:44.398208 26586 consensus_queue.cc:1059] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 22.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:20:44.421088 19504 raft_consensus.cc:1240] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:44.406263 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:44.422197 26125 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:44.422680 26125 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:44.423110 26125 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:44.425763 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.403546 26752 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:44.425786 26614 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:44.427203 26752 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:44.428011 26614 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.430109 26614 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:44.431915 26445 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:44.432080 19478 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:44.432528 26445 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.433002 26796 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:44.432098 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.404784 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.405473 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.408028 19581 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:44.411185 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:44.405562 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.415284 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:44.435730 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:44.416196 19627 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:44.436121 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:44.418053 26143 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:44.436836 19507 raft_consensus.cc:2368] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
I20260709 13:20:44.434670 19652 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:44.438167 19510 raft_consensus.cc:2393] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 22: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:44.436399 19582 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:44.439251 19584 raft_consensus.cc:2410] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 26 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:20:44.439201 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.441087 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:44.439322 19512 raft_consensus.cc:2468] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:44.442595 19503 raft_consensus.cc:2410] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 26 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:20:44.450704 26796 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:20:44.457263 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51062.2us
I20260709 13:20:44.458339 19551 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:44.460889 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:44.453989 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.462096 19580 raft_consensus.cc:2368] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
I20260709 13:20:44.405738 26598 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:44.375100 26548 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.472718 26143 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:44.429543 26752 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:44.475813 26439 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:44.478046 26513 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:44.484422 25579 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:44.440943 26440 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:44.452419 26767 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 17. Current term is 18.
I20260709 13:20:44.473301 26614 raft_consensus.cc:2804] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:44.518814 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.524727 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.525679 19654 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 24 index: 11. (index mismatch)
I20260709 13:20:44.525646 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:44.526388 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 68180.9us
I20260709 13:20:44.529610 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.491858 26548 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:44.589988 19476 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:44.513235 26143 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:44.543375 19553 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
W20260709 13:20:44.548377 26841 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.088s	user 0.003s	sys 0.000s
W20260709 13:20:44.534075 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 130922us
I20260709 13:20:44.552600 26830 raft_consensus.cc:3055] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:44.484444 26266 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:44.559098 26445 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:44.559556 26125 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:44.578346 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 161793us
W20260709 13:20:44.617193 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 125509us
I20260709 13:20:44.592782 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:44.615957 19510 raft_consensus.cc:1240] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26. Ops: []
I20260709 13:20:44.485317 26827 consensus_queue.cc:260] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.621223 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:44.622926 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.624601 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.610059 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:44.625715 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:44.626037 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:44.626593 19512 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:44.628240 19551 leader_election.cc:400] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23.
I20260709 13:20:44.628578 19551 leader_election.cc:403] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:20:44.635679 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 219555us
I20260709 13:20:44.636174 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.636978 19509 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:44.638535 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.639550 19505 raft_consensus.cc:2410] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for term 25 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:20:44.610159 26143 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:44.646466 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.645330 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.609247 26439 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:44.651387 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:44.655486 19511 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 19: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:44.615124 26614 raft_consensus.cc:697] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:44.630048 26447 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:44.559674 26842 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.172s
I20260709 13:20:44.634054 26586 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:44.672490 26586 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:44.633560 26720 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:44.634588 26311 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:44.667721 26737 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:44.640409 26598 consensus_queue.cc:1059] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:20:44.671970 26614 consensus_queue.cc:237] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.670322 25579 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.686738 25579 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.615962 26830 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:44.678496 19625 leader_election.cc:400] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
I20260709 13:20:44.687810 19625 leader_election.cc:403] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:20:44.658895 26548 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:20:44.654247 26439 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:44.685498 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 246354us
W20260709 13:20:44.685575 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 252268us
I20260709 13:20:44.688217 19512 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:44.693638 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:44.694713 19478 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:44.695259 19579 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
W20260709 13:20:44.695704 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 67584.9us
I20260709 13:20:44.697945 19659 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:20:44.702764 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:44.694514 26439 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:44.700830 26767 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:44.685595 26447 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.734087 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:44.746748 20663 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:44.750582 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:44.753670 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:44.754228 19583 raft_consensus.cc:3055] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:20:44.754703 19583 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:44.755591 19583 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.756700 19583 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:44.758693 19625 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:44.759684 25575 raft_consensus.cc:2804] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:44.760262 25575 raft_consensus.cc:697] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:44.761231 25575 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.763984 20666 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:44.821795 26830 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.10, Last appended by leader: 10, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.825474 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:44.828331 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.725394 26845 raft_consensus.cc:3060] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:20:44.682111 26586 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.689560 26846 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 29.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
W20260709 13:20:44.830225 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 67034.5us
I20260709 13:20:44.837734 19509 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:20:44.838660 19505 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:44.878213 26846 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.878517 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.875773 26853 raft_consensus.cc:3055] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:44.876773 26836 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
W20260709 13:20:44.884661 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 45546.4us
I20260709 13:20:44.728041 26548 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:44.829705 26767 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.890260 19508 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:44.889602 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:44.903043 26846 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.905313 26846 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:44.926190 26447 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:44.906495 26852 log.cc:927] Time spent T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 13:20:44.907989 26266 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 13:20:44.892642 26853 raft_consensus.cc:740] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:44.836741 26311 raft_consensus.cc:697] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:44.901634 26125 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:44.953369 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 228304us
I20260709 13:20:44.894529 26440 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:20:44.930276 26830 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:44.940706 26266 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:44.967020 26266 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.15, Last appended by leader: 15, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.968818 26266 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:20:44.969799 26548 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:44.957196 26439 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:44.898793 19512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:44.980306 19512 raft_consensus.cc:606] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:44.980794 19512 raft_consensus.cc:614] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:44.980720 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:44.981638 26125 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:44.978818 25579 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:44.982496 26854 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:44.917783 26767 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.000538 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.004575 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:44.980940 26439 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:45.012091 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.014343 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.010445 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:44.990939 26143 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.019392 26858 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 13:20:45.024317 26445 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.025890 19661 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:20:45.027176 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:45.031394 19661 raft_consensus.cc:606] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:45.039772 19661 raft_consensus.cc:614] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:45.042697 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.044450 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.046048 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:45.050176 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:45.050539 26840 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.328s	user 0.004s	sys 0.000s
I20260709 13:20:45.027194 26859 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:45.054142 26857 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:45.056455 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:45.057448 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:45.057808 26767 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:45.058750 19581 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 30: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:45.059808 19627 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:45.061676 19512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:45.062471 19512 raft_consensus.cc:606] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:45.062841 19512 raft_consensus.cc:614] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:45.063745 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.069057 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:45.069446 19478 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.070235 25579 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:45.070878 19583 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 13. (term mismatch)
I20260709 13:20:45.071226 19583 pending_rounds.cc:85] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 12
I20260709 13:20:45.071439 19583 pending_rounds.cc:107] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 25.13
I20260709 13:20:45.071756 19583 raft_consensus.cc:2889] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:45.072230 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:45.072460 26862 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:45.073171 26857 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:45.076623 26860 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:45.077698 26311 consensus_queue.cc:237] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.080943 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:45.084517 26845 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23.
I20260709 13:20:45.085912 26858 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:45.086621 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:45.088128 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:45.069360 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.041285 26853 consensus_queue.cc:260] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.090569 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:45.091004 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.095000 19586 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
W20260709 13:20:45.098757 26856 log.cc:927] Time spent T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:20:45.099779 26143 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:45.100590 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:45.101449 19587 raft_consensus.cc:2410] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 25 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:20:45.094455 19478 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.111920 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:45.114245 19627 leader_election.cc:400] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24.
I20260709 13:20:45.121428 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.116312 19627 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:45.062333 26614 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:45.072502 26836 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:45.125337 25575 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:45.095468 26858 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:45.126005 19583 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:45.101899 26439 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:45.127522 19551 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.126365 19627 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:45.134042 19627 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:45.135895 19587 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:20:45.136524 19508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:45.137009 26586 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:45.137182 19508 raft_consensus.cc:606] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:45.138056 26846 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:45.138096 26867 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.136s	user 0.002s	sys 0.000s
I20260709 13:20:45.141172 19508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:45.141891 19508 raft_consensus.cc:606] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:45.142313 19508 raft_consensus.cc:614] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:20:45.142647 26870 log.cc:927] Time spent T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:20:45.146054 26440 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.146898 26440 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.150748 26440 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:45.157387 19508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:45.159173 19508 raft_consensus.cc:606] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 25 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:45.165871 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:45.168201 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:45.061726 26445 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.110790 26707 consensus_queue.cc:1059] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:20:45.119015 26816 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:45.191838 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 64400.2us
I20260709 13:20:45.128533 26836 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:45.133225 26845 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:45.190083 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.180491 19582 raft_consensus.cc:2468] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:45.132221 26439 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:45.165483 26598 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
W20260709 13:20:45.198448 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 64511.5us
I20260709 13:20:45.183748 26853 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:45.202066 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:45.181921 26858 raft_consensus.cc:697] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:45.209928 19583 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:20:45.212762 26866 log.cc:927] Time spent T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.203s	user 0.003s	sys 0.000s
W20260709 13:20:45.223860 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 98802.9us
I20260709 13:20:45.198184 26854 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:45.225967 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.238699 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.239645 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:45.237380 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.226522 26311 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:45.226812 26432 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:45.226872 26436 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:45.261778 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:45.300031 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:45.300031 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:45.300661 19659 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:45.301097 19507 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:45.235556 19625 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:45.301175 19655 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:20:45.201321 26836 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:45.240311 19653 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 25.
I20260709 13:20:45.201463 26720 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:45.259965 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:45.204773 26203 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:45.258118 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:45.296499 19510 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 14. (term mismatch)
I20260709 13:20:45.309991 19510 pending_rounds.cc:85] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 13
I20260709 13:20:45.310341 19510 pending_rounds.cc:107] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 24.14
I20260709 13:20:45.310618 19510 raft_consensus.cc:2889] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:45.311105 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:45.257050 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:45.219569 26439 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:45.298642 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:45.299021 19503 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 24. Current term is 25. Ops: [24.11-24.11]
I20260709 13:20:45.229750 26737 raft_consensus.cc:3055] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:45.321067 19658 raft_consensus.cc:2393] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 22: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:45.316687 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:45.322101 19504 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 26: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:20:45.301975 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 64686.9us
I20260709 13:20:45.302978 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:45.307327 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:45.309510 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:45.312505 19505 raft_consensus.cc:2393] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 23: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:45.328130 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:45.329066 19583 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 25.
W20260709 13:20:45.319947 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 84480.5us
I20260709 13:20:45.298123 26125 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:45.300963 26845 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:45.333556 19656 raft_consensus.cc:2393] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 18: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:45.299199 26311 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:45.331849 19478 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:45.305318 26143 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:45.223558 26598 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.306130 26767 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:20:45.307144 26862 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.309347 26203 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:45.399505 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 67802.8us
I20260709 13:20:45.298467 26842 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:20:45.332579 26513 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:45.320550 26737 raft_consensus.cc:740] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:45.344337 26311 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:45.449303 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 137462us
I20260709 13:20:45.413482 26440 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:45.457904 26844 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.156s
I20260709 13:20:45.458843 26838 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.143s
W20260709 13:20:45.460855 26868 log.cc:927] Time spent T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:20:45.417356 26203 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:45.466241 19659 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 25.
I20260709 13:20:45.456532 26440 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.474900 26440 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:45.463936 26827 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:45.415127 26857 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 13:20:45.418123 26862 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.501123 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:45.501785 19654 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 25.
W20260709 13:20:45.504503 26873 log.cc:927] Time spent T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:20:45.506489 26874 log.cc:927] Time spent T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:20:45.520943 26847 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.521524 26847 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.524142 26847 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:45.526908 26878 log.cc:927] Time spent T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:20:45.527597 26872 log.cc:927] Time spent T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:20:45.532434 26513 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.540539 26513 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.450017 26858 consensus_queue.cc:237] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.546085 26513 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:45.554472 26598 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:45.555013 26439 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.557331 26439 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:45.558815 26447 raft_consensus.cc:993] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:45.578217 26440 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.581020 26440 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:45.585568 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:45.588371 20666 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 13:20:45.589494 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:45.490298 26737 consensus_queue.cc:260] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.595706 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:45.605216 19658 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
I20260709 13:20:45.588400 19656 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:20:45.617688 26876 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:45.606818 19654 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 24. Current term is 25. Ops: [24.11-24.11]
I20260709 13:20:45.618316 26876 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.548591 26862 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:45.611796 19655 raft_consensus.cc:1275] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:45.619467 19503 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:45.614192 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 136032us
I20260709 13:20:45.620417 26876 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:45.621834 26816 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:45.622354 19508 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 13:20:45.624446 26876 raft_consensus.cc:993] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:45.624886 26876 raft_consensus.cc:1081] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 25 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
W20260709 13:20:45.624936 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 86112.4us
I20260709 13:20:45.625401 19504 raft_consensus.cc:1275] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:45.628731 19551 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.628983 19508 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:45.629920 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:45.630369 26842 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.630560 19507 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 25.
I20260709 13:20:45.630651 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:45.630847 26842 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.631356 19510 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:45.628997 26311 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.632963 26842 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:45.605300 26737 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:45.633527 26311 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:45.634008 26439 raft_consensus.cc:1081] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:45.622414 26816 consensus_queue.cc:1243] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:45.639868 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.640816 19505 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:20:45.640906 26854 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 22.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:45.641326 26586 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:45.642099 26854 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:20:45.643136 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 53241.7us
I20260709 13:20:45.642185 26586 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:45.645920 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:45.646920 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:45.652571 19503 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:45.691725 19585 raft_consensus.cc:2468] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:45.654152 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.658164 19586 raft_consensus.cc:2393] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 21: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:45.647109 19476 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:45.660650 25575 consensus_queue.cc:1059] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:45.661339 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:45.693114 19587 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:45.667075 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:45.668433 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:45.694361 19581 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:45.660791 19625 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:45.672685 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:45.657049 26586 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:45.658161 26143 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.016s
W20260709 13:20:45.695672 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 78127.1us
I20260709 13:20:45.702637 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:45.696205 19654 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 25.
I20260709 13:20:45.683130 26767 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:20:45.688557 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:45.709440 19476 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:45.703289 19586 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:45.703375 25575 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:20:45.705185 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51105.4us
I20260709 13:20:45.699136 19659 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:45.709769 19578 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:20:45.696306 19625 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:45.686941 26842 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:45.715940 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:45.717469 19476 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:45.720687 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:45.726329 19582 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:20:45.725116 19578 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:20:45.721700 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:45.728286 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:45.728991 19503 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:45.730121 25575 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.730584 25575 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:45.727099 25692 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:45.733958 19508 raft_consensus.cc:2393] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 25: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:45.695616 26445 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:45.708288 26843 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:45.747211 26843 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.747241 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:45.747843 26843 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:45.748270 26830 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:45.731945 26513 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:45.743178 26342 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:45.723639 26799 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:45.714646 19580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60808
I20260709 13:20:45.764186 19580 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:45.764572 19580 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:45.737169 26598 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:20:45.737262 26862 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:45.766949 26862 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 26 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:45.767887 26862 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.769912 26342 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 25 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:45.770879 26342 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 22.10, Last appended by leader: 10, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.745872 26586 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 24.11, Last appended by leader: 11, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.746376 26858 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:45.702184 26844 raft_consensus.cc:3055] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:45.749368 19551 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:45.722930 19587 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60808
I20260709 13:20:45.754142 19581 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 26.
I20260709 13:20:45.748680 26830 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:45.750984 26513 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.784103 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:45.790438 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:45.779229 26844 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:45.787058 25575 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:45.797534 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 63947us
I20260709 13:20:45.733178 26842 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.799546 19478 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:45.810958 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:45.815567 19511 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:45.816759 25575 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:45.790567 26830 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:45.826941 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:45.797498 26853 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:45.796166 26513 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:45.835062 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 117683us
W20260709 13:20:45.826113 26890 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.054s	user 0.001s	sys 0.001s
I20260709 13:20:45.844630 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:45.845551 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:45.845893 19652 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:45.827780 26586 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:45.843463 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:45.848922 26861 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:45.850114 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:45.793591 26857 consensus_queue.cc:1175] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e19c80e9149b4b8d88ae13bde8e43864" responder_term: 25 status { last_received { term: 22 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 24. Current term is 25. Ops: [24.11-24.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:45.855197 19508 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:45.861100 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:45.814229 26854 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.038s
I20260709 13:20:45.863171 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:45.846174 26859 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:45.802831 26836 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.869880 19653 raft_consensus.cc:1217] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Deduplicated request from leader. Original: 16.10->[20.11-24.13]   Dedup: 20.11->[22.12-24.13]
I20260709 13:20:45.872993 19587 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:45.873514 19587 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:45.878105 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:45.836805 26125 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:20:45.836833 26860 consensus_queue.cc:1048] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:20:45.857963 26853 raft_consensus.cc:697] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:45.891628 26853 consensus_queue.cc:237] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.865797 26311 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:45.899215 19661 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
W20260709 13:20:45.887290 26884 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:20:45.889591 26893 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.872685 19653 pending_rounds.cc:85] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 11
I20260709 13:20:45.867841 26859 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.906419 19653 pending_rounds.cc:107] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 13:20:45.907233 19653 raft_consensus.cc:2889] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:45.893826 26447 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.913317 19652 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 26.
I20260709 13:20:45.908937 26859 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:45.863281 26844 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.909090 26311 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:45.976814 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:45.979892 26311 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.982522 26842 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:45.955235 19476 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:45.962563 26836 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:45.922072 26816 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.930588 26447 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.965183 26848 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:45.971537 19580 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.974133 26203 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.007987 26203 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:45.977918 26815 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:45.909719 26893 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.008762 26815 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:46.009900 19657 raft_consensus.cc:2368] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 23. Current term is 24.
I20260709 13:20:46.010475 26893 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:45.997363 26842 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:46.011358 26842 raft_consensus.cc:697] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:46.011677 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:46.012243 19504 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:46.012208 26842 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:46.019948 26827 consensus_meta.cc:287] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.003s
I20260709 13:20:46.021914 19655 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:46.022464 25575 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.022919 25575 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.993578 19587 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:45.998160 19511 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 26.
I20260709 13:20:46.005141 26447 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:46.033782 19504 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:20:46.055809 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:46.057438 19580 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:46.066376 19654 raft_consensus.cc:2393] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 22: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:46.066112 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:46.065415 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:46.068773 25575 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:46.068986 19652 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 25.
I20260709 13:20:46.067853 19510 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:46.091373 19587 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:46.092891 26513 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.101838 19625 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:46.002254 26816 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.031106 26844 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:46.106660 26894 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.106s	user 0.004s	sys 0.000s
I20260709 13:20:46.107527 26830 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:46.112310 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 86322.3us
I20260709 13:20:46.113097 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:46.112816 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 75826.3us
I20260709 13:20:46.137358 19478 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:46.167936 19654 raft_consensus.cc:2410] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 27 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 13:20:46.137548 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:46.141129 19625 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:46.166869 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:46.175235 19586 raft_consensus.cc:2393] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 22: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:46.176502 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:46.178859 19551 leader_election.cc:400] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 23. Current term is 24.
I20260709 13:20:46.179353 19551 leader_election.cc:403] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:46.181474 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:46.186038 19659 raft_consensus.cc:2368] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23.
I20260709 13:20:46.174227 19625 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:46.141113 26436 raft_consensus.cc:2804] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:46.199008 19584 raft_consensus.cc:3060] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:46.206136 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:46.143000 26818 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.204654 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:46.217211 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:46.222747 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:46.191893 26836 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:46.187945 26447 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:46.208201 26548 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:20:46.213088 26839 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:46.143601 26843 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.246268 25692 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:46.246938 19627 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:46.251668 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 114441us
I20260709 13:20:46.228313 26436 raft_consensus.cc:697] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:46.255244 19478 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:46.255801 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 83373.8us
I20260709 13:20:46.237835 26447 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.240531 26842 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:46.260417 19506 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 13:20:46.242125 26839 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.243191 26836 raft_consensus.cc:697] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:46.220378 26818 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.256939 26847 raft_consensus.cc:2804] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:46.259349 26447 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:46.301965 26836 consensus_queue.cc:237] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.302886 26830 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:46.304577 26848 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:46.305120 26848 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:46.305645 26454 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.306138 26454 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.308290 26454 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:46.268441 26839 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:46.305050 26203 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:46.328697 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 69459.6us
I20260709 13:20:46.292343 26513 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:46.338519 26843 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:46.308768 26892 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:46.340909 19584 raft_consensus.cc:2468] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 26.
W20260709 13:20:46.350209 26907 log.cc:927] Time spent T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:20:46.350607 26842 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:46.319669 26436 consensus_queue.cc:237] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.314328 26847 raft_consensus.cc:697] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:46.356451 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 96473.3us
I20260709 13:20:46.367905 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:46.368556 19510 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:46.370182 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:46.370819 19504 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 18.
I20260709 13:20:46.342767 26892 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:46.330801 26203 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.378276 26892 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:46.385975 26830 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.421845 26847 consensus_queue.cc:237] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.425514 26548 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 23. Current term is 24.
W20260709 13:20:46.426193 26910 log.cc:927] Time spent T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:20:46.428409 26815 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:46.429533 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:46.447003 26203 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:46.452081 26818 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:46.453259 26447 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.483408 26447 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:46.444164 26859 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.487665 26859 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:46.488480 19624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.489043 19585 raft_consensus.cc:2393] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 22: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:46.490957 26707 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.491532 26707 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.496230 26707 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:46.494084 19625 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:46.493185 26513 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:46.497006 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:46.497099 26454 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:46.497256 26513 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.497819 26454 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.498287 26454 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:46.499492 26513 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:46.497773 19512 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:46.502137 19551 leader_election.cc:400] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23.
I20260709 13:20:46.435859 26830 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.505363 19625 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:46.485724 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 145002us
I20260709 13:20:46.512630 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:46.513186 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:46.513497 19508 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 30.
W20260709 13:20:46.528097 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 262147us
I20260709 13:20:46.527105 19625 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:46.579169 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:46.524777 26885 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:20:46.593019 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 65998.6us
W20260709 13:20:46.592895 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 85040.2us
I20260709 13:20:46.602619 26843 raft_consensus.cc:3060] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:46.606161 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:46.606853 19504 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 27.
I20260709 13:20:46.607982 20619 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:46.609148 26815 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:20:46.609551 26815 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:46.609956 26815 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:46.585057 26688 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.615902 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:46.642192 26688 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.616577 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:46.643963 19655 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:46.619128 26827 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 13:20:46.620478 19652 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 25 index: 11. (index mismatch)
I20260709 13:20:46.592355 26885 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.647814 19586 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:20:46.595057 26311 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:46.600030 26923 log.cc:927] Time spent T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:20:46.651523 19657 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:20:46.636067 26839 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.637228 26930 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:20:46.638569 26830 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:46.646719 19656 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:20:46.624677 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:46.649893 19510 raft_consensus.cc:2468] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:46.628050 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:46.655700 19659 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:46.656216 19653 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:20:46.653553 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 58520.6us
I20260709 13:20:46.658517 19627 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:46.602768 19478 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:46.661792 26924 log.cc:927] Time spent T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:20:46.665153 26839 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:46.671052 26707 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:46.673784 19653 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 26.
I20260709 13:20:46.681855 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:46.682524 19587 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:46.681022 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:46.683032 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:46.683701 19583 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 30.
I20260709 13:20:46.677860 26843 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:46.683149 26688 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:46.684047 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:46.688349 19625 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:46.651037 26885 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:46.647908 26827 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.693130 26707 raft_consensus.cc:2804] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:46.694768 26799 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:46.695585 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:46.696456 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 93769us
I20260709 13:20:46.681141 26815 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:46.700910 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:46.654126 26311 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.703433 26311 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:46.677095 26892 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.748533 19578 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 25. Current term is 26. Ops: []
I20260709 13:20:46.704238 19476 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:46.750173 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:46.698021 26827 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:20:46.770684 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:46.766321 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:46.773597 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 73185.6us
I20260709 13:20:46.775646 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:46.781062 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:46.777374 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:46.704293 26707 raft_consensus.cc:697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:46.790716 19503 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:46.745577 26311 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:46.836874 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 59579.1us
I20260709 13:20:46.714402 26454 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.839320 19580 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 24 index: 11. Preceding OpId from leader: term: 25 index: 11. (term mismatch)
I20260709 13:20:46.842902 19580 pending_rounds.cc:85] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 10
I20260709 13:20:46.843170 19580 pending_rounds.cc:107] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 24.11
I20260709 13:20:46.783088 26893 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:20:46.837208 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 53432.8us
I20260709 13:20:46.843412 19580 raft_consensus.cc:2889] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:46.794886 26836 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.850739 19581 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:20:46.850664 26445 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
W20260709 13:20:46.853497 26933 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:20:46.836062 26737 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:46.790385 26447 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:20:46.856202 19476 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:46.861744 26818 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:46.863696 26768 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:46.864166 26768 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:46.869323 19506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 3053) took 1149 ms. Trace:
I20260709 13:20:46.869820 19506 rpcz_store.cc:276] 0709 13:20:45.720098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.720232 (+   134us) service_pool.cc:224] Handling call
0709 13:20:45.720601 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:46.260885 (+540284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.869026 (+608141us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54000fda54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:46.869252 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1240836864}
I20260709 13:20:46.872556 26447 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:46.873027 26447 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.873118 26454 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:46.873479 26447 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:46.865041 26768 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.847499 26893 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:46.855139 26848 consensus_meta.cc:287] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260709 13:20:46.916919 19653 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:20:46.917014 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:46.922649 19659 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:46.926162 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:46.927022 19660 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:46.927735 19510 raft_consensus.cc:3060] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:46.931547 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:46.932425 19652 raft_consensus.cc:2393] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 22: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:46.934597 19658 raft_consensus.cc:1240] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:46.935508 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:46.935703 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:46.932976 19653 raft_consensus.cc:1275] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:46.936309 19511 raft_consensus.cc:3055] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:46.936637 19511 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:46.937469 19511 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.936704 19507 raft_consensus.cc:1240] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26. Ops: []
I20260709 13:20:46.838241 26707 consensus_queue.cc:237] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.835657 26311 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.944093 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:46.945923 19658 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 27.
W20260709 13:20:46.940096 26934 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:20:46.952771 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:46.954840 26768 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:46.955552 26143 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:46.955783 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:46.957901 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:46.958657 19509 raft_consensus.cc:2368] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26.
I20260709 13:20:46.965158 26598 consensus_queue.cc:1059] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:46.952558 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:46.966003 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:46.966440 26598 raft_consensus.cc:3055] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:46.966569 19509 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:20:46.966971 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:46.967538 19507 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 27.
I20260709 13:20:46.967861 19509 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:46.967617 26859 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:46.970605 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:46.971820 26859 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:20:46.971693 26447 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.972307 26859 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.981050 26859 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:46.981536 26311 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:46.983352 26892 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:46.983587 19660 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
I20260709 13:20:46.984987 19659 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:46.986162 26815 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:46.988500 19510 raft_consensus.cc:2468] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:46.974231 19658 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:20:46.974987 26143 consensus_queue.cc:1059] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:46.967007 26598 raft_consensus.cc:740] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:46.940649 26893 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:46.954021 26887 log.cc:927] Time spent T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:20:46.859052 26836 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:46.940482 26830 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 13:20:47.006389 26311 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:46.945504 26848 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.056541 26447 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:47.061470 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 196862us
I20260709 13:20:47.026554 26845 raft_consensus.cc:3055] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:20:47.064900 19476 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:47.065920 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 209385us
I20260709 13:20:47.079092 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:47.080112 19582 raft_consensus.cc:2393] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 22: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:47.080178 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:47.070683 19586 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:20:47.077900 19478 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:47.085436 26447 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:47.067574 26885 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.095546 26447 raft_consensus.cc:697] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:47.096601 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:47.077375 26827 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.096549 26447 consensus_queue.cc:237] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.097371 26845 raft_consensus.cc:740] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:47.098345 26845 consensus_queue.cc:260] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.036509 26859 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.096894 19657 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 24: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:47.049533 26311 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.102211 26311 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:47.081118 26598 consensus_queue.cc:260] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.123409 26598 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:47.125339 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:47.125854 26816 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:47.126111 19655 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:47.127569 26892 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:20:47.129715 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:47.129877 26859 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:47.130052 26848 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:47.132709 19585 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:47.148592 26885 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:47.149652 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:47.154230 20665 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 28 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 27. Current term is 28. Ops: []
I20260709 13:20:47.154744 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:47.155162 26836 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:47.164885 19587 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260709 13:20:47.176959 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 59930.1us
I20260709 13:20:47.201416 19661 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23. Ops: []
W20260709 13:20:47.203145 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 228557us
I20260709 13:20:47.203795 19476 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:47.169299 26548 consensus_queue.cc:1059] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 27.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.035s
I20260709 13:20:47.214668 19551 leader_election.cc:400] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26.
I20260709 13:20:47.215737 19551 leader_election.cc:403] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:20:47.219580 26548 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26.
I20260709 13:20:47.199282 26203 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:20:47.220049 26816 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:47.220621 26816 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.220865 26913 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:47.222222 26913 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:47.225677 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.227381 26768 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:47.227943 26768 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.232362 26827 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 31 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:47.235143 19656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56816 (request call id 3836) took 1392 ms. Trace:
I20260709 13:20:47.235677 19656 rpcz_store.cc:276] 0709 13:20:45.843091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.843242 (+   151us) service_pool.cc:224] Handling call
0709 13:20:47.234838 (+1391596us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b5400020654. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:47.235016 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1452384000}
I20260709 13:20:47.208400 26938 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:20:47.206887 26826 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:20:47.244930 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:47.252358 20631 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:47.255529 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:47.270737 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:47.272275 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:47.273670 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:47.218045 19551 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:47.278563 19510 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 24. Current term is 25. Ops: []
W20260709 13:20:47.290448 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 72514.4us
I20260709 13:20:47.293213 19510 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:20:47.291290 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:20:47.296041 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 100771us
I20260709 13:20:47.266893 26817 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:20:47.298448 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:47.296981 25575 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:47.307718 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:47.309674 19584 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:47.314050 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:47.314620 19583 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:20:47.317037 25575 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.317644 25575 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.318670 26945 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:47.319931 25575 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:47.308977 26548 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:47.313006 19478 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:47.320231 26513 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:20:47.323570 26830 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:20:47.335012 19582 raft_consensus.cc:2410] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:20:47.299955 26859 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:47.343082 19512 raft_consensus.cc:1275] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:47.338783 19478 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:47.352731 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:47.353404 19506 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:20:47.355752 19478 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:47.329784 26548 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.323015 19510 raft_consensus.cc:1275] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:20:47.361739 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:47.364260 19512 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
W20260709 13:20:47.362514 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.362939 19583 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 31.
I20260709 13:20:47.339655 26830 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:47.349628 26801 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:47.369679 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:47.299377 26893 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.367236 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:47.496513 19510 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:47.321416 19627 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:47.372217 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:47.376677 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:47.498890 19657 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:47.366755 26548 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:47.384135 26768 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:47.386543 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:47.500180 19654 raft_consensus.cc:3060] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:47.361164 26842 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:47.390130 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:47.391291 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.505407 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:47.506145 19504 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:47.391515 26956 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:47.495035 19506 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 31.
I20260709 13:20:47.354046 26445 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:47.498893 19512 raft_consensus.cc:3060] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:47.378093 26845 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:20:47.527802 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 206461us
I20260709 13:20:47.542546 19510 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 28.
I20260709 13:20:47.488118 26816 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:47.550458 19627 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:47.558612 19505 raft_consensus.cc:1240] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:47.559463 25692 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 13:20:47.559965 25692 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 31 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:47.568151 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:47.568903 19510 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 26.
I20260709 13:20:47.560683 25692 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.15, Last appended by leader: 15, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.521301 26815 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:47.583384 19512 raft_consensus.cc:2468] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:20:47.533604 26953 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:47.608847 19654 raft_consensus.cc:2468] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 28.
I20260709 13:20:47.614594 19625 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:47.619899 19508 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:20:47.620427 19508 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:47.621356 19508 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.632498 19508 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:47.611527 26953 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.538064 26956 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.644980 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:47.623711 26836 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:47.627632 26846 raft_consensus.cc:2804] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:47.574029 26830 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.611141 26815 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:47.657558 19508 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
W20260709 13:20:47.650946 26955 log.cc:927] Time spent T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 13:20:47.643731 26953 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:47.634554 26886 consensus_queue.cc:1059] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.022s
I20260709 13:20:47.650405 26959 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.646368 26827 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:20:47.651382 26203 consensus_queue.cc:1048] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:20:47.661885 26846 raft_consensus.cc:697] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:47.671007 26342 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 26 current term: 26 is higher.
I20260709 13:20:47.655529 26836 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:47.684783 26952 log.cc:927] Time spent T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 13:20:47.689348 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:47.682749 26830 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:47.712219 19625 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:47.713238 25692 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:47.728592 25692 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.729040 25692 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:47.681447 26959 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:47.722254 26946 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.488s	user 0.004s	sys 0.000s
I20260709 13:20:47.725729 26815 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:47.722262 26956 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:47.674530 26432 consensus_queue.cc:1048] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:20:47.733094 25575 raft_consensus.cc:3055] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:47.733549 25575 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:47.734365 25575 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.725872 26893 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:47.737098 25575 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:47.737293 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:47.739717 19508 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:47.759855 20665 raft_consensus.cc:1240] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 28 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 27. Current term is 28. Ops: []
I20260709 13:20:47.758903 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:47.734135 26958 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:47.788583 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:47.792371 26957 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:47.792954 26957 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 26 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:47.793926 26598 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:47.794524 26598 raft_consensus.cc:697] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:47.795454 26598 consensus_queue.cc:237] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.799170 26964 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:20:47.793943 26311 raft_consensus.cc:3055] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:20:47.801120 26311 raft_consensus.cc:740] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:47.801978 26311 consensus_queue.cc:260] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:47.803234 26311 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:20:47.804801 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.771188 26826 raft_consensus.cc:2804] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:47.816581 26957 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.817823 26846 consensus_queue.cc:237] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.825059 19506 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:20:47.826990 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:47.781031 26961 log.cc:927] Time spent T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:20:47.836582 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:47.838066 19503 raft_consensus.cc:1240] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23. Ops: [22.15-22.15]
W20260709 13:20:47.842420 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.843223 19504 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 25: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:20:47.851099 26969 log.cc:927] Time spent T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 13:20:47.852842 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:47.834901 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:47.867610 19627 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:47.859359 25692 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.872696 19551 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:47.876410 26966 raft_consensus.cc:2804] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:20:47.877436 26962 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:47.867132 26956 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:47.882269 26956 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.882611 19504 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:47.882692 26956 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:47.890018 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:47.892058 26859 consensus_queue.cc:1059] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:47.892776 26859 consensus_queue.cc:1243] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 23.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:47.894079 26203 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:47.896255 19654 raft_consensus.cc:1240] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 26. Current term is 27. Ops: [26.17-26.17]
I20260709 13:20:47.896620 26953 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.898561 26966 raft_consensus.cc:697] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 28 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:47.898713 26959 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:47.898707 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:47.839141 26826 raft_consensus.cc:697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:47.899727 26966 consensus_queue.cc:237] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.900127 26826 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.10, Last appended by leader: 10, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.906476 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:47.907284 19504 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
I20260709 13:20:47.909420 26859 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:47.911536 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:47.877089 26967 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:47.920990 25692 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:47.921733 19511 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:47.828450 26958 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:47.931878 19511 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:47.932986 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:47.936684 26959 consensus_queue.cc:1059] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 13:20:47.978266 26975 log.cc:927] Time spent T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.068s	user 0.001s	sys 0.001s
I20260709 13:20:47.983052 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:47.987089 19476 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:48.003219 19652 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 25. Current term is 26. Ops: []
I20260709 13:20:48.004962 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:48.006273 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:47.962661 26965 consensus_queue.cc:1059] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.047s
I20260709 13:20:48.010939 19655 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:20:48.012795 19582 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 14. (term mismatch)
I20260709 13:20:48.013437 19582 pending_rounds.cc:85] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 13
I20260709 13:20:48.013737 19582 pending_rounds.cc:107] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 25.14
I20260709 13:20:48.014072 19582 raft_consensus.cc:2889] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:48.015604 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:48.020428 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:48.021342 19659 raft_consensus.cc:2368] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22.
I20260709 13:20:48.007400 26799 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:48.030858 26799 raft_consensus.cc:697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:48.031917 26799 consensus_queue.cc:237] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.009995 26836 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:48.036326 26953 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:48.041059 26967 raft_consensus.cc:3055] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:20:48.041543 26967 raft_consensus.cc:740] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:48.042291 26958 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:48.042596 26967 consensus_queue.cc:260] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.054801 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:48.061334 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:48.090665 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:48.043911 26967 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:48.096748 19655 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 24: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:48.112228 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:48.107717 26978 log.cc:927] Time spent T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:20:48.111712 26548 consensus_meta.cc:287] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.001s
I20260709 13:20:48.131522 19476 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:48.135426 19580 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:48.149194 19505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 3063) took 1214 ms. Trace:
I20260709 13:20:48.149732 19505 rpcz_store.cc:276] 0709 13:20:46.935177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.935311 (+   134us) service_pool.cc:224] Handling call
0709 13:20:46.935593 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:47.559082 (+623489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:48.148920 (+589838us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54001b03d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:48.149124 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1424515456}
I20260709 13:20:48.159374 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:48.170306 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:48.170410 25579 raft_consensus.cc:3055] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:48.171031 25579 raft_consensus.cc:740] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:48.180209 26956 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.181488 19584 raft_consensus.cc:2368] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22.
I20260709 13:20:48.112164 26768 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:20:48.187556 26768 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:48.195257 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 63856us
I20260709 13:20:48.123579 26962 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:20:48.193717 26947 log.cc:927] Time spent T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:20:48.240020 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:48.198810 26816 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:20:48.250057 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 61884.6us
W20260709 13:20:48.253427 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 53834.4us
W20260709 13:20:48.244825 26946 log.cc:927] Time spent T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:20:48.256546 20619 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:48.261022 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 146579us
W20260709 13:20:48.266587 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 131733us
I20260709 13:20:48.194350 26548 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.272931 26815 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:48.295569 19578 raft_consensus.cc:2393] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 24: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:20:48.302059 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 49438.8us
I20260709 13:20:48.292325 26768 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:48.321687 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:48.302174 26801 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:20:48.316543 26956 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:48.353796 26988 log.cc:927] Time spent T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:20:48.354221 26548 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:48.354948 26930 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:48.361303 26830 consensus_meta.cc:287] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.002s
I20260709 13:20:48.362071 26960 raft_consensus.cc:3055] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:48.362484 26960 raft_consensus.cc:740] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:48.363253 26960 consensus_queue.cc:260] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.364573 26960 raft_consensus.cc:3060] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:48.365475 26859 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:48.368062 26892 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:48.372668 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:48.375829 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:48.380015 19504 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:48.385939 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:48.386667 19507 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:20:48.390196 19504 raft_consensus.cc:1240] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:48.391471 19578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60800 (request call id 4019) took 1082 ms. Trace:
I20260709 13:20:48.391907 19578 rpcz_store.cc:276] 0709 13:20:47.298023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:47.298185 (+   162us) service_pool.cc:224] Handling call
0709 13:20:48.380083 (+1081898us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b54002fd854. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:48.380215 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2272007424}
I20260709 13:20:48.378690 25579 consensus_queue.cc:260] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.393896 25579 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:48.406005 19507 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:48.423362 19625 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:48.439522 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 139380us
I20260709 13:20:48.440378 19476 leader_election.cc:400] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22.
I20260709 13:20:48.440685 19476 leader_election.cc:403] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:20:48.445497 26998 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:20:48.447016 26920 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:20:48.448552 26987 log.cc:927] Time spent T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 13:20:48.450634 26997 log.cc:927] Time spent T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:20:48.454159 26919 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.454792 26919 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.457187 26919 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:48.467628 26980 log.cc:927] Time spent T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:20:48.479561 19409 catalog_manager.cc:5697] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 22 to 25. New cstate: current_term: 25 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:48.486449 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 44139.3us
I20260709 13:20:48.489235 26876 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22.
W20260709 13:20:48.491473 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51238.4us
I20260709 13:20:48.493652 26996 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:48.494879 19625 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:48.497843 26920 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:20:48.499663 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:48.509658 19625 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:48.510715 26968 raft_consensus.cc:3055] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:48.511116 26968 raft_consensus.cc:740] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:48.511917 26968 consensus_queue.cc:260] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.513113 26968 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:48.515290 19505 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 24 index: 11. (index mismatch)
W20260709 13:20:48.516420 27008 log.cc:927] Time spent T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.115s	user 0.002s	sys 0.000s
I20260709 13:20:48.517536 26737 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:48.518081 26737 raft_consensus.cc:697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:48.518922 26737 consensus_queue.cc:237] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.520726 26920 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:48.521252 26920 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.521960 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:48.522554 19504 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:48.523267 26920 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:48.527582 19478 leader_election.cc:400] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22.
I20260709 13:20:48.530339 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:48.532087 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:48.537282 19507 raft_consensus.cc:2393] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 26: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:48.544328 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:48.544466 25579 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:48.562857 26995 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:48.563483 26995 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.569793 26958 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:48.573945 26845 consensus_queue.cc:1059] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:48.575163 26143 raft_consensus.cc:3055] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:48.575603 26143 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:48.576460 26143 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.588604 19660 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:20:48.590924 26845 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.591449 26845 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.593397 19625 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:48.596138 26827 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:48.596628 26827 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.596992 26827 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:48.587690 26143 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:48.577044 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:48.603120 19584 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 24 index: 11. (index mismatch)
I20260709 13:20:48.579442 19507 raft_consensus.cc:1240] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:20:48.507546 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:48.580811 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:48.581550 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:48.582226 19506 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:48.606387 19586 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:20:48.583098 19505 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:20:48.606593 19409 catalog_manager.cc:5697] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:48.583685 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:48.607903 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:48.584357 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:48.609141 19504 raft_consensus.cc:2393] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 22: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:48.608775 19584 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 20.
I20260709 13:20:48.585180 19587 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 31 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 29 index: 15. Preceding OpId from leader: term: 31 index: 16. (index mismatch)
I20260709 13:20:48.580397 19503 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:20:48.606319 19510 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:48.618148 19503 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 31 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 29 index: 15. Preceding OpId from leader: term: 31 index: 16. (index mismatch)
I20260709 13:20:48.608785 19409 catalog_manager.cc:5697] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 19 to 21, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 21 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:20:48.623283 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:48.649721 19505 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:20:48.628528 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:48.653290 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:48.677134 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:48.678917 19655 raft_consensus.cc:1275] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:20:48.615504 26826 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.685098 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:48.670372 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:48.744192 19586 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 26.
I20260709 13:20:48.744596 26143 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:48.684309 19409 catalog_manager.cc:5697] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 18 to 20, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 20 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:48.669406 19585 raft_consensus.cc:1275] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 13:20:48.745048 26143 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:48.745437 19585 pending_rounds.cc:85] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 14
I20260709 13:20:48.745558 26143 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:48.745747 19585 pending_rounds.cc:107] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 13:20:48.746088 19585 raft_consensus.cc:2889] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:48.683374 19403 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48826 (request call id 183) took 19865 ms (client timeout 15000 ms). Trace:
I20260709 13:20:48.706408 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
W20260709 13:20:48.747731 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 77440us
I20260709 13:20:48.748499 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:48.766525 25579 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:48.761436 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:48.771163 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 64860.9us
I20260709 13:20:48.768534 19657 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
W20260709 13:20:48.770540 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 89726.9us
I20260709 13:20:48.775585 26143 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.653587 26958 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:48.669205 26962 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.111s
I20260709 13:20:48.679821 26965 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:48.780395 26311 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:48.565605 26995 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:48.782524 26767 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:48.784976 26957 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:48.683775 26203 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.107s
I20260709 13:20:48.768921 26826 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.689836 26964 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.799614 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:48.679467 26945 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.119s
I20260709 13:20:48.800858 26143 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:48.801241 19584 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:20:48.712610 26960 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.088s
I20260709 13:20:48.677809 26845 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:48.795630 26844 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.835990 26844 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.838140 26844 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:48.800598 26311 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.839699 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:48.812268 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:48.840328 19506 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:48.814082 26445 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.818077 26826 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:48.818794 19511 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:48.857579 19511 raft_consensus.cc:606] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Received request to transfer leadership to TS e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:48.858129 19511 raft_consensus.cc:614] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:48.822984 26203 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:48.823297 19627 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:48.823438 26967 consensus_queue.cc:1048] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:48.823936 27000 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:48.824545 26965 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:48.824760 19503 raft_consensus.cc:1275] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:20:48.825366 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:48.747084 19403 rpcz_store.cc:269] 0709 13:20:28.818157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.849736 (+ 31579us) service_pool.cc:224] Handling call
0709 13:20:48.683230 (+19833494us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:45.082170 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:45.082850 (+   680us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:45.082902 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:20:45.082935 (+    33us) tablet.cc:662] Decoding operations
0709 13:20:45.085368 (+  2433us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:45.085466 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:45.085490 (+    24us) tablet.cc:685] Acquiring locks for 31 operations
0709 13:20:45.087760 (+  2270us) tablet.cc:701] Row locks acquired
0709 13:20:45.087811 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:20:45.087962 (+   151us) write_op.cc:270] Start()
0709 13:20:45.088101 (+   139us) write_op.cc:276] Timestamp: P: 1783603245087904 usec, L: 0
0709 13:20:45.088136 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:20:45.088919 (+   783us) log.cc:844] Serialized 12320 byte log entry
0709 13:20:45.849317 (+760398us) op_driver.cc:464] REPLICATION: finished
0709 13:20:45.916566 (+ 67249us) write_op.cc:301] APPLY: starting
0709 13:20:45.916681 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:46.500830 (+584149us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:46.500962 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:47.095239 (+594277us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:47.122577 (+ 27338us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=62,key_file_lookups=62,delta_file_lookups=62,mrs_lookups=0
0709 13:20:47.122648 (+    71us) write_op.cc:312] APPLY: finished
0709 13:20:47.123241 (+   593us) log.cc:844] Serialized 268 byte log entry
0709 13:20:47.283991 (+160750us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:47.321454 (+ 37463us) write_op.cc:454] Released schema lock
0709 13:20:47.352188 (+ 30734us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:47.391979 (+ 39791us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:47.392017 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":66909,"apply.run_cpu_time_us":84349,"apply.run_wall_time_us":1451559,"cfile_cache_hit":126,"cfile_cache_hit_bytes":133645,"num_ops":31,"prepare.queue_time_us":103822,"prepare.run_cpu_time_us":29097,"prepare.run_wall_time_us":232727,"raft.queue_time_us":267277,"raft.run_cpu_time_us":21784,"raft.run_wall_time_us":105641,"replication_time_us":745201,"thread_start_us":616265,"threads_started":5,"wal-append.queue_time_us":575945,"wal-append.run_cpu_time_us":20808,"wal-append.run_wall_time_us":2705038}]]}
I20260709 13:20:48.827920 26995 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:48.828262 26892 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:48.834345 26885 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.841423 19625 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:48.862891 19655 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:48.876557 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:48.854290 26311 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:48.860610 26445 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.891324 26885 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.892720 26445 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:48.894433 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:48.894807 27007 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:48.895152 19582 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:20:48.895267 27007 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.895648 27007 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:48.896379 26995 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.884285 19504 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 21.
I20260709 13:20:48.801889 26966 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:20:48.905946 26995 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:48.888780 26844 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:48.910140 26844 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:48.910585 26844 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:20:48.888139 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 46794.4us
I20260709 13:20:48.888089 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:48.916944 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:48.917609 19508 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 26.
I20260709 13:20:48.919816 26885 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:48.920948 26962 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:48.904745 27007 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.923468 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:48.806061 26957 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.925238 27007 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:48.927410 26957 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:48.812813 26964 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.929850 26964 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:48.932523 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:48.933354 19585 raft_consensus.cc:2410] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 27 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:20:48.934911 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:48.935710 19503 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:48.936777 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:48.938366 19659 raft_consensus.cc:1240] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:20:48.941881 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:48.942514 19659 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:48.946475 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:48.951251 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:48.951422 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:48.954942 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:48.949873 26957 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:48.888249 26996 consensus_queue.cc:1048] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 13:20:48.964359 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:48.957521 26968 consensus_queue.cc:1059] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:20:48.961786 26966 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:48.964375 26827 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:48.964819 26957 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:48.982714 19654 raft_consensus.cc:2368] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22.
I20260709 13:20:48.975111 26966 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:48.993413 19551 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:48.982179 26965 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:48.989985 26966 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:49.006117 19511 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:49.007037 19511 raft_consensus.cc:606] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 25 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
W20260709 13:20:49.011518 27019 log.cc:927] Time spent T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:20:49.000360 26968 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:49.036096 26844 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.043032 26966 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.061443 26995 raft_consensus.cc:3055] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:49.062018 26995 raft_consensus.cc:740] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:49.047098 26968 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.074486 19506 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:49.076319 19506 raft_consensus.cc:606] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:49.076851 19506 raft_consensus.cc:614] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:49.070748 26995 consensus_queue.cc:260] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.009848 26957 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.053745 26844 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:49.100180 26827 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:49.104434 26311 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.110392 19509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9807bdebbbd742009e4a329706a92790"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:49.111116 19509 raft_consensus.cc:606] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:49.111519 19509 raft_consensus.cc:614] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:49.079478 26968 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.121430 26968 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:49.124158 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 32 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:49.127116 26918 raft_consensus.cc:993] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:49.127875 26918 raft_consensus.cc:1081] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 25 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:49.131827 26826 consensus_queue.cc:1048] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:49.142001 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:49.147135 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
W20260709 13:20:49.151436 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 227137us
I20260709 13:20:49.152916 19625 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:49.155503 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:49.155601 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 32 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:49.162000 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:49.162578 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:49.163467 19661 raft_consensus.cc:2410] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 27 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:20:49.164629 19658 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:20:49.162642 19506 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:49.168705 19551 leader_election.cc:400] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22.
I20260709 13:20:49.171813 19505 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:20:49.170145 19627 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:49.174714 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:49.175556 19507 raft_consensus.cc:2393] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 26: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:49.178560 19476 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:49.180333 26939 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:49.181522 26939 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:49.185184 19511 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:49.189110 19511 raft_consensus.cc:606] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:49.189590 19511 raft_consensus.cc:614] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:49.210124 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:49.211787 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:49.213811 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:49.214210 19506 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
W20260709 13:20:49.215814 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45928.4us
W20260709 13:20:49.217777 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 67067.6us
I20260709 13:20:49.225062 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:49.261979 19507 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:20:49.263995 19578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60808
I20260709 13:20:49.264587 19578 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:49.264935 19578 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:20:49.269055 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 49764.6us
W20260709 13:20:49.269981 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 49823us
I20260709 13:20:49.271032 19654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:20:49.271678 19654 raft_consensus.cc:606] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:49.272065 19654 raft_consensus.cc:614] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:49.221916 26996 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:49.276085 26996 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.276551 26996 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:49.286959 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:49.287602 19658 raft_consensus.cc:3060] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:49.290678 19586 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 26.
I20260709 13:20:49.284683 19578 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:49.293859 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 55474.4us
I20260709 13:20:49.295410 19578 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:49.297154 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:49.299067 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:49.300444 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:49.301023 19654 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:49.302224 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:49.302917 19511 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:20:49.303259 19511 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:49.304453 19511 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.11, Last appended by leader: 11, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.305577 19511 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:49.316277 26839 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:49.325207 19507 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:49.326926 19551 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:49.285027 26311 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:49.326953 19625 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:49.292774 26885 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:49.339071 19658 raft_consensus.cc:2468] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:49.341228 26143 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 13:20:49.346840 19511 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
I20260709 13:20:49.348215 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:49.334455 26967 raft_consensus.cc:2804] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:49.359169 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:49.360461 19507 raft_consensus.cc:2393] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 20: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:49.337271 26918 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.343251 26311 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.366521 19654 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
I20260709 13:20:49.351745 26815 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.367472 26815 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:49.360101 26959 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:20:49.377452 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:49.386459 27024 log.cc:927] Time spent T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:20:49.387375 26815 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:49.373306 26311 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.389894 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:49.390574 19579 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 28.
I20260709 13:20:49.391520 26311 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:49.392612 20631 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:20:49.393796 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:49.394610 19508 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 27.
I20260709 13:20:49.393886 26880 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:20:49.357810 27000 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:49.369300 26967 raft_consensus.cc:697] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:49.395596 26880 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.371348 26918 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.406908 26959 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 26 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:20:49.445235 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 153991us
W20260709 13:20:49.445159 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 106913us
I20260709 13:20:49.425498 26880 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:20:49.433233 27000 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
W20260709 13:20:49.534993 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:49.498394 27006 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.537151 26203 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.569829 27000 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.570052 26203 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:49.558612 27025 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:20:49.537505 26967 consensus_queue.cc:237] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.550124 27006 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:49.607122 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 69347.9us
W20260709 13:20:49.644209 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 65458.4us
I20260709 13:20:49.577925 26996 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.604074 26203 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:49.554613 26959 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.11, Last appended by leader: 11, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.651176 19627 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:49.657941 19659 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 24. Current term is 25. Ops: [24.15-24.15]
I20260709 13:20:49.658790 26996 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:49.658903 26918 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:49.660734 27006 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:49.661260 26995 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:49.661775 27029 log.cc:927] Time spent T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:20:49.673257 27000 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:49.674010 27000 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.676544 27000 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:49.686829 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:49.687583 19660 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 27.
I20260709 13:20:49.689270 19658 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:49.689682 27035 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:49.690284 27035 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 26 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:49.691066 26880 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:49.650184 26799 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:49.695401 26799 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.697451 26885 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:49.698067 26885 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:49.689270 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:49.699447 19579 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 25.
I20260709 13:20:49.700529 19587 raft_consensus.cc:2410] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:20:49.706387 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:49.707145 19579 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:20:49.708210 26966 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:49.708938 26885 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.691123 27035 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.713578 26885 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:49.717542 26799 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:49.735406 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:49.738421 19658 raft_consensus.cc:1240] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 26. Current term is 27. Ops: []
I20260709 13:20:49.745193 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:49.753866 27037 log.cc:927] Time spent T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.090s	user 0.000s	sys 0.005s
I20260709 13:20:49.755324 26964 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 13:20:49.755474 27033 log.cc:927] Time spent T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.214s	user 0.000s	sys 0.006s
I20260709 13:20:49.755827 26964 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.756278 26964 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:20:49.758472 27027 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.185s	user 0.006s	sys 0.000s
I20260709 13:20:49.760342 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:49.760990 19587 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:49.762187 19657 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 20.
I20260709 13:20:49.765833 26962 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:49.766696 26962 consensus_queue.cc:1243] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer e19c80e9149b4b8d88ae13bde8e43864 log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:49.767537 26957 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:49.767879 26957 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:49.746598 19478 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:49.749392 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:49.768952 27047 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:49.769377 27047 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.769726 27047 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:20:49.771544 27032 log.cc:927] Time spent T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.236s	user 0.004s	sys 0.000s
I20260709 13:20:49.773844 26962 consensus_queue.cc:1059] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:49.778103 19551 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:49.801378 19579 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 29.
I20260709 13:20:49.807626 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:49.808599 19587 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 25.
I20260709 13:20:49.810743 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:49.811133 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:49.811626 19659 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 25.
I20260709 13:20:49.812299 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:49.812947 19580 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:49.815379 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:49.816231 19659 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 20.
I20260709 13:20:49.802882 20631 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:20:49.821815 19511 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:49.822199 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:49.822768 26720 raft_consensus.cc:2804] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:20:49.822928 19506 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
I20260709 13:20:49.820007 26957 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.823372 26720 raft_consensus.cc:697] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 29 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:49.824172 26957 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:49.824373 26720 consensus_queue.cc:237] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:49.814795 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:49.831089 19580 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:20:49.798950 26880 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 29 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:49.839532 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:49.840499 19655 raft_consensus.cc:2393] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 27: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:49.838696 19478 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:49.800311 26962 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:49.798650 26966 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.852363 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:49.854799 19505 raft_consensus.cc:3060] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Advancing to term 29
I20260709 13:20:49.855002 25579 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:49.855551 25579 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.868283 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:49.870787 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:49.883808 25579 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:49.885222 19627 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:49.887857 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:49.888751 19511 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:49.864787 27034 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:49.895646 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:49.899387 25579 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:49.870713 26962 raft_consensus.cc:697] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:49.900254 19505 raft_consensus.cc:2468] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 29.
I20260709 13:20:49.870102 27041 consensus_queue.cc:1059] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:20:49.882455 26964 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.915189 26964 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:49.917181 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:49.917830 19655 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:49.893127 27034 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.919420 27034 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:49.916975 27047 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.923904 19508 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 26: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:49.924033 27047 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:49.925633 26962 consensus_queue.cc:237] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.867936 26966 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:49.929330 19582 raft_consensus.cc:2368] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 27. Current term is 28.
I20260709 13:20:49.929687 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:49.937083 19505 raft_consensus.cc:3060] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Advancing to term 28
I20260709 13:20:49.930991 19627 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:49.947607 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:49.949970 19511 raft_consensus.cc:2393] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 25: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
W20260709 13:20:49.955964 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 85259.9us
W20260709 13:20:49.952009 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 67880.3us
I20260709 13:20:49.935155 19655 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 28.
I20260709 13:20:49.964154 19505 raft_consensus.cc:2468] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 28.
I20260709 13:20:49.965662 19627 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:49.963579 19551 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:49.974610 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:49.975203 19581 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:49.969256 26959 raft_consensus.cc:2804] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:20:49.968883 26846 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:49.993640 26846 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.994104 26846 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:50.003265 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:20:49.988633 27050 log.cc:927] Time spent T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:20:49.973569 26513 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:50.009967 19581 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 26.
I20260709 13:20:50.014446 27048 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:50.010569 26959 raft_consensus.cc:697] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 28 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:50.040757 19478 leader_election.cc:400] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 27. Current term is 28.
I20260709 13:20:50.041903 19478 leader_election.cc:403] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:50.042704 19478 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:50.014459 26513 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:20:50.036731 27027 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:50.037962 26967 raft_consensus.cc:3055] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:20:50.052986 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:50.077945 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 66615.5us
W20260709 13:20:50.083635 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 110410us
I20260709 13:20:50.080539 26967 raft_consensus.cc:740] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
W20260709 13:20:50.161212 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 80316.4us
I20260709 13:20:50.080735 26876 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:50.196143 26876 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:50.197224 26876 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:50.048414 26513 raft_consensus.cc:3060] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:50.165664 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 110236us
I20260709 13:20:50.171346 26966 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:50.174846 19627 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:50.177999 26920 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:50.186524 26959 consensus_queue.cc:237] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:50.192646 26967 consensus_queue.cc:260] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:50.078552 26939 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Leader pre-election lost for term 27. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 27. Current term is 28.
W20260709 13:20:50.193898 27027 log.cc:927] Time spent T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:20:50.162578 27005 raft_consensus.cc:3055] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:20:50.234373 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 59639us
I20260709 13:20:50.235227 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:50.236057 19655 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:20:50.247370 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:50.248261 19581 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 25.
I20260709 13:20:50.247527 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:50.249289 19506 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 25.
I20260709 13:20:50.257151 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:50.259214 19510 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:50.264573 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:50.239935 26839 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:20:50.221180 27005 raft_consensus.cc:740] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:50.270351 26143 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:50.296587 26143 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.297066 26143 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:50.297582 27035 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:50.239053 27034 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:50.256000 26846 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:50.320503 26513 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:50.338476 26513 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:50.340703 26143 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:50.342658 26143 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:50.346374 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:50.347409 19659 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:50.375521 19585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45038
I20260709 13:20:50.376230 19585 raft_consensus.cc:606] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Received request to transfer leadership
W20260709 13:20:50.408913 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 151834us
W20260709 13:20:50.411298 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 147544us
I20260709 13:20:50.421703 19657 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 26: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:50.332406 27035 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:50.460089 19584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45038
I20260709 13:20:50.461072 19584 raft_consensus.cc:606] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Received request to transfer leadership
I20260709 13:20:50.476114 19659 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:20:50.344815 27034 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:50.501942 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 48412.4us
I20260709 13:20:50.503171 19476 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:20:50.506575 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 243283us
I20260709 13:20:50.506886 19504 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:20:50.514003 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 73701.7us
W20260709 13:20:50.453481 26957 consensus_meta.cc:287] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.629s	user 0.012s	sys 0.001s
I20260709 13:20:50.517711 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:50.526592 19504 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:20:50.453707 27032 log.cc:927] Time spent T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:20:50.451711 27035 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:50.533677 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:50.536127 19659 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 25 index: 11. Preceding OpId from leader: term: 26 index: 12. (index mismatch)
I20260709 13:20:50.536528 19654 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:50.536582 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:50.537070 19509 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 25 index: 11. Preceding OpId from leader: term: 26 index: 12. (index mismatch)
I20260709 13:20:50.544600 26962 raft_consensus.cc:993] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: : Instructing follower e19c80e9149b4b8d88ae13bde8e43864 to start an election
I20260709 13:20:50.496953 27041 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:50.545833 27041 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:50.548110 27041 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:50.552506 27005 consensus_queue.cc:260] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:50.564582 26846 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:50.620427 19504 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
W20260709 13:20:50.673753 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:50.694921 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 158441us
I20260709 13:20:50.714547 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:50.568123 27077 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:50.724499 19551 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:50.568281 26957 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.154s
I20260709 13:20:50.727458 19578 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 29 index: 21. (index mismatch)
I20260709 13:20:50.713560 26842 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.713423 26964 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:50.753998 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 54206.6us
I20260709 13:20:50.744227 26964 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:50.759014 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 189392us
I20260709 13:20:50.762666 19585 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:50.735044 26842 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:50.767076 26842 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:50.772526 26964 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:50.774453 26964 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:50.775071 26964 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 26 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:50.776283 26964 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:50.720630 26311 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:20:50.778687 19578 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:20:50.779090 19578 pending_rounds.cc:85] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 14
I20260709 13:20:50.779291 19578 pending_rounds.cc:107] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:20:50.779512 19578 raft_consensus.cc:2889] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:50.781862 26968 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:50.785738 26962 raft_consensus.cc:1081] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Signalling peer e19c80e9149b4b8d88ae13bde8e43864 to start an election
I20260709 13:20:50.789151 26967 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:50.720880 26995 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:20:50.790068 26995 raft_consensus.cc:3055] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:50.790417 26995 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:50.791167 26995 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:50.792248 26995 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:50.795562 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:50.805964 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:50.807080 19584 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 26: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:50.849478 19578 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260709 13:20:50.874704 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 74741.2us
W20260709 13:20:50.971216 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:50.979027 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 181429us
I20260709 13:20:50.977985 26203 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:50.991230 26203 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:50.992950 27041 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:50.993507 27041 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:50.997943 19397 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for c62f6690c8e840638906e0b59d2ae71d already in progress [suppressed 2 similar messages]
I20260709 13:20:50.998064 26954 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 13:20:51.001459 27041 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:50.979300 26959 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:51.019476 26959 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:51.027307 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 302906us
I20260709 13:20:51.029906 19583 raft_consensus.cc:2468] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:51.033900 26203 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:51.009011 27035 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:51.041015 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 500919us
I20260709 13:20:51.049153 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:51.058902 19508 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:51.050166 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:51.060009 19659 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:20:50.961266 26885 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 13:20:51.078761 26311 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.079056 26143 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.079332 26311 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.079790 26143 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.081240 26311 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.081562 26143 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.086675 19654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
 from {username='slave'} at 127.0.0.1:56824
I20260709 13:20:51.087260 19654 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:51.087611 19654 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:51.088470 26876 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:51.089046 26876 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.089793 26842 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:51.091572 19655 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:51.093724 19504 raft_consensus.cc:1275] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 29 index: 21. (index mismatch)
I20260709 13:20:51.093856 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:51.095168 19658 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 13:20:51.096601 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:51.099898 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:51.102831 19504 raft_consensus.cc:1275] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 13:20:51.110805 19655 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
I20260709 13:20:51.098598 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:51.122875 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:51.128741 19504 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:51.129781 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:51.130057 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:51.126777 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:51.138034 19503 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
I20260709 13:20:51.133415 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:51.147944 19506 raft_consensus.cc:2393] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 21: Already voted for candidate d56df3728fc04e37b2d29a3bcd91d167 in this term.
I20260709 13:20:51.115521 19654 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:51.071377 26203 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 13:20:51.153843 19505 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:20:51.156284 26143 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:20:51.097800 26842 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.121775 26815 consensus_queue.cc:1048] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.037s
I20260709 13:20:50.335269 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:51.341920 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:51.343856 26847 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:51.345250 26311 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.345721 19652 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 23: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:51.336334 19658 raft_consensus.cc:1240] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 24. Current term is 25. Ops: [24.15-24.15]
I20260709 13:20:51.346992 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:51.345937 26311 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.347913 19656 raft_consensus.cc:2410] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
W20260709 13:20:51.200022 19397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 202105us
W20260709 13:20:51.271018 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 104977us
I20260709 13:20:51.201121 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:51.268625 19409 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 58) took 12110 ms (client timeout 15000 ms). Trace:
I20260709 13:20:51.354457 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:51.356077 27069 consensus_queue.cc:1048] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:20:51.356251 19508 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:20:51.358696 26842 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.210346 27092 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.359767 27092 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.362560 27092 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.152396 26876 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:51.368326 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 167316us
I20260709 13:20:51.369169 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:51.370035 26143 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:51.370590 26143 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.371021 26143 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:51.376276 19580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45038
I20260709 13:20:51.376901 19580 raft_consensus.cc:606] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Received request to transfer leadership
W20260709 13:20:51.352144 19409 rpcz_store.cc:269] 0709 13:20:39.158259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.173873 (+ 15614us) service_pool.cc:224] Handling call
0709 13:20:51.268521 (+12094648us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:49.046198 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:49.056816 (+ 10618us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:49.056851 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:20:49.056879 (+    28us) tablet.cc:662] Decoding operations
0709 13:20:49.057482 (+   603us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:49.057564 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:49.057592 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:20:49.058061 (+   469us) tablet.cc:701] Row locks acquired
0709 13:20:49.058080 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:20:49.058228 (+   148us) write_op.cc:270] Start()
0709 13:20:49.058350 (+   122us) write_op.cc:276] Timestamp: P: 1783603249058183 usec, L: 0
0709 13:20:49.058376 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:20:49.059002 (+   626us) log.cc:844] Serialized 1758 byte log entry
0709 13:20:49.663292 (+604290us) op_driver.cc:464] REPLICATION: finished
0709 13:20:49.906193 (+242901us) write_op.cc:301] APPLY: starting
0709 13:20:49.906294 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:49.909070 (+  2776us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:49.909171 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:50.168828 (+259657us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:50.169058 (+   230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:20:50.169115 (+    57us) write_op.cc:312] APPLY: finished
0709 13:20:50.169387 (+   272us) log.cc:844] Serialized 49 byte log entry
0709 13:20:50.169597 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:50.169738 (+   141us) write_op.cc:454] Released schema lock
0709 13:20:50.169788 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:50.170305 (+   517us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:50.170339 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1132487,"reported_tablets":6,"spinlock_wait_cycles":8448,"child_traces":[["op",{"apply.queue_time_us":232110,"apply.run_cpu_time_us":8958,"apply.run_wall_time_us":264088,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20839,"num_ops":4,"prepare.queue_time_us":208169,"prepare.run_cpu_time_us":101619,"prepare.run_wall_time_us":256979,"raft.queue_time_us":220480,"raft.run_cpu_time_us":20207,"raft.run_wall_time_us":180787,"replication_time_us":604768,"spinlock_wait_cycles":3840,"thread_start_us":658218,"threads_started":4,"wal-append.queue_time_us":336217,"wal-append.run_cpu_time_us":57645,"wal-append.run_wall_time_us":1804520}]]}
I20260709 13:20:51.151754 26959 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.411697 26311 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.403465 19652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:51.417145 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:51.418119 19660 raft_consensus.cc:1275] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:51.322991 26966 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:51.329224 27043 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:51.150353 26967 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:51.423064 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:51.423295 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:51.433043 19653 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 27.
I20260709 13:20:51.254359 27035 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:51.430722 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 80761.7us
I20260709 13:20:51.251844 26995 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:51.158149 27077 raft_consensus.cc:697] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:51.436055 19658 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:20:51.438321 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:51.411368 27070 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:51.450170 26876 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:51.450122 26844 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:51.456593 27077 consensus_queue.cc:237] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.456966 26844 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.348152 26847 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.460119 26847 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:51.464570 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:51.439316 26967 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.443410 27090 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:51.445044 26962 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:20:51.450680 27070 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.485991 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:51.444459 26959 consensus_queue.cc:1048] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:20:51.435221 26966 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.488083 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:51.473172 26967 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:51.487620 26143 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.443536 26995 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.475194 26842 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:51.441895 27043 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.456733 26876 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.493708 19627 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:51.478729 26962 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.481092 27070 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:51.503563 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:51.504139 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:51.504359 19511 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:51.503526 19627 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:51.491528 26913 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:51.509431 26143 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.492870 27100 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:51.514911 19509 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
I20260709 13:20:51.517442 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:51.518143 19504 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:51.518549 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:51.522644 27066 raft_consensus.cc:2804] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:51.523262 27066 raft_consensus.cc:697] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:51.523622 26876 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.524117 27066 consensus_queue.cc:237] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.525199 26844 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:51.512019 26913 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:51.526024 26913 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:51.502156 26962 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:51.529434 19654 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:51.500334 27000 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:20:51.501538 26842 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:51.532768 26842 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:51.538957 19509 raft_consensus.cc:2368] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 25. Current term is 26.
I20260709 13:20:51.540318 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:51.540887 19511 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:20:51.541481 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:51.543161 19504 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:51.547290 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:51.548249 19504 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 26.
I20260709 13:20:51.554271 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:51.570734 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:51.571599 20665 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:51.481772 27090 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.549822 27089 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.035s
W20260709 13:20:51.575299 27106 log.cc:927] Time spent T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:20:51.539609 27100 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.519721 27084 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:20:51.515132 27034 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:51.567687 26143 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:51.613246 26143 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.607023 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:51.550508 26436 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:51.675554 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:20:51.678428 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 67047.3us
I20260709 13:20:51.681586 20665 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:51.614528 19625 leader_election.cc:400] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 25. Current term is 26.
I20260709 13:20:51.684947 19625 leader_election.cc:403] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
W20260709 13:20:51.684736 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:51.689908 26143 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.684784 19476 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:51.697736 26143 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:20:51.696377 19476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:51.693317 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 83472.6us
I20260709 13:20:51.698537 26143 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.709650 19510 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:51.709853 19625 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:51.715282 19627 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:51.612190 26767 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.084s
W20260709 13:20:51.722019 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 183924us
I20260709 13:20:51.728747 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:51.705571 26801 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:51.708609 26844 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 for earlier term 25. Current term is 26.
I20260709 13:20:51.704342 27086 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:51.690950 27115 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:51.676107 27034 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.731590 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:51.743111 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:51.735013 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:51.736589 27043 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.721676 26847 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:51.725567 26826 raft_consensus.cc:2804] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:51.690241 26436 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.749159 26143 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.779919 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:51.784003 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:51.784683 19586 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:51.778035 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:51.760492 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:51.738279 27113 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:51.787273 19587 raft_consensus.cc:3055] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:51.782418 26966 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.779140 27082 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:51.798574 27082 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.757714 26995 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.800889 27082 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.773870 27043 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:51.778862 27069 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:51.802130 27043 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.802314 27069 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.803211 27005 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:51.804563 27043 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.804643 27069 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.757356 26880 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:51.757266 27111 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:51.805338 26913 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.805648 27111 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.805524 26880 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:51.807708 26913 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.807973 27111 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.808498 26880 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.808864 27090 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.810437 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:51.810912 27034 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.766592 26965 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:51.785382 26826 raft_consensus.cc:697] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:51.791234 26962 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.792908 19587 raft_consensus.cc:740] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:51.794004 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:51.820391 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:51.835412 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:51.838999 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:51.839957 19505 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 17.
I20260709 13:20:51.840902 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:51.841538 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:51.841861 19661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:51.842295 19655 raft_consensus.cc:2393] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 23: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:51.755290 26847 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:51.828666 19587 consensus_queue.cc:260] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:51.846766 19505 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:20:51.847462 19660 raft_consensus.cc:2393] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 27: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:51.878633 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:51.878582 19587 raft_consensus.cc:3060] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:51.891495 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
W20260709 13:20:51.893205 19478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:51.893112 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:51.846921 27117 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:51.906077 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:51.853549 26847 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:51.909973 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:51.911294 19585 raft_consensus.cc:2410] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:20:51.746546 27086 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.751498 27115 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.921856 19585 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:20:51.924714 19587 raft_consensus.cc:2468] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:51.830559 26965 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.829376 27113 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.937915 26965 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.942574 27100 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:51.944645 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:51.947737 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:51.964568 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:51.938709 26826 consensus_queue.cc:237] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:51.935652 27117 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:51.970589 19510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50828 (request call id 3124) took 1363 ms. Trace:
I20260709 13:20:51.970463 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:51.972282 19510 rpcz_store.cc:276] 0709 13:20:50.607352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.608305 (+   953us) service_pool.cc:224] Handling call
0709 13:20:50.608727 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:51.710185 (+1101458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.970349 (+260164us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002071d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175ae01 00007f6c3175983e 00007f6c3671e419 00007f6c2fc95bd4 00007f6c2fc95b62 00007f6c2fc95a91 00007f6c2fc95a0c 00007f6c2fc94cc2 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:51.970541 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2531349376}
I20260709 13:20:51.976435 26436 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:51.953038 27120 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:20:51.980007 27070 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:51.982005 19578 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 26. Current term is 27. Ops: [26.15-26.15]
I20260709 13:20:51.984812 27070 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:52.003660 27086 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:52.004926 27115 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:52.006834 26962 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:52.016680 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 46323.2us
I20260709 13:20:52.021999 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:52.024407 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:52.025041 19509 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:52.016222 26720 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:52.033687 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:52.034977 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:52.035403 26962 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:52.035992 26962 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.039126 19505 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:20:52.043466 19511 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 25.
I20260709 13:20:52.029526 26720 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:52.048177 26885 consensus_queue.cc:1059] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:20:52.051481 27085 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.059113 26720 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:52.057732 26962 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:52.077304 27127 log.cc:927] Time spent T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:20:52.091646 27036 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:52.092198 27036 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:52.075327 27085 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.099856 27113 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:52.100275 26847 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.101035 27085 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:52.105134 19550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.119454 19509 raft_consensus.cc:2468] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 27.
I20260709 13:20:52.110209 26846 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:52.111163 26967 consensus_meta.cc:287] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.001s
I20260709 13:20:52.123791 26846 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.093160 27036 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.126168 26846 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:52.126330 27036 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:52.135169 26967 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.140545 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:52.066155 27117 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.167469 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:52.171540 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:52.172488 19585 raft_consensus.cc:2368] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 27. Current term is 28.
I20260709 13:20:52.174222 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:52.174512 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:52.176277 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:52.178117 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:52.180204 19579 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:20:52.180656 19579 pending_rounds.cc:85] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 12
I20260709 13:20:52.180930 19579 pending_rounds.cc:107] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:20:52.181529 19579 raft_consensus.cc:2889] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:52.189301 19551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:52.190325 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 47081.8us
I20260709 13:20:52.132612 26720 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:52.194820 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:52.197011 26720 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 18 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:52.212479 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:52.221105 19578 raft_consensus.cc:2368] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24.
I20260709 13:20:52.221732 26967 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:52.224632 26847 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:52.239755 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.247460 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:52.249200 19656 raft_consensus.cc:1240] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:52.250430 19508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50828 (request call id 3131) took 1140 ms. Trace:
I20260709 13:20:52.250842 19508 rpcz_store.cc:276] 0709 13:20:51.093478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.093587 (+   109us) service_pool.cc:224] Handling call
0709 13:20:52.234042 (+1140455us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54000fcb54. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c3571 00007f6c3175e2fa 00007f6c3671fb17 00007f6c2fc9a6d4 00007f6c2fc9a662 00007f6c2fc9a591 00007f6c2fc9a50c 00007f6c2fc997c2 00007f6c2fa9548c 00007f6c2fa948c6 00007f6c2fa9426f
0709 13:20:52.234181 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":602126080}
I20260709 13:20:52.252506 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.274353 19660 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 25: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:52.213866 27109 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:52.274528 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.276146 26880 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:52.279495 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.280406 19655 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:20:52.282573 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.282899 19657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.283005 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c89dfa6a61346148bb8520ed4d0ecd9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.252758 26995 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.301999 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:52.302873 19551 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:20:52.303169 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 230528us
I20260709 13:20:52.304243 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.304412 26967 raft_consensus.cc:2804] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:20:52.305044 26967 raft_consensus.cc:697] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:52.305512 27113 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:52.305970 27113 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:52.306429 27113 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:52.308699 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 67002.7us
I20260709 13:20:52.309836 19478 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:52.311414 19458 auto_rebalancer.cc:893] Removing replace marker failed: Replica 2cfd02601ea44976833027665abc93bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 22 committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:20:52.312047 19458 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for c62f6690c8e840638906e0b59d2ae71d already in progress
I20260709 13:20:52.311807 27092 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:20:52.312350 19458 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for c62f6690c8e840638906e0b59d2ae71d already in progress
I20260709 13:20:52.317559 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.318331 19656 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 25.
I20260709 13:20:52.319406 19404 catalog_manager.cc:5697] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 18 to 23, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 23 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:52.319931 26995 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.291639 27109 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.277331 26994 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:52.311554 26801 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:52.321280 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:52.321913 26994 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.322997 27109 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:52.323570 27109 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:52.323932 26994 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:52.324031 27109 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.293815 26880 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:52.326985 26995 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:52.327543 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:52.327752 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:52.328332 19509 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Advancing to term 28
I20260709 13:20:52.335418 19508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:52.305989 26967 consensus_queue.cc:237] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.327768 26880 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:52.337536 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:52.337858 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:52.338231 19510 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:52.324350 19476 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:52.339669 27041 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:52.340147 27041 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.340560 27041 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:52.343775 19404 catalog_manager.cc:5697] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:52.345083 19505 raft_consensus.cc:1240] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 26. Current term is 27. Ops: [25.14-26.15]
I20260709 13:20:52.346099 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.347317 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:52.349534 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.351166 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:52.352048 27108 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:52.352473 27108 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:52.352829 27108 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:52.353065 27109 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:52.311520 19478 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.354138 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.354653 19478 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.355101 27100 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:52.355419 26767 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:52.355899 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:52.356447 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:52.357370 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.357951 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:52.358106 26815 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:52.358561 19504 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:20:52.360095 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.363409 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:52.366691 19659 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:52.369434 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:52.371430 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.373721 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:52.377038 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:52.377904 19587 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:20:52.380681 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:52.383980 19509 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 28.
I20260709 13:20:52.385787 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.387632 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:52.390488 19655 raft_consensus.cc:3060] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:52.386531 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:52.393011 19510 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:20:52.390034 19478 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.398751 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.400346 19579 raft_consensus.cc:1240] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:20:52.395246 19551 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:52.402803 20666 raft_consensus.cc:1240] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:52.403435 19551 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:52.413789 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.413658 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.386271 26880 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:52.418247 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:52.420202 19659 raft_consensus.cc:3060] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:52.422823 19655 raft_consensus.cc:2468] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 28.
I20260709 13:20:52.418578 19660 raft_consensus.cc:1240] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 26. Current term is 27. Ops: []
I20260709 13:20:52.400700 27086 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:52.414669 27117 raft_consensus.cc:2804] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:20:52.428261 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.431720 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.415854 26968 raft_consensus.cc:2804] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:52.429459 27086 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:52.395550 27089 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:20:52.415686 27043 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:52.444376 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.447563 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:52.448613 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:52.449937 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.419718 26445 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:20:52.435493 27117 raft_consensus.cc:697] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 28 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:52.441228 27100 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:52.443166 27086 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:52.456524 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.469213 19551 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.469813 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:52.451499 19659 raft_consensus.cc:2468] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:20:52.453717 26968 raft_consensus.cc:697] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:52.459911 27121 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:52.477823 19551 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.482041 19551 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.467657 27119 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:52.472997 27110 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:52.506511 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:52.509896 19551 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.486037 27087 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:52.517248 19404 catalog_manager.cc:5697] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 13 to 14, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 14 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:52.520350 19404 catalog_manager.cc:5697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 14 to 17, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 17 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:52.477504 26959 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:52.536265 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.541522 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.542675 19551 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.483433 26962 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 13:20:52.531226 27119 raft_consensus.cc:2749] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:52.545912 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.535909 27087 raft_consensus.cc:2749] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:52.535746 26827 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:52.559198 19627 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:52.560930 19551 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.543637 27121 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:52.544147 26957 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:52.565189 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:52.562595 26827 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:52.568221 19404 catalog_manager.cc:5697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 15 to 16, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 16 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:52.562417 26959 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:52.528230 27117 consensus_queue.cc:237] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.555682 27110 consensus_queue.cc:1059] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:20:52.555076 27109 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:52.585237 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:52.545578 26968 consensus_queue.cc:237] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:52.608989 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 195281us
I20260709 13:20:52.586057 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:52.643150 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 57161us
I20260709 13:20:52.645582 19478 leader_election.cc:400] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 27. Current term is 28.
I20260709 13:20:52.647089 19478 leader_election.cc:403] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:52.650345 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:52.652627 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 67533.9us
I20260709 13:20:52.598518 27087 raft_consensus.cc:2749] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:52.666254 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.586433 26827 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:52.586692 26847 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 13:20:52.655565 27142 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:20:52.645557 27121 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:52.658735 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.674902 19580 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:52.677910 19478 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.678459 19579 raft_consensus.cc:1275] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:52.680892 19478 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.658695 27074 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:20:52.590544 27108 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.689806 26801 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:52.692199 26892 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:20:52.710855 27086 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.712093 19583 raft_consensus.cc:1240] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:52.711741 19404 catalog_manager.cc:5697] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:52.672026 27145 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Leader pre-election lost for term 27. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 27. Current term is 28.
I20260709 13:20:52.655804 27119 consensus_queue.cc:1059] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 26.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:20:52.668562 27109 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:52.686563 19478 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:52.726315 25579 raft_consensus.cc:3055] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:20:52.726907 25579 raft_consensus.cc:740] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:52.727986 25579 consensus_queue.cc:260] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.688832 27005 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:20:52.695508 27144 log.cc:927] Time spent T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:20:52.744658 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 58202.9us
I20260709 13:20:52.749440 19478 leader_election.cc:400] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24.
I20260709 13:20:52.750025 19478 leader_election.cc:403] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:20:52.682577 27146 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:52.751832 20665 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:52.719952 26847 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:20:52.754071 27147 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:52.758263 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 118421us
I20260709 13:20:52.723538 27119 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:20:52.753396 25579 raft_consensus.cc:3060] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:52.689534 27041 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.693881 26996 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 13:20:52.690692 27063 consensus_queue.cc:1059] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:20:52.743602 27113 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.782378 27063 raft_consensus.cc:3055] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:52.782788 27063 raft_consensus.cc:740] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:52.783555 27113 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:52.784914 27108 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:52.787818 26827 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.767360 27119 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:52.796082 27119 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 26.12, Last appended by leader: 12, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.797279 27119 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:52.802793 27041 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:52.803781 27086 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:52.805454 27046 consensus_queue.cc:1059] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:52.806061 26826 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:52.806568 27046 raft_consensus.cc:3055] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:52.806936 27046 raft_consensus.cc:740] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:52.807741 27046 consensus_queue.cc:260] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.809069 27046 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:52.783639 27063 consensus_queue.cc:260] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:52.818532 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 159937us
I20260709 13:20:52.819324 27117 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:52.823544 27007 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:52.838472 27007 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:52.838982 27007 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:52.841032 27063 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:52.844895 26827 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:52.854406 27007 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:52.856832 27007 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:20:52.915208 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 75788.6us
I20260709 13:20:52.918370 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:52.919924 19659 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:52.929019 27005 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24.
I20260709 13:20:52.929389 19506 raft_consensus.cc:1275] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:20:52.926313 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 176924us
I20260709 13:20:52.933272 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:52.935428 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:52.948701 19511 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:52.957945 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:52.961568 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:52.963639 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:52.971359 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:52.982703 19504 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:20:52.982429 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:52.984535 19506 raft_consensus.cc:2368] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26.
I20260709 13:20:52.991770 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:52.992928 19580 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:52.998072 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:53.000699 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:53.003003 19504 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:52.901424 19404 catalog_manager.cc:5697] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 9 to 13, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 13 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:53.002734 19551 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:53.010627 27117 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:53.010416 19404 catalog_manager.cc:5697] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:53.013434 27117 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:53.039233 19660 raft_consensus.cc:1275] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 15. (term mismatch)
I20260709 13:20:53.039742 19660 pending_rounds.cc:85] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 14
I20260709 13:20:53.040002 19660 pending_rounds.cc:107] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 26.15
I20260709 13:20:53.040263 19660 raft_consensus.cc:2889] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:53.040903 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:53.019938 19658 raft_consensus.cc:2468] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 25.
I20260709 13:20:53.026187 19659 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 26.
I20260709 13:20:53.045746 19655 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 13:20:53.046236 19655 pending_rounds.cc:85] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864: Aborting all ops after (but not including) 14
I20260709 13:20:53.046561 19655 pending_rounds.cc:107] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 13:20:53.046831 19655 raft_consensus.cc:2889] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:53.057991 27119 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:53.067618 19655 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:53.071710 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:53.096117 27063 consensus_queue.cc:1048] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:53.114902 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 59994.4us
I20260709 13:20:53.115703 26827 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:20:53.142606 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 101824us
I20260709 13:20:53.142707 19476 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:53.144047 27100 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:53.144693 27100 raft_consensus.cc:697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:53.146066 27100 consensus_queue.cc:237] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:53.146552 27147 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:53.153924 19580 raft_consensus.cc:2468] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:20:53.155318 19579 raft_consensus.cc:1240] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:20:53.155211 26968 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:53.172628 19551 leader_election.cc:400] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26.
I20260709 13:20:53.173182 19551 leader_election.cc:403] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:20:53.175657 27117 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:53.192239 26994 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:53.197104 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:53.200511 19551 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:53.212248 19579 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:53.213610 27119 raft_consensus.cc:2804] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:53.214386 27119 raft_consensus.cc:697] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:53.215597 27119 consensus_queue.cc:237] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:53.216223 27035 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:53.198673 26968 consensus_queue.cc:1048] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:20:53.229868 27147 consensus_queue.cc:1059] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:53.240761 19656 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:53.244050 27109 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:53.244225 27086 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:53.248859 26968 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:53.251362 27086 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:53.252113 26968 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:53.254820 27109 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:53.257452 27086 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:53.257339 27109 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:53.268600 27005 raft_consensus.cc:3055] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:53.272609 27005 raft_consensus.cc:740] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:53.273942 27005 consensus_queue.cc:260] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:53.281425 27005 raft_consensus.cc:3060] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:53.282346 27092 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:20:53.283577 27092 raft_consensus.cc:3055] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:53.284039 27092 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:53.285071 27092 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:53.286809 27092 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:53.297003 26968 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:20:53.352675 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 161310us
I20260709 13:20:53.370581 19627 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:53.379731 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:53.386686 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:53.391105 26827 raft_consensus.cc:2804] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:53.395685 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:53.398281 26827 raft_consensus.cc:697] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:53.399319 19505 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:20:53.399945 19507 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:20:53.399613 26827 consensus_queue.cc:237] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:53.400127 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:53.391808 19512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:53.399391 26847 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.404018 26847 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:53.406123 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:53.408578 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:53.434809 19654 raft_consensus.cc:1275] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:20:53.436432 27117 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645) with higher term. Message: Invalid argument: T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf for earlier term 25. Current term is 26.
I20260709 13:20:53.506556 19504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:53.515765 19660 raft_consensus.cc:1275] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:20:53.518745 26847 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:53.551927 26996 consensus_queue.cc:1059] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:20:53.553818 26827 raft_consensus.cc:3055] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:53.554265 26827 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:53.555266 26827 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:53.556800 26827 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:53.560334 27164 log.cc:927] Time spent T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.203s	user 0.002s	sys 0.000s
I20260709 13:20:53.569064 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:20:53.610286 27168 log.cc:927] Time spent T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:20:53.634178 19627 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:53.655856 26968 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:53.658535 27086 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:53.684921 27109 consensus_queue.cc:1048] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:53.694319 19551 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:53.702131 26994 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:53.704119 19551 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:53.711853 19551 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:53.697103 27109 consensus_queue.cc:1048] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:20:53.716550 27108 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:53.717038 27089 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:53.716086 27086 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:53.727867 19655 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:20:53.768713 19660 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:20:53.769883 19587 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:20:53.774887 27109 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:20:53.781962 27085 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:53.789750 27034 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:53.933563 19511 raft_consensus.cc:3060] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:53.934159 19409 catalog_manager.cc:5697] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 23 to 29, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 29 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:53.936058 19409 catalog_manager.cc:5697] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 11 to 14, term changed from 21 to 22, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to <none>, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New cstate: current_term: 22 committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:53.937899 26880 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.938634 26880 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:53.937920 19409 catalog_manager.cc:5697] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 16 to 18, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 18 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:53.940506 19409 catalog_manager.cc:5697] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 16 to 17, leader changed from 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 17 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:53.942893 19506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:53.967610 26880 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:53.984704 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:53.985514 19660 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 18.
I20260709 13:20:53.996554 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:54.000262 27179 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:54.000746 27179 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:54.001087 27179 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:54.007767 27187 log.cc:927] Time spent T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:20:53.993405 19511 raft_consensus.cc:1275] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:20:54.030915 27172 consensus_queue.cc:1048] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:20:54.042769 19578 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:20:54.119081 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 72684.8us
W20260709 13:20:54.130239 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 82061.7us
W20260709 13:20:54.133155 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 80249.6us
W20260709 13:20:54.161867 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 113960us
W20260709 13:20:54.178186 27189 log.cc:927] Time spent T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:20:54.187108 27179 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:54.189256 27179 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:54.197116 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:54.198218 19654 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:54.203706 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:54.206244 25579 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:20:54.251704 19654 raft_consensus.cc:2468] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 19.
I20260709 13:20:54.257151 20619 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:54.258468 26880 raft_consensus.cc:2804] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:54.259071 26880 raft_consensus.cc:697] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 19 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:20:54.275022 26436 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.275815 26436 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:54.276015 26880 consensus_queue.cc:237] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:54.283936 26436 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:54.307902 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 28 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:54.312340 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 28 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:54.314206 19505 raft_consensus.cc:1275] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:54.309998 19587 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 27.
I20260709 13:20:54.317514 25579 consensus_queue.cc:1048] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:54.327662 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:54.328753 26953 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:20:54.329174 26953 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:54.329522 26953 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:54.371165 19505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:54.375567 19505 raft_consensus.cc:606] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:54.376909 19505 raft_consensus.cc:614] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:54.349258 19409 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 59) took 2296 ms. Trace:
I20260709 13:20:54.380683 26953 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:54.382328 19511 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:54.383037 19511 raft_consensus.cc:606] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:54.383415 19511 raft_consensus.cc:614] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:54.386658 26953 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:54.386587 19507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f949ff511e844749624dedf436dff50"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:54.390053 19507 raft_consensus.cc:606] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:54.387540 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 28 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:54.393891 19507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "904d960364024273a420111ec6233e84"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:54.394719 19507 raft_consensus.cc:606] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:54.400619 19503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:54.401279 19503 raft_consensus.cc:606] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:54.401708 19503 raft_consensus.cc:614] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:54.403523 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:54.406989 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 28 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:54.407714 19583 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:54.410012 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:54.416975 19583 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 28.
I20260709 13:20:54.380554 19409 rpcz_store.cc:276] 0709 13:20:52.053073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.053213 (+   140us) service_pool.cc:224] Handling call
0709 13:20:54.349078 (+2295865us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:54.178971 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:54.211531 (+ 32560us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:54.211567 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:20:54.211587 (+    20us) tablet.cc:662] Decoding operations
0709 13:20:54.212254 (+   667us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:54.212311 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:54.212351 (+    40us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:20:54.212757 (+   406us) tablet.cc:701] Row locks acquired
0709 13:20:54.212772 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:20:54.212974 (+   202us) write_op.cc:270] Start()
0709 13:20:54.213107 (+   133us) write_op.cc:276] Timestamp: P: 1783603254212919 usec, L: 0
0709 13:20:54.213128 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:20:54.213912 (+   784us) log.cc:844] Serialized 1728 byte log entry
0709 13:20:54.310168 (+ 96256us) op_driver.cc:464] REPLICATION: finished
0709 13:20:54.310486 (+   318us) write_op.cc:301] APPLY: starting
0709 13:20:54.310579 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:54.313171 (+  2592us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:54.313260 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:54.316713 (+  3453us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:54.316924 (+   211us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:20:54.316978 (+    54us) write_op.cc:312] APPLY: finished
0709 13:20:54.317217 (+   239us) log.cc:844] Serialized 49 byte log entry
0709 13:20:54.317390 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:54.317493 (+   103us) write_op.cc:454] Released schema lock
0709 13:20:54.317539 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:54.321359 (+  3820us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:54.321392 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":33841,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":103,"apply.run_cpu_time_us":6718,"apply.run_wall_time_us":10815,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16712,"num_ops":4,"prepare.queue_time_us":198409,"prepare.run_cpu_time_us":3419,"prepare.run_wall_time_us":35312,"replication_time_us":96872,"thread_start_us":149091,"threads_started":1}]]}
I20260709 13:20:54.430819 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:54.432041 26996 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:20:54.432605 26996 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 28 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:54.433578 26996 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 26.12, Last appended by leader: 12, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:54.446993 19404 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48826 (request call id 182) took 49683 ms (client timeout 15000 ms). Trace:
W20260709 13:20:54.447576 19404 rpcz_store.cc:269] 0709 13:20:04.763544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.767999 (+  4455us) service_pool.cc:224] Handling call
0709 13:20:54.446869 (+49678870us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:53.170715 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:53.171527 (+   812us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:53.171577 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:20:53.171621 (+    44us) tablet.cc:662] Decoding operations
0709 13:20:53.173337 (+  1716us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:53.173419 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:53.173450 (+    31us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:20:53.230833 (+ 57383us) tablet.cc:701] Row locks acquired
0709 13:20:53.230883 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:20:53.231067 (+   184us) write_op.cc:270] Start()
0709 13:20:53.231218 (+   151us) write_op.cc:276] Timestamp: P: 1783603253231012 usec, L: 0
0709 13:20:53.231253 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:20:53.262652 (+ 31399us) log.cc:844] Serialized 3282 byte log entry
0709 13:20:53.600313 (+337661us) op_driver.cc:464] REPLICATION: finished
0709 13:20:53.725990 (+125677us) write_op.cc:301] APPLY: starting
0709 13:20:53.728724 (+  2734us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:53.786513 (+ 57789us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:53.786646 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:53.873061 (+ 86415us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:53.873449 (+   388us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:20:53.873513 (+    64us) write_op.cc:312] APPLY: finished
0709 13:20:53.873887 (+   374us) log.cc:844] Serialized 81 byte log entry
0709 13:20:53.874685 (+   798us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:53.874801 (+   116us) write_op.cc:454] Released schema lock
0709 13:20:53.874867 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:53.875335 (+   468us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:53.875363 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":139886,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":121106,"apply.run_cpu_time_us":15119,"apply.run_wall_time_us":150109,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37551,"num_ops":8,"prepare.queue_time_us":42566,"prepare.run_cpu_time_us":58142,"prepare.run_wall_time_us":200059,"raft.queue_time_us":285866,"raft.run_cpu_time_us":12879,"raft.run_wall_time_us":77353,"replication_time_us":368878,"thread_start_us":302624,"threads_started":5,"wal-append.queue_time_us":115134}]]}
I20260709 13:20:54.494716 27145 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:20:54.495420 27145 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:54.517113 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:54.518060 19581 raft_consensus.cc:2368] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 27. Current term is 28.
I20260709 13:20:54.550853 19478 leader_election.cc:400] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 27. Current term is 28.
I20260709 13:20:54.554776 19478 leader_election.cc:403] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:54.570094 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:54.572327 27145 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:54.564393 27092 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Advancing to term 28
I20260709 13:20:54.602176 27085 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:54.602852 27085 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:54.607033 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:20:54.608399 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:54.609160 19660 raft_consensus.cc:2368] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19.
I20260709 13:20:54.607568 19503 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:54.605310 27085 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:54.617798 19476 leader_election.cc:400] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19.
I20260709 13:20:54.618157 19476 leader_election.cc:403] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:54.619189 27085 raft_consensus.cc:3060] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:20:54.618579 19403 catalog_manager.cc:5697] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: leader changed from <none> to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 22 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:54.623525 19403 catalog_manager.cc:5697] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 17 to 19, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 19 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:54.624811 26994 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:54.625937 26994 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:54.630882 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:54.631678 19660 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 23: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:54.628734 26994 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:54.636593 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:54.637251 19511 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:20:54.632539 27092 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Leader pre-election lost for term 27. Reason: Vote denied by peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) with higher term. Message: Invalid argument: T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 27. Current term is 28.
I20260709 13:20:54.646687 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:20:54.650839 19478 consensus_peers.cc:597] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 -> Peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615): Couldn't send request to peer 068c03c9dcc848e6bf909131b1f83065. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e5f26f686634d4ab47c02b7a00ba584. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:54.652712 19660 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:20:54.656152 26994 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:54.657976 26994 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:20:54.665004 26994 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:54.650269 27085 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295) with higher term. Message: Invalid argument: T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 for earlier term 18. Current term is 19.
I20260709 13:20:54.669504 19583 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:20:54.669206 26445 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:54.677665 27193 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:54.723917 19573 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eb38e2ac9064d3286fe2f20aeb2381c with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 13)) from {username='slave'} at 127.0.0.1:45038
W20260709 13:20:54.746630 19408 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48840 (request call id 168) took 74540 ms (client timeout 15000 ms). Trace:
W20260709 13:20:54.747131 19408 rpcz_store.cc:269] 0709 13:19:40.206547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.206929 (+   382us) service_pool.cc:224] Handling call
0709 13:20:54.746427 (+74539498us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85343,"reported_tablets":50}
I20260709 13:20:54.755919 19511 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:54.787695 19410 catalog_manager.cc:5697] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 12 to 15, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 15 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:54.776515 27179 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:20:54.792455 26994 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:54.798271 19658 raft_consensus.cc:1275] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:54.804911 19397 catalog_manager.cc:5028] TS 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): tablet 6eb38e2ac9064d3286fe2f20aeb2381c (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
I20260709 13:20:54.801848 27130 consensus_queue.cc:1048] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:20:54.806913 27092 raft_consensus.cc:993] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:54.807449 27092 raft_consensus.cc:1081] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:54.808326 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:54.813362 19583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f949ff511e844749624dedf436dff50"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60808
I20260709 13:20:54.814066 19583 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:54.814533 19583 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:54.817281 26445 raft_consensus.cc:993] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:54.818053 26445 raft_consensus.cc:1081] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:54.823413 27092 raft_consensus.cc:2955] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Committing config change with OpId 26.16: config changed from index -1 to 16, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:20:54.839785 19581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "904d960364024273a420111ec6233e84"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60808
I20260709 13:20:54.840487 19581 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:54.840883 19581 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:54.827437 19579 raft_consensus.cc:2955] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Committing config change with OpId 26.16: config changed from index -1 to 16, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:20:54.846233 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:54.847119 19660 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 23: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:20:54.852805 19581 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:54.853228 19503 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:20:54.861239 19583 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:54.862828 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:20:54.863181 19583 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:54.864485 27108 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:54.865018 27108 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:54.854789 26994 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:54.867081 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:54.867966 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:54.868709 19507 raft_consensus.cc:3055] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:54.869171 19654 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:54.867019 27108 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:54.856550 19660 raft_consensus.cc:2955] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Committing config change with OpId 26.16: config changed from index -1 to 16, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:20:54.869167 19507 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:54.872920 19581 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:54.876160 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:54.876809 19655 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:54.882870 19503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:54.883626 19503 raft_consensus.cc:3055] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:54.883957 19503 raft_consensus.cc:740] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:54.884735 19507 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:54.884786 19503 consensus_queue.cc:260] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:54.892488 19655 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:20:54.897563 19551 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:54.898509 26994 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:54.899039 26994 raft_consensus.cc:697] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:54.900004 26994 consensus_queue.cc:237] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:54.899816 19402 catalog_manager.cc:5697] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 19 to 22, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 22 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:54.903520 19654 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 25.
I20260709 13:20:54.911933 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:54.913851 19507 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:54.917024 19503 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:54.920171 26968 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:54.919555 19402 catalog_manager.cc:5697] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:54.923959 26968 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:54.924973 26968 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:54.925081 19402 catalog_manager.cc:5697] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 19 to 22, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 22 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:54.934376 26445 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:54.935014 26445 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:54.951757 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:54.927194 19402 catalog_manager.cc:5697] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 23 to 24, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 24 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
W20260709 13:20:54.957381 19410 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48852 (request call id 177) took 52160 ms (client timeout 15000 ms). Trace:
I20260709 13:20:54.950073 26445 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:54.960366 19583 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 23: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:20:54.961426 19402 catalog_manager.cc:5697] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 19 to 26, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 26 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:54.967144 19402 catalog_manager.cc:5697] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:54.968896 19402 catalog_manager.cc:5697] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:54.970397 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:54.971004 19654 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:54.971252 19402 catalog_manager.cc:5697] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 21 to 23, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 23 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:54.973948 19476 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:54.977391 19505 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 26 index: 12. Preceding OpId from leader: term: 28 index: 13. (index mismatch)
I20260709 13:20:54.977658 26801 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:54.978094 26801 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:20:54.978446 26801 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:54.988174 19503 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 16.
I20260709 13:20:54.991590 19507 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 25.
I20260709 13:20:54.975389 19402 catalog_manager.cc:5697] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 16 to 18, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 18 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:54.958230 19410 rpcz_store.cc:269] 0709 13:20:02.796859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.797772 (+   913us) service_pool.cc:224] Handling call
0709 13:20:54.957245 (+52159473us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:54.820985 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:54.821588 (+   603us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:54.821652 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:20:54.821676 (+    24us) tablet.cc:662] Decoding operations
0709 13:20:54.822118 (+   442us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:54.822176 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:54.822212 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:20:54.822416 (+   204us) tablet.cc:701] Row locks acquired
0709 13:20:54.822436 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:20:54.822580 (+   144us) write_op.cc:270] Start()
0709 13:20:54.822691 (+   111us) write_op.cc:276] Timestamp: P: 1783603254822536 usec, L: 0
0709 13:20:54.822714 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:20:54.823406 (+   692us) log.cc:844] Serialized 544 byte log entry
0709 13:20:54.825433 (+  2027us) op_driver.cc:464] REPLICATION: finished
0709 13:20:54.825776 (+   343us) write_op.cc:301] APPLY: starting
0709 13:20:54.825869 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:54.826772 (+   903us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:54.827098 (+   326us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:54.827819 (+   721us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:54.827998 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:20:54.828050 (+    52us) write_op.cc:312] APPLY: finished
0709 13:20:54.828245 (+   195us) log.cc:844] Serialized 25 byte log entry
0709 13:20:54.828415 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:54.828507 (+    92us) write_op.cc:454] Released schema lock
0709 13:20:54.828551 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:54.828966 (+   415us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:54.829001 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":25838,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":147,"apply.run_cpu_time_us":3107,"apply.run_wall_time_us":3107,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4178,"num_ops":1,"prepare.queue_time_us":930,"prepare.run_cpu_time_us":2701,"prepare.run_wall_time_us":2718,"replication_time_us":2599}]]}
I20260709 13:20:55.007745 19402 catalog_manager.cc:5697] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:55.014103 19402 catalog_manager.cc:5697] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 21 to 24, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 24 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
W20260709 13:20:55.024212 19458 auto_rebalancer.cc:629] Failed to schedule move for tablet 313f9daf7de442378ef2abf1f4a4e665: Illegal state: Replica e19c80e9149b4b8d88ae13bde8e43864 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:55.023819 19402 catalog_manager.cc:5697] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 24 to 26, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 26 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:55.024698 27109 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.995682 26436 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:20:55.047051 19658 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:55.025964 19402 catalog_manager.cc:5697] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 17 to 23, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 23 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:55.050570 19402 catalog_manager.cc:5697] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 17 to 20, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 20 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.052902 19402 catalog_manager.cc:5697] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 14 to 21, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 21 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:55.034092 27109 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:20:55.065004 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 62884us
I20260709 13:20:55.078649 19402 catalog_manager.cc:5697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:55.079598 19583 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 26 index: 12. Preceding OpId from leader: term: 28 index: 13. (index mismatch)
I20260709 13:20:55.083915 26801 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:55.085331 27046 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:55.083942 19402 catalog_manager.cc:5697] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 18 to 25. New cstate: current_term: 25 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.091037 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:55.091984 19581 raft_consensus.cc:2393] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d56df3728fc04e37b2d29a3bcd91d167 in current term 23: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:20:55.101280 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 62202.5us
I20260709 13:20:55.112711 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:55.113421 19509 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:20:55.104413 27109 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:55.115900 19583 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:55.119231 26436 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:55.121940 26801 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:55.125556 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:20:55.134128 19627 consensus_peers.cc:597] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615): Couldn't send request to peer 068c03c9dcc848e6bf909131b1f83065. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c83387a56274f46bd5795b3376741c9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.136794 19509 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:55.091235 19402 catalog_manager.cc:5697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.142659 19402 catalog_manager.cc:5697] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.175074 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:55.178499 19658 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 23.
I20260709 13:20:55.178985 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:20:55.179703 19660 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:20:55.180249 27214 ts_tablet_manager.cc:933] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645)
I20260709 13:20:55.181677 19476 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:55.183168 27193 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:55.186072 27193 raft_consensus.cc:697] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:55.187194 27193 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:55.178644 27211 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:55.190040 27211 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.190472 27211 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:55.145249 19402 catalog_manager.cc:5697] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 19 to 25, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 25 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:55.207077 19402 catalog_manager.cc:5697] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 16 to 23, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 23 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:55.228219 27209 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.228885 27209 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:55.214691 27210 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:55.231429 27209 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:55.234371 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167" is_pre_election: true
I20260709 13:20:55.232514 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:20:55.234990 19511 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:20:55.238806 27211 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:55.241451 27211 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:55.245641 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:55.253161 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:55.254072 19660 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:55.254266 19625 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:55.259850 27089 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:55.267536 27089 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.267933 27089 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:55.272590 19660 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:20:55.274081 19402 catalog_manager.cc:5697] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.276198 19402 catalog_manager.cc:5697] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 19 to 22, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 22 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.280026 19402 catalog_manager.cc:5697] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 14 to 21. New cstate: current_term: 21 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.282228 27089 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:55.283694 19551 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:55.285775 27109 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:55.286320 27109 raft_consensus.cc:697] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:55.287218 27109 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:55.289664 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:55.301916 19402 catalog_manager.cc:5697] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:55.303563 19511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:55.304558 19511 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:55.306013 27046 raft_consensus.cc:2955] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:20:55.311837 19583 raft_consensus.cc:2955] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:20:55.302600 27089 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:20:55.258314 27214 tablet_copy_client.cc:323] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Beginning tablet copy session from remote peer at address 127.17.251.129:38645
I20260709 13:20:55.323448 19521 tablet_copy_service.cc:140] P d56df3728fc04e37b2d29a3bcd91d167: Received BeginTabletCopySession request for tablet 0e5f26f686634d4ab47c02b7a00ba584 from peer 068c03c9dcc848e6bf909131b1f83065 ({username='slave'} at 127.0.0.1:60692)
I20260709 13:20:55.324150 19521 tablet_copy_service.cc:161] P d56df3728fc04e37b2d29a3bcd91d167: Beginning new tablet copy session on tablet 0e5f26f686634d4ab47c02b7a00ba584 from peer 068c03c9dcc848e6bf909131b1f83065 at {username='slave'} at 127.0.0.1:60692: session id = 068c03c9dcc848e6bf909131b1f83065-0e5f26f686634d4ab47c02b7a00ba584
I20260709 13:20:55.323024 19511 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:20:55.338019 19521 tablet_copy_source_session.cc:215] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:55.305295 19402 catalog_manager.cc:5697] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 17 to 22, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 22 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.338585 19658 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:55.342427 27214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e5f26f686634d4ab47c02b7a00ba584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.354245 19660 raft_consensus.cc:1240] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Rejecting Update request from peer 2cfd02601ea44976833027665abc93bf for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:55.354174 19625 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:20:55.355100 27063 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:55.355607 27063 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:55.356071 26994 consensus_queue.cc:1059] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:55.356459 27063 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:55.357100 26994 raft_consensus.cc:3055] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:55.357554 26994 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:55.347436 19402 catalog_manager.cc:5697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 20 to 23, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 23 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:55.358522 26994 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:55.359910 26994 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:55.359393 19511 raft_consensus.cc:2955] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:20:55.358857 19402 catalog_manager.cc:5697] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 16 to 18, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 18 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:55.367435 19402 catalog_manager.cc:5697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:55.369084 19402 catalog_manager.cc:5697] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 13 to 17, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 17 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:55.398870 19402 catalog_manager.cc:5697] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 16 to 19, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 19 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:55.400410 19402 catalog_manager.cc:5697] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 19 to 20, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 20 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:55.407750 19511 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:20:55.409348 19660 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:20:55.411446 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:55.422963 19402 catalog_manager.cc:5697] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:55.423821 26994 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:55.425407 26994 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:20:55.446884 19581 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:20:55.447992 19627 consensus_peers.cc:597] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615): Couldn't send request to peer 068c03c9dcc848e6bf909131b1f83065. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b601da83bfc46088ab1ec232133b605. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.449254 19503 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:55.450465 27063 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:55.462932 19658 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:55.465008 27109 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:55.482798 27214 tablet_copy_client.cc:806] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:55.491058 26953 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:20:55.500725 27214 tablet_copy_client.cc:670] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:55.522212 19509 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:55.532660 27214 tablet_copy_client.cc:538] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:55.534715 27119 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:55.582872 27063 raft_consensus.cc:2955] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:20:55.591356 19581 raft_consensus.cc:2955] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:20:55.614393 27214 tablet_bootstrap.cc:492] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap starting.
I20260709 13:20:55.654762 19654 raft_consensus.cc:1240] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:55.656544 26445 consensus_queue.cc:1059] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:55.657383 26445 raft_consensus.cc:3055] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:55.657701 26445 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:55.658437 26445 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:55.659637 26445 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:55.662467 19509 raft_consensus.cc:2955] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:20:55.710024 19509 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 12. (term mismatch)
I20260709 13:20:55.710471 19509 pending_rounds.cc:85] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Aborting all ops after (but not including) 11
I20260709 13:20:55.720912 19509 pending_rounds.cc:107] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Aborting uncommitted NO_OP operation due to leader change: 23.12
I20260709 13:20:55.721254 19509 raft_consensus.cc:2889] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:55.723028 26994 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:55.740902 19654 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:20:55.758476 19511 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:20:55.754832 26994 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:20:55.774936 27234 ts_tablet_manager.cc:933] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:55.767256 27209 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:20:55.846625 19587 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 12. (term mismatch)
I20260709 13:20:55.847069 19587 pending_rounds.cc:85] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Aborting all ops after (but not including) 11
I20260709 13:20:55.847292 19587 pending_rounds.cc:107] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Aborting uncommitted NO_OP operation due to leader change: 23.12
I20260709 13:20:55.847519 19587 raft_consensus.cc:2889] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:55.849324 26953 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:55.852682 27234 tablet_copy_client.cc:323] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Beginning tablet copy session from remote peer at address 127.17.251.131:33295
I20260709 13:20:55.857340 19671 tablet_copy_service.cc:140] P e19c80e9149b4b8d88ae13bde8e43864: Received BeginTabletCopySession request for tablet 2c83387a56274f46bd5795b3376741c9 from peer 068c03c9dcc848e6bf909131b1f83065 ({username='slave'} at 127.0.0.1:59942)
I20260709 13:20:55.857952 19671 tablet_copy_service.cc:161] P e19c80e9149b4b8d88ae13bde8e43864: Beginning new tablet copy session on tablet 2c83387a56274f46bd5795b3376741c9 from peer 068c03c9dcc848e6bf909131b1f83065 at {username='slave'} at 127.0.0.1:59942: session id = 068c03c9dcc848e6bf909131b1f83065-2c83387a56274f46bd5795b3376741c9
I20260709 13:20:55.867512 19671 tablet_copy_source_session.cc:215] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:55.881557 27234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c83387a56274f46bd5795b3376741c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.945393 27240 ts_tablet_manager.cc:933] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:55.968576 27240 tablet_copy_client.cc:323] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Beginning tablet copy session from remote peer at address 127.17.251.131:33295
I20260709 13:20:55.970456 19671 tablet_copy_service.cc:140] P e19c80e9149b4b8d88ae13bde8e43864: Received BeginTabletCopySession request for tablet 2b601da83bfc46088ab1ec232133b605 from peer 068c03c9dcc848e6bf909131b1f83065 ({username='slave'} at 127.0.0.1:59942)
I20260709 13:20:55.970985 19671 tablet_copy_service.cc:161] P e19c80e9149b4b8d88ae13bde8e43864: Beginning new tablet copy session on tablet 2b601da83bfc46088ab1ec232133b605 from peer 068c03c9dcc848e6bf909131b1f83065 at {username='slave'} at 127.0.0.1:59942: session id = 068c03c9dcc848e6bf909131b1f83065-2b601da83bfc46088ab1ec232133b605
I20260709 13:20:55.985378 19671 tablet_copy_source_session.cc:215] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:55.997320 27240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b601da83bfc46088ab1ec232133b605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:56.010608 27234 tablet_copy_client.cc:806] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:56.018074 27234 tablet_copy_client.cc:670] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:56.019673 27214 tablet_bootstrap.cc:492] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:56.020756 27214 tablet_bootstrap.cc:492] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap complete.
I20260709 13:20:56.021552 27214 ts_tablet_manager.cc:1403] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065: Time spent bootstrapping tablet: real 0.439s	user 0.057s	sys 0.008s
I20260709 13:20:56.045761 27234 tablet_copy_client.cc:538] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:56.081921 27214 raft_consensus.cc:359] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [term 26 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:56.082902 27214 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [term 26 LEARNER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Initialized, Role: LEARNER
I20260709 13:20:56.090062 27240 tablet_copy_client.cc:806] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:56.090780 27240 tablet_copy_client.cc:670] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:56.090900 27214 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:56.101176 19410 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33582 (request call id 61) took 1077 ms. Trace:
I20260709 13:20:56.106310 19410 rpcz_store.cc:276] 0709 13:20:55.023928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.029206 (+  5278us) service_pool.cc:224] Handling call
0709 13:20:56.101081 (+1071875us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:20:56.113204 27214 ts_tablet_manager.cc:1434] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065: Time spent starting tablet: real 0.091s	user 0.004s	sys 0.003s
I20260709 13:20:56.115067 19521 tablet_copy_service.cc:342] P d56df3728fc04e37b2d29a3bcd91d167: Request end of tablet copy session 068c03c9dcc848e6bf909131b1f83065-0e5f26f686634d4ab47c02b7a00ba584 received from {username='slave'} at 127.0.0.1:60692
I20260709 13:20:56.115550 19521 tablet_copy_service.cc:434] P d56df3728fc04e37b2d29a3bcd91d167: ending tablet copy session 068c03c9dcc848e6bf909131b1f83065-0e5f26f686634d4ab47c02b7a00ba584 on tablet 0e5f26f686634d4ab47c02b7a00ba584 with peer 068c03c9dcc848e6bf909131b1f83065
I20260709 13:20:56.129962 27240 tablet_copy_client.cc:538] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:56.130755 27234 tablet_bootstrap.cc:492] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap starting.
I20260709 13:20:56.178745 20665 raft_consensus.cc:1217] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [term 26 LEARNER]: Deduplicated request from leader. Original: 26.15->[26.16-26.16]   Dedup: 26.16->[]
I20260709 13:20:56.229526 19401 catalog_manager.cc:5697] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 16 to 24, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 24 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:56.237524 19401 catalog_manager.cc:5697] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 18 to 24, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 24 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:56.243988 19402 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48826 (request call id 184) took 9582 ms. Trace:
I20260709 13:20:56.245843 19402 rpcz_store.cc:276] 0709 13:20:46.661414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.666616 (+  5202us) service_pool.cc:224] Handling call
0709 13:20:46.922663 (+256047us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b5400002210. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e635b71 00007f6c2e6360b2 00007f6c375afa89 00007f6c37547da6 00007f6c37519088 00007f6c3761737e 00007f6c35ad82a4 00007f6c35ad8232 00007f6c35ad8161 00007f6c35ad80dc
0709 13:20:56.243886 (+9321223us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:55.615584 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:55.616122 (+   538us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:55.616153 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:20:55.616176 (+    23us) tablet.cc:662] Decoding operations
0709 13:20:55.631527 (+ 15351us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:55.631608 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:55.631637 (+    29us) tablet.cc:685] Acquiring locks for 33 operations
0709 13:20:55.634157 (+  2520us) tablet.cc:701] Row locks acquired
0709 13:20:55.634176 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:20:55.634321 (+   145us) write_op.cc:270] Start()
0709 13:20:55.634469 (+   148us) write_op.cc:276] Timestamp: P: 1783603255634282 usec, L: 0
0709 13:20:55.634496 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:20:55.635162 (+   666us) log.cc:844] Serialized 13053 byte log entry
0709 13:20:55.667044 (+ 31882us) op_driver.cc:464] REPLICATION: finished
0709 13:20:55.682844 (+ 15800us) write_op.cc:301] APPLY: starting
0709 13:20:55.682937 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:55.897850 (+214913us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:55.897993 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:56.089094 (+191101us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:56.089489 (+   395us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=66,key_file_lookups=66,delta_file_lookups=66,mrs_lookups=0
0709 13:20:56.089535 (+    46us) write_op.cc:312] APPLY: finished
0709 13:20:56.090092 (+   557us) log.cc:844] Serialized 284 byte log entry
0709 13:20:56.091945 (+  1853us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:56.092203 (+   258us) write_op.cc:454] Released schema lock
0709 13:20:56.092275 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:56.106308 (+ 14033us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:56.106366 (+    58us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15436,"reported_tablets":57,"spinlock_wait_cycles":98365184,"child_traces":[["op",{"apply.queue_time_us":15532,"apply.run_cpu_time_us":49001,"apply.run_wall_time_us":423368,"cfile_cache_hit":134,"cfile_cache_hit_bytes":142001,"num_ops":33,"prepare.queue_time_us":42681,"prepare.run_cpu_time_us":7121,"prepare.run_wall_time_us":39962,"replication_time_us":32383,"thread_start_us":57488,"threads_started":2}]]}
I20260709 13:20:56.244814 19401 catalog_manager.cc:5697] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 17 to 26. New cstate: current_term: 26 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:56.256943 19401 catalog_manager.cc:5697] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 11 to 18, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 18 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:56.258865 19401 catalog_manager.cc:5697] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 12 to 26, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 26 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:56.270260 19401 catalog_manager.cc:5697] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 18 to 19, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 19 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:56.291961 27240 tablet_bootstrap.cc:492] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap starting.
I20260709 13:20:56.506645 27240 tablet_bootstrap.cc:700] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065: Time spent opening tablet: real 0.124s	user 0.000s	sys 0.006s
W20260709 13:20:56.530550 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 158420us
I20260709 13:20:56.572851 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:56.605405 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 46917.7us
W20260709 13:20:56.643436 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 46303.6us
W20260709 13:20:56.691308 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 65174.7us
W20260709 13:20:56.691601 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 84472.2us
W20260709 13:20:56.712667 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 97150.9us
W20260709 13:20:56.781757 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 53986.9us
W20260709 13:20:56.785274 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 143120us
W20260709 13:20:56.853070 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 69133us
W20260709 13:20:56.866528 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 81715us
I20260709 13:20:56.899890 19410 catalog_manager.cc:5697] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index -1 to 16, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New cstate: current_term: 26 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:20:56.901360 27254 raft_consensus.cc:1064] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:20:56.904233 27254 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 14, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:20:56.932256 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 55490.6us
I20260709 13:20:56.986893 19509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
W20260709 13:20:57.006428 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 129238us
I20260709 13:20:57.034142 19509 raft_consensus.cc:606] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:57.039237 20665 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [term 26 LEARNER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:20:57.039480 19503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:57.040205 19503 raft_consensus.cc:606] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:57.040576 19503 raft_consensus.cc:614] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:57.040834 27242 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:20:57.029397 27234 tablet_bootstrap.cc:492] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:57.044229 27234 tablet_bootstrap.cc:492] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap complete.
I20260709 13:20:57.044976 27234 ts_tablet_manager.cc:1403] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065: Time spent bootstrapping tablet: real 0.915s	user 0.046s	sys 0.019s
I20260709 13:20:57.045740 19503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "904d960364024273a420111ec6233e84"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:57.046447 19503 raft_consensus.cc:606] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:57.046957 19503 raft_consensus.cc:614] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:57.052675 19658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:20:57.053311 19658 raft_consensus.cc:606] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:57.055521 19578 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:20:57.057852 27242 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:20:57.059284 19503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:57.059885 19503 raft_consensus.cc:606] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:57.063653 19654 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:20:57.057848 27234 raft_consensus.cc:359] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:57.065121 19503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:20:57.065532 27234 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Initialized, Role: LEARNER
I20260709 13:20:57.065944 19503 raft_consensus.cc:606] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:20:57.066279 27234 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:57.067694 27242 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:20:57.068811 27234 ts_tablet_manager.cc:1434] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:20:57.066303 19503 raft_consensus.cc:614] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:57.070982 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:57.063611 27240 tablet_bootstrap.cc:492] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:57.074437 27240 tablet_bootstrap.cc:492] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap complete.
I20260709 13:20:57.075245 27240 ts_tablet_manager.cc:1403] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065: Time spent bootstrapping tablet: real 0.784s	user 0.046s	sys 0.021s
I20260709 13:20:57.078742 19671 tablet_copy_service.cc:342] P e19c80e9149b4b8d88ae13bde8e43864: Request end of tablet copy session 068c03c9dcc848e6bf909131b1f83065-2c83387a56274f46bd5795b3376741c9 received from {username='slave'} at 127.0.0.1:59942
I20260709 13:20:57.079304 19671 tablet_copy_service.cc:434] P e19c80e9149b4b8d88ae13bde8e43864: ending tablet copy session 068c03c9dcc848e6bf909131b1f83065-2c83387a56274f46bd5795b3376741c9 on tablet 2c83387a56274f46bd5795b3376741c9 with peer 068c03c9dcc848e6bf909131b1f83065
I20260709 13:20:57.080320 27240 raft_consensus.cc:359] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:57.081328 27240 raft_consensus.cc:740] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Initialized, Role: LEARNER
I20260709 13:20:57.082129 27240 consensus_queue.cc:260] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:20:57.083753 27253 raft_consensus.cc:993] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:57.084282 27253 raft_consensus.cc:1081] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:57.084729 27240 ts_tablet_manager.cc:1434] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:57.086032 19578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60808
I20260709 13:20:57.086793 19578 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:57.087138 19578 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:57.088955 19671 tablet_copy_service.cc:342] P e19c80e9149b4b8d88ae13bde8e43864: Request end of tablet copy session 068c03c9dcc848e6bf909131b1f83065-2b601da83bfc46088ab1ec232133b605 received from {username='slave'} at 127.0.0.1:59942
I20260709 13:20:57.087939 27263 raft_consensus.cc:2955] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Committing config change with OpId 26.17: config changed from index 16 to 17, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:57.089454 19671 tablet_copy_service.cc:434] P e19c80e9149b4b8d88ae13bde8e43864: ending tablet copy session 068c03c9dcc848e6bf909131b1f83065-2b601da83bfc46088ab1ec232133b605 on tablet 2b601da83bfc46088ab1ec232133b605 with peer 068c03c9dcc848e6bf909131b1f83065
I20260709 13:20:57.095980 19578 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:57.099195 19578 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:57.094198 20665 raft_consensus.cc:2955] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Committing config change with OpId 26.17: config changed from index 16 to 17, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:57.100840 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:57.101085 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: true dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:57.101487 19654 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:57.106580 19509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
W20260709 13:20:57.101349 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 67625.6us
I20260709 13:20:57.131801 19509 raft_consensus.cc:3055] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:20:57.132194 19509 raft_consensus.cc:740] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:57.133011 19509 consensus_queue.cc:260] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:57.134225 19509 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:57.137696 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:57.138743 19402 catalog_manager.cc:5697] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.140249 19402 catalog_manager.cc:5697] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.141539 19402 catalog_manager.cc:5697] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.142182 19578 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 26. Current term is 27. Ops: []
I20260709 13:20:57.143682 19654 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 27.
I20260709 13:20:57.143113 19402 catalog_manager.cc:5697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 24 to 25, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 25 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.146250 19402 catalog_manager.cc:5697] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 17 to 23, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 23 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.147660 19402 catalog_manager.cc:5697] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 25 to 28, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 28 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.150274 19658 raft_consensus.cc:1240] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 26. Current term is 27. Ops: []
I20260709 13:20:57.149034 19402 catalog_manager.cc:5697] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 24 to 26, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 26 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:57.157318 19509 raft_consensus.cc:2468] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 27.
I20260709 13:20:57.176158 19551 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065
I20260709 13:20:57.178273 27250 raft_consensus.cc:2804] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:20:57.178925 27250 raft_consensus.cc:697] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:57.179944 27250 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.17, Last appended by leader: 17, Current term: 27, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:57.181131 27253 raft_consensus.cc:993] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:57.184082 27253 raft_consensus.cc:1081] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:57.193845 19578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60808
W20260709 13:20:57.194350 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 67955us
I20260709 13:20:57.194558 19578 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:57.195081 19578 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:57.218571 19402 catalog_manager.cc:5697] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 17 to 21, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 21 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.220216 19402 catalog_manager.cc:5697] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 24 to 28, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 28 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.221787 19402 catalog_manager.cc:5697] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 25 to 28, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 28 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.223224 19402 catalog_manager.cc:5697] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 22 to 24, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 24 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.225119 19402 catalog_manager.cc:5697] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 22 to 24, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 24 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.226966 19402 catalog_manager.cc:5697] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 19 to 25. New cstate: current_term: 25 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.229174 19402 catalog_manager.cc:5697] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: config changed from index -1 to 14, term changed from 19 to 23, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New cstate: current_term: 23 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:20:57.230782 19402 catalog_manager.cc:5697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 23 to 26, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 26 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:57.232375 19402 catalog_manager.cc:5697] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 20 to 23, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 23 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.220721 19578 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:57.241564 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:57.242419 19578 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:57.242833 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:57.243489 19654 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:57.242777 19505 raft_consensus.cc:3055] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:20:57.246057 19505 raft_consensus.cc:740] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:57.247036 19505 consensus_queue.cc:260] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:57.248507 19505 raft_consensus.cc:3060] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:57.255693 19654 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 27.
I20260709 13:20:57.259512 19551 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:20:57.262046 27250 raft_consensus.cc:2804] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:20:57.262609 27250 raft_consensus.cc:697] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:57.263471 27250 consensus_queue.cc:237] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:57.314337 20665 raft_consensus.cc:1217] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.13->[21.14-21.14]   Dedup: 21.14->[]
I20260709 13:20:57.320071 19505 raft_consensus.cc:2468] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 27.
I20260709 13:20:57.360906 27269 raft_consensus.cc:993] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:57.363142 27209 raft_consensus.cc:1081] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:20:57.369165 19583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60800
I20260709 13:20:57.369827 19583 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:57.370198 19583 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:57.375310 19402 catalog_manager.cc:5697] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 17 to 20, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 20 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.384167 19402 catalog_manager.cc:5697] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 14 to 28, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 28 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.389766 19402 catalog_manager.cc:5697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.390707 19401 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48852 (request call id 179) took 9564 ms. Trace:
I20260709 13:20:57.391187 19401 rpcz_store.cc:276] 0709 13:20:47.826087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:47.826345 (+   258us) service_pool.cc:224] Handling call
0709 13:20:57.390636 (+9564291us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:56.507876 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:56.523858 (+ 15982us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b5c0023000c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c3794c331 00007f6c3794c221 00007f6c37946f6c 00007f6c351a4d69 00007f6c351900a6 00007f6c3518fd58 00007f6c351949f1 00007f6c351949a9 00007f6c35194939 00007f6c35194901 00007f6c35193b2d
0709 13:20:56.523929 (+    71us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:56.523960 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:20:56.523977 (+    17us) tablet.cc:662] Decoding operations
0709 13:20:56.524794 (+   817us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:56.524853 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:56.524880 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:20:56.525423 (+   543us) tablet.cc:701] Row locks acquired
0709 13:20:56.525444 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:20:56.525594 (+   150us) write_op.cc:270] Start()
0709 13:20:56.525813 (+   219us) write_op.cc:276] Timestamp: P: 1783603256525546 usec, L: 0
0709 13:20:56.525842 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:20:56.571746 (+ 45904us) log.cc:844] Serialized 2500 byte log entry
0709 13:20:56.644469 (+ 72723us) op_driver.cc:464] REPLICATION: finished
0709 13:20:56.723889 (+ 79420us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b4400022b4c. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c2e4f5db1 00007f6c2e593c85 00007f6c2e5946a2 00007f6c313061db 00007f6c31301aaf 00007f6c2e6500ac 00007f6c374aaab9 00007f6c2e66c69b 00007f6c2e66a93f 00007f6c2e66cc02 00007f6c35190ef0
0709 13:20:56.729907 (+  6018us) write_op.cc:301] APPLY: starting
0709 13:20:56.730000 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:56.763800 (+ 33800us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:56.763828 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:56.851245 (+ 87417us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:56.851469 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:20:56.851523 (+    54us) write_op.cc:312] APPLY: finished
0709 13:20:56.851775 (+   252us) log.cc:844] Serialized 65 byte log entry
0709 13:20:56.865451 (+ 13676us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:56.865578 (+   127us) write_op.cc:454] Released schema lock
0709 13:20:56.867759 (+  2181us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:56.879282 (+ 11523us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:56.879318 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":169239,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":85122,"apply.run_cpu_time_us":9617,"apply.run_wall_time_us":143886,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29195,"num_ops":6,"prepare.queue_time_us":184368,"prepare.run_cpu_time_us":6457,"prepare.run_wall_time_us":64220,"replication_time_us":93131,"spinlock_wait_cycles":17550464,"thread_start_us":170115,"threads_started":2}]]}
I20260709 13:20:57.391165 19402 catalog_manager.cc:5697] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 23 to 31, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 31 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.407902 19402 catalog_manager.cc:5697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 16 to 24, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 24 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.444340 19402 catalog_manager.cc:5697] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 16 to 27, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 27 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.445837 20665 raft_consensus.cc:1217] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.13->[23.14-23.14]   Dedup: 23.14->[]
I20260709 13:20:57.446019 19402 catalog_manager.cc:5697] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: config changed from index -1 to 14, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New cstate: current_term: 21 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:20:57.447526 19402 catalog_manager.cc:5697] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 21 to 24, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 24 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.417975 19583 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:57.452033 19583 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:20:57.457549 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:20:57.459417 19505 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:57.464685 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:57.465390 19654 raft_consensus.cc:3055] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:20:57.467274 19654 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:57.468204 19654 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:57.469488 19654 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:57.448868 19402 catalog_manager.cc:5697] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 21 to 22, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 22 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.482928 19402 catalog_manager.cc:5697] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 17 to 26, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 26 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:57.484740 19402 catalog_manager.cc:5697] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 15 to 16, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 16 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:57.513963 19505 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 27.
I20260709 13:20:57.538712 19551 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:57.539569 27250 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:20:57.540233 27250 raft_consensus.cc:697] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:20:57.543620 27250 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:20:57.545656 19654 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 27.
I20260709 13:20:57.643198 19507 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:20:57.646944 27258 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:20:57.745371 19658 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:20:57.747498 27211 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:20:57.770927 19654 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:20:57.772567 27250 raft_consensus.cc:2955] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Committing config change with OpId 26.17: config changed from index 16 to 17, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:57.775238 27211 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:57.775362 19654 raft_consensus.cc:2955] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Committing config change with OpId 26.17: config changed from index 16 to 17, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:57.786903 20665 raft_consensus.cc:3060] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:57.827334 19509 raft_consensus.cc:1275] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:20:57.829262 27259 consensus_queue.cc:1048] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:57.821300 20665 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:20:57.941372 19402 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48826 (request call id 185) took 1254 ms. Trace:
I20260709 13:20:57.941991 19402 rpcz_store.cc:276] 0709 13:20:56.686916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.687082 (+   166us) service_pool.cc:224] Handling call
0709 13:20:56.731314 (+ 44232us) spinlock_profiling.cc:243] Waited 39 ms on lock 0x7b54002ec7d4. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c316c4090 00007f6c31762f3a 00007f6c375191cc 00007f6c3761737e 00007f6c35ad82a4 00007f6c35ad8232 00007f6c35ad8161 00007f6c35ad80dc 00007f6c35ad7392 00007f6c2fa9548c 00007f6c2fa948c6
0709 13:20:57.941284 (+1209970us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:57.598014 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:57.598552 (+   538us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:57.598592 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:20:57.598609 (+    17us) tablet.cc:662] Decoding operations
0709 13:20:57.600757 (+  2148us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:57.600874 (+   117us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:57.600908 (+    34us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:20:57.603135 (+  2227us) tablet.cc:701] Row locks acquired
0709 13:20:57.603159 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:20:57.603303 (+   144us) write_op.cc:270] Start()
0709 13:20:57.603421 (+   118us) write_op.cc:276] Timestamp: P: 1783603257603259 usec, L: 0
0709 13:20:57.603446 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:20:57.615081 (+ 11635us) log.cc:844] Serialized 10829 byte log entry
0709 13:20:57.643767 (+ 28686us) op_driver.cc:464] REPLICATION: finished
0709 13:20:57.721536 (+ 77769us) write_op.cc:301] APPLY: starting
0709 13:20:57.721674 (+   138us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:57.765100 (+ 43426us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:57.765224 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:57.877030 (+111806us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:57.877376 (+   346us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=54,mrs_lookups=0
0709 13:20:57.877423 (+    47us) write_op.cc:312] APPLY: finished
0709 13:20:57.887902 (+ 10479us) log.cc:844] Serialized 236 byte log entry
0709 13:20:57.891660 (+  3758us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:57.891969 (+   309us) write_op.cc:454] Released schema lock
0709 13:20:57.892050 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:57.929821 (+ 37771us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:57.929858 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":255945,"reported_tablets":36,"spinlock_wait_cycles":89602944,"child_traces":[["op",{"apply.queue_time_us":77474,"apply.run_cpu_time_us":35805,"apply.run_wall_time_us":205580,"cfile_cache_hit":110,"cfile_cache_hit_bytes":116933,"num_ops":27,"prepare.queue_time_us":57523,"prepare.run_cpu_time_us":6638,"prepare.run_wall_time_us":17412,"replication_time_us":40166,"thread_start_us":132916,"threads_started":2}]]}
I20260709 13:20:57.922439 27259 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.009s
I20260709 13:20:58.033694 19654 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:20:58.037329 27259 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:58.053829 19509 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:20:58.059219 27259 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:58.062692 19408 catalog_manager.cc:5697] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 16 to 17, term changed from 26 to 27, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to <none>, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New cstate: current_term: 27 committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:58.067080 27269 raft_consensus.cc:1064] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:20:58.083591 27269 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:58.075414 27209 raft_consensus.cc:1064] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:20:58.087352 27209 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 12, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:58.122844 19402 catalog_manager.cc:5697] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 26 to 27, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 27 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:58.124414 19402 catalog_manager.cc:5697] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: leader changed from <none> to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 27 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:58.134985 20665 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065 [term 23 LEARNER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:58.135617 19505 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:58.137461 19578 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:58.140885 27271 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:58.156152 27271 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:58.169083 27209 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:58.174852 19503 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:58.180446 27261 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:58.195590 20666 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 21 LEARNER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:58.202801 19583 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:58.138780 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:58.336683 19408 catalog_manager.cc:5697] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 26 to 27, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 27 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } }
I20260709 13:20:58.386835 19660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52294
I20260709 13:20:58.387513 19660 raft_consensus.cc:606] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Received request to transfer leadership
I20260709 13:20:58.397799 27271 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:58.402992 27271 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:58.411337 26436 raft_consensus.cc:2955] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index 14 to 15, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:20:58.416329 27295 log.cc:927] Time spent T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:20:58.427230 19503 raft_consensus.cc:2955] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:58.440760 27269 raft_consensus.cc:993] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:20:58.441300 27269 raft_consensus.cc:1081] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Signalling peer d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:20:58.444558 19505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:50822
I20260709 13:20:58.445153 19505 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:58.445508 19505 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:58.455389 19505 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:58.467713 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:20:58.468348 19581 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:58.474071 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:20:58.474726 19660 raft_consensus.cc:3055] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:58.475059 19660 raft_consensus.cc:740] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:20:58.474486 19505 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:20:58.468212 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:20:58.476847 20665 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 21 LEARNER]: Advancing to term 22
I20260709 13:20:58.479632 19581 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:58.475837 19660 consensus_queue.cc:260] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:58.482904 19660 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:58.482962 19578 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:20:58.484949 19581 raft_consensus.cc:2955] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:58.500334 20665 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 22 LEARNER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
W20260709 13:20:58.504011 19405 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48840 (request call id 170) took 35482 ms (client timeout 15000 ms). Trace:
I20260709 13:20:58.504032 20666 raft_consensus.cc:1240] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 22 LEARNER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:20:58.506223 19654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52294
W20260709 13:20:58.509265 19405 rpcz_store.cc:269] 0709 13:20:23.022028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.022462 (+   434us) service_pool.cc:224] Handling call
0709 13:20:58.503788 (+35481326us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":293229,"reported_tablets":57}
I20260709 13:20:58.530066 19658 consensus_queue.cc:237] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:58.534586 19660 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 22.
I20260709 13:20:58.535423 19654 raft_consensus.cc:606] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Received request to transfer leadership
I20260709 13:20:58.535801 19654 raft_consensus.cc:614] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:58.521166 20666 raft_consensus.cc:2955] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:58.559221 19478 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:20:58.597009 27302 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:58.610810 20665 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:20:58.622287 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 63163.5us
I20260709 13:20:58.632941 19408 catalog_manager.cc:5697] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: config changed from index 14 to 15, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:20:58.653682 19458 auto_rebalancer.cc:893] Removing replace marker failed: Replica e19c80e9149b4b8d88ae13bde8e43864 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 22 committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } } pending_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:20:58.654399 19458 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:20:58.654817 19458 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 13:20:58.658502 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 61973.3us
I20260709 13:20:58.648005 27302 raft_consensus.cc:697] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:20:58.641017 27271 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 13:20:58.671087 27302 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:58.732491 19505 raft_consensus.cc:1275] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:20:58.810513 27319 consensus_queue.cc:1048] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:20:58.818673 27300 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.220s	user 0.003s	sys 0.002s
W20260709 13:20:58.844806 27313 log.cc:927] Time spent T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:20:58.857829 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 115774us
W20260709 13:20:58.987370 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 133848us
W20260709 13:20:58.992797 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 118121us
I20260709 13:20:58.995353 19503 raft_consensus.cc:2955] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 14 to 16, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:20:59.005100 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 134637us
W20260709 13:20:59.008114 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 148869us
I20260709 13:20:58.993455 27307 raft_consensus.cc:2955] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 14 to 16, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:20:59.033221 19407 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48840 (request call id 171) took 15469 ms (client timeout 15000 ms). Trace:
W20260709 13:20:59.033704 19407 rpcz_store.cc:269] 0709 13:20:43.565715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.574130 (+  8415us) service_pool.cc:224] Handling call
0709 13:20:59.032988 (+15458858us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21413,"reported_tablets":57}
I20260709 13:20:59.094336 19402 catalog_manager.cc:5697] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 21 to 22, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129), now has a pending config: VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129), VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130), VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131), VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 22 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:59.139470 19395 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c62f6690c8e840638906e0b59d2ae71d with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:59.149456 20666 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 22 LEARNER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:20:59.156661 27324 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:59.173465 19655 consensus_queue.cc:237] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:59.180833 19511 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:20:59.181917 19655 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:20:59.186992 27324 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:59.189142 27325 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:59.197837 19578 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:20:59.199399 27308 raft_consensus.cc:2955] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index 15 to 16, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:59.201285 19511 raft_consensus.cc:2955] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:59.199368 27324 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:20:59.209771 27312 raft_consensus.cc:2955] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:59.220371 20666 raft_consensus.cc:1275] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:20:59.224329 20665 raft_consensus.cc:2955] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 14 to 16, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:59.232105 27209 consensus_queue.cc:1048] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:59.232347 19410 catalog_manager.cc:5697] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: config changed from index 14 to 16, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New cstate: current_term: 22 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:59.229035 19655 raft_consensus.cc:2955] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:59.249857 20666 raft_consensus.cc:2955] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:59.254443 19573 tablet_service.cc:1558] Processing DeleteTablet for tablet c62f6690c8e840638906e0b59d2ae71d with delete_type TABLET_DATA_TOMBSTONED (TS 2cfd02601ea44976833027665abc93bf not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:45038
I20260709 13:20:59.270498 19395 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2b601da83bfc46088ab1ec232133b605 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:59.270697 19578 raft_consensus.cc:2955] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:59.296862 27330 tablet_replica.cc:333] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:20:59.303292 20666 raft_consensus.cc:2955] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:59.310926 27330 raft_consensus.cc:2243] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.311739 27330 raft_consensus.cc:2272] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.315949 19407 catalog_manager.cc:5697] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 15 to 16, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New cstate: current_term: 23 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:59.322094 27330 ts_tablet_manager.cc:1916] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:20:59.435937 19406 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48852 (request call id 178) took 31421 ms (client timeout 15000 ms). Trace:
W20260709 13:20:59.436391 19406 rpcz_store.cc:269] 0709 13:20:28.014402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.031770 (+ 17368us) service_pool.cc:224] Handling call
0709 13:20:59.366148 (+31334378us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84800,"reported_tablets":57}
I20260709 13:20:59.470988 27330 ts_tablet_manager.cc:1929] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 22.15
I20260709 13:20:59.471701 27330 log.cc:1199] T c62f6690c8e840638906e0b59d2ae71d P 2cfd02601ea44976833027665abc93bf: Deleting WAL directory at /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-1-root/wals/c62f6690c8e840638906e0b59d2ae71d
I20260709 13:20:59.483201 19410 catalog_manager.cc:5697] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: config changed from index 14 to 15, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129), VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130), VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131), VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 22 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:59.540592 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:59.521453 19573 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b601da83bfc46088ab1ec232133b605 with delete_type TABLET_DATA_TOMBSTONED (TS 2cfd02601ea44976833027665abc93bf not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:45038
I20260709 13:20:59.558794 19397 catalog_manager.cc:5028] TS 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): tablet c62f6690c8e840638906e0b59d2ae71d (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
I20260709 13:20:59.561188 27330 tablet_replica.cc:333] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:20:59.562372 27330 raft_consensus.cc:2243] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.563169 27330 raft_consensus.cc:2272] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.573212 19584 consensus_queue.cc:237] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:59.579409 27330 ts_tablet_manager.cc:1916] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:59.600790 19505 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:20:59.631274 27330 ts_tablet_manager.cc:1929] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 23.15
I20260709 13:20:59.631837 27330 log.cc:1199] T 2b601da83bfc46088ab1ec232133b605 P 2cfd02601ea44976833027665abc93bf: Deleting WAL directory at /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-1-root/wals/2b601da83bfc46088ab1ec232133b605
I20260709 13:20:59.633926 19397 catalog_manager.cc:5028] TS 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): tablet 2b601da83bfc46088ab1ec232133b605 (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
W20260709 13:20:59.683907 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 143514us
I20260709 13:20:59.686864 20666 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:20:59.688604 27302 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:20:59.723012 27324 raft_consensus.cc:2955] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Committing config change with OpId 22.17: config changed from index 15 to 17, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:59.727705 20666 raft_consensus.cc:2955] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 15 to 17, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:59.753319 19395 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2c83387a56274f46bd5795b3376741c9 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:20:59.761129 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 75771.4us
I20260709 13:20:59.759444 19410 catalog_manager.cc:5697] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 15 to 17, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New cstate: current_term: 22 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:59.770114 19503 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:20:59.779757 19646 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c83387a56274f46bd5795b3376741c9 with delete_type TABLET_DATA_TOMBSTONED (TS e19c80e9149b4b8d88ae13bde8e43864 not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:52294
I20260709 13:20:59.789101 19658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:20:59.789891 19658 raft_consensus.cc:606] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 28 LEADER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:59.791049 19584 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:20:59.803119 20666 raft_consensus.cc:1275] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:20:59.814066 27324 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:20:59.831212 27259 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.003s
I20260709 13:20:59.838502 27341 tablet_replica.cc:333] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:20:59.839965 27341 raft_consensus.cc:2243] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.840957 27341 raft_consensus.cc:2272] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.878310 27341 ts_tablet_manager.cc:1916] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:59.873721 27334 consensus_queue.cc:1048] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.015s
W20260709 13:20:59.930614 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 45160.9us
I20260709 13:20:59.935142 20666 raft_consensus.cc:2955] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Committing config change with OpId 27.19: config changed from index 17 to 19, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:59.929203 27258 raft_consensus.cc:2955] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Committing config change with OpId 27.19: config changed from index 17 to 19, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:59.972146 19410 catalog_manager.cc:5697] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 17 to 19, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New cstate: current_term: 27 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:20:59.984210 19581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:46086
I20260709 13:20:59.984974 19581 raft_consensus.cc:606] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:20:59.986003 27341 ts_tablet_manager.cc:1929] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 22.16
I20260709 13:20:59.989601 27341 log.cc:1199] T 2c83387a56274f46bd5795b3376741c9 P e19c80e9149b4b8d88ae13bde8e43864: Deleting WAL directory at /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-2-root/wals/2c83387a56274f46bd5795b3376741c9
I20260709 13:20:59.994544 19578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f949ff511e844749624dedf436dff50"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:46086
I20260709 13:20:59.995294 19578 raft_consensus.cc:606] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:00.003491 19659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:21:00.004143 19659 raft_consensus.cc:606] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:00.007212 19659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:21:00.007818 19659 raft_consensus.cc:606] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:00.009003 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:21:00.010882 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:59.997756 19395 catalog_manager.cc:5028] TS e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): tablet 2c83387a56274f46bd5795b3376741c9 (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
I20260709 13:21:00.041944 19646 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e5f26f686634d4ab47c02b7a00ba584 with delete_type TABLET_DATA_TOMBSTONED (TS e19c80e9149b4b8d88ae13bde8e43864 not found in new config with opid_index 19) from {username='slave'} at 127.0.0.1:52294
W20260709 13:21:00.047269 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 186880us
I20260709 13:21:00.048444 27335 raft_consensus.cc:993] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf: : Instructing follower d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:00.049006 27335 raft_consensus.cc:1081] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Signalling peer d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:00.052842 19397 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0e5f26f686634d4ab47c02b7a00ba584 with cas_config_opid_index 17: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:21:00.053323 27341 tablet_replica.cc:333] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:00.056398 19511 raft_consensus.cc:2955] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Committing config change with OpId 27.19: config changed from index 17 to 19, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:00.058259 19584 raft_consensus.cc:2955] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 15 to 17, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:00.078413 19505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:50828
I20260709 13:21:00.079144 19505 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:00.079604 19505 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:00.104321 19505 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:00.106505 19505 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:00.131747 27325 raft_consensus.cc:993] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:00.132417 27325 raft_consensus.cc:1081] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Signalling peer d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:00.134325 19503 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:50822
I20260709 13:21:00.134869 19503 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:00.135213 19503 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:21:00.136618 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 48636.9us
I20260709 13:21:00.141752 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:00.142341 19659 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:00.151661 19659 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:21:00.152858 19476 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:21:00.153680 27302 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:00.155423 27308 raft_consensus.cc:993] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:00.155936 27308 raft_consensus.cc:1081] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 28 LEADER]: Signalling peer d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:00.156893 27302 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:21:00.157835 27302 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:00.153576 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: true dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:00.161827 19584 raft_consensus.cc:3055] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:21:00.162231 19584 raft_consensus.cc:740] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:21:00.163153 19584 consensus_queue.cc:260] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:00.164511 19584 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:00.171698 27341 raft_consensus.cc:2243] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.172636 27341 raft_consensus.cc:2272] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.182889 19505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:50822
I20260709 13:21:00.183481 19505 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:00.183851 19505 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:21:00.194099 19503 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:00.200954 27341 ts_tablet_manager.cc:1916] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:21:00.204743 19503 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:00.215497 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:00.200802 19505 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:00.205308 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: true dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:00.216378 19578 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:00.220758 19584 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:21:00.224144 27258 raft_consensus.cc:993] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf: : Instructing follower d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:00.224682 27258 raft_consensus.cc:1081] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Signalling peer d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:00.226392 19503 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f949ff511e844749624dedf436dff50"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:50828
I20260709 13:21:00.227018 19503 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:00.232089 19503 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:00.246222 19578 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 26.
I20260709 13:21:00.246610 27308 raft_consensus.cc:993] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:00.247087 27317 raft_consensus.cc:1081] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Signalling peer d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:00.248855 19506 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:50822
I20260709 13:21:00.249420 19506 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:00.233148 19410 catalog_manager.cc:5697] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 23 to 24, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 24 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:00.250671 19505 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 29 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:00.252187 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 29 candidate_status { last_received { term: 28 index: 13 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:00.252866 19655 raft_consensus.cc:3055] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:21:00.253055 19478 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:21:00.255043 27302 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:21:00.255597 27302 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:21:00.258685 27302 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:00.253219 19655 raft_consensus.cc:740] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:00.261206 19655 consensus_queue.cc:260] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 28.13, Last appended by leader: 13, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:00.265228 19655 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:21:00.286684 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 29 candidate_status { last_received { term: 28 index: 13 } } ignore_live_leader: true dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:00.287854 19584 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:21:00.249818 19506 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:00.236454 19659 raft_consensus.cc:3055] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:21:00.294847 19659 raft_consensus.cc:740] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:00.296676 19659 consensus_queue.cc:260] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:00.299201 19655 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 29.
I20260709 13:21:00.314502 19659 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:00.314805 19476 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:21:00.327397 19410 catalog_manager.cc:5697] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 25 to 26, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 26 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:00.329216 27324 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:21:00.329862 27324 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 29 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:21:00.330785 27324 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 28.13, Last appended by leader: 13, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:00.358593 19584 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 29.
I20260709 13:21:00.308844 19503 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:00.374847 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: true dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:00.375514 19578 raft_consensus.cc:3055] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:21:00.375869 19578 raft_consensus.cc:740] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:21:00.376649 19578 consensus_queue.cc:260] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:00.378520 19578 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:00.386055 19410 catalog_manager.cc:5697] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 28 to 29, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 29 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:00.399130 19578 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 26.
I20260709 13:21:00.401994 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:00.402678 19655 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:00.400357 19503 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:00.370047 19506 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:00.406137 19478 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:21:00.407097 27324 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:21:00.407684 27324 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:21:00.408603 27324 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:00.412485 27341 ts_tablet_manager.cc:1929] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 27.18
I20260709 13:21:00.413515 27341 log.cc:1199] T 0e5f26f686634d4ab47c02b7a00ba584 P e19c80e9149b4b8d88ae13bde8e43864: Deleting WAL directory at /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-2-root/wals/0e5f26f686634d4ab47c02b7a00ba584
I20260709 13:21:00.412985 19506 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:00.415508 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:00.416218 19658 raft_consensus.cc:3055] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:21:00.365309 19659 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 26.
I20260709 13:21:00.416563 19658 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:00.417667 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: true dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:00.418403 19584 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:00.417806 19658 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:00.421764 19658 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:00.426179 19655 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 26.
I20260709 13:21:00.427047 19395 catalog_manager.cc:5028] TS e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): tablet 0e5f26f686634d4ab47c02b7a00ba584 (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
I20260709 13:21:00.429915 19584 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 26.
I20260709 13:21:00.444764 19478 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:21:00.450456 19410 catalog_manager.cc:5697] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 25 to 26, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 26 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:00.461735 27324 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:21:00.464804 27324 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:21:00.465961 27324 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:00.485317 19658 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 26.
I20260709 13:21:00.558256 19410 catalog_manager.cc:5697] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 25 to 26, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 26 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:00.661463 19658 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:21:00.670254 27324 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:00.736652 19584 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:21:00.740450 19578 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:21:00.743144 27344 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:21:00.746692 27345 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:00.749132 19658 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 29 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 28 index: 13. Preceding OpId from leader: term: 29 index: 14. (index mismatch)
I20260709 13:21:00.752811 27345 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:21:00.785303 19584 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 28 index: 13. Preceding OpId from leader: term: 29 index: 14. (index mismatch)
I20260709 13:21:00.791195 27345 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:21:00.799374 19659 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:21:00.813541 27345 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:21:00.900447 19660 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:21:00.904241 27344 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:21:00.925808 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 54205.3us
I20260709 13:21:00.936802 19660 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:21:00.948235 27302 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 13:21:00.977381 19578 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:21:00.979736 27324 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:01.011854 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:01.051559 19583 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:21:01.054028 27371 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:01.325141 19578 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
W20260709 13:21:01.376840 19553 consensus_peers.cc:597] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf -> Peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615): Couldn't send request to peer 068c03c9dcc848e6bf909131b1f83065. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b28ba556d85a4d61bf15492b88b280d9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.378705 19659 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:21:01.377363 19503 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:21:01.383917 27368 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:01.385968 27368 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:01.437263 27259 raft_consensus.cc:2955] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Committing config change with OpId 24.13: config changed from index -1 to 13, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:21:01.439214 19659 raft_consensus.cc:2955] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Committing config change with OpId 24.13: config changed from index -1 to 13, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:21:01.482806 19578 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
W20260709 13:21:01.531350 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51777.4us
I20260709 13:21:01.536963 19505 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:21:01.545394 19659 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:21:01.513171 19410 catalog_manager.cc:5697] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: config changed from index -1 to 13, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New cstate: current_term: 24 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:21:01.547091 27335 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:01.553108 27368 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:01.574579 27335 raft_consensus.cc:2955] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Committing config change with OpId 27.16: config changed from index -1 to 16, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:21:01.583072 19659 raft_consensus.cc:2955] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Committing config change with OpId 27.16: config changed from index -1 to 16, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
W20260709 13:21:01.593194 19553 consensus_peers.cc:597] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf -> Peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615): Couldn't send request to peer 068c03c9dcc848e6bf909131b1f83065. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: daee81c3dc8c4dc4b735d1643829fe76. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.597788 19503 raft_consensus.cc:2955] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Committing config change with OpId 24.13: config changed from index -1 to 13, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
W20260709 13:21:01.683753 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 78803.5us
I20260709 13:21:01.727514 19506 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:21:01.738412 19578 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:21:01.740075 27324 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:21:01.745033 19478 consensus_peers.cc:597] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 -> Peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615): Couldn't send request to peer 068c03c9dcc848e6bf909131b1f83065. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c3672e496ae4c7ab924bee7e50ecf70. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.752584 19659 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:21:01.755903 27371 raft_consensus.cc:2955] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Committing config change with OpId 26.16: config changed from index -1 to 16, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:21:01.757709 19505 raft_consensus.cc:2955] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Committing config change with OpId 27.16: config changed from index -1 to 16, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:21:01.762962 27384 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:01.784422 19659 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.11, Last appended by leader: 10, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:21:01.793773 19405 catalog_manager.cc:5697] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: config changed from index -1 to 16, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New cstate: current_term: 27 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:21:01.805411 19655 raft_consensus.cc:2955] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Committing config change with OpId 26.16: config changed from index -1 to 16, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:21:01.818003 19578 raft_consensus.cc:2955] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Committing config change with OpId 26.16: config changed from index -1 to 16, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:21:01.828635 19410 catalog_manager.cc:5697] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: config changed from index -1 to 16, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New cstate: current_term: 26 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:01.861099 19627 consensus_peers.cc:597] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615): Couldn't send request to peer 068c03c9dcc848e6bf909131b1f83065. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c89dfa6a61346148bb8520ed4d0ecd9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.868988 19506 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 24 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:21:01.869807 19581 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 24 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:21:01.874532 27387 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:01.878656 27385 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:01.953655 27394 ts_tablet_manager.cc:933] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:01.957391 27385 raft_consensus.cc:2955] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Committing config change with OpId 24.12: config changed from index -1 to 12, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:21:01.963516 19579 raft_consensus.cc:2955] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Committing config change with OpId 24.12: config changed from index -1 to 12, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:21:01.965531 19505 raft_consensus.cc:2955] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Committing config change with OpId 24.12: config changed from index -1 to 12, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:21:01.993804 27396 ts_tablet_manager.cc:933] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:02.000638 19407 catalog_manager.cc:5697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf reported cstate change: config changed from index -1 to 12, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New cstate: current_term: 24 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:21:02.041007 27396 tablet_copy_client.cc:323] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Beginning tablet copy session from remote peer at address 127.17.251.130:36471
I20260709 13:21:02.044965 19597 tablet_copy_service.cc:140] P 2cfd02601ea44976833027665abc93bf: Received BeginTabletCopySession request for tablet b28ba556d85a4d61bf15492b88b280d9 from peer 068c03c9dcc848e6bf909131b1f83065 ({username='slave'} at 127.0.0.1:35102)
I20260709 13:21:02.045609 19597 tablet_copy_service.cc:161] P 2cfd02601ea44976833027665abc93bf: Beginning new tablet copy session on tablet b28ba556d85a4d61bf15492b88b280d9 from peer 068c03c9dcc848e6bf909131b1f83065 at {username='slave'} at 127.0.0.1:35102: session id = 068c03c9dcc848e6bf909131b1f83065-b28ba556d85a4d61bf15492b88b280d9
I20260709 13:21:02.042169 27394 tablet_copy_client.cc:323] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Beginning tablet copy session from remote peer at address 127.17.251.130:36471
I20260709 13:21:02.050344 19596 tablet_copy_service.cc:140] P 2cfd02601ea44976833027665abc93bf: Received BeginTabletCopySession request for tablet daee81c3dc8c4dc4b735d1643829fe76 from peer 068c03c9dcc848e6bf909131b1f83065 ({username='slave'} at 127.0.0.1:35102)
I20260709 13:21:02.050968 19596 tablet_copy_service.cc:161] P 2cfd02601ea44976833027665abc93bf: Beginning new tablet copy session on tablet daee81c3dc8c4dc4b735d1643829fe76 from peer 068c03c9dcc848e6bf909131b1f83065 at {username='slave'} at 127.0.0.1:35102: session id = 068c03c9dcc848e6bf909131b1f83065-daee81c3dc8c4dc4b735d1643829fe76
I20260709 13:21:02.116550 19596 tablet_copy_source_session.cc:215] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:02.120167 27394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daee81c3dc8c4dc4b735d1643829fe76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:02.139222 27394 tablet_copy_client.cc:806] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:02.139919 27394 tablet_copy_client.cc:670] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:02.144163 27394 tablet_copy_client.cc:538] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:02.154021 27394 tablet_bootstrap.cc:492] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap starting.
I20260709 13:21:02.195381 19597 tablet_copy_source_session.cc:215] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:02.228439 27396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b28ba556d85a4d61bf15492b88b280d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:02.221698 27398 ts_tablet_manager.cc:933] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645)
I20260709 13:21:02.257434 27398 tablet_copy_client.cc:323] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Beginning tablet copy session from remote peer at address 127.17.251.129:38645
I20260709 13:21:02.259140 19521 tablet_copy_service.cc:140] P d56df3728fc04e37b2d29a3bcd91d167: Received BeginTabletCopySession request for tablet 8c3672e496ae4c7ab924bee7e50ecf70 from peer 068c03c9dcc848e6bf909131b1f83065 ({username='slave'} at 127.0.0.1:60692)
I20260709 13:21:02.259773 19521 tablet_copy_service.cc:161] P d56df3728fc04e37b2d29a3bcd91d167: Beginning new tablet copy session on tablet 8c3672e496ae4c7ab924bee7e50ecf70 from peer 068c03c9dcc848e6bf909131b1f83065 at {username='slave'} at 127.0.0.1:60692: session id = 068c03c9dcc848e6bf909131b1f83065-8c3672e496ae4c7ab924bee7e50ecf70
I20260709 13:21:02.268323 27394 tablet_bootstrap.cc:492] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=1 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:02.281713 27394 tablet_bootstrap.cc:492] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap complete.
I20260709 13:21:02.282925 27394 ts_tablet_manager.cc:1403] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065: Time spent bootstrapping tablet: real 0.129s	user 0.047s	sys 0.020s
I20260709 13:21:02.286877 19521 tablet_copy_source_session.cc:215] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:02.329450 27394 raft_consensus.cc:359] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [term 27 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:21:02.385944 27394 raft_consensus.cc:740] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [term 27 LEARNER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Initialized, Role: LEARNER
I20260709 13:21:02.340518 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:02.386701 27394 consensus_queue.cc:260] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:21:02.410933 27394 ts_tablet_manager.cc:1434] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065: Time spent starting tablet: real 0.128s	user 0.013s	sys 0.006s
I20260709 13:21:02.412804 19597 tablet_copy_service.cc:342] P 2cfd02601ea44976833027665abc93bf: Request end of tablet copy session 068c03c9dcc848e6bf909131b1f83065-daee81c3dc8c4dc4b735d1643829fe76 received from {username='slave'} at 127.0.0.1:35102
I20260709 13:21:02.413348 19597 tablet_copy_service.cc:434] P 2cfd02601ea44976833027665abc93bf: ending tablet copy session 068c03c9dcc848e6bf909131b1f83065-daee81c3dc8c4dc4b735d1643829fe76 on tablet daee81c3dc8c4dc4b735d1643829fe76 with peer 068c03c9dcc848e6bf909131b1f83065
W20260709 13:21:02.417814 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 102803us
I20260709 13:21:02.428910 27398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3672e496ae4c7ab924bee7e50ecf70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:02.446538 27394 ts_tablet_manager.cc:933] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:02.451617 27396 tablet_copy_client.cc:806] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:02.452343 27396 tablet_copy_client.cc:670] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:02.454941 27394 tablet_copy_client.cc:323] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Beginning tablet copy session from remote peer at address 127.17.251.131:33295
I20260709 13:21:02.459671 27396 tablet_copy_client.cc:538] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:02.496337 27396 tablet_bootstrap.cc:492] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap starting.
I20260709 13:21:02.496680 19671 tablet_copy_service.cc:140] P e19c80e9149b4b8d88ae13bde8e43864: Received BeginTabletCopySession request for tablet 6c89dfa6a61346148bb8520ed4d0ecd9 from peer 068c03c9dcc848e6bf909131b1f83065 ({username='slave'} at 127.0.0.1:59942)
I20260709 13:21:02.497269 19671 tablet_copy_service.cc:161] P e19c80e9149b4b8d88ae13bde8e43864: Beginning new tablet copy session on tablet 6c89dfa6a61346148bb8520ed4d0ecd9 from peer 068c03c9dcc848e6bf909131b1f83065 at {username='slave'} at 127.0.0.1:59942: session id = 068c03c9dcc848e6bf909131b1f83065-6c89dfa6a61346148bb8520ed4d0ecd9
I20260709 13:21:02.511044 20666 raft_consensus.cc:1217] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [term 27 LEARNER]: Deduplicated request from leader. Original: 27.15->[27.16-27.16]   Dedup: 27.16->[]
I20260709 13:21:02.520983 19671 tablet_copy_source_session.cc:215] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:02.540203 27394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c89dfa6a61346148bb8520ed4d0ecd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:02.560371 27398 tablet_copy_client.cc:806] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:02.561053 27398 tablet_copy_client.cc:670] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:02.574636 27398 tablet_copy_client.cc:538] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:02.651255 19660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:21:02.651965 19660 raft_consensus.cc:606] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:21:02.654160 27398 tablet_bootstrap.cc:492] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap starting.
I20260709 13:21:02.668478 19660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:21:02.669090 19660 raft_consensus.cc:606] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:02.672334 27394 tablet_copy_client.cc:806] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:02.674523 27394 tablet_copy_client.cc:670] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:02.674999 19660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:21:02.675580 19660 raft_consensus.cc:606] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:02.681021 27394 tablet_copy_client.cc:538] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:02.683123 19660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:21:02.683776 19660 raft_consensus.cc:606] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 31 LEADER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:02.692142 19505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f516f797b78848a5825878b37c422f07"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:21:02.692803 19505 raft_consensus.cc:606] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:21:02.694299 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:21:02.698905 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:02.713200 27385 raft_consensus.cc:993] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:02.713730 27385 raft_consensus.cc:1081] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Signalling peer d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:02.716152 19503 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:50822
I20260709 13:21:02.716712 19503 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:02.717057 19503 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:02.741074 27394 tablet_bootstrap.cc:492] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap starting.
I20260709 13:21:02.756588 19503 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:02.780376 19503 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:02.784633 27396 tablet_bootstrap.cc:492] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=2 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:02.785715 27396 tablet_bootstrap.cc:492] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap complete.
I20260709 13:21:02.786468 27396 ts_tablet_manager.cc:1403] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065: Time spent bootstrapping tablet: real 0.290s	user 0.050s	sys 0.026s
I20260709 13:21:02.787388 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:02.787968 19581 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:02.788348 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:02.788911 19660 raft_consensus.cc:3055] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:21:02.789196 19660 raft_consensus.cc:740] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:02.800524 19660 consensus_queue.cc:260] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:02.801838 19660 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:02.791661 27396 raft_consensus.cc:359] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:21:02.833575 27396 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Initialized, Role: LEARNER
I20260709 13:21:02.836807 19581 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:21:02.834759 27396 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:21:02.838825 19478 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:21:02.839763 27406 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:02.840770 27406 raft_consensus.cc:697] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:21:02.841820 27406 consensus_queue.cc:237] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:02.828723 19660 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 24.
I20260709 13:21:02.878350 27396 ts_tablet_manager.cc:1434] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065: Time spent starting tablet: real 0.092s	user 0.005s	sys 0.004s
I20260709 13:21:02.898881 19597 tablet_copy_service.cc:342] P 2cfd02601ea44976833027665abc93bf: Request end of tablet copy session 068c03c9dcc848e6bf909131b1f83065-b28ba556d85a4d61bf15492b88b280d9 received from {username='slave'} at 127.0.0.1:35102
I20260709 13:21:02.899358 19597 tablet_copy_service.cc:434] P 2cfd02601ea44976833027665abc93bf: ending tablet copy session 068c03c9dcc848e6bf909131b1f83065-b28ba556d85a4d61bf15492b88b280d9 on tablet b28ba556d85a4d61bf15492b88b280d9 with peer 068c03c9dcc848e6bf909131b1f83065
I20260709 13:21:02.938774 27335 raft_consensus.cc:1064] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:21:02.941419 27335 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 14, Current term: 27, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:02.960408 27394 tablet_bootstrap.cc:492] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:02.964457 27394 tablet_bootstrap.cc:492] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap complete.
I20260709 13:21:02.965140 27394 ts_tablet_manager.cc:1403] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065: Time spent bootstrapping tablet: real 0.224s	user 0.054s	sys 0.019s
I20260709 13:21:02.970780 27394 raft_consensus.cc:359] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065 [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:21:02.972103 27394 raft_consensus.cc:740] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065 [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Initialized, Role: LEARNER
I20260709 13:21:02.972823 27394 consensus_queue.cc:260] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:21:02.992835 19407 catalog_manager.cc:5697] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 23 to 24, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 24 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:02.995585 27394 ts_tablet_manager.cc:1434] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
W20260709 13:21:02.997367 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 71071.3us
I20260709 13:21:02.998569 19671 tablet_copy_service.cc:342] P e19c80e9149b4b8d88ae13bde8e43864: Request end of tablet copy session 068c03c9dcc848e6bf909131b1f83065-6c89dfa6a61346148bb8520ed4d0ecd9 received from {username='slave'} at 127.0.0.1:59942
I20260709 13:21:03.001592 19671 tablet_copy_service.cc:434] P e19c80e9149b4b8d88ae13bde8e43864: ending tablet copy session 068c03c9dcc848e6bf909131b1f83065-6c89dfa6a61346148bb8520ed4d0ecd9 on tablet 6c89dfa6a61346148bb8520ed4d0ecd9 with peer 068c03c9dcc848e6bf909131b1f83065
I20260709 13:21:03.038928 27387 raft_consensus.cc:993] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:03.039454 27387 raft_consensus.cc:1081] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 31 LEADER]: Signalling peer d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:03.041600 19503 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:50822
I20260709 13:21:03.042315 19503 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 31 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:03.042737 19503 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:21:03.046128 20666 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [term 27 LEARNER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:21:03.047690 27383 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:21:03.057519 19660 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:21:03.058246 27398 tablet_bootstrap.cc:492] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=2 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:03.059280 27398 tablet_bootstrap.cc:492] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065: Bootstrap complete.
I20260709 13:21:03.060086 27398 ts_tablet_manager.cc:1403] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065: Time spent bootstrapping tablet: real 0.406s	user 0.053s	sys 0.014s
I20260709 13:21:03.064410 27335 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:21:03.063534 27398 raft_consensus.cc:359] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 26 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:21:03.065433 27398 raft_consensus.cc:740] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 26 LEARNER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Initialized, Role: LEARNER
I20260709 13:21:03.066180 27398 consensus_queue.cc:260] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:21:03.069201 27398 ts_tablet_manager.cc:1434] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:21:03.131085 19521 tablet_copy_service.cc:342] P d56df3728fc04e37b2d29a3bcd91d167: Request end of tablet copy session 068c03c9dcc848e6bf909131b1f83065-8c3672e496ae4c7ab924bee7e50ecf70 received from {username='slave'} at 127.0.0.1:60692
I20260709 13:21:03.132061 19506 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:21:03.132453 19521 tablet_copy_service.cc:434] P d56df3728fc04e37b2d29a3bcd91d167: ending tablet copy session 068c03c9dcc848e6bf909131b1f83065-8c3672e496ae4c7ab924bee7e50ecf70 on tablet 8c3672e496ae4c7ab924bee7e50ecf70 with peer 068c03c9dcc848e6bf909131b1f83065
I20260709 13:21:03.168437 27418 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:21:03.209681 19503 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 32 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:03.213279 19503 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 32 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:03.235328 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: true dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:03.236480 19581 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:21:03.250022 27307 raft_consensus.cc:993] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:03.250892 27307 raft_consensus.cc:1081] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Signalling peer d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:03.275278 19581 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 32.
I20260709 13:21:03.280969 19578 raft_consensus.cc:1240] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 32 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 31. Current term is 32. Ops: []
I20260709 13:21:03.286397 19511 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:50822
I20260709 13:21:03.287446 19511 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:03.287961 19511 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:03.300642 19511 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:03.319408 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 160889us
I20260709 13:21:03.325173 27259 raft_consensus.cc:2955] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Committing config change with OpId 27.17: config changed from index 16 to 17, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:03.350941 20666 raft_consensus.cc:1217] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [term 24 LEARNER]: Deduplicated request from leader. Original: 24.12->[24.13-24.13]   Dedup: 24.13->[]
I20260709 13:21:03.391683 27421 consensus_queue.cc:1059] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: INVALID_TERM, Last received: 31.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:21:03.395200 27422 raft_consensus.cc:3055] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 31 LEADER]: Stepping down as leader of term 31
I20260709 13:21:03.395747 27422 raft_consensus.cc:740] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:03.391701 19511 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:21:03.444475 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 64464.2us
I20260709 13:21:03.396924 27422 consensus_queue.cc:260] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 31.16, Last appended by leader: 16, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:03.450024 20666 raft_consensus.cc:2955] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Committing config change with OpId 27.17: config changed from index 16 to 17, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:03.464097 19509 raft_consensus.cc:2955] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Committing config change with OpId 27.17: config changed from index 16 to 17, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:03.505905 27422 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:21:03.524514 19478 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
W20260709 13:21:03.525393 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 110002us
I20260709 13:21:03.526543 27429 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 13:21:03.529250 27429 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 32 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:21:03.536558 20665 raft_consensus.cc:1217] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 26 LEARNER]: Deduplicated request from leader. Original: 26.15->[26.16-26.16]   Dedup: 26.16->[]
I20260709 13:21:03.537925 27385 raft_consensus.cc:993] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:21:03.538582 27385 raft_consensus.cc:1081] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
W20260709 13:21:03.543450 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 89524.2us
I20260709 13:21:03.545717 19406 catalog_manager.cc:5697] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf reported cstate change: config changed from index 16 to 17, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New cstate: current_term: 27 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:03.547395 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:03.556946 19578 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:03.532141 27429 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 31.16, Last appended by leader: 16, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:03.570624 19660 raft_consensus.cc:2955] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Committing config change with OpId 27.17: config changed from index 16 to 17, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:03.599552 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:03.603741 27406 raft_consensus.cc:993] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:21:03.606217 27406 raft_consensus.cc:1081] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:21:03.610896 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:03.611685 19655 raft_consensus.cc:3055] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:03.612094 19655 raft_consensus.cc:740] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:03.613045 19655 consensus_queue.cc:260] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:03.614871 19655 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:03.636824 19503 raft_consensus.cc:1240] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:03.637739 19578 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:21:03.660306 19654 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:21:03.645133 19581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f516f797b78848a5825878b37c422f07"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60808
I20260709 13:21:03.661752 19581 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:03.662110 19581 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:03.658550 27418 raft_consensus.cc:1064] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:21:03.611022 19658 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 32.
I20260709 13:21:03.669590 27418 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 11, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:03.646513 19587 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 13:21:03.670663 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 152966us
I20260709 13:21:03.685451 20666 raft_consensus.cc:1217] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065 [term 24 LEARNER]: Deduplicated request from leader. Original: 24.11->[24.12-24.12]   Dedup: 24.12->[]
I20260709 13:21:03.690541 19478 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:21:03.691530 27324 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:03.680042 19578 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:03.696594 27324 raft_consensus.cc:697] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:21:03.697585 27324 consensus_queue.cc:237] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:03.700223 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:03.700399 19583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60800
I20260709 13:21:03.701134 19583 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:03.701602 19583 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:03.697814 27406 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:21:03.673928 19581 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:03.710875 19581 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:03.718469 20663 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:21:03.726043 27383 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:21:03.736521 19660 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:21:03.738492 27383 raft_consensus.cc:2955] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Committing config change with OpId 27.18: config changed from index 17 to 18, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:21:03.743527 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 47158.8us
I20260709 13:21:03.749850 19655 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 21.
I20260709 13:21:03.754194 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:21:03.754952 19505 raft_consensus.cc:3055] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:21:03.755321 19505 raft_consensus.cc:740] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:21:03.754477 20663 raft_consensus.cc:2955] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Committing config change with OpId 27.18: config changed from index 17 to 18, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:03.754716 19408 catalog_manager.cc:5697] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 31 to 32, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 32 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:03.756256 19505 consensus_queue.cc:260] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:03.757205 19505 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:03.774807 19505 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:21:03.776026 19581 raft_consensus.cc:1240] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Rejecting Update request from peer d56df3728fc04e37b2d29a3bcd91d167 for earlier term 22. Current term is 23. Ops: []
I20260709 13:21:03.787006 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:03.787659 19655 raft_consensus.cc:3060] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:03.804845 27384 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:03.776824 19583 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:03.812860 19655 raft_consensus.cc:2468] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:21:03.817759 19551 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:21:03.826277 20663 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [term 24 LEARNER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:21:03.830246 27411 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.019s
I20260709 13:21:03.835773 19583 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:03.849596 27259 raft_consensus.cc:2804] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:03.850191 27259 raft_consensus.cc:697] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:21:03.851075 27259 consensus_queue.cc:237] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:03.851619 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 176165us
I20260709 13:21:03.862071 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:21:03.873829 19505 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:03.875463 19660 raft_consensus.cc:2955] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Committing config change with OpId 27.18: config changed from index 17 to 18, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:03.872299 19406 catalog_manager.cc:5697] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 17 to 18, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New cstate: current_term: 27 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:03.879040 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:03.879654 19659 raft_consensus.cc:3055] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:21:03.879989 19659 raft_consensus.cc:740] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:03.881956 27335 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:03.880990 19659 consensus_queue.cc:260] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:03.886873 19659 raft_consensus.cc:3060] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:03.888154 19509 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:21:03.889948 27411 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:21:03.929713 19397 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet daee81c3dc8c4dc4b735d1643829fe76 with cas_config_opid_index 17: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:21:03.944962 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 49889.2us
W20260709 13:21:03.975835 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 149008us
I20260709 13:21:03.999511 19505 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:21:04.000232 19509 raft_consensus.cc:1240] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Rejecting Update request from peer e19c80e9149b4b8d88ae13bde8e43864 for earlier term 22. Current term is 23. Ops: []
I20260709 13:21:04.002374 19659 raft_consensus.cc:2468] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:21:04.025380 19551 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:21:04.026667 27418 raft_consensus.cc:2804] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:04.027153 27418 raft_consensus.cc:697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:21:04.069753 27442 raft_consensus.cc:1064] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:21:04.069262 27418 consensus_queue.cc:237] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:04.064234 27432 raft_consensus.cc:2955] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Committing config change with OpId 24.14: config changed from index 13 to 14, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:21:04.083318 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 56130.9us
I20260709 13:21:04.103212 20663 raft_consensus.cc:2955] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Committing config change with OpId 24.14: config changed from index 13 to 14, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:21:04.114688 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 111103us
I20260709 13:21:04.125694 19658 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:21:04.072624 27442 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 14, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:21:04.168264 19626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:04.175287 19498 tablet_service.cc:1558] Processing DeleteTablet for tablet daee81c3dc8c4dc4b735d1643829fe76 with delete_type TABLET_DATA_TOMBSTONED (TS d56df3728fc04e37b2d29a3bcd91d167 not found in new config with opid_index 18) from {username='slave'} at 127.0.0.1:50816
I20260709 13:21:04.221026 27417 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:21:04.231070 20663 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 26 LEARNER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:21:04.243835 19659 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 32 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 31 index: 16. Preceding OpId from leader: term: 32 index: 17. (index mismatch)
I20260709 13:21:04.260426 19660 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:21:04.251595 19503 raft_consensus.cc:2955] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Committing config change with OpId 24.14: config changed from index 13 to 14, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:04.282869 19406 catalog_manager.cc:5697] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 20 to 21, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 21 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:04.294437 19659 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:21:04.268389 27324 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 13:21:04.316190 19587 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:21:04.317021 19578 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 32 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 31 index: 16. Preceding OpId from leader: term: 32 index: 17. (index mismatch)
I20260709 13:21:04.342778 19410 catalog_manager.cc:5697] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 13 to 14, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:04.344069 27457 tablet_replica.cc:333] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:04.351423 27209 raft_consensus.cc:1064] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:21:04.357877 27209 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 10, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:04.396662 19507 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:21:04.407133 27432 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:04.417688 19407 catalog_manager.cc:5697] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 22 to 23, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 23 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:04.432684 20666 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065 [term 24 LEARNER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:21:04.434671 27431 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:04.453120 19503 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:21:04.456240 27431 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:21:04.477664 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 188164us
W20260709 13:21:04.478809 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 190050us
I20260709 13:21:04.479982 27424 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:21:04.487308 19655 raft_consensus.cc:2955] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Committing config change with OpId 24.14: config changed from index 13 to 14, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:04.504216 27424 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:21:04.551021 19578 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:21:04.509950 27423 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.062s
I20260709 13:21:04.614351 27457 raft_consensus.cc:2243] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:04.635569 19407 catalog_manager.cc:5697] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 22 to 23, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 23 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:04.650494 19658 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:21:04.734994 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 174633us
I20260709 13:21:04.788431 27209 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:04.789969 19587 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:21:04.764580 27463 log.cc:927] Time spent T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.121s	user 0.000s	sys 0.006s
I20260709 13:21:04.796190 19658 raft_consensus.cc:1275] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:21:04.784802 27457 raft_consensus.cc:2272] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:04.823032 27448 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:21:04.827050 27466 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:21:04.811728 27470 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
W20260709 13:21:04.870747 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 79076us
I20260709 13:21:04.817641 27424 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.051s
W20260709 13:21:04.884284 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 74541.2us
W20260709 13:21:04.885327 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 97825.1us
W20260709 13:21:04.894843 27468 log.cc:927] Time spent T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:21:04.907339 27469 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.168s	user 0.002s	sys 0.000s
I20260709 13:21:04.910943 27457 ts_tablet_manager.cc:1916] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:21:04.911761 19505 raft_consensus.cc:1275] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:21:04.933435 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 64014.3us
W20260709 13:21:04.938755 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 69679us
I20260709 13:21:04.961792 27259 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:21:04.994163 27475 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:21:04.996057 27324 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:21:05.008000 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 44403.7us
I20260709 13:21:05.008057 27259 consensus_queue.cc:1048] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 13:21:05.034827 19655 raft_consensus.cc:2955] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Committing config change with OpId 26.17: config changed from index 16 to 17, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:05.048043 27445 raft_consensus.cc:2955] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Committing config change with OpId 24.13: config changed from index 12 to 13, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:05.081794 19507 raft_consensus.cc:2955] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Committing config change with OpId 24.13: config changed from index 12 to 13, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:21:05.093766 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 60245.4us
I20260709 13:21:05.032020 27425 raft_consensus.cc:2955] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Committing config change with OpId 26.17: config changed from index 16 to 17, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:05.119987 27335 consensus_queue.cc:1048] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:21:05.144968 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 48433.1us
W20260709 13:21:05.208344 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 60982.9us
W20260709 13:21:05.219115 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 47346.2us
I20260709 13:21:05.227101 19581 raft_consensus.cc:2955] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Committing config change with OpId 26.17: config changed from index 16 to 17, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:05.267099 19406 catalog_manager.cc:5697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: config changed from index 12 to 13, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:21:05.284497 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 111144us
I20260709 13:21:05.321429 20666 raft_consensus.cc:2955] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Committing config change with OpId 24.13: config changed from index 12 to 13, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:05.353438 27457 ts_tablet_manager.cc:1929] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 27.17
I20260709 13:21:05.463342 27457 log.cc:1199] T daee81c3dc8c4dc4b735d1643829fe76 P d56df3728fc04e37b2d29a3bcd91d167: Deleting WAL directory at /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-0-root/wals/daee81c3dc8c4dc4b735d1643829fe76
W20260709 13:21:05.547133 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 104318us
I20260709 13:21:05.599186 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:21:05.651963 27488 log.cc:927] Time spent T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 13:21:05.670226 27489 log.cc:927] Time spent T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:21:05.673640 27457 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50816 (request call id 78) took 1506 ms. Trace:
I20260709 13:21:05.674340 27457 rpcz_store.cc:276] 0709 13:21:04.167553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.174925 (+  7372us) service_pool.cc:224] Handling call
0709 13:21:04.343554 (+168629us) ts_tablet_manager.cc:1151] Deleting tablet daee81c3dc8c4dc4b735d1643829fe76
0709 13:21:04.343648 (+    94us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:21:05.236212 (+892564us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:05.353261 (+117049us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:05.673475 (+320214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":273643,"tablet-delete.queue_time_us":158646,"thread_start_us":100236,"threads_started":1}
I20260709 13:21:05.703419 20663 raft_consensus.cc:2955] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Committing config change with OpId 26.17: config changed from index 16 to 17, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:21:05.708063 27493 log.cc:927] Time spent T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.215s	user 0.000s	sys 0.003s
W20260709 13:21:05.710907 27494 log.cc:927] Time spent T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 13:21:05.725419 27491 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:21:05.772161 19395 catalog_manager.cc:5028] TS d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): tablet daee81c3dc8c4dc4b735d1643829fe76 (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
W20260709 13:21:05.785310 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 46682us
W20260709 13:21:05.788259 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 52878.6us
W20260709 13:21:05.790030 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 70603us
W20260709 13:21:05.798763 27492 log.cc:927] Time spent T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 13:21:05.916383 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 81480us
I20260709 13:21:05.936882 19660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:21:05.940588 19660 raft_consensus.cc:606] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:21:05.939044 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 71125.2us
I20260709 13:21:05.952596 19587 raft_consensus.cc:2955] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Committing config change with OpId 24.13: config changed from index 12 to 13, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:05.982652 19587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
new_leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
 from {username='slave'} at 127.0.0.1:46086
I20260709 13:21:05.983474 19587 raft_consensus.cc:606] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Received request to transfer leadership to TS e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:06.020552 27431 raft_consensus.cc:993] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower d56df3728fc04e37b2d29a3bcd91d167 to start an election
W20260709 13:21:06.031291 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 243619us
I20260709 13:21:06.032158 27209 raft_consensus.cc:1081] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Signalling peer d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:06.034113 27259 raft_consensus.cc:993] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: : Instructing follower e19c80e9149b4b8d88ae13bde8e43864 to start an election
I20260709 13:21:06.037938 27259 raft_consensus.cc:1081] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Signalling peer e19c80e9149b4b8d88ae13bde8e43864 to start an election
I20260709 13:21:06.064046 19658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
 from {username='slave'} at 127.0.0.1:56824
I20260709 13:21:06.067353 19658 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:06.067826 19658 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:06.078579 19658 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:06.081070 19410 catalog_manager.cc:5697] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: config changed from index 16 to 17, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New cstate: current_term: 26 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } attrs { replace: true } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:06.084932 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: true dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:06.085664 19587 raft_consensus.cc:3055] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:21:06.086030 19587 raft_consensus.cc:740] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:21:06.086856 19587 consensus_queue.cc:260] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:06.088374 19587 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:06.097992 19660 consensus_queue.cc:237] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 10, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:06.108924 20663 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 13:21:06.114404 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 51637.8us
I20260709 13:21:06.122552 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:21:06.123286 19510 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:06.124985 19658 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:21:06.127027 19587 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 25.
I20260709 13:21:06.140589 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: true dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
W20260709 13:21:06.137790 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 105467us
I20260709 13:21:06.141242 20663 raft_consensus.cc:3060] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:06.136178 19506 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:21:06.144227 19511 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:50822
I20260709 13:21:06.155807 19511 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:06.156133 19511 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:06.170027 19397 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b28ba556d85a4d61bf15492b88b280d9 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER failed with leader 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2cfd02601ea44976833027665abc93bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 25 committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:06.143929 19506 raft_consensus.cc:606] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:21:06.189935 20663 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 25.
I20260709 13:21:06.192217 19510 raft_consensus.cc:2468] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 25.
I20260709 13:21:06.139942 27421 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 13:21:06.204386 19625 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:21:06.218686 19511 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:06.220979 19511 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Requested vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:21:06.223318 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:06.224081 19658 raft_consensus.cc:3055] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:06.224437 19658 raft_consensus.cc:740] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:06.230448 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:21:06.232077 20663 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:06.232824 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:21:06.246842 27387 raft_consensus.cc:2804] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:21:06.247524 27387 raft_consensus.cc:697] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:06.248659 27387 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:06.241215 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:06.238723 19658 consensus_queue.cc:260] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:06.280510 19658 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:06.285094 27474 raft_consensus.cc:993] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:21:06.285768 27474 raft_consensus.cc:1081] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:21:06.288905 19506 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:06.303612 20665 raft_consensus.cc:2955] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Committing config change with OpId 24.14: config changed from index 13 to 14, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:06.301290 27476 raft_consensus.cc:2955] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Committing config change with OpId 24.14: config changed from index 13 to 14, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:06.319979 19587 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60808
I20260709 13:21:06.320618 19587 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:06.320999 19587 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:06.259081 20663 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:21:06.324654 19511 raft_consensus.cc:1275] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:21:06.325824 20666 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:21:06.328166 27436 consensus_queue.cc:1048] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:21:06.362680 27423 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:21:06.366710 19478 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:21:06.367712 27371 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:06.368517 27371 raft_consensus.cc:697] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:21:06.369475 27371 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:06.372632 19587 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:06.357053 19408 catalog_manager.cc:5697] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 13 to 14, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New cstate: current_term: 24 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:06.377388 19505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:21:06.378031 19505 raft_consensus.cc:3055] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:21:06.379313 19505 raft_consensus.cc:740] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:21:06.381049 19658 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 19.
I20260709 13:21:06.385524 19584 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:21:06.398663 19505 consensus_queue.cc:260] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:06.401117 19505 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:06.400868 19395 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6c89dfa6a61346148bb8520ed4d0ecd9 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:21:06.404526 19587 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:06.428786 27502 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.024s
I20260709 13:21:06.445873 27499 raft_consensus.cc:2955] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Committing config change with OpId 26.18: config changed from index 17 to 18, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:21:06.467576 19475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:06.494356 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:06.495096 19658 raft_consensus.cc:3060] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:06.548851 19658 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:21:06.497466 19511 raft_consensus.cc:2955] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Committing config change with OpId 24.14: config changed from index 13 to 14, VOTER 2cfd02601ea44976833027665abc93bf (127.17.251.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:06.574640 19402 catalog_manager.cc:5697] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 24 to 25, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 25 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:06.584147 19551 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:21:06.585023 27419 raft_consensus.cc:2804] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:06.585567 27419 raft_consensus.cc:697] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:21:06.586512 27419 consensus_queue.cc:237] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:06.596374 19395 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8c3672e496ae4c7ab924bee7e50ecf70 with cas_config_opid_index 17: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:21:06.636312 19573 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c89dfa6a61346148bb8520ed4d0ecd9 with delete_type TABLET_DATA_TOMBSTONED (TS 2cfd02601ea44976833027665abc93bf not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:45038
I20260709 13:21:06.652406 19505 raft_consensus.cc:2468] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:21:06.648408 19410 catalog_manager.cc:5697] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 18 to 19, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 19 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:06.717222 20663 raft_consensus.cc:2955] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Committing config change with OpId 26.18: config changed from index 17 to 18, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:06.729900 19578 raft_consensus.cc:2955] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Committing config change with OpId 26.18: config changed from index 17 to 18, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:06.778708 27519 tablet_replica.cc:333] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:06.795742 19579 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:21:06.803692 19510 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:21:06.819594 27408 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:06.782308 27519 raft_consensus.cc:2243] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.848479 27408 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:21:06.850170 27519 raft_consensus.cc:2272] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:06.860204 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 116328us
I20260709 13:21:06.863096 19402 catalog_manager.cc:5697] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 17 to 18, VOTER e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) evicted. New cstate: current_term: 26 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:21:06.869858 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 114919us
I20260709 13:21:06.867543 19408 catalog_manager.cc:5697] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 22 to 23, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 23 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:06.890604 20665 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:21:06.913108 19646 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c3672e496ae4c7ab924bee7e50ecf70 with delete_type TABLET_DATA_TOMBSTONED (TS e19c80e9149b4b8d88ae13bde8e43864 not found in new config with opid_index 18) from {username='slave'} at 127.0.0.1:52294
I20260709 13:21:06.927534 27519 ts_tablet_manager.cc:1916] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:21:06.931658 19658 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:21:06.937726 27474 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:06.976691 27430 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:06.998576 19507 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:21:07.001245 27524 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:07.003410 20665 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:21:07.037098 19654 raft_consensus.cc:1275] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:21:07.042900 27524 consensus_queue.cc:1048] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:07.045425 27460 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:21:07.107841 27526 tablet_replica.cc:333] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:07.109246 27526 raft_consensus.cc:2243] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:07.124758 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 79153.2us
I20260709 13:21:07.202524 27519 ts_tablet_manager.cc:1929] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 24.13
I20260709 13:21:07.203150 27519 log.cc:1199] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 2cfd02601ea44976833027665abc93bf: Deleting WAL directory at /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-1-root/wals/6c89dfa6a61346148bb8520ed4d0ecd9
I20260709 13:21:07.209851 19397 catalog_manager.cc:5028] TS 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): tablet 6c89dfa6a61346148bb8520ed4d0ecd9 (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
I20260709 13:21:07.215806 27526 raft_consensus.cc:2272] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:07.260422 27525 log.cc:927] Time spent T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.133s	user 0.000s	sys 0.006s
W20260709 13:21:07.261025 27532 log.cc:927] Time spent T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065: Append to log took a long time: real 0.080s	user 0.001s	sys 0.001s
I20260709 13:21:07.286686 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:07.277218 27526 ts_tablet_manager.cc:1916] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:21:07.398175 27533 log.cc:927] Time spent T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:21:07.450338 19658 consensus_queue.cc:237] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:07.503412 20665 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:21:07.506177 19586 raft_consensus.cc:1275] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:21:07.512523 27307 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:07.520624 27434 consensus_queue.cc:1048] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:07.547395 27430 raft_consensus.cc:2955] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Committing config change with OpId 25.16: config changed from index 14 to 16, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:07.571852 19395 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b28ba556d85a4d61bf15492b88b280d9 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
I20260709 13:21:07.585028 19405 catalog_manager.cc:5697] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: config changed from index 14 to 16, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New cstate: current_term: 25 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:07.591131 19586 raft_consensus.cc:2955] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 14 to 16, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:07.596487 27526 ts_tablet_manager.cc:1929] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 26.17
I20260709 13:21:07.602113 20665 raft_consensus.cc:2955] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 14 to 16, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:07.602980 27526 log.cc:1199] T 8c3672e496ae4c7ab924bee7e50ecf70 P e19c80e9149b4b8d88ae13bde8e43864: Deleting WAL directory at /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-2-root/wals/8c3672e496ae4c7ab924bee7e50ecf70
I20260709 13:21:07.610816 19395 catalog_manager.cc:5028] TS e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): tablet 8c3672e496ae4c7ab924bee7e50ecf70 (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
I20260709 13:21:07.686941 19498 tablet_service.cc:1558] Processing DeleteTablet for tablet b28ba556d85a4d61bf15492b88b280d9 with delete_type TABLET_DATA_TOMBSTONED (TS d56df3728fc04e37b2d29a3bcd91d167 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:50816
I20260709 13:21:07.723867 27543 tablet_replica.cc:333] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:07.725165 27543 raft_consensus.cc:2243] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:07.726186 27543 raft_consensus.cc:2272] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:07.736168 27543 ts_tablet_manager.cc:1916] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:21:07.789441 27543 ts_tablet_manager.cc:1929] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 25.15
I20260709 13:21:07.809967 27543 log.cc:1199] T b28ba556d85a4d61bf15492b88b280d9 P d56df3728fc04e37b2d29a3bcd91d167: Deleting WAL directory at /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0/minicluster-data/ts-0-root/wals/b28ba556d85a4d61bf15492b88b280d9
I20260709 13:21:07.811858 19395 catalog_manager.cc:5028] TS d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): tablet b28ba556d85a4d61bf15492b88b280d9 (table test-workload [id=aed62f436c1a475c9621b6aef3f2a036]) successfully deleted
W20260709 13:21:08.062249 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 82608.7us
W20260709 13:21:08.145839 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 71683.3us
W20260709 13:21:08.153931 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 89235us
I20260709 13:21:08.468957 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:08.721647 19511 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
mode: GRACEFUL
new_leader_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:54532
I20260709 13:21:08.722319 19511 raft_consensus.cc:606] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Received request to transfer leadership to TS 2cfd02601ea44976833027665abc93bf
I20260709 13:21:08.786355 19579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "904d960364024273a420111ec6233e84"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
mode: GRACEFUL
new_leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
 from {username='slave'} at 127.0.0.1:46086
I20260709 13:21:08.786959 19579 raft_consensus.cc:606] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Received request to transfer leadership to TS e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:08.793098 19654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
mode: GRACEFUL
new_leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:48052
I20260709 13:21:08.793758 19654 raft_consensus.cc:606] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Received request to transfer leadership to TS d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:08.802670 27419 raft_consensus.cc:993] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf: : Instructing follower e19c80e9149b4b8d88ae13bde8e43864 to start an election
I20260709 13:21:08.803254 27419 raft_consensus.cc:1081] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Signalling peer e19c80e9149b4b8d88ae13bde8e43864 to start an election
I20260709 13:21:08.807497 19660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "904d960364024273a420111ec6233e84"
dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
 from {username='slave'} at 127.0.0.1:56824
I20260709 13:21:08.808159 19660 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:08.808566 19660 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:08.810779 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:21:08.812779 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:08.832365 19660 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:08.840153 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:21:08.840766 19507 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:08.841516 19660 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:08.841962 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:08.842473 19579 raft_consensus.cc:3055] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:08.842728 19579 raft_consensus.cc:740] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:21:08.843770 19579 consensus_queue.cc:260] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:08.845110 19579 raft_consensus.cc:3060] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:08.848268 19507 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
W20260709 13:21:08.849192 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 49695.2us
I20260709 13:21:08.849648 19625 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:21:08.850802 27430 raft_consensus.cc:2804] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:08.851307 27430 raft_consensus.cc:697] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:08.852200 27430 consensus_queue.cc:237] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:08.855574 19579 raft_consensus.cc:2468] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 17.
I20260709 13:21:08.893610 19402 catalog_manager.cc:5697] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 16 to 17, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 17 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:08.942049 19584 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
W20260709 13:21:08.988983 19553 consensus_peers.cc:597] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf -> Peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615): Couldn't send request to peer 068c03c9dcc848e6bf909131b1f83065. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7dd800f2a6b149a5b3ab177899d5f6bf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:08.996141 19660 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:21:08.997757 27521 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:21:09.006367 19511 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:21:09.008176 27521 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:21:09.022859 27432 raft_consensus.cc:2955] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 26 LEADER]: Committing config change with OpId 26.17: config changed from index -1 to 17, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:21:09.050937 19507 raft_consensus.cc:2955] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Committing config change with OpId 26.17: config changed from index -1 to 17, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:21:09.067147 19660 raft_consensus.cc:2955] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Committing config change with OpId 26.17: config changed from index -1 to 17, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
W20260709 13:21:09.074029 19458 auto_rebalancer.cc:629] Failed to schedule move for tablet 38e3a22b2b34405ebc267cd44391da92: Remote error: Service unavailable: leader transfer in progress
I20260709 13:21:09.089560 19402 catalog_manager.cc:5697] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf reported cstate change: config changed from index -1 to 17, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New cstate: current_term: 26 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:09.156248 27470 raft_consensus.cc:993] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167: : Instructing follower 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:21:09.226450 27470 raft_consensus.cc:1081] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Signalling peer 2cfd02601ea44976833027665abc93bf to start an election
I20260709 13:21:09.161211 27430 raft_consensus.cc:993] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864: : Instructing follower d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:09.228089 27430 raft_consensus.cc:1081] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Signalling peer d56df3728fc04e37b2d29a3bcd91d167 to start an election
I20260709 13:21:09.230510 19511 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6"
dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
 from {username='slave'} at 127.0.0.1:50822
I20260709 13:21:09.231208 19511 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:09.231652 19511 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:09.232630 19654 consensus_queue.cc:237] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:21:09.240204 19578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92"
dest_uuid: "2cfd02601ea44976833027665abc93bf"
 from {username='slave'} at 127.0.0.1:60808
I20260709 13:21:09.240842 19578 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:09.241214 19578 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:09.258985 19578 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:09.265690 19511 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:09.281967 19511 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:09.282109 19507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "d56df3728fc04e37b2d29a3bcd91d167"
I20260709 13:21:09.282843 19507 raft_consensus.cc:3055] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:21:09.283281 19507 raft_consensus.cc:740] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:21:09.284484 19507 consensus_queue.cc:260] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:09.285955 19507 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:09.270284 19578 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:09.288570 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:09.311537 19658 raft_consensus.cc:3060] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:09.272130 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 94952.7us
I20260709 13:21:09.296352 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: true dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:09.298118 19585 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:21:09.322073 19584 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:09.336300 19584 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 25.
I20260709 13:21:09.341243 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: true dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:09.342012 19660 raft_consensus.cc:3055] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:21:09.342322 19660 raft_consensus.cc:740] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:09.343186 19660 consensus_queue.cc:260] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:09.344524 19660 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:21:09.361720 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 51423.4us
I20260709 13:21:09.368808 19658 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:21:09.395080 19478 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167; no voters: 
I20260709 13:21:09.397449 27430 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:09.409799 27544 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:21:09.410471 27544 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 LEADER]: Becoming Leader. State: Replica: d56df3728fc04e37b2d29a3bcd91d167, State: Running, Role: LEADER
I20260709 13:21:09.411415 27544 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:09.421461 19511 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:21:09.423189 27545 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:21:09.436290 19627 consensus_peers.cc:597] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615): Couldn't send request to peer 068c03c9dcc848e6bf909131b1f83065. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a2800ca4ded4227b5bb5e48f0572eaa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:09.400429 19660 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56df3728fc04e37b2d29a3bcd91d167 in term 25.
I20260709 13:21:09.437309 19507 raft_consensus.cc:2468] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
I20260709 13:21:09.449806 19578 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:21:09.480345 19507 raft_consensus.cc:1275] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:21:09.467675 27437 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 13:21:09.485594 27437 consensus_queue.cc:1048] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:21:09.510776 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 71686.1us
I20260709 13:21:09.511646 19551 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:21:09.509793 19402 catalog_manager.cc:5697] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: term changed from 24 to 25, leader changed from e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131) to d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129). New cstate: current_term: 25 leader_uuid: "d56df3728fc04e37b2d29a3bcd91d167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:09.516954 27562 raft_consensus.cc:2804] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:09.528825 27557 raft_consensus.cc:2955] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
W20260709 13:21:09.637359 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 108525us
I20260709 13:21:09.639426 27562 raft_consensus.cc:697] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:21:09.662325 27562 consensus_queue.cc:237] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:09.670580 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 56475.5us
I20260709 13:21:09.723224 19510 raft_consensus.cc:2955] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
W20260709 13:21:09.748382 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 172678us
I20260709 13:21:09.786814 27584 ts_tablet_manager.cc:933] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:09.879308 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 139780us
W20260709 13:21:09.996066 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 200891us
W20260709 13:21:09.997313 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 113639us
I20260709 13:21:09.999207 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:21:09.999359 27561 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
W20260709 13:21:10.054687 27570 log.cc:927] Time spent T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:21:10.129802 27584 tablet_copy_client.cc:323] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Beginning tablet copy session from remote peer at address 127.17.251.130:36471
I20260709 13:21:10.136325 19597 tablet_copy_service.cc:140] P 2cfd02601ea44976833027665abc93bf: Received BeginTabletCopySession request for tablet 7dd800f2a6b149a5b3ab177899d5f6bf from peer 068c03c9dcc848e6bf909131b1f83065 ({username='slave'} at 127.0.0.1:35102)
I20260709 13:21:10.136962 19597 tablet_copy_service.cc:161] P 2cfd02601ea44976833027665abc93bf: Beginning new tablet copy session on tablet 7dd800f2a6b149a5b3ab177899d5f6bf from peer 068c03c9dcc848e6bf909131b1f83065 at {username='slave'} at 127.0.0.1:35102: session id = 068c03c9dcc848e6bf909131b1f83065-7dd800f2a6b149a5b3ab177899d5f6bf
W20260709 13:21:10.175349 27574 log.cc:927] Time spent T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.249s	user 0.004s	sys 0.001s
W20260709 13:21:10.207314 27591 log.cc:927] Time spent T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.081s	user 0.001s	sys 0.001s
I20260709 13:21:10.217682 19584 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:21:10.224712 19408 catalog_manager.cc:5697] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 reported cstate change: config changed from index -1 to 15, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New cstate: current_term: 22 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:21:10.193810 19405 catalog_manager.cc:5697] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 23 to 24, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 24 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:10.235455 19597 tablet_copy_source_session.cc:215] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:21:10.241863 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 77572.7us
W20260709 13:21:10.307389 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 90602.1us
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 3
W20260709 13:21:10.323321 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 59639.7us
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:21:10.327852 27558 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
W20260709 13:21:10.390950 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 50206.7us
W20260709 13:21:10.402856 27557 consensus_meta.cc:287] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: Time spent flushing consensus metadata: real 0.661s	user 0.011s	sys 0.000s
I20260709 13:21:10.405722 18414 tablet_server.cc:179] TabletServer@127.17.251.129:0 shutting down...
W20260709 13:21:10.414767 19625 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:10.442756 19584 raft_consensus.cc:2955] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } } }
I20260709 13:21:10.476775 27594 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:10.508245 19660 raft_consensus.cc:1275] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:21:10.518966 27584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd800f2a6b149a5b3ab177899d5f6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:10.525542 27594 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:10.529227 27594 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:10.534137 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:21:10.523309 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 215538us
W20260709 13:21:10.562008 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 81203.8us
W20260709 13:21:10.569818 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 155078us
I20260709 13:21:10.552196 27557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:39174 (request call id 10) took 1312 ms. Trace:
W20260709 13:21:10.595382 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 70450.8us
I20260709 13:21:10.578282 27557 rpcz_store.cc:276] 0709 13:21:09.225279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:09.230413 (+  5134us) service_pool.cc:224] Handling call
0709 13:21:09.292223 (+ 61810us) log.cc:844] Serialized 513 byte log entry
0709 13:21:10.537933 (+1245710us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1369,"raft.run_cpu_time_us":1903,"raft.run_wall_time_us":2412,"thread_start_us":124532,"threads_started":1,"wal-append.queue_time_us":90717,"wal-append.run_cpu_time_us":1759,"wal-append.run_wall_time_us":1001791}
W20260709 13:21:10.602181 27619 log.cc:927] Time spent T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: Append to log took a long time: real 0.056s	user 0.002s	sys 0.000s
W20260709 13:21:10.617709 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 63032.7us
I20260709 13:21:10.618244 27607 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:10.618952 27607 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:10.624953 19653 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Refusing update from remote peer d56df3728fc04e37b2d29a3bcd91d167: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
W20260709 13:21:10.622198 19625 consensus_peers.cc:597] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:10.628822 19625 consensus_peers.cc:597] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:10.632398 19625 consensus_peers.cc:597] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:10.649380 27616 consensus_queue.cc:1048] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:10.651712 27607 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:10.657871 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:21:10.646817 19625 consensus_peers.cc:597] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:10.658987 19625 consensus_peers.cc:597] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:10.659578 19625 consensus_peers.cc:597] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:10.671322 19625 consensus_peers.cc:597] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:10.636119 27548 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
W20260709 13:21:10.681551 19625 consensus_peers.cc:597] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:10.684659 19625 consensus_peers.cc:597] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:10.685494 19625 leader_election.cc:336] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:10.687146 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28ba556d85a4d61bf15492b88b280d9" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:10.686663 19625 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:21:10.698328 19625 consensus_peers.cc:597] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:10.703083 20619 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:10.732167 27615 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:21:10.734573 19458 auto_rebalancer.cc:629] Failed to schedule move for tablet ed30843c798c4e38898b991bd1ecf1f6: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:10.743216 19625 consensus_peers.cc:597] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:10.729431 27547 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:21:10.746532 19551 consensus_peers.cc:597] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:10.752987 19625 consensus_peers.cc:597] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:10.774546 19625 consensus_peers.cc:597] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:10.778301 19551 consensus_peers.cc:597] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:10.757104 27605 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:10.795828 27605 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:10.798219 27605 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:10.799293 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:21:10.785531 20619 consensus_peers.cc:597] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:10.801488 20619 consensus_peers.cc:597] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:10.802800 19625 consensus_peers.cc:597] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:10.802878 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9807bdebbbd742009e4a329706a92790" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:21:10.803597 19625 consensus_peers.cc:597] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:10.804107 20619 consensus_peers.cc:597] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:10.804739 20619 consensus_peers.cc:597] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:10.812145 19476 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:10.841694 27580 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:10.869370 27584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59444 (request call id 320) took 1209 ms. Trace:
I20260709 13:21:10.878096 27584 rpcz_store.cc:276] 0709 13:21:09.668503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:09.685212 (+ 16709us) service_pool.cc:224] Handling call
0709 13:21:09.787461 (+102249us) ts_tablet_manager.cc:934] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
0709 13:21:10.484055 (+696594us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:21:10.622019 (+137964us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:10.629895 (+  7876us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:21:10.785715 (+155820us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:21:10.857291 (+ 71576us) tablet_replica.cc:206] Creating consensus instance
0709 13:21:10.869189 (+ 11898us) ts_tablet_manager.cc:989] Replica registered.
0709 13:21:10.869252 (+    63us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":19069,"spinlock_wait_cycles":37120,"tablet-copy.queue_time_us":94671,"thread_start_us":109880,"threads_started":2}
I20260709 13:21:10.879818 27584 tablet_copy_client.cc:806] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:10.880412 27584 tablet_copy_client.cc:670] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:10.856921 27605 raft_consensus.cc:493] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:21:10.882804 27605 raft_consensus.cc:515] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:10.885082 27605 leader_election.cc:290] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:21:10.885429 27583 raft_consensus.cc:493] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:10.886153 27583 raft_consensus.cc:515] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:10.888375 27583 leader_election.cc:290] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:10.890326 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:10.853498 27628 ts_tablet_manager.cc:933] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065: Initiating tablet copy from peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:10.908847 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 30 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:21:10.912727 19625 consensus_peers.cc:597] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:10.915300 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911988cab3914bb19f77d4d3e24a31f4" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 30 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:10.919448 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5456af6e274a4116a91b4bc0e326ca5f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:10.927134 27548 raft_consensus.cc:493] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:10.931861 27583 raft_consensus.cc:493] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:10.943773 19478 leader_election.cc:304] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:10.941781 27584 tablet_copy_client.cc:538] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:10.956791 19478 leader_election.cc:304] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:21:10.961905 27621 raft_consensus.cc:2749] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:10.964511 27608 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:10.965337 27608 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:10.968168 27608 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:10.970674 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:10.953800 27583 raft_consensus.cc:515] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:10.956377 27548 raft_consensus.cc:515] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:10.982651 27605 raft_consensus.cc:2749] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:21:10.996178 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df137c733a0a470c9e35fa2b09c6c619" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:10.999246 27604 raft_consensus.cc:493] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:11.006709 27604 raft_consensus.cc:515] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.016722 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.009565 27604 leader_election.cc:290] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:21:11.027298 19551 consensus_peers.cc:597] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:11.031361 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4aaf446674d6ab6bbc9a3aae5af92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.029654 19478 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.024442 27580 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:21:11.036859 19551 consensus_peers.cc:597] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:11.054070 19551 consensus_peers.cc:597] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:11.069514 19551 consensus_peers.cc:597] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:11.053668 27544 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:11.075161 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.073194 27548 leader_election.cc:290] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:21:11.074349 19551 consensus_peers.cc:597] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:11.084656 19551 consensus_peers.cc:597] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:11.085419 19551 consensus_peers.cc:597] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:11.086236 19551 consensus_peers.cc:597] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:11.086959 19551 consensus_peers.cc:597] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:11.064427 27611 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:11.095712 27583 leader_election.cc:290] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.089208 27611 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:11.100318 27611 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:21:11.056651 27580 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.103196 27580 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:21:11.122972 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 45417.8us
W20260709 13:21:11.116914 19551 consensus_peers.cc:597] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:11.083175 27628 tablet_copy_client.cc:323] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Beginning tablet copy session from remote peer at address 127.17.251.131:33295
W20260709 13:21:11.129741 19551 consensus_peers.cc:597] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:11.147974 19671 tablet_copy_service.cc:140] P e19c80e9149b4b8d88ae13bde8e43864: Received BeginTabletCopySession request for tablet 4a2800ca4ded4227b5bb5e48f0572eaa from peer 068c03c9dcc848e6bf909131b1f83065 ({username='slave'} at 127.0.0.1:59942)
I20260709 13:21:11.148655 19671 tablet_copy_service.cc:161] P e19c80e9149b4b8d88ae13bde8e43864: Beginning new tablet copy session on tablet 4a2800ca4ded4227b5bb5e48f0572eaa from peer 068c03c9dcc848e6bf909131b1f83065 at {username='slave'} at 127.0.0.1:59942: session id = 068c03c9dcc848e6bf909131b1f83065-4a2800ca4ded4227b5bb5e48f0572eaa
I20260709 13:21:11.149168 27603 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:11.151959 27603 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.156410 27584 tablet_bootstrap.cc:492] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065: Bootstrap starting.
I20260709 13:21:11.157804 27603 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:21:11.190223 19551 consensus_peers.cc:597] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:11.197436 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.197217 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c656f1e9148d4056945c02ce537d8b12" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:21:11.198724 19551 consensus_peers.cc:597] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:11.200196 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386001789c264ef8b0ac13cf938a8390" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:21:11.201884 19551 consensus_peers.cc:597] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:11.204680 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.205963 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.208772 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.210558 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b601da83bfc46088ab1ec232133b605" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:21:11.212944 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167513761bee46908eb48f5cad0c0a7f" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.217564 19478 leader_election.cc:304] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.219856 27603 raft_consensus.cc:2749] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:11.224948 27470 raft_consensus.cc:493] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:11.232573 27470 raft_consensus.cc:515] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.235154 27470 leader_election.cc:290] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.238418 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d073a31754234c93b24b8ffbc9f8fb3b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.241638 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.251641 27611 raft_consensus.cc:493] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:11.252586 27470 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:11.252295 27611 raft_consensus.cc:515] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.260174 27470 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:21:11.261767 27611 leader_election.cc:290] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.262760 27470 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.267131 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd2e208ec7f47bb80deb85a455f2b16" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.268790 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.269088 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.257874 19671 tablet_copy_source_session.cc:215] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:11.275890 27635 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.280589 19476 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.333874 27611 raft_consensus.cc:493] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:21:11.334542 27611 raft_consensus.cc:515] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:11.336328 27628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a2800ca4ded4227b5bb5e48f0572eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:11.336668 27611 leader_election.cc:290] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:21:11.338260 27583 raft_consensus.cc:493] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:21:11.278053 27635 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.338804 27583 raft_consensus.cc:515] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:11.339357 27544 raft_consensus.cc:493] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 068c03c9dcc848e6bf909131b1f83065)
I20260709 13:21:11.340065 27544 raft_consensus.cc:515] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:11.349445 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:21:11.345306 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 64798.7us
I20260709 13:21:11.350813 19476 leader_election.cc:304] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.340626 27583 leader_election.cc:290] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:21:11.355836 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:21:11.340610 27635 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.349172 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.342257 27544 leader_election.cc:290] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:21:11.345474 27470 raft_consensus.cc:2749] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:11.365535 19476 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.367640 19476 leader_election.cc:304] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.373654 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40c25a076fd424281aab1a64f5a1498" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:21:11.381002 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:21:11.373147 27583 raft_consensus.cc:2749] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:11.368758 27635 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:11.387849 27605 raft_consensus.cc:2749] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:11.388119 19478 leader_election.cc:304] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:21:11.400416 27605 raft_consensus.cc:2749] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:11.423381 19476 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.424353 27605 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:21:11.441402 19476 leader_election.cc:304] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.454325 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a944fb0aa87a4a33a0dc2975f4a306dd" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.456769 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.458149 27583 raft_consensus.cc:2749] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:11.465583 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8709264e614e01ad899bfabc6c04f7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.469913 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05498e224814b9b8f31e3f965ab2583" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.506511 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2800ca4ded4227b5bb5e48f0572eaa" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:21:11.507654 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 49648.3us
W20260709 13:21:11.523500 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 72471.4us
I20260709 13:21:11.526762 19476 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.531883 19476 leader_election.cc:304] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.542223 27608 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:11.550184 27470 raft_consensus.cc:2749] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:11.551968 19476 leader_election.cc:304] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.580196 27635 raft_consensus.cc:2749] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:11.581549 19476 leader_election.cc:304] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.586082 27635 raft_consensus.cc:2749] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:11.587414 27628 tablet_copy_client.cc:806] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:11.610844 27635 raft_consensus.cc:493] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:11.630328 19476 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.657773 27603 raft_consensus.cc:493] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:11.659232 27608 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:11.633069 27635 raft_consensus.cc:515] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.632647 27580 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:11.633908 27628 tablet_copy_client.cc:670] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:11.666929 27558 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:11.667824 27621 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:11.664489 27603 raft_consensus.cc:515] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.676291 27605 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:11.683032 27605 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.685284 27605 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.675753 27583 raft_consensus.cc:493] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:11.665831 27608 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:11.678820 27558 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.716420 27558 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.717720 27635 leader_election.cc:290] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.720494 27603 leader_election.cc:290] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.688581 27621 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.704578 27583 raft_consensus.cc:515] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.716686 27608 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:21:11.734200 19478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 60906.8us
I20260709 13:21:11.735893 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.738334 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:11.732007 27628 tablet_copy_client.cc:538] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:11.741093 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.743011 18414 tablet_replica.cc:333] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:11.744890 18414 raft_consensus.cc:2243] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:11.745219 27583 leader_election.cc:290] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.745428 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:21:11.747157 27583 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:11.747177 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5f26f686634d4ab47c02b7a00ba584" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.748553 27605 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:11.745637 18414 raft_consensus.cc:2272] T 4a2800ca4ded4227b5bb5e48f0572eaa P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:11.749140 27605 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.752854 27605 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.747697 27583 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.755353 27621 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.755399 27583 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.758024 18414 tablet_replica.cc:333] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:11.759085 18414 raft_consensus.cc:2243] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:11.760452 18414 raft_consensus.cc:2272] T e2c677be72b048b0a9bc9b5c175d6738 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:11.764321 18414 tablet_replica.cc:333] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:11.765498 18414 raft_consensus.cc:2243] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:21:11.770744 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.773156 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.788432 18414 raft_consensus.cc:2272] T ea04cb0adf2c4607846aba51fc4960f1 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:11.791858 18414 tablet_replica.cc:333] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:11.793962 18414 raft_consensus.cc:2243] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:11.794612 18414 raft_consensus.cc:2272] T 1a8709264e614e01ad899bfabc6c04f7 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:11.797593 18414 tablet_replica.cc:333] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:11.798835 18414 raft_consensus.cc:2243] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:11.799923 18414 raft_consensus.cc:2272] T 167513761bee46908eb48f5cad0c0a7f P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:11.802909 18414 tablet_replica.cc:333] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:11.806929 18414 raft_consensus.cc:2243] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:11.808202 18414 raft_consensus.cc:2272] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:11.815110 18414 tablet_replica.cc:333] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:11.816215 18414 raft_consensus.cc:2243] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:11.817114 18414 raft_consensus.cc:2272] T 6c89dfa6a61346148bb8520ed4d0ecd9 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:11.822330 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:21:11.824445 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 144879us
I20260709 13:21:11.824888 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.826396 19478 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:21:11.828188 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6b515c02d4d26bc1bc2a7b2a9a794" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.830129 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.831323 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef314c9487594fb2a581796b86eb958e" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.832378 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbfe9942c714d1295ec8011ab27a574" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.833221 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904d960364024273a420111ec6233e84" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.834074 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4589d6497c49308384eacc43241a32" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.835088 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313f9daf7de442378ef2abf1f4a4e665" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.835963 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.837719 27583 raft_consensus.cc:493] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:11.838308 27583 raft_consensus.cc:515] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.840427 27583 leader_election.cc:290] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.836112 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.836056 27605 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:11.845010 18414 tablet_replica.cc:333] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:11.846068 18414 raft_consensus.cc:2243] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:21:11.852725 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a54cd81e4a54059a10f1f9e291c49d0" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.862139 27605 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:11.862344 27641 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:11.862813 27605 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.863091 27641 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.865006 27605 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.866009 27611 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:11.866532 27611 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.868553 27611 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.870198 27611 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:11.870689 27611 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.873786 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.876427 27628 tablet_bootstrap.cc:492] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065: Bootstrap starting.
I20260709 13:21:11.883646 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.883924 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:11.884505 19476 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.889889 27611 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.865029 27641 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.893988 18414 raft_consensus.cc:2272] T 6f949ff511e844749624dedf436dff50 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:11.897186 18414 tablet_replica.cc:333] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:11.905959 27641 raft_consensus.cc:493] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:11.906608 27641 raft_consensus.cc:515] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:11.908871 27641 leader_election.cc:290] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.910012 27605 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:11.910815 27605 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:21:11.913280 27605 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:11.915045 18414 raft_consensus.cc:2243] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:11.916731 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff318d429f74439a25e68f54950fb36" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.918648 27605 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:11.919294 19476 leader_election.cc:304] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.920061 27611 raft_consensus.cc:2749] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:11.927186 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb2be7d455242c08b014289ea6b1347" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.927824 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.928418 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f516f797b78848a5825878b37c422f07" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.931878 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.916960 18414 raft_consensus.cc:2272] T 5456af6e274a4116a91b4bc0e326ca5f P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:11.932174 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.943377 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:11.946786 19478 leader_election.cc:304] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.948688 27640 raft_consensus.cc:2749] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:11.951691 19478 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.953202 18414 tablet_replica.cc:333] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:11.954003 19476 leader_election.cc:304] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.961867 18414 raft_consensus.cc:2243] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:11.966805 19476 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.967044 27611 raft_consensus.cc:2749] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:11.980160 19476 raft_consensus.cc:2686] T ef314c9487594fb2a581796b86eb958e P d56df3728fc04e37b2d29a3bcd91d167: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:21:11.981231 19476 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.982796 18414 raft_consensus.cc:2272] T df137c733a0a470c9e35fa2b09c6c619 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:11.968791 27640 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:11.984437 19476 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.989887 19476 leader_election.cc:304] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:11.989588 27470 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:21:11.994401 18414 tablet_replica.cc:333] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:11.995368 18414 raft_consensus.cc:2243] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:11.999161 27583 raft_consensus.cc:493] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:11.999727 27583 raft_consensus.cc:515] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:12.002439 18414 raft_consensus.cc:2272] T 2b601da83bfc46088ab1ec232133b605 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.002477 27583 leader_election.cc:290] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:12.005864 18414 tablet_replica.cc:333] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.006516 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:12.008148 18414 raft_consensus.cc:2243] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 32 LEADER]: Raft consensus shutting down.
I20260709 13:21:11.984148 27611 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:12.014525 27608 raft_consensus.cc:2749] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:12.012023 18414 raft_consensus.cc:2272] T b91cdbdc59c54db98e6692ac65df1b3b P d56df3728fc04e37b2d29a3bcd91d167 [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.036352 19476 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:12.038219 19476 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:12.045773 27605 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:12.069476 27641 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:12.092427 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80abeb366b70484a8b8df5a0575643e7" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:12.092697 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f31f753f7c4508a56dd7bb7648615b" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:12.094058 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:12.094604 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47cfd5bbfb1407c879f892f35cc1502" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:12.095829 27605 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:12.096647 27605 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:12.101619 19476 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:12.102073 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c0e3535ed14c77bc069b999fbb18bc" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:12.137887 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:21:12.138269 19476 leader_election.cc:304] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:12.131635 18414 tablet_replica.cc:333] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.176177 18414 raft_consensus.cc:2243] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:12.105333 27605 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:21:12.102388 27584 tablet_bootstrap.cc:492] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=1 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:12.144757 27608 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:12.182720 18414 raft_consensus.cc:2272] T 6b53fc6e49df441b959a20ab5dd387dd P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.185597 18414 tablet_replica.cc:333] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.186632 18414 raft_consensus.cc:2243] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:21:12.187600 18414 raft_consensus.cc:2272] T b0ac31068f224487a102689bcb76cc21 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.190280 18414 tablet_replica.cc:333] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.191205 18414 raft_consensus.cc:2243] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:21:12.192142 18414 raft_consensus.cc:2272] T 8c3672e496ae4c7ab924bee7e50ecf70 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.194865 18414 tablet_replica.cc:333] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.195755 18414 raft_consensus.cc:2243] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.196475 18414 raft_consensus.cc:2272] T db4589d6497c49308384eacc43241a32 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.200829 18414 tablet_replica.cc:333] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.202116 18414 raft_consensus.cc:2243] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:12.203433 27584 tablet_bootstrap.cc:492] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065: Bootstrap complete.
I20260709 13:21:12.204353 18414 raft_consensus.cc:2272] T 3bb3362944f5459e982bd278a6a4c561 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.204423 27584 ts_tablet_manager.cc:1403] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065: Time spent bootstrapping tablet: real 1.048s	user 0.073s	sys 0.016s
I20260709 13:21:12.213670 27628 tablet_bootstrap.cc:492] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:12.209290 18414 tablet_replica.cc:333] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
W20260709 13:21:12.210044 19476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 71852.4us
I20260709 13:21:12.245950 18414 raft_consensus.cc:2243] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:12.246170 19476 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:12.210516 27608 raft_consensus.cc:2749] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:12.247169 18414 raft_consensus.cc:2272] T 6eb38e2ac9064d3286fe2f20aeb2381c P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.247716 19476 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:12.251039 27611 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:12.253063 18414 tablet_replica.cc:333] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.254148 18414 raft_consensus.cc:2243] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.256099 27605 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:12.263995 19476 leader_election.cc:304] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:12.265170 27628 tablet_bootstrap.cc:492] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065: Bootstrap complete.
I20260709 13:21:12.265398 27640 raft_consensus.cc:2749] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:12.268884 18414 raft_consensus.cc:2272] T 52f31f753f7c4508a56dd7bb7648615b P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.268007 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62f6690c8e840638906e0b59d2ae71d" candidate_uuid: "d56df3728fc04e37b2d29a3bcd91d167" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:12.283121 18414 tablet_replica.cc:333] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.279623 27628 ts_tablet_manager.cc:1403] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065: Time spent bootstrapping tablet: real 0.403s	user 0.117s	sys 0.065s
I20260709 13:21:12.284075 18414 raft_consensus.cc:2243] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:12.285225 18414 raft_consensus.cc:2272] T 2c83387a56274f46bd5795b3376741c9 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.287259 27628 raft_consensus.cc:359] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:21:12.288403 18414 tablet_replica.cc:333] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.307210 27628 raft_consensus.cc:740] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Initialized, Role: LEARNER
I20260709 13:21:12.307879 18414 raft_consensus.cc:2243] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.311741 18414 raft_consensus.cc:2272] T 7bbfe9942c714d1295ec8011ab27a574 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.311564 27628 consensus_queue.cc:260] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:21:12.318463 18414 tablet_replica.cc:333] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.319326 18414 raft_consensus.cc:2243] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.319953 18414 raft_consensus.cc:2272] T dff318d429f74439a25e68f54950fb36 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.320142 19476 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d56df3728fc04e37b2d29a3bcd91d167; no voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:12.321204 27640 raft_consensus.cc:2749] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:12.295171 27584 raft_consensus.cc:359] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [term 26 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:21:12.322078 27628 ts_tablet_manager.cc:1434] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 13:21:12.323726 18414 tablet_replica.cc:333] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.322243 27584 raft_consensus.cc:740] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [term 26 LEARNER]: Becoming Follower/Learner. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Initialized, Role: LEARNER
I20260709 13:21:12.334203 27584 consensus_queue.cc:260] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: NON_VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: true } }
I20260709 13:21:12.334880 19671 tablet_copy_service.cc:342] P e19c80e9149b4b8d88ae13bde8e43864: Request end of tablet copy session 068c03c9dcc848e6bf909131b1f83065-4a2800ca4ded4227b5bb5e48f0572eaa received from {username='slave'} at 127.0.0.1:59942
I20260709 13:21:12.335424 19671 tablet_copy_service.cc:434] P e19c80e9149b4b8d88ae13bde8e43864: ending tablet copy session 068c03c9dcc848e6bf909131b1f83065-4a2800ca4ded4227b5bb5e48f0572eaa on tablet 4a2800ca4ded4227b5bb5e48f0572eaa with peer 068c03c9dcc848e6bf909131b1f83065
I20260709 13:21:12.337163 27584 ts_tablet_manager.cc:1434] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065: Time spent starting tablet: real 0.099s	user 0.002s	sys 0.005s
I20260709 13:21:12.338662 18414 raft_consensus.cc:2243] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.339855 18414 raft_consensus.cc:2272] T f516f797b78848a5825878b37c422f07 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.340612 19597 tablet_copy_service.cc:342] P 2cfd02601ea44976833027665abc93bf: Request end of tablet copy session 068c03c9dcc848e6bf909131b1f83065-7dd800f2a6b149a5b3ab177899d5f6bf received from {username='slave'} at 127.0.0.1:35102
I20260709 13:21:12.341123 19597 tablet_copy_service.cc:434] P 2cfd02601ea44976833027665abc93bf: ending tablet copy session 068c03c9dcc848e6bf909131b1f83065-7dd800f2a6b149a5b3ab177899d5f6bf on tablet 7dd800f2a6b149a5b3ab177899d5f6bf with peer 068c03c9dcc848e6bf909131b1f83065
I20260709 13:21:12.342913 18414 tablet_replica.cc:333] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.344183 18414 raft_consensus.cc:2243] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.344821 18414 raft_consensus.cc:2272] T c47cfd5bbfb1407c879f892f35cc1502 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.348038 18414 tablet_replica.cc:333] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.349040 18414 raft_consensus.cc:2243] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.349712 18414 raft_consensus.cc:2272] T 9dd2e208ec7f47bb80deb85a455f2b16 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.352970 18414 tablet_replica.cc:333] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.354009 18414 raft_consensus.cc:2243] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:21:12.355370 18414 raft_consensus.cc:2272] T 0c4c20e4aab6496cb949c1fad0dbcc66 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.364701 18414 tablet_replica.cc:333] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.365780 18414 raft_consensus.cc:2243] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:21:12.367146 18414 raft_consensus.cc:2272] T 2c1d08b75392466298c02ea9d4d765dd P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.370201 18414 tablet_replica.cc:333] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.371126 18414 raft_consensus.cc:2243] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.371899 18414 raft_consensus.cc:2272] T 80abeb366b70484a8b8df5a0575643e7 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.375213 18414 tablet_replica.cc:333] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.376142 18414 raft_consensus.cc:2243] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:12.377324 18414 raft_consensus.cc:2272] T ed30843c798c4e38898b991bd1ecf1f6 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.406513 18414 tablet_replica.cc:333] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.415236 18414 raft_consensus.cc:2243] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.415880 18414 raft_consensus.cc:2272] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.418390 18414 tablet_replica.cc:333] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.419140 18414 raft_consensus.cc:2243] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.419754 18414 raft_consensus.cc:2272] T e6c8f93967114cebaf0e506a31814929 P d56df3728fc04e37b2d29a3bcd91d167 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.450404 18414 tablet_replica.cc:333] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.451201 18414 raft_consensus.cc:2243] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.451876 18414 raft_consensus.cc:2272] T 313f9daf7de442378ef2abf1f4a4e665 P d56df3728fc04e37b2d29a3bcd91d167 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.471067 18414 tablet_replica.cc:333] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.471987 18414 raft_consensus.cc:2243] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.472683 18414 raft_consensus.cc:2272] T a944fb0aa87a4a33a0dc2975f4a306dd P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.475767 18414 tablet_replica.cc:333] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.476672 18414 raft_consensus.cc:2243] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.477604 18414 raft_consensus.cc:2272] T 0e5f26f686634d4ab47c02b7a00ba584 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.509657 18414 tablet_replica.cc:333] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.510545 18414 raft_consensus.cc:2243] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.511219 18414 raft_consensus.cc:2272] T 1a54cd81e4a54059a10f1f9e291c49d0 P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.527526 18414 tablet_replica.cc:333] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.528373 18414 raft_consensus.cc:2243] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.529098 18414 raft_consensus.cc:2272] T d073a31754234c93b24b8ffbc9f8fb3b P d56df3728fc04e37b2d29a3bcd91d167 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.532390 18414 tablet_replica.cc:333] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.533558 18414 raft_consensus.cc:2243] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.544637 18414 raft_consensus.cc:2272] T 911988cab3914bb19f77d4d3e24a31f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.547538 18414 tablet_replica.cc:333] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
W20260709 13:21:12.551478 19625 consensus_peers.cc:597] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:12.548426 18414 raft_consensus.cc:2243] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:21:12.563395 18414 raft_consensus.cc:2272] T 9116dce1321e475194eeaa1705fd6ac0 P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.566562 18414 tablet_replica.cc:333] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.567510 18414 raft_consensus.cc:2243] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:12.568657 18414 raft_consensus.cc:2272] T 9c9a4266bc2b4d15ac7862c48149bb66 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.571417 18414 tablet_replica.cc:333] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.572263 18414 raft_consensus.cc:2243] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.572990 18414 raft_consensus.cc:2272] T 61d4aaf446674d6ab6bbc9a3aae5af92 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.593515 18414 tablet_replica.cc:333] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.594583 18414 raft_consensus.cc:2243] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.595403 18414 raft_consensus.cc:2272] T c62f6690c8e840638906e0b59d2ae71d P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.601792 18414 tablet_replica.cc:333] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.608141 18414 raft_consensus.cc:2243] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.608793 18414 raft_consensus.cc:2272] T 386001789c264ef8b0ac13cf938a8390 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:12.612979 19625 consensus_peers.cc:597] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:12.615134 20665 raft_consensus.cc:1217] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [term 26 LEARNER]: Deduplicated request from leader. Original: 26.16->[26.17-26.17]   Dedup: 26.17->[]
I20260709 13:21:12.625762 18414 tablet_replica.cc:333] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.626708 18414 raft_consensus.cc:2243] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.627430 18414 raft_consensus.cc:2272] T 7dd800f2a6b149a5b3ab177899d5f6bf P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.638283 18414 tablet_replica.cc:333] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.639073 18414 raft_consensus.cc:2243] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.639633 18414 raft_consensus.cc:2272] T deb2be7d455242c08b014289ea6b1347 P d56df3728fc04e37b2d29a3bcd91d167 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.642248 18414 tablet_replica.cc:333] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.642963 18414 raft_consensus.cc:2243] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:12.643989 18414 raft_consensus.cc:2272] T d9242425d3a744c3b8742c30995129f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.646642 18414 tablet_replica.cc:333] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.647421 18414 raft_consensus.cc:2243] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.664773 18414 raft_consensus.cc:2272] T 88c0e3535ed14c77bc069b999fbb18bc P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.668273 18414 tablet_replica.cc:333] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.669162 18414 raft_consensus.cc:2243] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.674247 18414 raft_consensus.cc:2272] T e40c25a076fd424281aab1a64f5a1498 P d56df3728fc04e37b2d29a3bcd91d167 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.677057 18414 tablet_replica.cc:333] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.677803 18414 raft_consensus.cc:2243] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.678287 18414 raft_consensus.cc:2272] T 38e3a22b2b34405ebc267cd44391da92 P d56df3728fc04e37b2d29a3bcd91d167 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.680856 18414 tablet_replica.cc:333] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.681545 18414 raft_consensus.cc:2243] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:12.696466 18414 raft_consensus.cc:2272] T d5f9fbdbd620463b9c81f3c5c92b40f4 P d56df3728fc04e37b2d29a3bcd91d167 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.699239 18414 tablet_replica.cc:333] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.703140 27606 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:12.703823 27606 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:12.707301 19584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:12.708192 18414 raft_consensus.cc:2243] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.708846 18414 raft_consensus.cc:2272] T 9807bdebbbd742009e4a329706a92790 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.711581 18414 tablet_replica.cc:333] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.712304 18414 raft_consensus.cc:2243] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.726377 18414 raft_consensus.cc:2272] T 904d960364024273a420111ec6233e84 P d56df3728fc04e37b2d29a3bcd91d167 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.728996 18414 tablet_replica.cc:333] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.729708 18414 raft_consensus.cc:2243] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.730091 20665 raft_consensus.cc:1217] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.14->[22.15-22.15]   Dedup: 22.15->[]
I20260709 13:21:12.730283 18414 raft_consensus.cc:2272] T c656f1e9148d4056945c02ce537d8b12 P d56df3728fc04e37b2d29a3bcd91d167 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.734457 18414 tablet_replica.cc:333] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.735144 18414 raft_consensus.cc:2243] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.743553 27606 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:12.744172 18414 raft_consensus.cc:2272] T d05498e224814b9b8f31e3f965ab2583 P d56df3728fc04e37b2d29a3bcd91d167 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:12.744326 19625 leader_election.cc:336] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:12.744812 19625 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:21:12.746471 19625 consensus_peers.cc:597] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:12.747047 27606 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:12.749708 18414 tablet_replica.cc:333] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167: stopping tablet replica
I20260709 13:21:12.750411 18414 raft_consensus.cc:2243] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:21:12.754805 18414 raft_consensus.cc:2272] T 03f9956d44294112accb74ea1a18065b P d56df3728fc04e37b2d29a3bcd91d167 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:12.822042 19551 consensus_peers.cc:597] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:12.877792 19625 consensus_peers.cc:597] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:12.892035 19625 consensus_peers.cc:597] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:12.897805 19625 consensus_peers.cc:597] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:12.929525 20619 consensus_peers.cc:597] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:12.959683 19625 consensus_peers.cc:597] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:12.981348 19625 consensus_peers.cc:597] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:13.004522 27598 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.005194 27598 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.010145 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:13.019835 27598 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:13.034276 27590 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.034983 27590 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.039779 27593 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.040416 27593 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:13.041848 19625 consensus_peers.cc:597] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:13.042443 19625 leader_election.cc:336] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:13.042706 27593 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:13.042975 19625 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:13.043921 27598 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:13.046188 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:13.046887 19660 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 18.
I20260709 13:21:13.049458 27590 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:21:13.050556 19551 leader_election.cc:336] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:13.053328 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:13.055267 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:21:13.056365 19551 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:13.059774 27593 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:13.060225 27593 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.060598 27593 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:13.065374 27590 raft_consensus.cc:2749] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:13.071987 27593 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:13.088534 19551 leader_election.cc:336] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:13.102185 20619 consensus_peers.cc:597] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:13.113911 27593 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:21:13.115919 19551 consensus_peers.cc:597] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:13.120003 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:13.120664 19660 raft_consensus.cc:3060] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:13.129964 19660 raft_consensus.cc:2468] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 19.
I20260709 13:21:13.135591 19551 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:21:13.187597 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 52093.5us
W20260709 13:21:13.188361 19551 consensus_peers.cc:597] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:13.188827 19551 leader_election.cc:336] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:13.204314 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 99023.5us
I20260709 13:21:13.196344 27646 raft_consensus.cc:2804] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:13.226673 27598 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.227248 27598 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.229421 27598 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:13.232177 27598 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.232702 27598 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.242206 27598 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:13.244079 27606 raft_consensus.cc:1064] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:21:13.606352 27659 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.608639 27659 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:13.613142 27659 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:13.645879 27646 raft_consensus.cc:697] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:21:13.648317 27646 consensus_queue.cc:237] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.663898 27547 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.665642 27547 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:13.688253 27547 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:13.689060 19625 consensus_peers.cc:597] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:13.695230 27648 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.696273 27648 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:13.702340 27662 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.703349 27662 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:21:13.705904 19551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.005s	sys 0.000s
I20260709 13:21:13.706046 27662 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:21:13.706343 19551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.005s	sys 0.000s
I20260709 13:21:13.709481 27648 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:21:13.711512 19625 consensus_peers.cc:597] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:13.712488 19625 leader_election.cc:336] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:13.713479 19625 consensus_peers.cc:597] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:13.714041 19625 leader_election.cc:336] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:13.716823 19625 leader_election.cc:336] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:13.725155 27658 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 32 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:21:13.726598 19627 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.004s	sys 0.012s
I20260709 13:21:13.726387 27658 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:13.727058 19627 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.005s	sys 0.012s
I20260709 13:21:13.729105 27651 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.730119 27651 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.732990 27651 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:13.735893 20663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:21:13.739045 20663 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 19.
I20260709 13:21:13.742738 27658 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:21:13.763067 19550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.001s	sys 0.010s
W20260709 13:21:13.763535 19550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.002s	sys 0.010s
W20260709 13:21:13.763965 19552 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.002s	sys 0.006s
W20260709 13:21:13.764482 19552 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.002s	sys 0.006s
I20260709 13:21:13.766677 27658 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.767599 27658 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:13.770556 27658 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:21:13.779649 19624 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.010s	sys 0.055s
W20260709 13:21:13.780252 19624 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.010s	sys 0.056s
I20260709 13:21:13.780912 27653 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.781996 27653 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:13.786338 27590 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.806358 27606 consensus_queue.cc:237] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:13.810544 27651 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.811317 27651 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.815106 27655 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.789340 27590 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.813819 27593 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.816336 27652 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.819278 27654 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.814183 27646 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.826071 27646 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.822048 27648 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.822176 27652 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.822736 27654 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.815955 27655 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.832909 27652 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:13.833760 27655 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:13.835372 27646 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:13.835541 27654 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:13.841739 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 50632.5us
W20260709 13:21:13.828327 19625 consensus_peers.cc:597] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:13.831022 27648 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.842309 27593 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.844622 27593 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:13.844647 27648 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:13.830225 27653 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:21:13.859670 27651 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:13.871035 27648 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.882097 27648 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.888068 27648 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:13.889134 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:13.889443 27654 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.890031 19656 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 19.
I20260709 13:21:13.894228 19627 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:13.895224 27652 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:21:13.895964 19625 consensus_peers.cc:597] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:13.895910 27652 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.898841 27590 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:13.902282 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:21:13.903051 20666 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
W20260709 13:21:13.903800 19625 consensus_peers.cc:597] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:13.904397 19625 leader_election.cc:336] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:13.904948 19625 leader_election.cc:336] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:13.905504 19625 consensus_peers.cc:597] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:13.905740 27598 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:21:13.906064 19625 leader_election.cc:336] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:13.906250 27598 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:21:13.906780 19625 leader_election.cc:336] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:13.890240 27654 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:13.907593 19625 leader_election.cc:336] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:13.910501 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 124632us
I20260709 13:21:13.906721 27598 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:13.862023 27646 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.876538 27655 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.914057 27646 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.918824 27655 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.920715 27646 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:13.914875 27590 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.921938 27590 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.924026 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:13.924422 27590 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:13.924933 19586 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 32.
I20260709 13:21:13.915442 27651 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.915558 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
I20260709 13:21:13.934940 27651 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:13.926476 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:13.938536 19583 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 26.
I20260709 13:21:13.939343 27654 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:13.939790 27651 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:13.934260 20666 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
I20260709 13:21:13.952677 27655 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:13.954895 27652 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:13.957337 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:13.958106 19583 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 26.
I20260709 13:21:13.958367 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:13.959089 19580 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:21:13.962445 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:13.963774 19582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:13.964331 19582 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 29.
I20260709 13:21:13.965888 19582 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:21:13.964306 19587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:13.967020 19587 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 21.
I20260709 13:21:13.967133 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:13.967730 19585 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:21:13.960371 19581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:13.968796 19581 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 23.
I20260709 13:21:13.968921 27670 raft_consensus.cc:1064] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf: attempting to promote NON_VOTER 068c03c9dcc848e6bf909131b1f83065 to VOTER
I20260709 13:21:13.972123 27670 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 15, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:13.960402 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:13.974273 19580 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 26.
I20260709 13:21:13.983063 27606 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:21:13.979302 20619 leader_election.cc:336] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:13.983930 27606 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:13.984854 20619 consensus_peers.cc:597] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:13.985498 20619 leader_election.cc:336] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:13.985992 20619 consensus_peers.cc:597] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:13.986409 20619 leader_election.cc:336] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:13.986830 27606 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:13.988379 20666 raft_consensus.cc:1275] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065 [term 22 LEARNER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:21:13.989357 27606 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:13.990168 27606 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:13.992967 18414 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 19533)
I20260709 13:21:13.993549 27598 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:13.995939 27598 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:21:13.998560 19553 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:21:13.999846 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.000840 27662 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:14.001256 27662 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.001669 27662 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:21:14.011315 19551 leader_election.cc:336] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.011940 27669 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.012755 27669 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.015215 27669 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:14.015653 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.017097 27651 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:21:14.017558 27651 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.017930 27651 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:14.021986 19553 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:21:14.022053 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:14.022977 27590 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:14.023415 27590 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.023820 27590 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:14.036723 27590 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:21:14.038779 19625 leader_election.cc:336] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:14.039759 19625 leader_election.cc:336] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.039990 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:21:14.040274 19625 leader_election.cc:336] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:14.040813 19625 consensus_peers.cc:597] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:14.041255 19625 leader_election.cc:336] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.044260 27651 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting leader election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:21:14.012020 19551 consensus_peers.cc:597] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:14.045519 19580 raft_consensus.cc:2393] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 27: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:21:14.045888 19551 leader_election.cc:336] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:14.046442 19551 consensus_peers.cc:597] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:14.046859 19551 leader_election.cc:336] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:14.047304 19551 leader_election.cc:336] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:14.047906 19551 consensus_peers.cc:597] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:14.048302 19551 consensus_peers.cc:597] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:14.048460 27606 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:14.048815 19551 leader_election.cc:336] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:14.049316 19551 leader_election.cc:336] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.050175 19627 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:21:14.041744 19625 leader_election.cc:336] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:14.057909 19551 consensus_peers.cc:597] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:14.058421 19625 leader_election.cc:336] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.059242 19627 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.050987 27673 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:21:14.059659 27652 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 13:21:14.063599 27651 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:21:14.063793 27652 raft_consensus.cc:493] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 32 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.064136 20631 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.064682 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3672e496ae4c7ab924bee7e50ecf70" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:21:14.065258 20666 raft_consensus.cc:3060] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:14.066337 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c83387a56274f46bd5795b3376741c9" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:21:14.066917 27590 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:21:14.067050 20665 raft_consensus.cc:3060] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:14.064236 27652 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 32 FOLLOWER]: Advancing to term 33
I20260709 13:21:14.060290 19586 raft_consensus.cc:2393] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 23: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:21:14.050529 27662 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:14.076862 27662 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 20 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:14.061039 19408 catalog_manager.cc:5697] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 18 to 19, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 19 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:14.079612 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:14.080631 19653 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 068c03c9dcc848e6bf909131b1f83065 in current term 20: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
W20260709 13:21:14.082978 20619 leader_election.cc:336] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.083120 20665 raft_consensus.cc:2468] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:21:14.083592 27673 raft_consensus.cc:493] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.084128 27673 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:14.084297 19553 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:21:14.084452 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:14.085201 27590 raft_consensus.cc:2804] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:14.085793 27590 raft_consensus.cc:697] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:21:14.086819 27590 consensus_queue.cc:237] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:14.089632 20666 raft_consensus.cc:2468] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 27.
I20260709 13:21:14.090354 27607 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:14.085805 27662 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:14.093470 19553 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf; no voters: 
I20260709 13:21:14.094920 27670 raft_consensus.cc:2804] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:21:14.095978 27670 raft_consensus.cc:697] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:21:14.097414 27670 consensus_queue.cc:237] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:14.059885 27606 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.061576 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:21:14.066409 19551 consensus_peers.cc:597] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:14.100728 19658 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 29.
I20260709 13:21:14.062575 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:14.102854 20666 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [term 26 LEARNER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:21:14.104489 27651 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:21:14.100596 27606 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:14.100867 19551 consensus_peers.cc:597] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:14.110087 19551 consensus_peers.cc:597] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:14.110577 19551 consensus_peers.cc:597] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:14.110991 19551 leader_election.cc:336] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:14.111997 19551 consensus_peers.cc:597] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:14.112440 19551 leader_election.cc:336] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:14.112905 19551 leader_election.cc:336] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:14.113343 19551 leader_election.cc:336] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:14.116483 19625 leader_election.cc:336] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.082717 27652 raft_consensus.cc:515] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:14.125314 19625 leader_election.cc:336] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.126397 19655 raft_consensus.cc:2393] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 33: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:21:14.128065 20631 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.129276 27607 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:14.130606 27598 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:21:14.131026 27598 raft_consensus.cc:493] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.131415 27598 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:21:14.138005 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 78840.9us
I20260709 13:21:14.138926 19627 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.139871 27664 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:21:14.140375 27664 raft_consensus.cc:493] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.140745 27664 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:14.154227 27598 raft_consensus.cc:515] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:14.162387 19625 leader_election.cc:336] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.169538 27590 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.170389 27590 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.173821 19660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:14.176234 19658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:14.176542 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:14.177191 19658 raft_consensus.cc:2393] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 27: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:21:14.177798 19659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:14.178471 19659 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:21:14.177234 19653 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 24.
W20260709 13:21:14.180102 19551 consensus_peers.cc:597] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:14.183873 19551 leader_election.cc:336] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:14.190661 19551 leader_election.cc:336] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:14.194001 19551 consensus_peers.cc:597] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:14.197343 19551 leader_election.cc:336] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.199100 27652 leader_election.cc:290] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 33 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:14.200122 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:14.200884 19655 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
I20260709 13:21:14.202649 27664 raft_consensus.cc:515] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.206724 19660 raft_consensus.cc:2393] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 25: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:21:14.208361 27664 leader_election.cc:290] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:14.215452 19625 leader_election.cc:336] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:14.216388 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 77572.1us
I20260709 13:21:14.217190 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.218839 27575 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:14.220803 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.225863 27575 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:21:14.226306 27575 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 29 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.226684 27575 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:21:14.215154 27606 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:14.236626 27575 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.238848 27590 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:14.239219 27598 leader_election.cc:290] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:14.241463 27673 raft_consensus.cc:515] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:14.248298 19625 leader_election.cc:336] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:14.243474 19551 leader_election.cc:336] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.249439 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:14.250133 19654 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 25.
I20260709 13:21:14.252068 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:14.252643 19654 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
I20260709 13:21:14.254009 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:14.254581 19654 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
I20260709 13:21:14.256129 19654 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:21:14.257856 19654 raft_consensus.cc:1275] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:21:14.259078 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:14.259629 19654 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 22.
W20260709 13:21:14.266463 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 45736.5us
I20260709 13:21:14.269352 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.271438 27606 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:14.275110 27575 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 30 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:14.279971 19625 leader_election.cc:336] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.282224 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.283281 27590 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:21:14.283756 27590 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.283681 19551 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:14.285388 19627 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:21:14.288198 19441 debug-util.cc:398] Leaking SignalData structure 0x7b080033bd40 after lost signal to thread 18417
W20260709 13:21:14.289608 19441 debug-util.cc:398] Leaking SignalData structure 0x7b0800269e60 after lost signal to thread 19444
I20260709 13:21:14.290383 27606 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:21:14.290812 27606 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:21:14.290992 19441 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5a40 after lost signal to thread 19611
I20260709 13:21:14.291263 27606 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:21:14.292155 19441 debug-util.cc:398] Leaking SignalData structure 0x7b080020f7e0 after lost signal to thread 19685
W20260709 13:21:14.293349 19441 debug-util.cc:398] Leaking SignalData structure 0x7b08001dc040 after lost signal to thread 20690
I20260709 13:21:14.284721 27651 raft_consensus.cc:3060] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 32 FOLLOWER]: Advancing to term 33
I20260709 13:21:14.284489 27590 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:21:14.305683 27575 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:14.306016 19551 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:14.306173 27575 raft_consensus.cc:493] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.287349 19627 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.307247 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.309715 27598 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:14.309790 27658 raft_consensus.cc:3060] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:14.310235 27598 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.310627 27598 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:14.309530 27575 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:14.315996 27670 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:14.316434 27670 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.316820 27670 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:14.319377 27673 leader_election.cc:290] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:14.320861 27651 raft_consensus.cc:2749] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 33 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 13:21:14.326844 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.327629 27655 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:21:14.328008 27655 raft_consensus.cc:493] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.328354 27655 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:14.330655 27590 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.332801 27590 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 30 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:14.333510 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:14.334156 19586 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 25.
I20260709 13:21:14.338563 27655 raft_consensus.cc:515] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.353607 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cdbdc59c54db98e6692ac65df1b3b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:14.339395 20666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065"
I20260709 13:21:14.339555 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:14.354436 19586 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 26.
I20260709 13:21:14.355495 20666 raft_consensus.cc:2393] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 20: Already voted for candidate 068c03c9dcc848e6bf909131b1f83065 in this term.
I20260709 13:21:14.361248 27658 raft_consensus.cc:2749] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:14.361991 19583 raft_consensus.cc:2468] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 33.
I20260709 13:21:14.340754 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.363653 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:21:14.364145 19625 leader_election.cc:336] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.365439 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb3362944f5459e982bd278a6a4c561" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:14.367424 19583 raft_consensus.cc:3060] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:14.371654 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:14.372399 19579 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 30: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:21:14.374818 27575 raft_consensus.cc:515] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.347268 27606 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.352984 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:14.352995 27670 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.376776 19580 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 26.
I20260709 13:21:14.368507 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac31068f224487a102689bcb76cc21" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:14.368827 27666 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:21:14.377885 27666 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.378295 27666 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:14.369253 27593 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:21:14.380308 27593 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.380739 27593 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:14.387322 27606 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:14.349592 27598 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.387815 27670 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:14.397373 27598 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:14.400262 19579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f949ff511e844749624dedf436dff50" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:14.402395 19579 raft_consensus.cc:3060] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:14.404428 27666 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.406540 27666 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:14.370296 19551 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:14.403983 19408 catalog_manager.cc:5697] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 22 to 23, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 23 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:14.409650 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.421352 27669 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:21:14.421806 27669 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.422224 27669 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:14.429983 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.398020 27593 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.432890 27593 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:14.433725 27646 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:21:14.434247 27646 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.434665 27646 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:14.438709 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.410743 19579 raft_consensus.cc:2468] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 27.
I20260709 13:21:14.389395 27655 leader_election.cc:290] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:14.410486 19408 catalog_manager.cc:5697] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 26 to 27, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 27 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:14.419857 19586 raft_consensus.cc:2468] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 27.
I20260709 13:21:14.461272 27669 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.466607 27651 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:21:14.476181 27651 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.476583 27651 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:14.481344 27673 consensus_queue.cc:1048] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:21:14.482357 19625 leader_election.cc:336] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.484810 19627 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.485935 27651 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.486639 27673 raft_consensus.cc:2749] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:14.490392 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:14.491160 19586 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 25: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:21:14.492223 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9116dce1321e475194eeaa1705fd6ac0" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:14.492823 19578 raft_consensus.cc:3060] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:14.495501 19580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:14.496234 19580 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 24: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:21:14.504206 27653 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:21:14.505961 27653 consensus_queue.cc:1048] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:14.508555 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.464082 27669 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:14.510633 27673 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:21:14.507670 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:21:14.511190 27673 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.511641 27673 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:14.511977 19578 raft_consensus.cc:2468] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 27.
W20260709 13:21:14.482987 19625 leader_election.cc:336] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.512130 19627 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.514604 19627 leader_election.cc:304] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.512501 27575 leader_election.cc:290] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:14.517591 19583 raft_consensus.cc:2468] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 25.
I20260709 13:21:14.523583 27590 raft_consensus.cc:2749] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:14.528107 20665 raft_consensus.cc:1275] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:21:14.531497 27651 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:14.475397 27646 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.534350 27646 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:14.534945 27646 consensus_queue.cc:1048] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:21:14.535194 27673 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.537269 27673 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:14.515925 19625 leader_election.cc:336] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.518064 27666 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:14.538225 27666 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
W20260709 13:21:14.513752 19551 leader_election.cc:336] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.538677 27666 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:14.540536 27655 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:21:14.540994 27655 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.541391 27655 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:14.546973 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.547318 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:14.550791 19627 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.558023 19627 leader_election.cc:304] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.557225 19654 raft_consensus.cc:2393] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 30: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:21:14.567062 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:14.567934 19655 raft_consensus.cc:2393] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 25: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:21:14.568586 19627 leader_election.cc:304] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.571552 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:14.572109 19627 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.573248 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:14.573884 19656 raft_consensus.cc:3060] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:14.557081 27673 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:21:14.576781 27673 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting leader election (detected failure of leader d56df3728fc04e37b2d29a3bcd91d167)
I20260709 13:21:14.577230 27673 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:14.570354 27664 raft_consensus.cc:2804] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:21:14.574424 19653 raft_consensus.cc:2393] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 24: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:21:14.582314 27664 raft_consensus.cc:697] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:14.574436 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:14.583204 19654 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 26: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:21:14.583307 27664 consensus_queue.cc:237] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.575549 27667 raft_consensus.cc:2804] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:21:14.585943 27667 raft_consensus.cc:697] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:14.586871 27667 consensus_queue.cc:237] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.589214 19656 raft_consensus.cc:2468] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 27.
I20260709 13:21:14.570452 27654 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 13:21:14.550866 27683 raft_consensus.cc:2804] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 33 FOLLOWER]: Leader election won for term 33
I20260709 13:21:14.592658 19627 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.593526 27606 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:21:14.598058 27652 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:21:14.604162 27666 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.607227 27655 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.610643 27683 raft_consensus.cc:697] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 33 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:14.611745 27683 consensus_queue.cc:237] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 32.17, Last appended by leader: 17, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.622562 19627 leader_election.cc:304] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.624351 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:14.625422 19654 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 27: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:21:14.626037 19627 leader_election.cc:304] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:21:14.626299 19551 consensus_peers.cc:597] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:14.628358 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:14.628645 27606 raft_consensus.cc:2804] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:21:14.628688 27575 raft_consensus.cc:2804] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:21:14.629495 27575 raft_consensus.cc:697] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:14.629930 27606 raft_consensus.cc:697] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:14.630501 27575 consensus_queue.cc:237] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.631039 27606 consensus_queue.cc:237] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.634956 19583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9a4266bc2b4d15ac7862c48149bb66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:14.635622 19583 raft_consensus.cc:3060] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:14.636600 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:14.637689 19586 raft_consensus.cc:2393] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 27: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:21:14.649909 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:14.650795 19578 raft_consensus.cc:2393] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 26: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
I20260709 13:21:14.650390 27648 raft_consensus.cc:2955] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:14.664999 19583 raft_consensus.cc:2468] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 22.
I20260709 13:21:14.625708 27655 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:14.671690 27666 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:14.660688 20666 raft_consensus.cc:2955] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:14.686075 19627 leader_election.cc:304] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.701821 27673 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.702828 19583 raft_consensus.cc:2955] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:14.704759 27673 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:14.705508 19653 raft_consensus.cc:2393] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfd02601ea44976833027665abc93bf in current term 27: Already voted for candidate e19c80e9149b4b8d88ae13bde8e43864 in this term.
I20260709 13:21:14.693897 27648 raft_consensus.cc:2804] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:14.726713 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:14.727746 19586 raft_consensus.cc:2393] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c80e9149b4b8d88ae13bde8e43864 in current term 27: Already voted for candidate 2cfd02601ea44976833027665abc93bf in this term.
W20260709 13:21:14.734871 19625 leader_election.cc:336] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.735438 19625 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.736447 27648 raft_consensus.cc:697] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:14.737502 27648 consensus_queue.cc:237] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:14.740041 27575 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:21:14.751999 19551 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:21:14.753893 27646 raft_consensus.cc:2804] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:21:14.754444 27646 raft_consensus.cc:697] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:21:14.755441 27646 consensus_queue.cc:237] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:14.760406 19625 leader_election.cc:336] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.760895 19625 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:21:14.764973 19625 leader_election.cc:336] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.765561 19625 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:14.768374 19655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f9fbdbd620463b9c81f3c5c92b40f4" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
W20260709 13:21:14.768569 19551 leader_election.cc:336] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.768939 19655 raft_consensus.cc:3060] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:14.769258 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:21:14.770658 19551 leader_election.cc:336] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.771224 19551 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:14.772905 19408 catalog_manager.cc:5697] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf reported cstate change: config changed from index 15 to 16, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:21:14.773950 19551 leader_election.cc:336] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.774636 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:14.776037 27666 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:21:14.776901 27593 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:21:14.766985 27683 raft_consensus.cc:2749] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:21:14.782361 27575 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:21:14.790993 27653 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:21:14.801772 19655 raft_consensus.cc:2468] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 23.
I20260709 13:21:14.817351 27653 raft_consensus.cc:2955] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 26 LEADER]: Committing config change with OpId 26.18: config changed from index 17 to 18, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:14.845274 20665 raft_consensus.cc:2955] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Committing config change with OpId 26.18: config changed from index 17 to 18, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:14.896701 20665 raft_consensus.cc:1275] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:21:14.909834 27653 consensus_queue.cc:1048] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:21:14.922602 19656 raft_consensus.cc:2955] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Committing config change with OpId 26.18: config changed from index 17 to 18, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:14.924431 19408 catalog_manager.cc:5697] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 17 to 18, 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132) changed from NON_VOTER to VOTER. New cstate: current_term: 26 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } attrs { replace: true } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:21:14.928010 19551 consensus_peers.cc:597] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:14.928622 19551 consensus_peers.cc:597] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:14.929051 19551 leader_election.cc:336] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:14.929741 19551 leader_election.cc:336] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.930156 19551 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:14.933307 19402 catalog_manager.cc:5697] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 26 to 27, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 27 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:14.946709 19551 leader_election.cc:336] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.947273 19551 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:14.949551 27651 raft_consensus.cc:2749] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 13:21:14.954628 19410 catalog_manager.cc:5697] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 26 to 27, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 27 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:14.961911 27651 raft_consensus.cc:2749] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:21:14.962266 19551 leader_election.cc:336] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.962914 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfd02601ea44976833027665abc93bf; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:14.963726 27651 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:21:14.964145 19551 consensus_peers.cc:597] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:14.965075 19551 leader_election.cc:336] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:14.954316 19402 catalog_manager.cc:5697] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 32 to 33, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 33 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:14.970837 19402 catalog_manager.cc:5697] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 24 to 25, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 25 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:14.972718 19402 catalog_manager.cc:5697] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 26 to 27, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 27 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:14.976243 19402 catalog_manager.cc:5697] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 26 to 27, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 27 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:14.981014 19402 catalog_manager.cc:5697] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 21 to 22, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 22 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:14.986331 19585 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:21:14.993476 18414 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 19533)
I20260709 13:21:15.038743 20665 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:21:15.052785 27666 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:21:15.055589 19551 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:15.056392 27593 raft_consensus.cc:2804] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:15.056975 27593 raft_consensus.cc:697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:21:15.057031 19585 raft_consensus.cc:1275] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:21:15.058115 27593 consensus_queue.cc:237] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:15.059995 27575 consensus_queue.cc:1048] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:21:15.072283 27653 raft_consensus.cc:2955] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 26 LEADER]: Committing config change with OpId 26.19: config changed from index 18 to 19, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:15.075748 19583 raft_consensus.cc:1275] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:21:15.075487 20665 raft_consensus.cc:2955] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Committing config change with OpId 26.19: config changed from index 18 to 19, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
I20260709 13:21:15.104702 27648 consensus_queue.cc:1048] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
I20260709 13:21:15.111423 19402 catalog_manager.cc:5697] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 22 to 23, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 23 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:15.114643 19552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:15.161237 19625 consensus_peers.cc:597] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:15.168460 19410 catalog_manager.cc:5697] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: config changed from index 18 to 19, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New cstate: current_term: 26 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:21:15.179800 19625 consensus_peers.cc:597] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:15.180408 19625 consensus_peers.cc:597] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:15.181092 19625 consensus_peers.cc:597] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:15.186035 19625 consensus_peers.cc:597] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:15.199584 19397 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7dd800f2a6b149a5b3ab177899d5f6bf with cas_config_opid_index 18: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:21:15.208943 19583 raft_consensus.cc:1275] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 33 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 32 index: 17. Preceding OpId from leader: term: 33 index: 18. (index mismatch)
I20260709 13:21:15.214262 27648 consensus_queue.cc:1048] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:21:15.201408 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 115359us
I20260709 13:21:15.218185 19586 raft_consensus.cc:1275] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:21:15.226106 27655 consensus_queue.cc:1048] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:15.232394 19578 raft_consensus.cc:1275] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:21:15.236667 27673 consensus_queue.cc:1048] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:21:15.238322 19655 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:21:15.244445 19578 raft_consensus.cc:1275] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:21:15.250130 27654 consensus_queue.cc:1048] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 13:21:15.303785 19656 raft_consensus.cc:1275] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:21:15.306098 27590 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 13:21:15.309137 19625 consensus_peers.cc:597] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:15.332876 27701 consensus_queue.cc:1048] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:15.339612 19660 raft_consensus.cc:2955] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Committing config change with OpId 26.19: config changed from index 18 to 19, VOTER d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } } }
W20260709 13:21:15.371819 19551 consensus_peers.cc:597] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:15.418862 19551 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111) [suppressed 382 similar messages]
W20260709 13:21:15.477768 19395 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 64975.3us
W20260709 13:21:15.505189 19395 catalog_manager.cc:4755] TS d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7dd800f2a6b149a5b3ab177899d5f6bf: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:15.535642 20619 consensus_peers.cc:597] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:15.594129 20619 consensus_peers.cc:597] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:15.601855 19656 raft_consensus.cc:1275] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:21:15.619431 27662 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.620069 27662 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:15.625439 27662 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:15.628454 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:15.629142 19656 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 20.
I20260709 13:21:15.631129 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
W20260709 13:21:15.632740 19625 consensus_peers.cc:597] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:15.632764 27607 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:15.634006 27607 raft_consensus.cc:493] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:15.634398 27607 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:15.638994 27670 consensus_queue.cc:1048] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:21:15.640681 20619 leader_election.cc:336] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:15.652987 27607 raft_consensus.cc:515] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:21:15.663980 20619 leader_election.cc:336] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:15.680289 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb38e2ac9064d3286fe2f20aeb2381c" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:15.680936 19653 raft_consensus.cc:3060] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:15.685742 27607 leader_election.cc:290] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 21 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:15.688990 19653 raft_consensus.cc:2468] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 21.
I20260709 13:21:15.691543 20619 leader_election.cc:304] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:15.692369 27607 raft_consensus.cc:2804] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:15.693742 27607 raft_consensus.cc:697] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 21 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:21:15.694788 27607 consensus_queue.cc:237] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:21:15.720973 19551 consensus_peers.cc:597] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:15.745682 19410 catalog_manager.cc:5697] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 19 to 21, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 21 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:15.747176 19625 consensus_peers.cc:597] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:15.798048 19551 consensus_peers.cc:597] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:15.886299 19625 consensus_peers.cc:597] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:15.918181 19625 consensus_peers.cc:597] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:15.991933 19625 consensus_peers.cc:597] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:15.994304 18414 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 19533)
W20260709 13:21:16.005859 19625 consensus_peers.cc:597] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:16.012490 19625 consensus_peers.cc:597] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:16.027916 19625 consensus_peers.cc:597] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:16.059294 19625 consensus_peers.cc:597] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:16.072769 19625 consensus_peers.cc:597] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:16.073264 19625 consensus_peers.cc:597] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:16.132340 27720 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.133155 27720 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:16.136458 27720 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:16.141731 19625 leader_election.cc:336] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:16.148516 20619 consensus_peers.cc:597] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:16.169135 19627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 54519.4us
I20260709 13:21:16.176591 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:16.177359 19585 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 24.
I20260709 13:21:16.196781 19627 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:16.207696 27720 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:21:16.208156 27720 raft_consensus.cc:493] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.208514 27720 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:21:16.232640 20619 consensus_peers.cc:597] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:16.243520 27720 raft_consensus.cc:515] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:16.245990 27720 leader_election.cc:290] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:16.250906 19625 leader_election.cc:336] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:16.253157 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9242425d3a744c3b8742c30995129f4" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:16.254747 19586 raft_consensus.cc:3060] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:21:16.264518 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 52093.4us
I20260709 13:21:16.284780 19653 raft_consensus.cc:1275] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:21:16.286791 27723 consensus_queue.cc:1048] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:21:16.296643 19586 raft_consensus.cc:2468] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 25.
I20260709 13:21:16.298009 19627 leader_election.cc:304] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:16.300148 27721 raft_consensus.cc:2804] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:21:16.302045 27721 raft_consensus.cc:697] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:16.303013 27721 consensus_queue.cc:237] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:16.370823 19408 catalog_manager.cc:5697] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 23 to 25, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 25 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:16.384261 19551 consensus_peers.cc:597] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:16.405390 19625 consensus_peers.cc:597] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:16.424713 27670 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.425346 27670 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:16.427747 27670 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:16.436741 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:16.437527 19653 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
I20260709 13:21:16.443280 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:21:16.444618 27670 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:21:16.445358 27670 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.445740 27670 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:21:16.476480 19551 leader_election.cc:336] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:16.495657 27722 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.496255 27722 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:16.498483 27722 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:16.503819 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:16.504602 19653 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 27.
I20260709 13:21:16.508071 27670 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:16.510206 19551 consensus_peers.cc:597] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:16.512609 27670 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:16.511256 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:21:16.510207 27721 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.514026 27721 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:16.515626 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:16.516047 27721 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:16.516273 19656 raft_consensus.cc:3060] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:16.517974 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 31 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:16.518635 19586 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 30.
I20260709 13:21:16.519878 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:21:16.520781 27648 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 13:21:16.521183 27648 raft_consensus.cc:493] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.521731 27648 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:21:16.523923 19656 raft_consensus.cc:2468] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 27.
W20260709 13:21:16.525167 19551 consensus_peers.cc:597] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:16.527976 27666 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:21:16.528403 27666 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.528743 27666 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:21:16.529208 19551 leader_election.cc:336] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:16.530494 19551 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:21:16.531297 27722 raft_consensus.cc:2804] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:21:16.531781 27722 raft_consensus.cc:697] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:21:16.532689 27722 consensus_queue.cc:237] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:16.539865 20619 consensus_peers.cc:597] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:16.543630 19551 leader_election.cc:336] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:16.534952 19625 leader_election.cc:336] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:16.559828 19408 catalog_manager.cc:5697] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 25 to 27, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 27 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:16.562891 27666 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:16.565237 27666 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:16.569864 27648 raft_consensus.cc:515] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:16.571415 19625 consensus_peers.cc:597] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:16.576396 19656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f9956d44294112accb74ea1a18065b" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:16.582815 19656 raft_consensus.cc:3060] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:21:16.583818 27648 leader_election.cc:290] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 31 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:16.587037 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1d08b75392466298c02ea9d4d765dd" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 31 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:16.587631 19586 raft_consensus.cc:3060] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 30 FOLLOWER]: Advancing to term 31
W20260709 13:21:16.589351 19625 consensus_peers.cc:597] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:16.579485 27720 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.589941 27720 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:16.592530 19656 raft_consensus.cc:2468] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 28.
I20260709 13:21:16.593050 27720 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:16.593705 19625 consensus_peers.cc:597] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:16.594106 19625 leader_election.cc:336] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:16.595758 19551 consensus_peers.cc:597] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:16.595885 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:16.596602 19585 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 27.
I20260709 13:21:16.598555 19627 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:21:16.604460 27648 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 13:21:16.606189 19625 leader_election.cc:336] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:16.604907 27648 raft_consensus.cc:493] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.608500 27648 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:21:16.603262 19586 raft_consensus.cc:2468] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 31.
I20260709 13:21:16.614719 19627 leader_election.cc:304] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:16.616016 27720 raft_consensus.cc:2804] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 13:21:16.616845 27720 raft_consensus.cc:697] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 31 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:16.617930 27720 consensus_queue.cc:237] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 29.14, Last appended by leader: 14, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:16.619690 19551 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:21:16.620560 27666 raft_consensus.cc:2804] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:21:16.621107 27666 raft_consensus.cc:697] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 28 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:21:16.622098 27666 consensus_queue.cc:237] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:16.639648 19551 consensus_peers.cc:597] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:16.640216 19551 leader_election.cc:336] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:16.640977 19551 consensus_peers.cc:597] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:16.659312 19408 catalog_manager.cc:5697] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 26 to 28, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 28 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:16.661957 19625 consensus_peers.cc:597] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:16.681478 27666 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.665644 27648 raft_consensus.cc:515] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:16.682075 27666 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:16.689080 27666 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:16.688762 19410 catalog_manager.cc:5697] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 29 to 31, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 31 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:16.692981 19625 leader_election.cc:336] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:16.696503 19586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4c20e4aab6496cb949c1fad0dbcc66" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf"
I20260709 13:21:16.697242 19586 raft_consensus.cc:3060] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:21:16.704638 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:16.705466 19653 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 25.
I20260709 13:21:16.709949 27648 leader_election.cc:290] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:16.716372 19586 raft_consensus.cc:2468] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c80e9149b4b8d88ae13bde8e43864 in term 28.
I20260709 13:21:16.725986 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: 
I20260709 13:21:16.728891 27666 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:21:16.729391 27666 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.729810 27666 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:16.754371 27666 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:16.756093 19627 leader_election.cc:304] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:16.756757 27666 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 election: Requested vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:21:16.757579 19551 consensus_peers.cc:597] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:16.758170 19551 leader_election.cc:336] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:16.760416 19653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b53fc6e49df441b959a20ab5dd387dd" candidate_uuid: "2cfd02601ea44976833027665abc93bf" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:16.761004 19653 raft_consensus.cc:3060] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:16.757416 27648 raft_consensus.cc:2804] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:21:16.768476 27648 raft_consensus.cc:697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 28 LEADER]: Becoming Leader. State: Replica: e19c80e9149b4b8d88ae13bde8e43864, State: Running, Role: LEADER
I20260709 13:21:16.769476 27648 consensus_queue.cc:237] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:16.776455 19551 leader_election.cc:336] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:16.791316 19653 raft_consensus.cc:2468] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfd02601ea44976833027665abc93bf in term 26.
I20260709 13:21:16.792816 19551 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864; no voters: d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:16.794139 27670 raft_consensus.cc:2804] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:21:16.795935 27670 raft_consensus.cc:697] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 26 LEADER]: Becoming Leader. State: Replica: 2cfd02601ea44976833027665abc93bf, State: Running, Role: LEADER
I20260709 13:21:16.797031 27670 consensus_queue.cc:237] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:16.801362 19551 consensus_peers.cc:597] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:16.871665 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 49504.9us
I20260709 13:21:16.865052 19410 catalog_manager.cc:5697] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf reported cstate change: term changed from 24 to 26, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to 2cfd02601ea44976833027665abc93bf (127.17.251.130). New cstate: current_term: 26 leader_uuid: "2cfd02601ea44976833027665abc93bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:16.879472 19395 catalog_manager.cc:4755] TS d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7dd800f2a6b149a5b3ab177899d5f6bf: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:16.883282 19625 consensus_peers.cc:597] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:16.899200 19551 consensus_peers.cc:597] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:16.896955 19408 catalog_manager.cc:5697] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 reported cstate change: term changed from 26 to 28, leader changed from d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129) to e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131). New cstate: current_term: 28 leader_uuid: "e19c80e9149b4b8d88ae13bde8e43864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:16.902293 19551 consensus_peers.cc:597] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:16.902822 19551 consensus_peers.cc:597] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:16.911893 19578 raft_consensus.cc:1275] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:21:16.915271 27720 consensus_queue.cc:1048] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:21:16.924022 19551 consensus_peers.cc:597] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:16.958879 19551 consensus_peers.cc:597] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:16.969133 19653 raft_consensus.cc:1275] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:21:16.970636 27658 consensus_queue.cc:1048] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:21:16.994784 18414 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 19533)
W20260709 13:21:17.066078 19551 consensus_peers.cc:597] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:17.082548 19551 consensus_peers.cc:597] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:17.100148 19551 consensus_peers.cc:597] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:17.101936 19586 raft_consensus.cc:1275] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 31 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 29 index: 14. Preceding OpId from leader: term: 31 index: 15. (index mismatch)
I20260709 13:21:17.103513 27746 consensus_queue.cc:1048] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:21:17.160015 19625 consensus_peers.cc:597] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:17.179198 19656 raft_consensus.cc:1275] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:21:17.182650 27722 consensus_queue.cc:1048] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:21:17.205955 19551 consensus_peers.cc:597] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:17.232065 19653 raft_consensus.cc:1275] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Refusing update from remote peer 2cfd02601ea44976833027665abc93bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 13:21:17.240921 27666 consensus_queue.cc:1048] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:21:17.262959 19551 consensus_peers.cc:597] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:17.289074 19625 consensus_peers.cc:597] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:17.296813 19585 raft_consensus.cc:1275] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Refusing update from remote peer e19c80e9149b4b8d88ae13bde8e43864: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:21:17.299991 27746 consensus_queue.cc:1048] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:21:17.351912 19551 consensus_peers.cc:597] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:17.364022 19625 consensus_peers.cc:597] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:17.409209 19551 consensus_peers.cc:597] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:17.459496 19625 consensus_peers.cc:597] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:17.501709 19625 consensus_peers.cc:597] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:17.701824 19625 consensus_peers.cc:597] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:17.757840 19625 consensus_peers.cc:597] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:17.799778 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 63837.2us
W20260709 13:21:17.804872 19551 consensus_peers.cc:597] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:17.804947 19625 consensus_peers.cc:597] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:17.829397 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 90947.3us
W20260709 13:21:17.881819 20619 consensus_peers.cc:597] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:17.967327 19395 catalog_manager.cc:4755] TS d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7dd800f2a6b149a5b3ab177899d5f6bf: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:17.995464 18414 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 19533)
W20260709 13:21:18.095391 20619 consensus_peers.cc:597] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.175050 19625 consensus_peers.cc:597] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.236338 19625 consensus_peers.cc:597] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.239430 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 141037us
W20260709 13:21:18.252532 19625 consensus_peers.cc:597] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.276499 19551 consensus_peers.cc:597] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:18.367527 19625 consensus_peers.cc:597] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.442691 19625 consensus_peers.cc:597] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.486398 19625 consensus_peers.cc:597] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.488142 19551 consensus_peers.cc:597] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.520656 19625 consensus_peers.cc:597] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.528602 19625 consensus_peers.cc:597] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.603197 19625 consensus_peers.cc:597] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.610700 20619 consensus_peers.cc:597] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.610967 19625 consensus_peers.cc:597] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.664736 20619 consensus_peers.cc:597] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.665151 19625 consensus_peers.cc:597] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.721860 20619 consensus_peers.cc:597] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:18.780795 19625 consensus_peers.cc:597] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.856760 19551 consensus_peers.cc:597] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.949065 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 92359.3us
W20260709 13:21:18.956207 19625 consensus_peers.cc:597] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.996130 18414 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 19533)
W20260709 13:21:19.022404 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 66255.9us
W20260709 13:21:19.008020 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 47869.2us
W20260709 13:21:19.021157 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 69443.1us
W20260709 13:21:19.091027 19625 consensus_peers.cc:597] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:19.102739 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:40615, user_credentials={real_user=slave}} blocked reactor thread for 47742.8us
W20260709 13:21:19.151448 19551 consensus_peers.cc:597] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:19.186625 19551 consensus_peers.cc:597] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:19.187287 19551 consensus_peers.cc:597] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:19.187777 19551 consensus_peers.cc:597] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:19.188254 19551 consensus_peers.cc:597] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:19.209890 19551 consensus_peers.cc:597] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:19.234688 19625 consensus_peers.cc:597] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:19.283820 19551 consensus_peers.cc:597] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:19.297971 19551 consensus_peers.cc:597] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:19.371410 19625 consensus_peers.cc:597] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:19.640319 19625 consensus_peers.cc:597] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:19.730305 19551 consensus_peers.cc:597] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:19.745846 19625 consensus_peers.cc:597] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:19.778144 19551 consensus_peers.cc:597] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:19.778740 19551 consensus_peers.cc:597] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:19.779150 19551 consensus_peers.cc:597] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:19.795354 19551 consensus_peers.cc:597] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:19.811640 19551 consensus_peers.cc:597] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:19.812247 19551 consensus_peers.cc:597] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:19.812669 19551 consensus_peers.cc:597] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:19.842492 19551 consensus_peers.cc:597] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:19.853351 19551 consensus_peers.cc:597] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:19.866354 19625 consensus_peers.cc:597] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:20.022591 18414 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 19533)
W20260709 13:21:20.062876 19395 catalog_manager.cc:4755] TS d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7dd800f2a6b149a5b3ab177899d5f6bf: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:20.133807 19625 consensus_peers.cc:597] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.147687 19625 consensus_peers.cc:597] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.152017 19551 consensus_peers.cc:597] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.221897 19625 consensus_peers.cc:597] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.237406 19625 consensus_peers.cc:597] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.311849 19625 consensus_peers.cc:597] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.403095 20619 consensus_peers.cc:597] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:20.433147 19625 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111) [suppressed 531 similar messages]
W20260709 13:21:20.570111 19625 consensus_peers.cc:597] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.585907 20619 consensus_peers.cc:597] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:20.611107 19551 consensus_peers.cc:597] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.642936 19625 consensus_peers.cc:597] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:20.645886 19625 consensus_peers.cc:597] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:20.649096 19625 consensus_peers.cc:597] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:20.808617 19625 consensus_peers.cc:597] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:20.849537 19625 consensus_peers.cc:597] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:20.878984 19551 consensus_peers.cc:597] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:20.926007 19551 consensus_peers.cc:597] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.970971 19625 consensus_peers.cc:597] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:20.994442 19625 consensus_peers.cc:597] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:21.023103 18414 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 19533)
W20260709 13:21:21.044631 19625 consensus_peers.cc:597] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:21.051836 20619 consensus_peers.cc:597] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:21.106084 19625 consensus_peers.cc:597] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:21.148145 19625 consensus_peers.cc:597] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:21.149012 19551 consensus_peers.cc:597] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:21.166069 20619 consensus_peers.cc:597] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:21.190433 19625 consensus_peers.cc:597] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:21.265702 19551 consensus_peers.cc:597] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:21.273909 19551 consensus_peers.cc:597] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:21.341091 19625 consensus_peers.cc:597] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:21.391906 20619 consensus_peers.cc:597] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:21.489902 19625 consensus_peers.cc:597] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:21.622612 19551 consensus_peers.cc:597] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:21.672685 19625 consensus_peers.cc:597] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:21.680615 19625 consensus_peers.cc:597] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:21.724722 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 44164.6us
W20260709 13:21:21.848142 19551 consensus_peers.cc:597] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:21.950241 19551 consensus_peers.cc:597] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:21.951017 19551 consensus_peers.cc:597] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:21.971197 19625 consensus_peers.cc:597] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:22.023617 18414 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 19533)
W20260709 13:21:22.056579 19551 consensus_peers.cc:597] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:22.079051 19551 consensus_peers.cc:597] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:22.087721 19625 consensus_peers.cc:597] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:22.188548 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 52807.5us
W20260709 13:21:22.204304 19625 consensus_peers.cc:597] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:22.208377 19551 consensus_peers.cc:597] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:22.218233 19551 consensus_peers.cc:597] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:22.218765 19551 consensus_peers.cc:597] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:22.294816 19551 consensus_peers.cc:597] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:22.295590 19551 consensus_peers.cc:597] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:22.296309 19551 consensus_peers.cc:597] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:22.358877 19551 consensus_peers.cc:597] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:22.440790 19551 consensus_peers.cc:597] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:22.449892 19625 consensus_peers.cc:597] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:22.530706 19551 consensus_peers.cc:597] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:22.596808 19625 consensus_peers.cc:597] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:22.599987 19625 consensus_peers.cc:597] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:22.607281 19551 consensus_peers.cc:597] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:22.653087 19625 consensus_peers.cc:597] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:22.659883 19551 consensus_peers.cc:597] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:22.666770 20619 consensus_peers.cc:597] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:22.745324 19625 consensus_peers.cc:597] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:22.848028 19625 consensus_peers.cc:597] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:22.882423 19625 consensus_peers.cc:597] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:22.908016 19625 consensus_peers.cc:597] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:22.917523 20619 consensus_peers.cc:597] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:22.954828 19551 consensus_peers.cc:597] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:23.024180 18414 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 19533)
W20260709 13:21:23.108057 19625 consensus_peers.cc:597] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:23.128840 19625 consensus_peers.cc:597] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:23.314304 19625 consensus_peers.cc:597] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:23.314814 19625 consensus_peers.cc:597] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:23.385251 19625 consensus_peers.cc:597] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:23.408382 20619 consensus_peers.cc:597] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:23.459110 19551 consensus_peers.cc:597] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:23.459802 19551 consensus_peers.cc:597] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:23.713694 19551 consensus_peers.cc:597] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:23.715734 19551 consensus_peers.cc:597] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:23.714654 20619 consensus_peers.cc:597] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:23.722338 19625 consensus_peers.cc:597] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:23.761073 20619 consensus_peers.cc:597] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:23.781333 19625 consensus_peers.cc:597] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:23.836081 19625 consensus_peers.cc:597] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:23.853524 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 44014.3us
W20260709 13:21:23.878053 19551 consensus_peers.cc:597] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:23.946792 19551 consensus_peers.cc:597] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:23.984642 19625 consensus_peers.cc:597] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:23.997750 19625 consensus_peers.cc:597] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:24.013196 19625 consensus_peers.cc:597] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:24.024900 18414 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 19533)
W20260709 13:21:24.061443 19625 consensus_peers.cc:597] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:24.156755 19625 consensus_peers.cc:597] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:24.186519 19551 consensus_peers.cc:597] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:24.202495 19551 consensus_peers.cc:597] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:24.213472 19399 maintenance_manager.cc:419] P 5aff2c187289436a846acba13255b21f: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033402
W20260709 13:21:24.242290 19395 catalog_manager.cc:4755] TS d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7dd800f2a6b149a5b3ab177899d5f6bf: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:24.250669 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 48219us
W20260709 13:21:24.404457 19625 consensus_peers.cc:597] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:24.461539 19551 consensus_peers.cc:597] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:24.489764 19551 consensus_peers.cc:597] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:24.508796 19551 consensus_peers.cc:597] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:24.512540 19625 consensus_peers.cc:597] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:24.518384 19625 consensus_peers.cc:597] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:24.557456 19398 maintenance_manager.cc:643] P 5aff2c187289436a846acba13255b21f: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.324s	user 0.054s	sys 0.007s Metrics: {"bytes_written":8096,"delete_count":0,"lbm_write_time_us":13193,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":5,"reinsert_count":0,"thread_start_us":33928,"threads_started":1,"update_count":331,"wal-append.queue_time_us":34481}
I20260709 13:21:24.560423 19399 maintenance_manager.cc:419] P 5aff2c187289436a846acba13255b21f: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.371148
W20260709 13:21:24.604055 19551 consensus_peers.cc:597] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:24.626703 19551 consensus_peers.cc:597] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:24.655517 19551 consensus_peers.cc:597] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:24.659637 19551 consensus_peers.cc:597] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:24.706801 19625 consensus_peers.cc:597] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:24.751334 19551 consensus_peers.cc:597] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:24.830474 19551 consensus_peers.cc:597] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:24.891116 19625 consensus_peers.cc:597] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:24.988471 19551 consensus_peers.cc:597] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:25.025789 18414 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 19533)
W20260709 13:21:25.029363 19551 consensus_peers.cc:597] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:25.117285 19398 maintenance_manager.cc:643] P 5aff2c187289436a846acba13255b21f: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.556s	user 0.113s	sys 0.030s Metrics: {"cfile_cache_miss":10,"cfile_cache_miss_bytes":29334,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":44061,"dirs.run_cpu_time_us":611,"dirs.run_wall_time_us":33809,"lbm_read_time_us":2773,"lbm_reads_lt_1ms":26,"lbm_write_time_us":1763,"lbm_writes_lt_1ms":12,"peak_mem_usage":584858,"reinsert_count":0,"thread_start_us":66237,"threads_started":2,"update_count":334}
I20260709 13:21:25.129299 19399 maintenance_manager.cc:419] P 5aff2c187289436a846acba13255b21f: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:21:25.175890 19398 maintenance_manager.cc:643] P 5aff2c187289436a846acba13255b21f: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260709 13:21:25.244721 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33295, user_credentials={real_user=slave}} blocked reactor thread for 114863us
W20260709 13:21:25.287737 20619 consensus_peers.cc:597] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:25.296574 19625 consensus_peers.cc:597] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:25.317493 19625 consensus_peers.cc:597] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:25.324388 19625 consensus_peers.cc:597] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:25.372323 19625 consensus_peers.cc:597] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:25.386934 19625 consensus_peers.cc:597] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:25.442075 19551 consensus_peers.cc:597] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:25.443045 19551 consensus_peers.cc:597] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:26.026428 18414 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 19533)
W20260709 13:21:26.041800 19682 debug-util.cc:398] Leaking SignalData structure 0x7b080035d600 after lost signal to thread 18417
W20260709 13:21:26.043412 19682 debug-util.cc:398] Leaking SignalData structure 0x7b0800195c20 after lost signal to thread 19444
W20260709 13:21:26.045177 19682 debug-util.cc:398] Leaking SignalData structure 0x7b08002c3180 after lost signal to thread 19611
W20260709 13:21:26.047171 19682 debug-util.cc:398] Leaking SignalData structure 0x7b08002a2340 after lost signal to thread 19685
W20260709 13:21:26.048868 19682 debug-util.cc:398] Leaking SignalData structure 0x7b08002d71e0 after lost signal to thread 20690
I20260709 13:21:26.342952 27804 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:26.360559 27804 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:25.443797 19551 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111) [suppressed 518 similar messages]
I20260709 13:21:26.388264 27804 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:26.372910 20619 consensus_peers.cc:597] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:26.434852 20619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 61996.6us
W20260709 13:21:26.463886 19551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 1.02004e+06us
W20260709 13:21:26.464545 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 92375.4us
I20260709 13:21:26.537675 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c8f93967114cebaf0e506a31814929" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:21:26.543926 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 49985.4us
W20260709 13:21:26.557642 19608 debug-util.cc:398] Leaking SignalData structure 0x7b0800170780 after lost signal to thread 18417
W20260709 13:21:26.559077 19608 debug-util.cc:398] Leaking SignalData structure 0x7b0800162b40 after lost signal to thread 19444
W20260709 13:21:26.559710 19625 consensus_peers.cc:597] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:26.560667 19608 debug-util.cc:398] Leaking SignalData structure 0x7b08000a19a0 after lost signal to thread 19611
W20260709 13:21:26.560763 19625 consensus_peers.cc:597] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:26.563700 19608 debug-util.cc:398] Leaking SignalData structure 0x7b08000a63e0 after lost signal to thread 19685
W20260709 13:21:26.565176 19608 debug-util.cc:398] Leaking SignalData structure 0x7b0800212e20 after lost signal to thread 20690
W20260709 13:21:26.597039 20619 consensus_peers.cc:597] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:26.610234 20619 consensus_peers.cc:597] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:26.617995 19551 consensus_peers.cc:597] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:26.632246 19625 leader_election.cc:336] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:26.632921 19625 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:21:26.642346 19551 consensus_peers.cc:597] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:26.649128 27817 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:26.650343 19625 consensus_peers.cc:597] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:26.650873 19625 consensus_peers.cc:597] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:26.652463 19625 consensus_peers.cc:597] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:26.728111 19551 consensus_peers.cc:597] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:26.731251 19625 consensus_peers.cc:597] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:26.763715 19625 consensus_peers.cc:597] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:26.791153 19551 consensus_peers.cc:597] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:26.847808 19625 consensus_peers.cc:597] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:26.873383 20619 consensus_peers.cc:597] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:26.910827 19625 consensus_peers.cc:597] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:26.911389 19625 consensus_peers.cc:597] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:26.911826 19625 consensus_peers.cc:597] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:26.929767 27804 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:26.930953 27817 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:26.931525 27817 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:26.932262 27821 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:21:26.934087 19551 consensus_peers.cc:597] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:26.934176 27817 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:26.936403 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e3a22b2b34405ebc267cd44391da92" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:26.930379 27804 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:26.932799 27821 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:26.983614 27821 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:26.986667 27804 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:26.998560 27776 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:26.999193 27776 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:27.000470 19585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed30843c798c4e38898b991bd1ecf1f6" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
I20260709 13:21:27.001169 27776 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:27.002156 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c677be72b048b0a9bc9b5c175d6738" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:21:27.006428 19625 leader_election.cc:336] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:27.011838 19627 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:27.013517 27816 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:27.019572 19625 leader_election.cc:336] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:27.020197 19625 leader_election.cc:336] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:27.027148 18414 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 19533)
I20260709 13:21:27.027091 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:27.028126 27817 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:21:27.030905 19625 consensus_peers.cc:597] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:27.031594 19625 leader_election.cc:336] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:27.045801 19627 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:27.047668 27823 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:27.049759 19578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04cb0adf2c4607846aba51fc4960f1" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "2cfd02601ea44976833027665abc93bf" is_pre_election: true
W20260709 13:21:27.056161 19551 consensus_peers.cc:597] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:27.085608 19627 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:27.088081 27817 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:21:27.100334 19625 consensus_peers.cc:597] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:27.178668 19551 consensus_peers.cc:597] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:27.186205 19625 consensus_peers.cc:597] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:27.467725 19551 consensus_peers.cc:597] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:27.470752 19625 consensus_peers.cc:597] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:27.479146 19625 consensus_peers.cc:597] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:27.522603 19551 consensus_peers.cc:597] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:27.610029 19551 consensus_peers.cc:597] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:27.724323 19551 consensus_peers.cc:597] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:27.781901 19625 consensus_peers.cc:597] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:27.785310 19625 consensus_peers.cc:597] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:27.832209 19551 consensus_peers.cc:597] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:27.834650 19625 consensus_peers.cc:597] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:27.965436 19625 consensus_peers.cc:597] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:27.975739 19551 consensus_peers.cc:597] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:27.976349 19551 consensus_peers.cc:597] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:27.976820 19551 consensus_peers.cc:597] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:28.027763 18414 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 19533)
W20260709 13:21:28.075608 19551 consensus_peers.cc:597] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:28.078547 20619 consensus_peers.cc:597] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:28.378507 19551 consensus_peers.cc:597] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:28.396271 19625 consensus_peers.cc:597] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:28.412002 19625 consensus_peers.cc:597] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:28.441589 19551 consensus_peers.cc:597] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:28.442346 19551 consensus_peers.cc:597] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:28.452188 19625 consensus_peers.cc:597] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:28.467988 19551 consensus_peers.cc:597] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:28.472575 19551 consensus_peers.cc:597] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:28.584565 19625 consensus_peers.cc:597] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:28.587951 19551 consensus_peers.cc:597] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:28.675458 19625 consensus_peers.cc:597] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:28.730746 19551 consensus_peers.cc:597] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:28.775992 19551 consensus_peers.cc:597] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:28.786554 19625 consensus_peers.cc:597] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:28.859373 20619 consensus_peers.cc:597] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:28.872866 19551 consensus_peers.cc:597] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:28.872965 19625 consensus_peers.cc:597] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:28.944725 20619 consensus_peers.cc:597] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:28.979790 19625 consensus_peers.cc:597] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:28.999579 20619 consensus_peers.cc:597] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:29.029063 18414 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 19533)
W20260709 13:21:29.162854 19441 debug-util.cc:398] Leaking SignalData structure 0x7b0800255c00 after lost signal to thread 18417
W20260709 13:21:29.164065 19441 debug-util.cc:398] Leaking SignalData structure 0x7b080029c0e0 after lost signal to thread 19444
W20260709 13:21:29.165588 19441 debug-util.cc:398] Leaking SignalData structure 0x7b080020a7e0 after lost signal to thread 19611
W20260709 13:21:29.166833 19441 debug-util.cc:398] Leaking SignalData structure 0x7b08001d80e0 after lost signal to thread 19685
W20260709 13:21:29.173839 19441 debug-util.cc:398] Leaking SignalData structure 0x7b08003166a0 after lost signal to thread 20690
W20260709 13:21:29.209195 19625 consensus_peers.cc:597] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:29.222596 19551 consensus_peers.cc:597] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:29.242354 19625 consensus_peers.cc:597] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:29.246359 19551 consensus_peers.cc:597] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:29.275044 19625 consensus_peers.cc:597] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:29.307631 19551 consensus_peers.cc:597] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:29.350039 19625 consensus_peers.cc:597] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:29.374598 19625 consensus_peers.cc:597] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:29.413897 19551 consensus_peers.cc:597] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:29.428440 20619 consensus_peers.cc:597] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:29.479095 19625 consensus_peers.cc:597] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:29.554901 19625 consensus_peers.cc:597] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:29.617807 19625 consensus_peers.cc:597] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:29.684491 19625 consensus_peers.cc:597] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:29.717736 19625 consensus_peers.cc:597] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:29.788928 19551 consensus_peers.cc:597] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:29.866786 19625 consensus_peers.cc:597] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:29.928997 19551 consensus_peers.cc:597] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:30.029575 18414 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 19533)
W20260709 13:21:30.040700 19625 consensus_peers.cc:597] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:30.108371 19551 consensus_peers.cc:597] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:30.176963 19625 consensus_peers.cc:597] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:30.207536 19551 consensus_peers.cc:597] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:30.299993 19551 consensus_peers.cc:597] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:30.300714 19551 consensus_peers.cc:597] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:30.307987 19625 consensus_peers.cc:597] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:30.336378 19625 consensus_peers.cc:597] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:30.375887 20631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:36471, user_credentials={real_user=slave}} blocked reactor thread for 57539.6us
W20260709 13:21:30.394726 19551 consensus_peers.cc:597] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:30.451004 19625 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111) [suppressed 455 similar messages]
W20260709 13:21:30.463491 20619 consensus_peers.cc:597] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:30.492734 19551 consensus_peers.cc:597] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:30.493409 19551 consensus_peers.cc:597] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:30.569118 19551 consensus_peers.cc:597] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:30.643824 19625 consensus_peers.cc:597] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:30.684959 19625 consensus_peers.cc:597] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:30.697986 19551 consensus_peers.cc:597] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:30.700426 19625 consensus_peers.cc:597] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:30.770674 19625 consensus_peers.cc:597] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:30.783357 19625 consensus_peers.cc:597] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:30.856014 19551 consensus_peers.cc:597] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:30.860555 19625 consensus_peers.cc:597] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:30.875667 19551 consensus_peers.cc:597] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:31.030563 18414 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 19533)
W20260709 13:21:31.035046 19551 consensus_peers.cc:597] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:31.077569 19551 consensus_peers.cc:597] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:31.086627 19551 consensus_peers.cc:597] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:31.092327 19551 consensus_peers.cc:597] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:31.100162 19625 consensus_peers.cc:597] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.179400 19625 consensus_peers.cc:597] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.346248 19625 consensus_peers.cc:597] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.365352 20619 consensus_peers.cc:597] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.410735 19625 consensus_peers.cc:597] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.426656 19551 consensus_peers.cc:597] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.450448 19551 consensus_peers.cc:597] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:31.530129 20619 consensus_peers.cc:597] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.649950 20619 consensus_peers.cc:597] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.686421 19551 consensus_peers.cc:597] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.711426 19551 consensus_peers.cc:597] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:31.756836 19625 consensus_peers.cc:597] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.757340 19625 consensus_peers.cc:597] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.832466 19625 consensus_peers.cc:597] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:31.835402 19625 consensus_peers.cc:597] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:31.836894 20619 consensus_peers.cc:597] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:31.912307 19625 consensus_peers.cc:597] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.944499 19551 consensus_peers.cc:597] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.975742 19551 consensus_peers.cc:597] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:32.066018 19625 consensus_peers.cc:597] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:32.087507 19551 consensus_peers.cc:597] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:32.123683 19625 consensus_peers.cc:597] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:32.224888 19625 consensus_peers.cc:597] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:32.269007 19625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:38645, user_credentials={real_user=slave}} blocked reactor thread for 44172.8us
W20260709 13:21:32.311579 19625 consensus_peers.cc:597] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:32.347800 19625 consensus_peers.cc:597] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:32.435660 19551 consensus_peers.cc:597] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:32.447930 19551 consensus_peers.cc:597] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:32.467751 19395 catalog_manager.cc:4755] TS d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7dd800f2a6b149a5b3ab177899d5f6bf: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:32.481110 18414 tablet_server.cc:196] TabletServer@127.17.251.129:0 shutdown complete.
W20260709 13:21:32.500604 19551 consensus_peers.cc:597] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:32.518656 19625 consensus_peers.cc:597] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:32.578447 19625 consensus_peers.cc:597] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:32.625767 19625 consensus_peers.cc:597] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:32.660218 19551 consensus_peers.cc:597] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:32.688118 18414 tablet_server.cc:179] TabletServer@127.17.251.130:0 shutting down...
W20260709 13:21:32.695197 19625 consensus_peers.cc:597] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:32.709770 19627 consensus_peers.cc:597] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:32.717079 20631 consensus_peers.cc:597] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:32.719079 19627 consensus_peers.cc:597] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:32.719646 19625 consensus_peers.cc:597] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:32.753810 19627 consensus_peers.cc:597] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:32.762923 19551 consensus_peers.cc:597] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:32.769160 19627 consensus_peers.cc:597] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:32.777375 19551 consensus_peers.cc:597] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:32.789443 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:32.791321 18414 tablet_replica.cc:333] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.792488 18414 raft_consensus.cc:2243] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:32.793129 19625 consensus_peers.cc:597] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:32.793874 18414 raft_consensus.cc:2272] T 4a2800ca4ded4227b5bb5e48f0572eaa P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.798101 18414 tablet_replica.cc:333] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.799173 18414 raft_consensus.cc:2243] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:32.799973 20631 consensus_peers.cc:597] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:32.800143 18414 raft_consensus.cc:2272] T 46d39387ed0c44978cdb2b736f9c1ccf P 2cfd02601ea44976833027665abc93bf [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.803210 18414 tablet_replica.cc:333] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.804184 18414 raft_consensus.cc:2243] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:32.805084 18414 raft_consensus.cc:2272] T b91cdbdc59c54db98e6692ac65df1b3b P 2cfd02601ea44976833027665abc93bf [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.808547 18414 tablet_replica.cc:333] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.809566 18414 raft_consensus.cc:2243] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:21:32.811076 18414 raft_consensus.cc:2272] T ef314c9487594fb2a581796b86eb958e P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.815717 18414 tablet_replica.cc:333] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
W20260709 13:21:32.816838 19551 consensus_peers.cc:597] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:32.817643 18414 raft_consensus.cc:2243] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:21:32.819136 18414 raft_consensus.cc:2272] T 167513761bee46908eb48f5cad0c0a7f P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.822207 18414 tablet_replica.cc:333] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.823167 18414 raft_consensus.cc:2243] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:32.824579 18414 raft_consensus.cc:2272] T 2c83387a56274f46bd5795b3376741c9 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.827821 18414 tablet_replica.cc:333] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.828761 18414 raft_consensus.cc:2243] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Raft consensus shutting down.
W20260709 13:21:32.829041 19627 consensus_peers.cc:597] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:32.830267 18414 raft_consensus.cc:2272] T 8c3672e496ae4c7ab924bee7e50ecf70 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.833674 18414 tablet_replica.cc:333] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.834631 18414 raft_consensus.cc:2243] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:32.835443 18414 raft_consensus.cc:2272] T b0ac31068f224487a102689bcb76cc21 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.838443 18414 tablet_replica.cc:333] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.839345 18414 raft_consensus.cc:2243] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:32.840030 18414 raft_consensus.cc:2272] T 7bbfe9942c714d1295ec8011ab27a574 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.849015 18414 tablet_replica.cc:333] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.849942 18414 raft_consensus.cc:2243] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:32.851090 18414 raft_consensus.cc:2272] T 52f31f753f7c4508a56dd7bb7648615b P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.860809 18414 tablet_replica.cc:333] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.861712 18414 raft_consensus.cc:2243] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:21:32.863229 18414 raft_consensus.cc:2272] T 6b53fc6e49df441b959a20ab5dd387dd P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.876410 18414 tablet_replica.cc:333] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.877341 18414 raft_consensus.cc:2243] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:32.878252 18414 raft_consensus.cc:2272] T dff318d429f74439a25e68f54950fb36 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:32.880173 20631 consensus_peers.cc:597] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:32.882596 19627 consensus_peers.cc:597] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:32.883018 18414 tablet_replica.cc:333] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.885248 18414 raft_consensus.cc:2243] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:21:32.886402 18414 raft_consensus.cc:2272] T daee81c3dc8c4dc4b735d1643829fe76 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.889379 18414 tablet_replica.cc:333] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.891398 18414 raft_consensus.cc:2243] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:32.892318 18414 raft_consensus.cc:2272] T 9dd2e208ec7f47bb80deb85a455f2b16 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.895013 18414 tablet_replica.cc:333] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.895830 18414 raft_consensus.cc:2243] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:32.896822 18414 raft_consensus.cc:2272] T 0c4c20e4aab6496cb949c1fad0dbcc66 P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.899767 18414 tablet_replica.cc:333] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.900630 18414 raft_consensus.cc:2243] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:32.901871 18414 raft_consensus.cc:2272] T c47cfd5bbfb1407c879f892f35cc1502 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.904947 18414 tablet_replica.cc:333] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
W20260709 13:21:32.905253 19625 consensus_peers.cc:597] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:32.905947 18414 raft_consensus.cc:2243] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:32.907305 18414 raft_consensus.cc:2272] T f516f797b78848a5825878b37c422f07 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:32.908341 19627 consensus_peers.cc:597] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:32.910682 18414 tablet_replica.cc:333] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.911789 18414 raft_consensus.cc:2243] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:32.912724 18414 raft_consensus.cc:2272] T a944fb0aa87a4a33a0dc2975f4a306dd P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.915944 18414 tablet_replica.cc:333] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.916863 18414 raft_consensus.cc:2243] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:32.918195 18414 raft_consensus.cc:2272] T 313f9daf7de442378ef2abf1f4a4e665 P 2cfd02601ea44976833027665abc93bf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.921446 18414 tablet_replica.cc:333] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.922399 18414 raft_consensus.cc:2243] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Raft consensus shutting down.
W20260709 13:21:32.923463 19627 consensus_peers.cc:597] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:32.923568 18414 raft_consensus.cc:2272] T 0e5f26f686634d4ab47c02b7a00ba584 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.926674 18414 tablet_replica.cc:333] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.927618 18414 raft_consensus.cc:2243] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:32.928190 18414 raft_consensus.cc:2272] T 6f949ff511e844749624dedf436dff50 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.931341 18414 tablet_replica.cc:333] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.932221 18414 raft_consensus.cc:2243] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:32.933036 18414 raft_consensus.cc:2272] T 5456af6e274a4116a91b4bc0e326ca5f P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.936367 18414 tablet_replica.cc:333] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.937361 18414 raft_consensus.cc:2243] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:21:32.938642 18414 raft_consensus.cc:2272] T 1a54cd81e4a54059a10f1f9e291c49d0 P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:32.948625 19627 consensus_peers.cc:597] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:32.949681 18414 tablet_replica.cc:333] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.950660 18414 raft_consensus.cc:2243] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:32.951480 18414 raft_consensus.cc:2272] T 911988cab3914bb19f77d4d3e24a31f4 P 2cfd02601ea44976833027665abc93bf [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:32.952582 19627 consensus_peers.cc:597] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:32.953284 19627 consensus_peers.cc:597] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:32.954483 18414 tablet_replica.cc:333] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.955500 18414 raft_consensus.cc:2243] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:21:32.956653 18414 raft_consensus.cc:2272] T d073a31754234c93b24b8ffbc9f8fb3b P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.959755 18414 tablet_replica.cc:333] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.960695 18414 raft_consensus.cc:2243] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:32.961771 18414 raft_consensus.cc:2272] T 9116dce1321e475194eeaa1705fd6ac0 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.966879 18414 tablet_replica.cc:333] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.967785 18414 raft_consensus.cc:2243] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:32.971493 19627 consensus_peers.cc:597] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:32.972254 18414 raft_consensus.cc:2272] T 9c9a4266bc2b4d15ac7862c48149bb66 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:32.974462 19625 consensus_peers.cc:597] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:32.975181 18414 tablet_replica.cc:333] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.976382 18414 raft_consensus.cc:2243] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:32.977674 18414 raft_consensus.cc:2272] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.980526 18414 tablet_replica.cc:333] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.981382 18414 raft_consensus.cc:2243] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:32.982501 18414 raft_consensus.cc:2272] T e6c8f93967114cebaf0e506a31814929 P 2cfd02601ea44976833027665abc93bf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.985093 18414 tablet_replica.cc:333] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.985993 18414 raft_consensus.cc:2243] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:32.986732 18414 raft_consensus.cc:2272] T db4589d6497c49308384eacc43241a32 P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.990043 18414 tablet_replica.cc:333] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.990929 18414 raft_consensus.cc:2243] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:32.991568 18414 raft_consensus.cc:2272] T 3bb3362944f5459e982bd278a6a4c561 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:32.994426 18414 tablet_replica.cc:333] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:32.995643 18414 raft_consensus.cc:2243] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:32.996647 18414 raft_consensus.cc:2272] T 2c1d08b75392466298c02ea9d4d765dd P 2cfd02601ea44976833027665abc93bf [term 31 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:32.999420 19627 consensus_peers.cc:597] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:32.999732 18414 tablet_replica.cc:333] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.002235 18414 raft_consensus.cc:2243] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.003644 18414 raft_consensus.cc:2272] T ed30843c798c4e38898b991bd1ecf1f6 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.007066 18414 tablet_replica.cc:333] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.008311 18414 raft_consensus.cc:2243] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.009796 18414 raft_consensus.cc:2272] T 80abeb366b70484a8b8df5a0575643e7 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.012717 18414 tablet_replica.cc:333] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.013710 18414 raft_consensus.cc:2243] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.014430 18414 raft_consensus.cc:2272] T b28ba556d85a4d61bf15492b88b280d9 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.017253 18414 tablet_replica.cc:333] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.018497 18414 raft_consensus.cc:2243] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.020040 18414 raft_consensus.cc:2272] T 61d4aaf446674d6ab6bbc9a3aae5af92 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:33.022904 20631 consensus_peers.cc:597] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.023109 18414 tablet_replica.cc:333] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.024291 18414 raft_consensus.cc:2243] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.025871 18414 raft_consensus.cc:2272] T e2c677be72b048b0a9bc9b5c175d6738 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.029120 18414 tablet_replica.cc:333] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.029989 18414 raft_consensus.cc:2243] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.031273 18414 raft_consensus.cc:2272] T ea04cb0adf2c4607846aba51fc4960f1 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.034448 18414 tablet_replica.cc:333] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.035336 18414 raft_consensus.cc:2243] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.036435 18414 raft_consensus.cc:2272] T 7dd800f2a6b149a5b3ab177899d5f6bf P 2cfd02601ea44976833027665abc93bf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.040171 18414 tablet_replica.cc:333] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.041039 18414 raft_consensus.cc:2243] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.042104 18414 raft_consensus.cc:2272] T 556595dcbb8644d2a073cbc04a679832 P 2cfd02601ea44976833027665abc93bf [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:33.043012 19627 consensus_peers.cc:597] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.043803 20619 consensus_peers.cc:597] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:33.045264 18414 tablet_replica.cc:333] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.046269 18414 raft_consensus.cc:2243] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.047482 18414 raft_consensus.cc:2272] T deb2be7d455242c08b014289ea6b1347 P 2cfd02601ea44976833027665abc93bf [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.051112 18414 tablet_replica.cc:333] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.052019 18414 raft_consensus.cc:2243] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.052983 18414 raft_consensus.cc:2272] T d9242425d3a744c3b8742c30995129f4 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:33.055276 19627 consensus_peers.cc:597] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.056740 18414 tablet_replica.cc:333] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.058128 18414 raft_consensus.cc:2243] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.059016 18414 raft_consensus.cc:2272] T 88c0e3535ed14c77bc069b999fbb18bc P 2cfd02601ea44976833027665abc93bf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.062430 18414 tablet_replica.cc:333] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
W20260709 13:21:33.062381 19627 consensus_peers.cc:597] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.063541 18414 raft_consensus.cc:2243] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.065593 18414 raft_consensus.cc:2272] T e40c25a076fd424281aab1a64f5a1498 P 2cfd02601ea44976833027665abc93bf [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.069684 18414 tablet_replica.cc:333] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.070572 18414 raft_consensus.cc:2243] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.073179 18414 raft_consensus.cc:2272] T 56b49831037b480f8eda4069cf653878 P 2cfd02601ea44976833027665abc93bf [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:33.073827 19627 consensus_peers.cc:597] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.076149 18414 tablet_replica.cc:333] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.077109 18414 raft_consensus.cc:2243] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.077811 18414 raft_consensus.cc:2272] T 386001789c264ef8b0ac13cf938a8390 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.080675 18414 tablet_replica.cc:333] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.081401 18414 raft_consensus.cc:2243] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.083168 18414 raft_consensus.cc:2272] T 38e3a22b2b34405ebc267cd44391da92 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.086241 18414 tablet_replica.cc:333] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.087165 18414 raft_consensus.cc:2243] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.088419 18414 raft_consensus.cc:2272] T d5f9fbdbd620463b9c81f3c5c92b40f4 P 2cfd02601ea44976833027665abc93bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.091372 18414 tablet_replica.cc:333] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.092123 18414 raft_consensus.cc:2243] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.095165 18414 raft_consensus.cc:2272] T 9807bdebbbd742009e4a329706a92790 P 2cfd02601ea44976833027665abc93bf [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:33.095415 19627 consensus_peers.cc:597] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.098395 18414 tablet_replica.cc:333] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.100495 18414 raft_consensus.cc:2243] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 28 LEADER]: Raft consensus shutting down.
W20260709 13:21:33.100777 19627 consensus_peers.cc:597] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.101758 18414 raft_consensus.cc:2272] T 03f9956d44294112accb74ea1a18065b P 2cfd02601ea44976833027665abc93bf [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:33.103654 19625 consensus_peers.cc:597] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:33.106585 18414 tablet_replica.cc:333] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.107514 18414 raft_consensus.cc:2243] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.108165 18414 raft_consensus.cc:2272] T 904d960364024273a420111ec6233e84 P 2cfd02601ea44976833027665abc93bf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.111006 18414 tablet_replica.cc:333] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.111706 18414 raft_consensus.cc:2243] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.112635 18414 raft_consensus.cc:2272] T c656f1e9148d4056945c02ce537d8b12 P 2cfd02601ea44976833027665abc93bf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.115409 18414 tablet_replica.cc:333] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf: stopping tablet replica
I20260709 13:21:33.116112 18414 raft_consensus.cc:2243] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.117415 18414 raft_consensus.cc:2272] T df137c733a0a470c9e35fa2b09c6c619 P 2cfd02601ea44976833027665abc93bf [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:33.122779 19627 consensus_peers.cc:597] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.156983 19627 consensus_peers.cc:597] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.203229 19627 consensus_peers.cc:597] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.203828 19627 consensus_peers.cc:597] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.209275 19625 consensus_peers.cc:597] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:33.239025 20631 consensus_peers.cc:597] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.259220 19625 consensus_peers.cc:597] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:33.456269 19625 consensus_peers.cc:597] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:33.531805 19625 consensus_peers.cc:597] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:33.612197 19625 consensus_peers.cc:597] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:33.946753 19625 consensus_peers.cc:597] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:33.952827 27850 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:33.960119 27850 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:33.963665 27850 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:33.975824 20631 leader_election.cc:336] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:33.992817 27838 raft_consensus.cc:493] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:33.993817 27838 raft_consensus.cc:515] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:33.997035 27838 leader_election.cc:290] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:34.002009 27838 raft_consensus.cc:493] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.002748 27838 raft_consensus.cc:515] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:34.005391 27838 leader_election.cc:290] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:34.005646 19625 leader_election.cc:336] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:34.014385 27851 raft_consensus.cc:493] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.015383 27851 raft_consensus.cc:515] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:34.021320 19625 leader_election.cc:336] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:34.034512 27851 leader_election.cc:290] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:34.034711 20619 consensus_peers.cc:597] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:34.035370 20619 leader_election.cc:336] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:34.035790 20619 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:21:34.036851 20619 consensus_peers.cc:597] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:34.039017 27841 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:21:34.052894 19625 leader_election.cc:336] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:34.059156 20619 consensus_peers.cc:597] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:34.064586 27850 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.065395 27850 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:34.067312 27856 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.068324 27856 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:34.068917 27850 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:34.069211 27851 raft_consensus.cc:493] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.074244 27854 raft_consensus.cc:493] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.075089 27854 raft_consensus.cc:515] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:34.074862 27851 raft_consensus.cc:515] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
W20260709 13:21:34.073643 20619 leader_election.cc:336] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:34.077621 20631 leader_election.cc:336] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.078214 27854 leader_election.cc:290] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:34.079990 20631 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.081427 27850 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:34.081707 27856 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
W20260709 13:21:34.084237 19625 leader_election.cc:336] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:34.090694 27851 leader_election.cc:290] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:34.106388 19625 leader_election.cc:336] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:34.106757 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:21:34.119374 19627 leader_election.cc:336] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.119910 19627 leader_election.cc:304] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.120980 27846 raft_consensus.cc:2749] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:34.121021 19627 leader_election.cc:336] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.121744 19627 leader_election.cc:304] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.122552 27846 raft_consensus.cc:2749] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:34.123095 19627 leader_election.cc:336] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.123656 19627 leader_election.cc:304] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.124436 27846 raft_consensus.cc:2749] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:21:34.125002 19627 leader_election.cc:336] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.125507 19627 leader_election.cc:304] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.126353 27846 raft_consensus.cc:2749] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:21:34.126616 19627 leader_election.cc:336] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.127205 19627 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:21:34.127969 27846 raft_consensus.cc:2749] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:21:34.128132 19627 leader_election.cc:336] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.128702 19627 leader_election.cc:304] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.129632 27846 raft_consensus.cc:2749] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:34.132500 27856 raft_consensus.cc:493] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.133271 27856 raft_consensus.cc:515] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:34.135413 27851 raft_consensus.cc:493] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.136229 27851 raft_consensus.cc:515] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:34.137094 27856 leader_election.cc:290] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:34.138551 27851 leader_election.cc:290] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:34.145133 27846 raft_consensus.cc:493] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:21:34.145509 19627 leader_election.cc:336] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
W20260709 13:21:34.146274 19627 leader_election.cc:336] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.145963 27846 raft_consensus.cc:515] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:34.152652 27846 leader_election.cc:290] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:34.157696 19625 leader_election.cc:336] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:34.158347 19625 leader_election.cc:304] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.160080 27851 raft_consensus.cc:493] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.160907 27851 raft_consensus.cc:515] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:34.161859 27856 raft_consensus.cc:2749] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:34.163311 27851 leader_election.cc:290] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:34.164471 19627 leader_election.cc:336] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
W20260709 13:21:34.164499 19625 consensus_peers.cc:597] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:34.165824 19625 leader_election.cc:336] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:34.166388 19625 leader_election.cc:304] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.168567 27856 raft_consensus.cc:2749] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:34.171805 19627 leader_election.cc:336] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
W20260709 13:21:34.178990 19625 leader_election.cc:336] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:34.179653 19625 leader_election.cc:304] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.180517 27856 raft_consensus.cc:2749] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:34.187846 27856 raft_consensus.cc:493] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.188642 27856 raft_consensus.cc:515] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:34.191345 27856 leader_election.cc:290] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:34.188611 19625 leader_election.cc:336] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:34.192451 19625 leader_election.cc:304] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.193284 27856 raft_consensus.cc:2749] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:21:34.200886 19627 leader_election.cc:336] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
W20260709 13:21:34.201680 19625 leader_election.cc:336] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:34.202195 19625 leader_election.cc:304] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.203747 27856 raft_consensus.cc:2749] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:34.216446 27856 raft_consensus.cc:493] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.217223 27856 raft_consensus.cc:515] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:34.219707 27856 leader_election.cc:290] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:34.225380 19625 leader_election.cc:336] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:34.226339 19627 leader_election.cc:336] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.226811 19627 leader_election.cc:304] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.227881 27856 raft_consensus.cc:2749] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:34.231948 27856 raft_consensus.cc:493] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.232662 27856 raft_consensus.cc:515] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:34.234948 27856 leader_election.cc:290] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:34.240821 19625 leader_election.cc:336] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:34.242470 19627 leader_election.cc:336] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.243657 19627 leader_election.cc:304] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.244472 27846 raft_consensus.cc:2749] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:34.243113 27856 raft_consensus.cc:493] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.245385 27856 raft_consensus.cc:515] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:34.247681 27856 leader_election.cc:290] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:34.254963 27856 raft_consensus.cc:493] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.255645 27856 raft_consensus.cc:515] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:34.257501 27846 raft_consensus.cc:493] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.257752 27856 leader_election.cc:290] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:34.258255 27846 raft_consensus.cc:515] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:34.260437 27846 leader_election.cc:290] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:34.263697 19625 leader_election.cc:336] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:34.265367 19627 leader_election.cc:336] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.265825 19627 leader_election.cc:304] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.266526 27846 raft_consensus.cc:2749] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:34.268935 19625 leader_election.cc:336] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:34.269479 19625 leader_election.cc:336] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:34.272861 19627 leader_election.cc:336] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.273279 19627 leader_election.cc:304] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.274071 27846 raft_consensus.cc:2749] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:21:34.276739 19627 leader_election.cc:336] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.277207 19627 leader_election.cc:304] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.277956 27846 raft_consensus.cc:2749] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:34.284696 27846 raft_consensus.cc:493] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.285326 27846 raft_consensus.cc:515] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:34.287470 27846 leader_election.cc:290] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:34.291749 19625 leader_election.cc:336] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:34.293293 19627 leader_election.cc:336] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.293721 19627 leader_election.cc:304] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.294548 27846 raft_consensus.cc:2749] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:21:34.302639 27856 raft_consensus.cc:493] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.303254 27856 raft_consensus.cc:515] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:34.305217 27856 leader_election.cc:290] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:34.310648 27841 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
W20260709 13:21:34.311599 19625 leader_election.cc:336] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:34.311628 27841 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:21:34.314502 19627 leader_election.cc:336] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.315071 19627 leader_election.cc:304] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.316695 27856 raft_consensus.cc:2749] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:34.316776 27853 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.317704 27853 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:34.319249 27841 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:34.319626 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
W20260709 13:21:34.320056 20631 leader_election.cc:336] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.320155 27853 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:34.320325 19654 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 26.
I20260709 13:21:34.320070 27856 raft_consensus.cc:493] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.321921 20619 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:21:34.322268 27856 raft_consensus.cc:515] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:34.323944 27853 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 13:21:34.325228 20619 leader_election.cc:336] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:34.327301 20631 leader_election.cc:336] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.327714 20631 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
W20260709 13:21:34.331591 19625 leader_election.cc:336] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:34.333179 27841 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:34.335610 27853 raft_consensus.cc:493] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.336134 27853 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:21:34.338094 19627 leader_election.cc:336] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.338550 19627 leader_election.cc:304] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.339354 27846 raft_consensus.cc:2749] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:34.340723 27856 leader_election.cc:290] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:34.347237 27853 raft_consensus.cc:515] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:34.350612 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd800f2a6b149a5b3ab177899d5f6bf" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:34.351222 19654 raft_consensus.cc:3060] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:34.354519 27853 leader_election.cc:290] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 27 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:21:34.356993 20631 leader_election.cc:336] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.360296 19654 raft_consensus.cc:2468] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 27.
I20260709 13:21:34.361933 20619 leader_election.cc:304] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:21:34.362706 27853 raft_consensus.cc:2804] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:21:34.363260 27853 raft_consensus.cc:697] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [term 27 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:21:34.364125 27856 raft_consensus.cc:493] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.364751 27856 raft_consensus.cc:515] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:34.364794 27853 consensus_queue.cc:237] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:34.365399 27846 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.366063 27846 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:34.366922 27856 leader_election.cc:290] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:34.368131 27846 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132:40615)
I20260709 13:21:34.369455 20665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "e19c80e9149b4b8d88ae13bde8e43864" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "068c03c9dcc848e6bf909131b1f83065" is_pre_election: true
W20260709 13:21:34.376160 19627 leader_election.cc:336] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
W20260709 13:21:34.377377 19627 leader_election.cc:336] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.380075 19627 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 068c03c9dcc848e6bf909131b1f83065, 2cfd02601ea44976833027665abc93bf
I20260709 13:21:34.381387 27846 raft_consensus.cc:2749] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:21:34.380632 19625 leader_election.cc:336] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:34.382848 19625 leader_election.cc:304] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.383666 27846 raft_consensus.cc:2749] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:34.392767 27850 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.393569 27850 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:34.395742 27850 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
I20260709 13:21:34.396927 19408 catalog_manager.cc:5697] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 26 to 27, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 27 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:34.401965 20631 leader_election.cc:336] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.406947 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864" is_pre_election: true
I20260709 13:21:34.407693 19654 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 27.
I20260709 13:21:34.412097 20619 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:21:34.416651 27841 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:21:34.417109 27841 raft_consensus.cc:493] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.417493 27841 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:21:34.427094 27841 raft_consensus.cc:515] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:21:34.439049 20631 leader_election.cc:336] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.458143 27841 leader_election.cc:290] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 election: Requested vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:21:34.459774 19625 consensus_peers.cc:597] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:34.462034 19654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daee81c3dc8c4dc4b735d1643829fe76" candidate_uuid: "068c03c9dcc848e6bf909131b1f83065" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "e19c80e9149b4b8d88ae13bde8e43864"
I20260709 13:21:34.462649 19654 raft_consensus.cc:3060] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:21:34.463856 27846 raft_consensus.cc:493] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:34.464428 27846 raft_consensus.cc:515] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } }
I20260709 13:21:34.466699 27846 leader_election.cc:290] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:34.470490 19654 raft_consensus.cc:2468] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068c03c9dcc848e6bf909131b1f83065 in term 28.
I20260709 13:21:34.471916 20619 leader_election.cc:304] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065, e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf
I20260709 13:21:34.472788 27841 raft_consensus.cc:2804] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:21:34.473290 27841 raft_consensus.cc:697] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [term 28 LEADER]: Becoming Leader. State: Replica: 068c03c9dcc848e6bf909131b1f83065, State: Running, Role: LEADER
I20260709 13:21:34.474357 27841 consensus_queue.cc:237] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
W20260709 13:21:34.476899 19625 leader_election.cc:336] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
W20260709 13:21:34.479522 20619 consensus_peers.cc:597] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:34.482199 19627 leader_election.cc:336] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:34.483963 19627 leader_election.cc:304] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c80e9149b4b8d88ae13bde8e43864; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:34.484901 27856 raft_consensus.cc:2749] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:34.528965 19410 catalog_manager.cc:5697] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 reported cstate change: term changed from 27 to 28, leader changed from 2cfd02601ea44976833027665abc93bf (127.17.251.130) to 068c03c9dcc848e6bf909131b1f83065 (127.17.251.132). New cstate: current_term: 28 leader_uuid: "068c03c9dcc848e6bf909131b1f83065" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:34.583213 19625 consensus_peers.cc:597] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:34.613178 19625 consensus_peers.cc:597] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:34.651809 19625 consensus_peers.cc:597] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:34.662338 19625 consensus_peers.cc:597] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:34.788154 19625 consensus_peers.cc:597] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:34.805055 20631 consensus_peers.cc:597] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:34.841125 19654 raft_consensus.cc:1275] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 13:21:34.842650 27841 consensus_queue.cc:1048] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:21:34.849028 18414 tablet_server.cc:196] TabletServer@127.17.251.130:0 shutdown complete.
I20260709 13:21:34.958134 19655 raft_consensus.cc:1275] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Refusing update from remote peer 068c03c9dcc848e6bf909131b1f83065: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 13:21:34.960651 27868 consensus_queue.cc:1048] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 13:21:34.979702 19627 consensus_peers.cc:597] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:34.984145 20631 consensus_peers.cc:597] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.018700 19625 consensus_peers.cc:597] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:35.019856 20687 debug-util.cc:398] Leaking SignalData structure 0x7b0800083b20 after lost signal to thread 18417
W20260709 13:21:35.021015 20687 debug-util.cc:398] Leaking SignalData structure 0x7b08000ac820 after lost signal to thread 19444
W20260709 13:21:35.022554 20687 debug-util.cc:398] Leaking SignalData structure 0x7b08002df240 after lost signal to thread 19685
W20260709 13:21:35.024446 20687 debug-util.cc:398] Leaking SignalData structure 0x7b0800277560 after lost signal to thread 20690
I20260709 13:21:35.088073 18414 tablet_server.cc:179] TabletServer@127.17.251.131:0 shutting down...
W20260709 13:21:35.091782 19625 consensus_peers.cc:597] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:35.099874 19625 consensus_peers.cc:597] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:35.136668 19625 consensus_peers.cc:597] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:35.150743 19625 consensus_peers.cc:597] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:35.165802 19625 consensus_peers.cc:597] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:35.166585 20631 consensus_peers.cc:597] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:35.199950 20619 consensus_peers.cc:597] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 -> Peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Couldn't send request to peer e19c80e9149b4b8d88ae13bde8e43864. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.206092 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:35.207301 18414 tablet_replica.cc:333] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.208670 18414 raft_consensus.cc:2243] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.209551 18414 raft_consensus.cc:2272] T 46d39387ed0c44978cdb2b736f9c1ccf P e19c80e9149b4b8d88ae13bde8e43864 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:35.212428 19625 consensus_peers.cc:597] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:35.212894 18414 tablet_replica.cc:333] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.214982 18414 raft_consensus.cc:2243] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.217902 18414 raft_consensus.cc:2272] T 4a2800ca4ded4227b5bb5e48f0572eaa P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.221084 18414 tablet_replica.cc:333] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.222273 18414 raft_consensus.cc:2243] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.223404 18414 raft_consensus.cc:2272] T 6c89dfa6a61346148bb8520ed4d0ecd9 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.225878 18414 tablet_replica.cc:333] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.226578 18414 raft_consensus.cc:2243] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.228341 18414 raft_consensus.cc:2272] T ef314c9487594fb2a581796b86eb958e P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.231742 18414 tablet_replica.cc:333] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.232676 18414 raft_consensus.cc:2243] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.233507 18414 raft_consensus.cc:2272] T 1a8709264e614e01ad899bfabc6c04f7 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.235986 18414 tablet_replica.cc:333] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.236616 18414 raft_consensus.cc:2243] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.237175 18414 raft_consensus.cc:2272] T 167513761bee46908eb48f5cad0c0a7f P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.239502 18414 tablet_replica.cc:333] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.240271 18414 raft_consensus.cc:2243] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 33 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.241510 18414 raft_consensus.cc:2272] T b91cdbdc59c54db98e6692ac65df1b3b P e19c80e9149b4b8d88ae13bde8e43864 [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.244831 18414 tablet_replica.cc:333] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.245765 18414 raft_consensus.cc:2243] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.247155 18414 raft_consensus.cc:2272] T 7bbfe9942c714d1295ec8011ab27a574 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:35.248383 19627 consensus_peers.cc:597] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:35.250222 18414 tablet_replica.cc:333] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.251016 18414 raft_consensus.cc:2243] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.252295 18414 raft_consensus.cc:2272] T b0ac31068f224487a102689bcb76cc21 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.254951 18414 tablet_replica.cc:333] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.255566 18414 raft_consensus.cc:2243] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.256656 18414 raft_consensus.cc:2272] T 52f31f753f7c4508a56dd7bb7648615b P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.259570 18414 tablet_replica.cc:333] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.260427 18414 raft_consensus.cc:2243] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.261703 18414 raft_consensus.cc:2272] T dff318d429f74439a25e68f54950fb36 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.264638 18414 tablet_replica.cc:333] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.265491 18414 raft_consensus.cc:2243] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.266186 18414 raft_consensus.cc:2272] T f516f797b78848a5825878b37c422f07 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.269125 18414 tablet_replica.cc:333] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.269976 18414 raft_consensus.cc:2243] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.270630 18414 raft_consensus.cc:2272] T c47cfd5bbfb1407c879f892f35cc1502 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.273432 18414 tablet_replica.cc:333] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.274305 18414 raft_consensus.cc:2243] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.274955 18414 raft_consensus.cc:2272] T 6b53fc6e49df441b959a20ab5dd387dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.277904 18414 tablet_replica.cc:333] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.278755 18414 raft_consensus.cc:2243] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.280042 18414 raft_consensus.cc:2272] T daee81c3dc8c4dc4b735d1643829fe76 P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.283134 18414 tablet_replica.cc:333] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.283974 18414 raft_consensus.cc:2243] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.284614 18414 raft_consensus.cc:2272] T 5ff6b515c02d4d26bc1bc2a7b2a9a794 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.287477 18414 tablet_replica.cc:333] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.288265 18414 raft_consensus.cc:2243] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.288880 18414 raft_consensus.cc:2272] T e6c8f93967114cebaf0e506a31814929 P e19c80e9149b4b8d88ae13bde8e43864 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.291083 18414 tablet_replica.cc:333] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.291692 18414 raft_consensus.cc:2243] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.292236 18414 raft_consensus.cc:2272] T 6eb38e2ac9064d3286fe2f20aeb2381c P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.294409 18414 tablet_replica.cc:333] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.295058 18414 raft_consensus.cc:2243] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.296164 18414 raft_consensus.cc:2272] T db4589d6497c49308384eacc43241a32 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.298422 18414 tablet_replica.cc:333] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.299080 18414 raft_consensus.cc:2243] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.300117 18414 raft_consensus.cc:2272] T 3bb3362944f5459e982bd278a6a4c561 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.302433 18414 tablet_replica.cc:333] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.302989 18414 raft_consensus.cc:2243] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.303977 18414 raft_consensus.cc:2272] T a944fb0aa87a4a33a0dc2975f4a306dd P e19c80e9149b4b8d88ae13bde8e43864 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.306080 18414 tablet_replica.cc:333] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.306634 18414 raft_consensus.cc:2243] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.307277 18414 raft_consensus.cc:2272] T 313f9daf7de442378ef2abf1f4a4e665 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.309419 18414 tablet_replica.cc:333] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.310261 18414 raft_consensus.cc:2243] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.311515 18414 raft_consensus.cc:2272] T 9dd2e208ec7f47bb80deb85a455f2b16 P e19c80e9149b4b8d88ae13bde8e43864 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.314189 18414 tablet_replica.cc:333] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.314940 18414 raft_consensus.cc:2243] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.316304 18414 raft_consensus.cc:2272] T 0c4c20e4aab6496cb949c1fad0dbcc66 P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:35.316686 20619 consensus_peers.cc:597] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 -> Peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Couldn't send request to peer e19c80e9149b4b8d88ae13bde8e43864. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.319183 18414 tablet_replica.cc:333] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.320055 18414 raft_consensus.cc:2243] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.321535 18414 raft_consensus.cc:2272] T 6f949ff511e844749624dedf436dff50 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.324290 18414 tablet_replica.cc:333] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.325048 18414 raft_consensus.cc:2243] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.326373 18414 raft_consensus.cc:2272] T 5456af6e274a4116a91b4bc0e326ca5f P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:35.328580 19627 consensus_peers.cc:597] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:35.329077 18414 tablet_replica.cc:333] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.329962 18414 raft_consensus.cc:2243] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.330966 18414 raft_consensus.cc:2272] T d073a31754234c93b24b8ffbc9f8fb3b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.333295 18414 tablet_replica.cc:333] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.333961 18414 raft_consensus.cc:2243] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.334623 18414 raft_consensus.cc:2272] T 1a54cd81e4a54059a10f1f9e291c49d0 P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.336956 18414 tablet_replica.cc:333] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.337783 18414 raft_consensus.cc:2243] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.339085 18414 raft_consensus.cc:2272] T 9116dce1321e475194eeaa1705fd6ac0 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.341491 18414 tablet_replica.cc:333] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.342101 18414 raft_consensus.cc:2243] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.343156 18414 raft_consensus.cc:2272] T 9c9a4266bc2b4d15ac7862c48149bb66 P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.346047 18414 tablet_replica.cc:333] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.346824 18414 raft_consensus.cc:2243] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.348122 18414 raft_consensus.cc:2272] T 61d4aaf446674d6ab6bbc9a3aae5af92 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.350885 18414 tablet_replica.cc:333] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.351629 18414 raft_consensus.cc:2243] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.352341 18414 raft_consensus.cc:2272] T e2c677be72b048b0a9bc9b5c175d6738 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:35.353098 19627 consensus_peers.cc:597] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:35.355070 18414 tablet_replica.cc:333] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.355693 18414 raft_consensus.cc:2243] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.356305 18414 raft_consensus.cc:2272] T ea04cb0adf2c4607846aba51fc4960f1 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.358403 18414 tablet_replica.cc:333] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.358968 18414 raft_consensus.cc:2243] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.359468 18414 raft_consensus.cc:2272] T 556595dcbb8644d2a073cbc04a679832 P e19c80e9149b4b8d88ae13bde8e43864 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.361366 18414 tablet_replica.cc:333] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.361943 18414 raft_consensus.cc:2243] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.363222 18414 raft_consensus.cc:2272] T 7dd800f2a6b149a5b3ab177899d5f6bf P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.374032 18414 tablet_replica.cc:333] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.374858 18414 raft_consensus.cc:2243] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.375566 18414 raft_consensus.cc:2272] T 38e3a22b2b34405ebc267cd44391da92 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.377476 18414 tablet_replica.cc:333] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.378036 18414 raft_consensus.cc:2243] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.378692 18414 raft_consensus.cc:2272] T d5f9fbdbd620463b9c81f3c5c92b40f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.380594 18414 tablet_replica.cc:333] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.381136 18414 raft_consensus.cc:2243] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.381736 18414 raft_consensus.cc:2272] T 9807bdebbbd742009e4a329706a92790 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.383534 18414 tablet_replica.cc:333] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.384065 18414 raft_consensus.cc:2243] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.385087 18414 raft_consensus.cc:2272] T 88c0e3535ed14c77bc069b999fbb18bc P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.387017 18414 tablet_replica.cc:333] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.387567 18414 raft_consensus.cc:2243] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.388168 18414 raft_consensus.cc:2272] T deb2be7d455242c08b014289ea6b1347 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.390710 18414 tablet_replica.cc:333] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.391453 18414 raft_consensus.cc:2243] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.392690 18414 raft_consensus.cc:2272] T d9242425d3a744c3b8742c30995129f4 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.395406 18414 tablet_replica.cc:333] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.396147 18414 raft_consensus.cc:2243] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:21:35.396611 20631 consensus_peers.cc:597] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:35.397454 18414 raft_consensus.cc:2272] T 386001789c264ef8b0ac13cf938a8390 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.400053 18414 tablet_replica.cc:333] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.400708 18414 raft_consensus.cc:2243] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.401793 18414 raft_consensus.cc:2272] T c62f6690c8e840638906e0b59d2ae71d P e19c80e9149b4b8d88ae13bde8e43864 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.403950 18414 tablet_replica.cc:333] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.404567 18414 raft_consensus.cc:2243] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.405579 18414 raft_consensus.cc:2272] T b28ba556d85a4d61bf15492b88b280d9 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.407714 18414 tablet_replica.cc:333] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.408327 18414 raft_consensus.cc:2243] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 31 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.409405 18414 raft_consensus.cc:2272] T 2c1d08b75392466298c02ea9d4d765dd P e19c80e9149b4b8d88ae13bde8e43864 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.411697 18414 tablet_replica.cc:333] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.412254 18414 raft_consensus.cc:2243] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.412854 18414 raft_consensus.cc:2272] T 80abeb366b70484a8b8df5a0575643e7 P e19c80e9149b4b8d88ae13bde8e43864 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.415124 18414 tablet_replica.cc:333] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.415751 18414 raft_consensus.cc:2243] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.416301 18414 raft_consensus.cc:2272] T ed30843c798c4e38898b991bd1ecf1f6 P e19c80e9149b4b8d88ae13bde8e43864 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.418447 18414 tablet_replica.cc:333] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.419353 18414 raft_consensus.cc:2243] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.419992 18414 raft_consensus.cc:2272] T 03f9956d44294112accb74ea1a18065b P e19c80e9149b4b8d88ae13bde8e43864 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.422262 18414 tablet_replica.cc:333] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.422968 18414 raft_consensus.cc:2243] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.424345 18414 raft_consensus.cc:2272] T 56b49831037b480f8eda4069cf653878 P e19c80e9149b4b8d88ae13bde8e43864 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.427249 18414 tablet_replica.cc:333] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.427897 18414 raft_consensus.cc:2243] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:21:35.428198 20619 consensus_peers.cc:597] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 -> Peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Couldn't send request to peer e19c80e9149b4b8d88ae13bde8e43864. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.429221 18414 raft_consensus.cc:2272] T c656f1e9148d4056945c02ce537d8b12 P e19c80e9149b4b8d88ae13bde8e43864 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.431648 18414 tablet_replica.cc:333] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.432220 18414 raft_consensus.cc:2243] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.433386 18414 raft_consensus.cc:2272] T 904d960364024273a420111ec6233e84 P e19c80e9149b4b8d88ae13bde8e43864 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.435766 18414 tablet_replica.cc:333] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.436939 18414 raft_consensus.cc:2243] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.438238 18414 raft_consensus.cc:2272] T 2b601da83bfc46088ab1ec232133b605 P e19c80e9149b4b8d88ae13bde8e43864 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.441152 18414 tablet_replica.cc:333] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.441963 18414 raft_consensus.cc:2243] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.443017 18414 raft_consensus.cc:2272] T df137c733a0a470c9e35fa2b09c6c619 P e19c80e9149b4b8d88ae13bde8e43864 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.446153 18414 tablet_replica.cc:333] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864: stopping tablet replica
I20260709 13:21:35.446728 18414 raft_consensus.cc:2243] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.447309 18414 raft_consensus.cc:2272] T d05498e224814b9b8f31e3f965ab2583 P e19c80e9149b4b8d88ae13bde8e43864 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:35.456287 20619 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111) [suppressed 615 similar messages]
W20260709 13:21:35.487299 20619 consensus_peers.cc:597] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 -> Peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Couldn't send request to peer e19c80e9149b4b8d88ae13bde8e43864. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.488317 20619 consensus_peers.cc:597] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 -> Peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Couldn't send request to peer e19c80e9149b4b8d88ae13bde8e43864. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.491555 20619 consensus_peers.cc:597] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 -> Peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Couldn't send request to peer e19c80e9149b4b8d88ae13bde8e43864. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.609053 20619 consensus_peers.cc:597] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 -> Peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Couldn't send request to peer e19c80e9149b4b8d88ae13bde8e43864. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.131:33295: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.611502 20619 consensus_peers.cc:597] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 -> Peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Couldn't send request to peer e19c80e9149b4b8d88ae13bde8e43864. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.131:33295: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.659461 20619 consensus_peers.cc:597] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:35.665416 20631 consensus_peers.cc:597] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:35.687413 20631 consensus_peers.cc:597] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:35.934456 20631 consensus_peers.cc:597] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:35.988960 27841 raft_consensus.cc:493] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:35.989579 27841 raft_consensus.cc:515] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:35.991928 27841 leader_election.cc:290] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
I20260709 13:21:36.010156 27841 raft_consensus.cc:493] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:36.010740 27841 raft_consensus.cc:515] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:36.012897 27841 leader_election.cc:290] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:36.020427 20631 leader_election.cc:336] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
W20260709 13:21:36.022935 20619 leader_election.cc:336] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:36.023406 20619 leader_election.cc:304] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:36.025794 27841 raft_consensus.cc:2749] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:36.030436 20631 leader_election.cc:336] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
W20260709 13:21:36.032051 20619 leader_election.cc:336] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:36.032711 20619 leader_election.cc:304] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:36.033599 27841 raft_consensus.cc:2749] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:36.290443 27873 raft_consensus.cc:493] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2cfd02601ea44976833027665abc93bf)
I20260709 13:21:36.291074 27873 raft_consensus.cc:515] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:36.293284 27873 leader_election.cc:290] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471)
W20260709 13:21:36.312379 20631 leader_election.cc:336] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
W20260709 13:21:36.338830 20619 leader_election.cc:336] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:36.340699 20619 leader_election.cc:304] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, d56df3728fc04e37b2d29a3bcd91d167
I20260709 13:21:36.360430 27875 raft_consensus.cc:2749] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:36.361186 27875 raft_consensus.cc:493] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:36.361786 27875 raft_consensus.cc:515] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } attrs { replace: true } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:36.364801 27875 leader_election.cc:290] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:21:36.377164 20631 leader_election.cc:336] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
W20260709 13:21:36.393993 20619 leader_election.cc:336] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Network error: Client connection negotiation failed: client connection to 127.17.251.131:33295: connect: Connection refused (error 111)
I20260709 13:21:36.394618 20619 leader_election.cc:304] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:36.395364 27841 raft_consensus.cc:2749] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:36.548282 27841 raft_consensus.cc:493] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:36.548976 27841 raft_consensus.cc:515] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "2cfd02601ea44976833027665abc93bf" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 36471 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:36.551302 27841 leader_election.cc:290] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:21:36.558769 20619 leader_election.cc:336] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Network error: Client connection negotiation failed: client connection to 127.17.251.131:33295: connect: Connection refused (error 111)
W20260709 13:21:36.571255 20631 leader_election.cc:336] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111)
I20260709 13:21:36.571741 20631 leader_election.cc:304] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: 2cfd02601ea44976833027665abc93bf, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:36.572470 27841 raft_consensus.cc:2749] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:36.694555 27841 raft_consensus.cc:493] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:36.695129 27841 raft_consensus.cc:515] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:36.697320 27841 leader_election.cc:290] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:21:36.703481 20619 leader_election.cc:336] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Network error: Client connection negotiation failed: client connection to 127.17.251.131:33295: connect: Connection refused (error 111)
I20260709 13:21:36.708149 27841 raft_consensus.cc:493] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:36.708739 27841 raft_consensus.cc:515] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:36.712672 27841 leader_election.cc:290] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:21:36.720136 20619 leader_election.cc:336] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Network error: Client connection negotiation failed: client connection to 127.17.251.131:33295: connect: Connection refused (error 111)
I20260709 13:21:36.852350 27841 raft_consensus.cc:493] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e19c80e9149b4b8d88ae13bde8e43864)
I20260709 13:21:36.852950 27841 raft_consensus.cc:515] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d56df3728fc04e37b2d29a3bcd91d167" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 38645 } } peers { permanent_uuid: "e19c80e9149b4b8d88ae13bde8e43864" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33295 } } peers { permanent_uuid: "068c03c9dcc848e6bf909131b1f83065" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 40615 } attrs { promote: false } }
I20260709 13:21:36.855291 27841 leader_election.cc:290] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645), e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295)
W20260709 13:21:36.860468 20619 leader_election.cc:336] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e19c80e9149b4b8d88ae13bde8e43864 (127.17.251.131:33295): Network error: Client connection negotiation failed: client connection to 127.17.251.131:33295: connect: Connection refused (error 111)
I20260709 13:21:37.051992 18414 tablet_server.cc:196] TabletServer@127.17.251.131:0 shutdown complete.
W20260709 13:21:37.076278 19441 debug-util.cc:398] Leaking SignalData structure 0x7b080039f100 after lost signal to thread 18417
W20260709 13:21:37.077504 19441 debug-util.cc:398] Leaking SignalData structure 0x7b080011b300 after lost signal to thread 19444
W20260709 13:21:37.078959 19441 debug-util.cc:398] Leaking SignalData structure 0x7b08002d4a80 after lost signal to thread 20690
I20260709 13:21:37.205256 18414 tablet_server.cc:179] TabletServer@127.17.251.132:0 shutting down...
I20260709 13:21:37.294682 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:37.295549 18414 tablet_replica.cc:333] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065: stopping tablet replica
I20260709 13:21:37.296635 18414 raft_consensus.cc:2243] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.298229 18414 raft_consensus.cc:2272] T 7dd800f2a6b149a5b3ab177899d5f6bf P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.301781 18414 tablet_replica.cc:333] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065: stopping tablet replica
I20260709 13:21:37.302868 18414 raft_consensus.cc:2243] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.303757 18414 raft_consensus.cc:2272] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.307514 18414 tablet_replica.cc:333] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065: stopping tablet replica
I20260709 13:21:37.308503 18414 raft_consensus.cc:2243] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.309559 18414 raft_consensus.cc:2272] T 8c3672e496ae4c7ab924bee7e50ecf70 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.313297 18414 tablet_replica.cc:333] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065: stopping tablet replica
I20260709 13:21:37.314270 18414 raft_consensus.cc:2243] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.315380 18414 raft_consensus.cc:2272] T b28ba556d85a4d61bf15492b88b280d9 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.318907 18414 tablet_replica.cc:333] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065: stopping tablet replica
I20260709 13:21:37.319803 18414 raft_consensus.cc:2243] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.320633 18414 raft_consensus.cc:2272] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.324414 18414 tablet_replica.cc:333] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065: stopping tablet replica
I20260709 13:21:37.325297 18414 raft_consensus.cc:2243] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.326376 18414 raft_consensus.cc:2272] T 2c83387a56274f46bd5795b3376741c9 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.329869 18414 tablet_replica.cc:333] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065: stopping tablet replica
I20260709 13:21:37.330610 18414 raft_consensus.cc:2243] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.331557 18414 raft_consensus.cc:2272] T d05498e224814b9b8f31e3f965ab2583 P 068c03c9dcc848e6bf909131b1f83065 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.334597 18414 tablet_replica.cc:333] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065: stopping tablet replica
I20260709 13:21:37.337021 18414 raft_consensus.cc:2243] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.338372 18414 raft_consensus.cc:2272] T 46d39387ed0c44978cdb2b736f9c1ccf P 068c03c9dcc848e6bf909131b1f83065 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.343644 18414 tablet_replica.cc:333] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065: stopping tablet replica
I20260709 13:21:37.344460 18414 raft_consensus.cc:2243] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.345237 18414 raft_consensus.cc:2272] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:37.353672 20631 consensus_peers.cc:597] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 -> Peer 2cfd02601ea44976833027665abc93bf (127.17.251.130:36471): Couldn't send request to peer 2cfd02601ea44976833027665abc93bf. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:36471: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:37.355260 18414 tablet_replica.cc:333] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065: stopping tablet replica
I20260709 13:21:37.356149 18414 raft_consensus.cc:2243] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.357156 18414 raft_consensus.cc:2272] T 6eb38e2ac9064d3286fe2f20aeb2381c P 068c03c9dcc848e6bf909131b1f83065 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.360198 18414 tablet_replica.cc:333] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065: stopping tablet replica
I20260709 13:21:37.360948 18414 raft_consensus.cc:2243] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.361989 18414 raft_consensus.cc:2272] T 911988cab3914bb19f77d4d3e24a31f4 P 068c03c9dcc848e6bf909131b1f83065 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.364689 18414 tablet_replica.cc:333] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065: stopping tablet replica
I20260709 13:21:37.365432 18414 raft_consensus.cc:2243] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.366803 18414 raft_consensus.cc:2272] T daee81c3dc8c4dc4b735d1643829fe76 P 068c03c9dcc848e6bf909131b1f83065 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.369850 18414 tablet_replica.cc:333] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065: stopping tablet replica
I20260709 13:21:37.372187 18414 raft_consensus.cc:2243] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.373111 18414 raft_consensus.cc:2272] T e40c25a076fd424281aab1a64f5a1498 P 068c03c9dcc848e6bf909131b1f83065 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.375929 18414 tablet_replica.cc:333] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065: stopping tablet replica
I20260709 13:21:37.376619 18414 raft_consensus.cc:2243] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.377789 18414 raft_consensus.cc:2272] T 556595dcbb8644d2a073cbc04a679832 P 068c03c9dcc848e6bf909131b1f83065 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.380604 18414 tablet_replica.cc:333] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065: stopping tablet replica
I20260709 13:21:37.381282 18414 raft_consensus.cc:2243] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.382320 18414 raft_consensus.cc:2272] T 56b49831037b480f8eda4069cf653878 P 068c03c9dcc848e6bf909131b1f83065 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.385124 18414 tablet_replica.cc:333] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065: stopping tablet replica
I20260709 13:21:37.385852 18414 raft_consensus.cc:2243] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.386535 18414 raft_consensus.cc:2272] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.392480 18414 tablet_replica.cc:333] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065: stopping tablet replica
W20260709 13:21:37.392724 20619 leader_election.cc:336] T 4a2800ca4ded4227b5bb5e48f0572eaa P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:37.393195 18414 raft_consensus.cc:2243] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:37.393713 20619 consensus_peers.cc:597] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 -> Peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Couldn't send request to peer d56df3728fc04e37b2d29a3bcd91d167. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:21:37.394285 18414 raft_consensus.cc:2272] T 0e5f26f686634d4ab47c02b7a00ba584 P 068c03c9dcc848e6bf909131b1f83065 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:37.394676 20619 leader_election.cc:336] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:37.395160 20619 leader_election.cc:304] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:21:37.395839 20619 raft_consensus.cc:2686] T 2b601da83bfc46088ab1ec232133b605 P 068c03c9dcc848e6bf909131b1f83065: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:21:37.396438 20619 leader_election.cc:336] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:37.396850 20619 leader_election.cc:304] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
I20260709 13:21:37.397506 18414 tablet_replica.cc:333] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065: stopping tablet replica
I20260709 13:21:37.398231 18414 raft_consensus.cc:2243] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.399279 18414 raft_consensus.cc:2272] T 1a8709264e614e01ad899bfabc6c04f7 P 068c03c9dcc848e6bf909131b1f83065 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:37.397500 20619 raft_consensus.cc:2686] T 6c89dfa6a61346148bb8520ed4d0ecd9 P 068c03c9dcc848e6bf909131b1f83065: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:21:37.400673 20619 leader_election.cc:336] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:37.401089 20619 leader_election.cc:304] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068c03c9dcc848e6bf909131b1f83065; no voters: d56df3728fc04e37b2d29a3bcd91d167, e19c80e9149b4b8d88ae13bde8e43864
W20260709 13:21:37.401775 20619 raft_consensus.cc:2686] T c62f6690c8e840638906e0b59d2ae71d P 068c03c9dcc848e6bf909131b1f83065: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:21:38.030324 18414 tablet_server.cc:196] TabletServer@127.17.251.132:0 shutdown complete.
I20260709 13:21:38.086628 18414 master.cc:562] Master@127.17.251.190:33289 shutting down...
W20260709 13:21:38.132961 19458 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:21:38.133224 19458 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:21:38.133383 19458 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:21:48.890079 19395 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111) [suppressed 87 similar messages]
W20260709 13:21:48.895000 19395 catalog_manager.cc:4755] TS d56df3728fc04e37b2d29a3bcd91d167 (127.17.251.129:38645): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7dd800f2a6b149a5b3ab177899d5f6bf: Network error: Client connection negotiation failed: client connection to 127.17.251.129:38645: connect: Connection refused (error 111)
I20260709 13:21:49.035398 18414 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:49.036578 18414 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:49.036969 18414 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5aff2c187289436a846acba13255b21f: stopping tablet replica
I20260709 13:21:49.267777 18414 master.cc:584] Master@127.17.251.190:33289 shutdown complete.
I20260709 13:21:49.322244 18414 test_util.cc:182] -----------------------------------------------
I20260709 13:21:49.322477 18414 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603012191013-18414-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (273927 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:21:49.326238 18414 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.251.190:33451
I20260709 13:21:49.327338 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:49.333371 27882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:49.333945 27883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:49.334235 27885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:49.335455 18414 server_base.cc:1061] running on GCE node
I20260709 13:21:49.339335 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:49.339561 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:49.339767 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603309339734 us; error 0 us; skew 500 ppm
I20260709 13:21:49.340312 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:49.342962 18414 webserver.cc:533] Webserver started at http://127.17.251.190:39059/ using document root <none> and password file <none>
I20260709 13:21:49.343504 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:49.343709 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:49.343988 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:49.345306 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/master-0-root/instance:
uuid: "9932ddcf115449d3b4be7818b4d708db"
format_stamp: "Formatted at 2026-07-09 13:21:49 on dist-test-slave-7f95"
I20260709 13:21:49.350131 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:21:49.353801 27890 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:49.354703 18414 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:21:49.355070 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/master-0-root
uuid: "9932ddcf115449d3b4be7818b4d708db"
format_stamp: "Formatted at 2026-07-09 13:21:49 on dist-test-slave-7f95"
I20260709 13:21:49.355392 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:49.367515 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:49.368894 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:49.409566 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.190:33451
I20260709 13:21:49.409751 27941 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.190:33451 every 8 connection(s)
I20260709 13:21:49.414459 27942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.426324 27942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db: Bootstrap starting.
I20260709 13:21:49.431946 27942 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:49.437554 27942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db: No bootstrap required, opened a new log
I20260709 13:21:49.440022 27942 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9932ddcf115449d3b4be7818b4d708db" member_type: VOTER }
I20260709 13:21:49.440502 27942 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:49.440689 27942 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9932ddcf115449d3b4be7818b4d708db, State: Initialized, Role: FOLLOWER
I20260709 13:21:49.441198 27942 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9932ddcf115449d3b4be7818b4d708db" member_type: VOTER }
I20260709 13:21:49.441738 27942 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:49.441964 27942 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:49.442198 27942 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:49.446659 27942 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9932ddcf115449d3b4be7818b4d708db" member_type: VOTER }
I20260709 13:21:49.447162 27942 leader_election.cc:304] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9932ddcf115449d3b4be7818b4d708db; no voters: 
I20260709 13:21:49.448279 27942 leader_election.cc:290] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:49.448702 27945 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:49.450241 27945 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [term 1 LEADER]: Becoming Leader. State: Replica: 9932ddcf115449d3b4be7818b4d708db, State: Running, Role: LEADER
I20260709 13:21:49.451027 27945 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9932ddcf115449d3b4be7818b4d708db" member_type: VOTER }
I20260709 13:21:49.451335 27942 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:49.458299 27947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9932ddcf115449d3b4be7818b4d708db. Latest consensus state: current_term: 1 leader_uuid: "9932ddcf115449d3b4be7818b4d708db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9932ddcf115449d3b4be7818b4d708db" member_type: VOTER } }
I20260709 13:21:49.458952 27947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:49.459553 27946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9932ddcf115449d3b4be7818b4d708db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9932ddcf115449d3b4be7818b4d708db" member_type: VOTER } }
I20260709 13:21:49.460318 27946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:49.461284 27955 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:49.469084 27955 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:49.470132 18414 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:49.478528 27955 catalog_manager.cc:1383] Generated new cluster ID: b44cb77ecbad4e70835b06376314895d
I20260709 13:21:49.478832 27955 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:49.511749 27955 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:49.513131 27955 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:49.526998 27955 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db: Generated new TSK 0
I20260709 13:21:49.527649 27955 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:49.536757 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:49.543318 27963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:49.544469 27964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:49.547756 27966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:49.548884 18414 server_base.cc:1061] running on GCE node
I20260709 13:21:49.551370 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:49.551656 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:49.551831 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603309551808 us; error 0 us; skew 500 ppm
I20260709 13:21:49.552403 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:49.555147 18414 webserver.cc:533] Webserver started at http://127.17.251.129:41059/ using document root <none> and password file <none>
I20260709 13:21:49.555673 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:49.555864 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:49.556172 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:49.557700 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-0-root/instance:
uuid: "6b1d1aefe48e42119ca040c70045fe28"
format_stamp: "Formatted at 2026-07-09 13:21:49 on dist-test-slave-7f95"
I20260709 13:21:49.563040 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:49.567185 27971 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:49.568262 18414 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:21:49.568629 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-0-root
uuid: "6b1d1aefe48e42119ca040c70045fe28"
format_stamp: "Formatted at 2026-07-09 13:21:49 on dist-test-slave-7f95"
I20260709 13:21:49.568915 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:49.586261 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:49.587579 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:49.589272 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:49.592358 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:49.592659 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:49.592950 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:49.593183 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:49.640364 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.129:33695
I20260709 13:21:49.640460 28033 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.129:33695 every 8 connection(s)
I20260709 13:21:49.646101 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:49.656725 28039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:49.660200 28038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:49.660738 28041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:49.662966 18414 server_base.cc:1061] running on GCE node
I20260709 13:21:49.665551 28034 heartbeater.cc:344] Connected to a master server at 127.17.251.190:33451
I20260709 13:21:49.666049 28034 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:49.666486 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:49.666780 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:49.666980 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603309666962 us; error 0 us; skew 500 ppm
I20260709 13:21:49.667044 28034 heartbeater.cc:507] Master 127.17.251.190:33451 requested a full tablet report, sending...
I20260709 13:21:49.667819 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:49.669575 27907 ts_manager.cc:194] Registered new tserver with Master: 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:49.671276 18414 webserver.cc:533] Webserver started at http://127.17.251.130:33841/ using document root <none> and password file <none>
I20260709 13:21:49.671903 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:49.671881 27907 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60552
I20260709 13:21:49.672405 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:49.672780 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:49.674950 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-1-root/instance:
uuid: "d80a443d06244116ae813b77fc539651"
format_stamp: "Formatted at 2026-07-09 13:21:49 on dist-test-slave-7f95"
I20260709 13:21:49.679893 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:21:49.683605 28046 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:49.684587 18414 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:21:49.684857 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-1-root
uuid: "d80a443d06244116ae813b77fc539651"
format_stamp: "Formatted at 2026-07-09 13:21:49 on dist-test-slave-7f95"
I20260709 13:21:49.685114 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:49.694978 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:49.696235 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:49.697892 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:49.700588 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:49.700798 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:49.701103 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:49.701265 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:49.744920 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.130:43901
I20260709 13:21:49.745049 28108 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.130:43901 every 8 connection(s)
I20260709 13:21:49.750245 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:49.758265 28112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:49.759373 28113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:49.763105 28115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:49.764245 18414 server_base.cc:1061] running on GCE node
I20260709 13:21:49.765707 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:49.765965 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:49.766069 28109 heartbeater.cc:344] Connected to a master server at 127.17.251.190:33451
I20260709 13:21:49.766193 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603309766172 us; error 0 us; skew 500 ppm
I20260709 13:21:49.766523 28109 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:49.767073 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:49.767570 28109 heartbeater.cc:507] Master 127.17.251.190:33451 requested a full tablet report, sending...
I20260709 13:21:49.769934 18414 webserver.cc:533] Webserver started at http://127.17.251.131:44021/ using document root <none> and password file <none>
I20260709 13:21:49.770120 27907 ts_manager.cc:194] Registered new tserver with Master: d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:49.770725 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:49.770999 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:49.771332 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:49.772019 27907 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60560
I20260709 13:21:49.773196 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-2-root/instance:
uuid: "afb0dc4e88ca4275975541dfe077b38b"
format_stamp: "Formatted at 2026-07-09 13:21:49 on dist-test-slave-7f95"
I20260709 13:21:49.778542 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:21:49.782282 28120 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:49.783128 18414 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:21:49.783453 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-2-root
uuid: "afb0dc4e88ca4275975541dfe077b38b"
format_stamp: "Formatted at 2026-07-09 13:21:49 on dist-test-slave-7f95"
I20260709 13:21:49.783777 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:49.823038 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:49.824369 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:49.826217 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:49.828553 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:49.828785 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:49.829023 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:49.829206 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:49.873957 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.131:44409
I20260709 13:21:49.874060 28182 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.131:44409 every 8 connection(s)
I20260709 13:21:49.879256 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:49.888089 28186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:49.889386 28187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:49.893278 28183 heartbeater.cc:344] Connected to a master server at 127.17.251.190:33451
I20260709 13:21:49.894068 28183 heartbeater.cc:461] Registering TS with master...
W20260709 13:21:49.895069 28189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:49.895429 28183 heartbeater.cc:507] Master 127.17.251.190:33451 requested a full tablet report, sending...
I20260709 13:21:49.895502 18414 server_base.cc:1061] running on GCE node
I20260709 13:21:49.896746 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:49.896983 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:49.897199 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603309897175 us; error 0 us; skew 500 ppm
I20260709 13:21:49.897854 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:49.898057 27907 ts_manager.cc:194] Registered new tserver with Master: afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:49.899706 27907 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60566
I20260709 13:21:49.900513 18414 webserver.cc:533] Webserver started at http://127.17.251.132:36725/ using document root <none> and password file <none>
I20260709 13:21:49.901156 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:49.901400 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:49.901757 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:49.903162 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-3-root/instance:
uuid: "2e2f737d674147808bb32783de176848"
format_stamp: "Formatted at 2026-07-09 13:21:49 on dist-test-slave-7f95"
I20260709 13:21:49.907764 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:21:49.911280 28194 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:49.912165 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:21:49.912487 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-3-root
uuid: "2e2f737d674147808bb32783de176848"
format_stamp: "Formatted at 2026-07-09 13:21:49 on dist-test-slave-7f95"
I20260709 13:21:49.912794 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:49.922465 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:49.923780 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:49.925259 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:49.927578 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:49.927822 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:49.928066 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:49.928249 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:49.974112 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.132:36151
I20260709 13:21:49.974213 28256 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.132:36151 every 8 connection(s)
I20260709 13:21:49.989686 28257 heartbeater.cc:344] Connected to a master server at 127.17.251.190:33451
I20260709 13:21:49.990103 28257 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:49.990911 28257 heartbeater.cc:507] Master 127.17.251.190:33451 requested a full tablet report, sending...
I20260709 13:21:49.993106 27907 ts_manager.cc:194] Registered new tserver with Master: 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:49.993816 18414 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016266604s
I20260709 13:21:49.994746 27907 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60568
I20260709 13:21:50.023325 27907 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60574:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:21:50.276839 28222 tablet_service.cc:1511] Processing CreateTablet for tablet 2964725f81fe44ec98f509298316722b (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:50.277292 27999 tablet_service.cc:1511] Processing CreateTablet for tablet 2964725f81fe44ec98f509298316722b (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:50.278482 28222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2964725f81fe44ec98f509298316722b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.278678 27999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2964725f81fe44ec98f509298316722b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.280684 27996 tablet_service.cc:1511] Processing CreateTablet for tablet e19c61eea3984e50916353d4844fe718 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:50.282401 27996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19c61eea3984e50916353d4844fe718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.282917 27997 tablet_service.cc:1511] Processing CreateTablet for tablet 35b5e77de8ab4ce39569a347a84ed651 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:50.284461 27997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b5e77de8ab4ce39569a347a84ed651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.280804 27998 tablet_service.cc:1511] Processing CreateTablet for tablet 896e12f9e1f649c19b7ba5bac1e051dd (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:50.286092 28221 tablet_service.cc:1511] Processing CreateTablet for tablet 35b5e77de8ab4ce39569a347a84ed651 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:50.287536 28221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b5e77de8ab4ce39569a347a84ed651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.291509 28220 tablet_service.cc:1511] Processing CreateTablet for tablet dc2ec8b6b6234ee6b530a1c4b7e18618 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:50.292631 28073 tablet_service.cc:1511] Processing CreateTablet for tablet 35b5e77de8ab4ce39569a347a84ed651 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:50.294236 28073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b5e77de8ab4ce39569a347a84ed651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.294632 28074 tablet_service.cc:1511] Processing CreateTablet for tablet 896e12f9e1f649c19b7ba5bac1e051dd (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:50.296030 28074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 896e12f9e1f649c19b7ba5bac1e051dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.298933 28072 tablet_service.cc:1511] Processing CreateTablet for tablet dc2ec8b6b6234ee6b530a1c4b7e18618 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:50.299412 28219 tablet_service.cc:1511] Processing CreateTablet for tablet d90c9f452bac4ef0b959ca0e78ab475f (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:50.300473 28072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2ec8b6b6234ee6b530a1c4b7e18618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.293092 28220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2ec8b6b6234ee6b530a1c4b7e18618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.301364 27995 tablet_service.cc:1511] Processing CreateTablet for tablet d90c9f452bac4ef0b959ca0e78ab475f (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:50.302031 28219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90c9f452bac4ef0b959ca0e78ab475f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.302199 28071 tablet_service.cc:1511] Processing CreateTablet for tablet e19c61eea3984e50916353d4844fe718 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:50.303647 28071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19c61eea3984e50916353d4844fe718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.307199 28070 tablet_service.cc:1511] Processing CreateTablet for tablet d90c9f452bac4ef0b959ca0e78ab475f (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:50.308900 28070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90c9f452bac4ef0b959ca0e78ab475f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.313992 27998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 896e12f9e1f649c19b7ba5bac1e051dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.317317 27995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90c9f452bac4ef0b959ca0e78ab475f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.339665 28148 tablet_service.cc:1511] Processing CreateTablet for tablet 2964725f81fe44ec98f509298316722b (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:50.341317 28148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2964725f81fe44ec98f509298316722b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.343151 28147 tablet_service.cc:1511] Processing CreateTablet for tablet 896e12f9e1f649c19b7ba5bac1e051dd (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:50.345999 28146 tablet_service.cc:1511] Processing CreateTablet for tablet dc2ec8b6b6234ee6b530a1c4b7e18618 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:50.348763 28145 tablet_service.cc:1511] Processing CreateTablet for tablet e19c61eea3984e50916353d4844fe718 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:50.351456 28144 tablet_service.cc:1511] Processing CreateTablet for tablet 755b1458334b47b2ae9a71fb44952d95 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:50.351717 27994 tablet_service.cc:1511] Processing CreateTablet for tablet 755b1458334b47b2ae9a71fb44952d95 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:50.353986 27994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 755b1458334b47b2ae9a71fb44952d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.355708 28218 tablet_service.cc:1511] Processing CreateTablet for tablet 755b1458334b47b2ae9a71fb44952d95 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:50.364606 28145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19c61eea3984e50916353d4844fe718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.366797 28069 tablet_service.cc:1511] Processing CreateTablet for tablet 88b8050a4f374a91b8993cd0d6ed3dbd (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:50.368516 28069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b8050a4f374a91b8993cd0d6ed3dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.369382 28143 tablet_service.cc:1511] Processing CreateTablet for tablet 88b8050a4f374a91b8993cd0d6ed3dbd (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:50.371505 28143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b8050a4f374a91b8993cd0d6ed3dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.374377 28144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 755b1458334b47b2ae9a71fb44952d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.378095 28147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 896e12f9e1f649c19b7ba5bac1e051dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.382172 28146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2ec8b6b6234ee6b530a1c4b7e18618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.357486 28218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 755b1458334b47b2ae9a71fb44952d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.387001 28217 tablet_service.cc:1511] Processing CreateTablet for tablet 88b8050a4f374a91b8993cd0d6ed3dbd (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:50.388803 28217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b8050a4f374a91b8993cd0d6ed3dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.396883 27993 tablet_service.cc:1511] Processing CreateTablet for tablet 0f95034322d746e4aaf06b06873de375 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:50.398568 27993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f95034322d746e4aaf06b06873de375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.405580 28068 tablet_service.cc:1511] Processing CreateTablet for tablet 0f95034322d746e4aaf06b06873de375 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:50.407232 28068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f95034322d746e4aaf06b06873de375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.406818 28142 tablet_service.cc:1511] Processing CreateTablet for tablet 0f95034322d746e4aaf06b06873de375 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:50.408461 28142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f95034322d746e4aaf06b06873de375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.410943 28216 tablet_service.cc:1511] Processing CreateTablet for tablet 251228d678dc4ab7887704367c7bd62a (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:50.412533 28216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 251228d678dc4ab7887704367c7bd62a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:50.462893 27954 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:50.413218 27999 tablet_service.cc:1511] Processing CreateTablet for tablet 251228d678dc4ab7887704367c7bd62a (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:50.499461 28278 tablet_bootstrap.cc:492] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:50.516137 28073 tablet_service.cc:1511] Processing CreateTablet for tablet 251228d678dc4ab7887704367c7bd62a (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:50.517589 28073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 251228d678dc4ab7887704367c7bd62a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.520397 28217 tablet_service.cc:1511] Processing CreateTablet for tablet 34330356e21a4098a1c12380085e120f (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:50.521723 28217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34330356e21a4098a1c12380085e120f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.519357 28141 tablet_service.cc:1511] Processing CreateTablet for tablet 34330356e21a4098a1c12380085e120f (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:50.527174 28141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34330356e21a4098a1c12380085e120f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.534212 28069 tablet_service.cc:1511] Processing CreateTablet for tablet 75fae586ea8f4cc8a5e968c2e41f2e8d (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:50.534545 28140 tablet_service.cc:1511] Processing CreateTablet for tablet 75fae586ea8f4cc8a5e968c2e41f2e8d (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:50.535678 28069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75fae586ea8f4cc8a5e968c2e41f2e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.535956 28140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75fae586ea8f4cc8a5e968c2e41f2e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.552054 28222 tablet_service.cc:1511] Processing CreateTablet for tablet 75fae586ea8f4cc8a5e968c2e41f2e8d (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:50.553580 28222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75fae586ea8f4cc8a5e968c2e41f2e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.565543 28280 tablet_bootstrap.cc:492] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:50.568557 28278 tablet_bootstrap.cc:654] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:50.564114 27999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 251228d678dc4ab7887704367c7bd62a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.565596 28279 tablet_bootstrap.cc:492] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:50.583657 27997 tablet_service.cc:1511] Processing CreateTablet for tablet b0ed080f456b4849b44145557b5889b1 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:50.585966 28218 tablet_service.cc:1511] Processing CreateTablet for tablet 01b35f8e5efb4b2194c44623574d41e4 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:50.587107 27997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ed080f456b4849b44145557b5889b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.587507 28218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b35f8e5efb4b2194c44623574d41e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.588793 27995 tablet_service.cc:1511] Processing CreateTablet for tablet 01b35f8e5efb4b2194c44623574d41e4 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:50.585168 28070 tablet_service.cc:1511] Processing CreateTablet for tablet b0ed080f456b4849b44145557b5889b1 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:50.582396 27996 tablet_service.cc:1511] Processing CreateTablet for tablet 34330356e21a4098a1c12380085e120f (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:50.592147 27996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34330356e21a4098a1c12380085e120f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.592798 28280 tablet_bootstrap.cc:654] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:50.594246 28070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ed080f456b4849b44145557b5889b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.594913 28071 tablet_service.cc:1511] Processing CreateTablet for tablet 01b35f8e5efb4b2194c44623574d41e4 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:50.600791 28071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b35f8e5efb4b2194c44623574d41e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.584386 28277 tablet_bootstrap.cc:492] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:50.606051 27995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b35f8e5efb4b2194c44623574d41e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.614058 28279 tablet_bootstrap.cc:654] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:50.618484 28140 tablet_service.cc:1511] Processing CreateTablet for tablet bb17cd0859ea43a5b7c93c90f172a611 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:50.619949 28140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb17cd0859ea43a5b7c93c90f172a611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.619743 28217 tablet_service.cc:1511] Processing CreateTablet for tablet bb17cd0859ea43a5b7c93c90f172a611 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:50.621146 28217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb17cd0859ea43a5b7c93c90f172a611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.626709 28147 tablet_service.cc:1511] Processing CreateTablet for tablet b0ed080f456b4849b44145557b5889b1 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:50.628136 28147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ed080f456b4849b44145557b5889b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.640966 28280 tablet_bootstrap.cc:492] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:50.641594 28280 ts_tablet_manager.cc:1403] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.000s
I20260709 13:21:50.644974 28280 raft_consensus.cc:359] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:50.645766 28280 raft_consensus.cc:385] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:50.646220 28280 raft_consensus.cc:740] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:50.647116 27999 tablet_service.cc:1511] Processing CreateTablet for tablet bb17cd0859ea43a5b7c93c90f172a611 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:50.647240 28280 consensus_queue.cc:260] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:50.650586 28071 tablet_service.cc:1511] Processing CreateTablet for tablet 6b91d5539ce0478a92a005af25d828a6 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:50.652469 28071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b91d5539ce0478a92a005af25d828a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.654438 28141 tablet_service.cc:1511] Processing CreateTablet for tablet 6b91d5539ce0478a92a005af25d828a6 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:50.655917 28141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b91d5539ce0478a92a005af25d828a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.657651 28222 tablet_service.cc:1511] Processing CreateTablet for tablet 6b91d5539ce0478a92a005af25d828a6 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:50.659857 28222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b91d5539ce0478a92a005af25d828a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.660030 28279 tablet_bootstrap.cc:492] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:50.660537 28279 ts_tablet_manager.cc:1403] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.006s
I20260709 13:21:50.662452 28277 tablet_bootstrap.cc:654] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:50.664127 28279 raft_consensus.cc:359] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:50.664975 28279 raft_consensus.cc:385] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:50.665802 28279 raft_consensus.cc:740] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:50.666946 27999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb17cd0859ea43a5b7c93c90f172a611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.667814 28279 consensus_queue.cc:260] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:50.672719 27998 tablet_service.cc:1511] Processing CreateTablet for tablet 027980aba9e546578394bd75f01ffba4 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:50.674211 27998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 027980aba9e546578394bd75f01ffba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.676676 28034 heartbeater.cc:499] Master 127.17.251.190:33451 was elected leader, sending a full tablet report...
I20260709 13:21:50.682147 28279 ts_tablet_manager.cc:1434] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.004s
I20260709 13:21:50.698457 28218 tablet_service.cc:1511] Processing CreateTablet for tablet 8733000b90a544ba82435f9b7f6e5403 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:50.700683 28218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8733000b90a544ba82435f9b7f6e5403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.703787 28069 tablet_service.cc:1511] Processing CreateTablet for tablet 027980aba9e546578394bd75f01ffba4 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:50.705706 28109 heartbeater.cc:499] Master 127.17.251.190:33451 was elected leader, sending a full tablet report...
I20260709 13:21:50.710047 28069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 027980aba9e546578394bd75f01ffba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.713207 28279 tablet_bootstrap.cc:492] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:50.718837 28277 tablet_bootstrap.cc:492] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:50.719442 28277 ts_tablet_manager.cc:1403] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.135s	user 0.012s	sys 0.007s
I20260709 13:21:50.722882 28277 raft_consensus.cc:359] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:50.723608 28277 raft_consensus.cc:385] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:50.723928 28277 raft_consensus.cc:740] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:50.724690 28277 consensus_queue.cc:260] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:50.741464 28183 heartbeater.cc:499] Master 127.17.251.190:33451 was elected leader, sending a full tablet report...
I20260709 13:21:50.741456 28286 raft_consensus.cc:493] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:50.743608 28286 raft_consensus.cc:515] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
W20260709 13:21:50.750223 28110 tablet.cc:2406] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:21:50.750931 28286 leader_election.cc:290] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:50.752302 27999 tablet_service.cc:1511] Processing CreateTablet for tablet 8733000b90a544ba82435f9b7f6e5403 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:50.754235 27999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8733000b90a544ba82435f9b7f6e5403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.766911 28278 tablet_bootstrap.cc:492] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:50.767570 28278 ts_tablet_manager.cc:1403] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.269s	user 0.005s	sys 0.013s
I20260709 13:21:50.779310 28278 raft_consensus.cc:359] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:50.780097 28278 raft_consensus.cc:385] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:50.780408 28278 raft_consensus.cc:740] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:50.784060 28279 tablet_bootstrap.cc:654] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:50.792127 28217 tablet_service.cc:1511] Processing CreateTablet for tablet d84d9e7845264be9b66bcd292aab7e1d (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:50.796522 28217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84d9e7845264be9b66bcd292aab7e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.781239 28278 consensus_queue.cc:260] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:50.811368 27997 tablet_service.cc:1511] Processing CreateTablet for tablet d84d9e7845264be9b66bcd292aab7e1d (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:50.812805 27997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84d9e7845264be9b66bcd292aab7e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.822569 28147 tablet_service.cc:1511] Processing CreateTablet for tablet 027980aba9e546578394bd75f01ffba4 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:50.824048 28147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 027980aba9e546578394bd75f01ffba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.835693 28277 ts_tablet_manager.cc:1434] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.116s	user 0.013s	sys 0.024s
I20260709 13:21:50.828107 28140 tablet_service.cc:1511] Processing CreateTablet for tablet d84d9e7845264be9b66bcd292aab7e1d (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:50.838673 28257 heartbeater.cc:499] Master 127.17.251.190:33451 was elected leader, sending a full tablet report...
I20260709 13:21:50.839136 28140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84d9e7845264be9b66bcd292aab7e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.839792 28277 tablet_bootstrap.cc:492] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:50.848908 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755b1458334b47b2ae9a71fb44952d95" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
W20260709 13:21:50.850847 28121 leader_election.cc:343] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2f737d674147808bb32783de176848 (127.17.251.132:36151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:50.853035 28277 tablet_bootstrap.cc:654] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:50.855257 28218 tablet_service.cc:1511] Processing CreateTablet for tablet 6a85c97f3d564240a87737e17e8b536e (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:50.856623 28218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a85c97f3d564240a87737e17e8b536e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.862165 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755b1458334b47b2ae9a71fb44952d95" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:21:50.864037 28122 leader_election.cc:343] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:50.864547 28122 leader_election.cc:304] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:50.865989 28287 raft_consensus.cc:2749] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:50.869079 27997 tablet_service.cc:1511] Processing CreateTablet for tablet b2f566c9bd364fbcbc859d1c30f0f793 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:50.870609 27997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f566c9bd364fbcbc859d1c30f0f793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.872599 28073 tablet_service.cc:1511] Processing CreateTablet for tablet b2f566c9bd364fbcbc859d1c30f0f793 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:50.876523 28222 tablet_service.cc:1511] Processing CreateTablet for tablet a685a97179a94ca299d31636b789c516 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:50.877784 28073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f566c9bd364fbcbc859d1c30f0f793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.879475 27999 tablet_service.cc:1511] Processing CreateTablet for tablet a685a97179a94ca299d31636b789c516 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:50.880764 27999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a685a97179a94ca299d31636b789c516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.874950 28146 tablet_service.cc:1511] Processing CreateTablet for tablet b2f566c9bd364fbcbc859d1c30f0f793 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:50.882447 28146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f566c9bd364fbcbc859d1c30f0f793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.871495 28141 tablet_service.cc:1511] Processing CreateTablet for tablet 6a85c97f3d564240a87737e17e8b536e (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:50.877816 28222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a685a97179a94ca299d31636b789c516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.883580 28141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a85c97f3d564240a87737e17e8b536e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.834497 28280 ts_tablet_manager.cc:1434] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.192s	user 0.010s	sys 0.037s
I20260709 13:21:50.890166 28279 tablet_bootstrap.cc:492] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:50.899605 28279 ts_tablet_manager.cc:1403] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.187s	user 0.015s	sys 0.012s
I20260709 13:21:50.893718 28070 tablet_service.cc:1511] Processing CreateTablet for tablet 8733000b90a544ba82435f9b7f6e5403 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:50.902493 28070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8733000b90a544ba82435f9b7f6e5403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.902966 28279 raft_consensus.cc:359] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:50.903759 28279 raft_consensus.cc:385] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:50.904033 28279 raft_consensus.cc:740] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:50.905737 28279 consensus_queue.cc:260] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:50.907883 28279 ts_tablet_manager.cc:1434] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:21:50.908860 28279 tablet_bootstrap.cc:492] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:50.875798 28069 tablet_service.cc:1511] Processing CreateTablet for tablet 6a85c97f3d564240a87737e17e8b536e (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:50.913074 28277 tablet_bootstrap.cc:492] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:50.914395 28068 tablet_service.cc:1511] Processing CreateTablet for tablet a685a97179a94ca299d31636b789c516 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:50.914319 28280 tablet_bootstrap.cc:492] T 2964725f81fe44ec98f509298316722b P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:50.924024 28068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a685a97179a94ca299d31636b789c516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.924584 28284 raft_consensus.cc:493] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:50.925092 28284 raft_consensus.cc:515] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:50.932595 28284 leader_election.cc:290] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:50.932405 28218 tablet_service.cc:1511] Processing CreateTablet for tablet a8359246c5ff428e89f3b5c15a65aa98 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:50.922919 28277 ts_tablet_manager.cc:1403] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.015s
I20260709 13:21:50.935151 28218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8359246c5ff428e89f3b5c15a65aa98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.938580 28277 raft_consensus.cc:359] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:50.939746 28277 raft_consensus.cc:385] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:50.940191 28277 raft_consensus.cc:740] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:50.933853 28069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a85c97f3d564240a87737e17e8b536e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.941912 28142 tablet_service.cc:1511] Processing CreateTablet for tablet 6dd28360227f4dca8286a91d1be17d04 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:50.943295 28142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd28360227f4dca8286a91d1be17d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.943498 28217 tablet_service.cc:1511] Processing CreateTablet for tablet 6dd28360227f4dca8286a91d1be17d04 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:50.944753 28217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd28360227f4dca8286a91d1be17d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.945909 28074 tablet_service.cc:1511] Processing CreateTablet for tablet 6dd28360227f4dca8286a91d1be17d04 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:50.947223 28074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd28360227f4dca8286a91d1be17d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.947325 28280 tablet_bootstrap.cc:654] T 2964725f81fe44ec98f509298316722b P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:50.951697 27995 tablet_service.cc:1511] Processing CreateTablet for tablet c25fa78648f943939c0b04e5ae654cdf (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:50.953445 27995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c25fa78648f943939c0b04e5ae654cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.959059 27999 tablet_service.cc:1511] Processing CreateTablet for tablet a8359246c5ff428e89f3b5c15a65aa98 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:50.960598 27999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8359246c5ff428e89f3b5c15a65aa98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.964690 28278 ts_tablet_manager.cc:1434] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.197s	user 0.008s	sys 0.005s
I20260709 13:21:50.964581 28072 tablet_service.cc:1511] Processing CreateTablet for tablet c25fa78648f943939c0b04e5ae654cdf (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:50.966205 28072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c25fa78648f943939c0b04e5ae654cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.966671 28216 tablet_service.cc:1511] Processing CreateTablet for tablet a1ccc7022ab04f9a8ddc87ac37f31c7c (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:50.968025 28216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ccc7022ab04f9a8ddc87ac37f31c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.919966 28279 tablet_bootstrap.cc:654] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:50.983533 27998 tablet_service.cc:1511] Processing CreateTablet for tablet a1ccc7022ab04f9a8ddc87ac37f31c7c (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:50.984442 28144 tablet_service.cc:1511] Processing CreateTablet for tablet c25fa78648f943939c0b04e5ae654cdf (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:50.987323 28278 tablet_bootstrap.cc:492] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:50.987831 28144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c25fa78648f943939c0b04e5ae654cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.988332 28141 tablet_service.cc:1511] Processing CreateTablet for tablet a8359246c5ff428e89f3b5c15a65aa98 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:50.990046 28141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8359246c5ff428e89f3b5c15a65aa98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.996973 28070 tablet_service.cc:1511] Processing CreateTablet for tablet a1ccc7022ab04f9a8ddc87ac37f31c7c (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:50.998202 28070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ccc7022ab04f9a8ddc87ac37f31c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.000711 28145 tablet_service.cc:1511] Processing CreateTablet for tablet b4edfd4e5ea7461eaa8917755dff8c60 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:51.002081 28145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4edfd4e5ea7461eaa8917755dff8c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.002010 28222 tablet_service.cc:1511] Processing CreateTablet for tablet b4edfd4e5ea7461eaa8917755dff8c60 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:51.003438 28222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4edfd4e5ea7461eaa8917755dff8c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.003085 27996 tablet_service.cc:1511] Processing CreateTablet for tablet b4edfd4e5ea7461eaa8917755dff8c60 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:50.981097 28277 consensus_queue.cc:260] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:51.009595 28291 raft_consensus.cc:493] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.010154 28291 raft_consensus.cc:515] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:51.013741 27998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ccc7022ab04f9a8ddc87ac37f31c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.024255 27996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4edfd4e5ea7461eaa8917755dff8c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.030972 28291 leader_election.cc:290] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:51.062959 27993 tablet_service.cc:1511] Processing CreateTablet for tablet f3a25078ad8448a485e557a6edaf0118 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:51.063465 28073 tablet_service.cc:1511] Processing CreateTablet for tablet 3758e0f5638b496dbea84f0014c5e6a5 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:51.064435 27993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3a25078ad8448a485e557a6edaf0118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.064790 28073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3758e0f5638b496dbea84f0014c5e6a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.065024 28140 tablet_service.cc:1511] Processing CreateTablet for tablet f3a25078ad8448a485e557a6edaf0118 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:51.066365 28140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3a25078ad8448a485e557a6edaf0118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.067830 28277 ts_tablet_manager.cc:1434] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.133s	user 0.007s	sys 0.016s
I20260709 13:21:51.067610 28071 tablet_service.cc:1511] Processing CreateTablet for tablet f3a25078ad8448a485e557a6edaf0118 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:51.068856 28277 tablet_bootstrap.cc:492] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:51.068861 28071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3a25078ad8448a485e557a6edaf0118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.078091 28293 raft_consensus.cc:493] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.078701 28293 raft_consensus.cc:515] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:51.089586 28291 raft_consensus.cc:493] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.090224 28291 raft_consensus.cc:515] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:51.106997 28067 tablet_service.cc:1511] Processing CreateTablet for tablet 09ce0cdf347247538a4b952da2421761 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:51.111692 28067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09ce0cdf347247538a4b952da2421761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.118146 28146 tablet_service.cc:1511] Processing CreateTablet for tablet 3758e0f5638b496dbea84f0014c5e6a5 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:51.119609 28146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3758e0f5638b496dbea84f0014c5e6a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.122773 28147 tablet_service.cc:1511] Processing CreateTablet for tablet 77ff8ad68e8c484084ae9ff0160e712f (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:51.124253 28147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ff8ad68e8c484084ae9ff0160e712f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.129397 28284 raft_consensus.cc:493] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.130048 28284 raft_consensus.cc:515] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:51.131110 28280 tablet_bootstrap.cc:492] T 2964725f81fe44ec98f509298316722b P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:51.131672 28280 ts_tablet_manager.cc:1403] T 2964725f81fe44ec98f509298316722b P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.218s	user 0.023s	sys 0.005s
I20260709 13:21:51.094336 27997 tablet_service.cc:1511] Processing CreateTablet for tablet 09ce0cdf347247538a4b952da2421761 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:51.140964 28278 tablet_bootstrap.cc:654] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.142477 27997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09ce0cdf347247538a4b952da2421761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.102383 28293 leader_election.cc:290] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:51.133258 28277 tablet_bootstrap.cc:654] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.134503 28284 leader_election.cc:290] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:51.193293 27994 tablet_service.cc:1511] Processing CreateTablet for tablet 77ff8ad68e8c484084ae9ff0160e712f (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:51.194905 27994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ff8ad68e8c484084ae9ff0160e712f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.193295 28068 tablet_service.cc:1511] Processing CreateTablet for tablet ed7ccef5723d4614918b18c47b9dfa3a (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:51.200176 28068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed7ccef5723d4614918b18c47b9dfa3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.207288 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90c9f452bac4ef0b959ca0e78ab475f" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:21:51.215679 28048 leader_election.cc:343] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.230134 28291 leader_election.cc:290] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:51.232753 28279 tablet_bootstrap.cc:492] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:51.232587 27995 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1dc5fdce0d4a289fc84c10ecbcd2c7 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:51.234445 28279 ts_tablet_manager.cc:1403] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.326s	user 0.011s	sys 0.013s
I20260709 13:21:51.293134 27995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1dc5fdce0d4a289fc84c10ecbcd2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.295018 28143 tablet_service.cc:1511] Processing CreateTablet for tablet ed7ccef5723d4614918b18c47b9dfa3a (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:51.296676 28143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed7ccef5723d4614918b18c47b9dfa3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.294808 28280 raft_consensus.cc:359] T 2964725f81fe44ec98f509298316722b P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:51.298717 28280 raft_consensus.cc:385] T 2964725f81fe44ec98f509298316722b P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.299172 28280 raft_consensus.cc:740] T 2964725f81fe44ec98f509298316722b P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.364711 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90c9f452bac4ef0b959ca0e78ab475f" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:51.300357 28280 consensus_queue.cc:260] T 2964725f81fe44ec98f509298316722b P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:51.357832 28084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b8050a4f374a91b8993cd0d6ed3dbd" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:51.375257 28216 tablet_service.cc:1511] Processing CreateTablet for tablet 3758e0f5638b496dbea84f0014c5e6a5 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:51.375624 28142 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1dc5fdce0d4a289fc84c10ecbcd2c7 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:51.376771 28216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3758e0f5638b496dbea84f0014c5e6a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.377058 28142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1dc5fdce0d4a289fc84c10ecbcd2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.379024 27992 tablet_service.cc:1511] Processing CreateTablet for tablet 86e62ca8c25e497bb3f7ad553ee4f3c2 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:51.380714 27992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e62ca8c25e497bb3f7ad553ee4f3c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.382726 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2ec8b6b6234ee6b530a1c4b7e18618" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
W20260709 13:21:51.353960 27893 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.17.251.130:43901, user_credentials={real_user=slave}} blocked reactor thread for 62786.5us
W20260709 13:21:51.385053 28047 leader_election.cc:343] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2f737d674147808bb32783de176848 (127.17.251.132:36151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.385634 28047 leader_election.cc:304] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:51.387439 28069 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1dc5fdce0d4a289fc84c10ecbcd2c7 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:51.397544 28284 raft_consensus.cc:2749] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:51.398628 28069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1dc5fdce0d4a289fc84c10ecbcd2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.399019 28279 raft_consensus.cc:359] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:51.399850 28279 raft_consensus.cc:385] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.400255 28279 raft_consensus.cc:740] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.401036 28279 consensus_queue.cc:260] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
W20260709 13:21:51.402523 28047 leader_election.cc:343] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2f737d674147808bb32783de176848 (127.17.251.132:36151): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:51.400027 28197 leader_election.cc:343] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.442720 28084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b5e77de8ab4ce39569a347a84ed651" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:51.442771 28222 tablet_service.cc:1511] Processing CreateTablet for tablet 09ce0cdf347247538a4b952da2421761 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260709 13:21:51.444411 27974 leader_election.cc:343] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.445221 28222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09ce0cdf347247538a4b952da2421761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.453971 28217 tablet_service.cc:1511] Processing CreateTablet for tablet 77ff8ad68e8c484084ae9ff0160e712f (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:51.454267 28218 tablet_service.cc:1511] Processing CreateTablet for tablet ed7ccef5723d4614918b18c47b9dfa3a (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:51.455406 28217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ff8ad68e8c484084ae9ff0160e712f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.456077 28218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed7ccef5723d4614918b18c47b9dfa3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.459671 28219 tablet_service.cc:1511] Processing CreateTablet for tablet 86e62ca8c25e497bb3f7ad553ee4f3c2 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:51.460379 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b5e77de8ab4ce39569a347a84ed651" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:51.461017 28219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e62ca8c25e497bb3f7ad553ee4f3c2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:51.461884 27972 leader_election.cc:343] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2f737d674147808bb32783de176848 (127.17.251.132:36151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.462365 27972 leader_election.cc:304] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28; no voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651
I20260709 13:21:51.462954 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964725f81fe44ec98f509298316722b" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:51.463562 28293 raft_consensus.cc:2749] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:51.465163 28196 leader_election.cc:343] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:51.466470 27954 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:51.467425 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2ec8b6b6234ee6b530a1c4b7e18618" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
W20260709 13:21:51.470175 28050 leader_election.cc:343] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.439759 28279 ts_tablet_manager.cc:1434] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.148s	user 0.011s	sys 0.002s
I20260709 13:21:51.470691 28050 leader_election.cc:304] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:51.471892 28284 raft_consensus.cc:2749] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:51.473933 28277 tablet_bootstrap.cc:492] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:51.474524 28277 ts_tablet_manager.cc:1403] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.406s	user 0.023s	sys 0.003s
I20260709 13:21:51.475104 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b8050a4f374a91b8993cd0d6ed3dbd" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:51.474433 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964725f81fe44ec98f509298316722b" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:51.476943 28157 raft_consensus.cc:2468] T 2964725f81fe44ec98f509298316722b P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
W20260709 13:21:51.479326 28198 leader_election.cc:343] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.479830 28198 leader_election.cc:304] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651
I20260709 13:21:51.480633 28291 raft_consensus.cc:2749] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:51.478629 28279 tablet_bootstrap.cc:492] T 35b5e77de8ab4ce39569a347a84ed651 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:51.481827 28067 tablet_service.cc:1511] Processing CreateTablet for tablet 86e62ca8c25e497bb3f7ad553ee4f3c2 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:51.487596 28140 tablet_service.cc:1511] Processing CreateTablet for tablet 81f6ad6d00d44eb5b9914641b6da9ae5 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:51.488546 28067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e62ca8c25e497bb3f7ad553ee4f3c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.489650 28140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f6ad6d00d44eb5b9914641b6da9ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.494616 28198 leader_election.cc:304] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:51.498237 28280 ts_tablet_manager.cc:1434] T 2964725f81fe44ec98f509298316722b P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.366s	user 0.014s	sys 0.014s
W20260709 13:21:51.542550 28198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:44409, user_credentials={real_user=slave}} blocked reactor thread for 48044.3us
I20260709 13:21:51.543051 28280 tablet_bootstrap.cc:492] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:51.502945 28279 tablet_bootstrap.cc:654] T 35b5e77de8ab4ce39569a347a84ed651 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.543686 27994 tablet_service.cc:1511] Processing CreateTablet for tablet 81f6ad6d00d44eb5b9914641b6da9ae5 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:51.544718 28291 raft_consensus.cc:2804] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:51.545190 28291 raft_consensus.cc:493] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:51.545275 27994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f6ad6d00d44eb5b9914641b6da9ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.545595 28291 raft_consensus.cc:3060] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.502436 28278 tablet_bootstrap.cc:492] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:51.547456 28278 ts_tablet_manager.cc:1403] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.562s	user 0.020s	sys 0.022s
I20260709 13:21:51.504495 28277 raft_consensus.cc:359] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:51.549827 28277 raft_consensus.cc:385] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.550174 28277 raft_consensus.cc:740] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
W20260709 13:21:51.531599 27893 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.17.251.130:43901, user_credentials={real_user=slave}} blocked reactor thread for 54268.1us
I20260709 13:21:51.550979 28277 consensus_queue.cc:260] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:51.553932 28277 ts_tablet_manager.cc:1434] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.003s
I20260709 13:21:51.559870 28277 tablet_bootstrap.cc:492] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:51.562250 28278 raft_consensus.cc:359] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:51.563064 28278 raft_consensus.cc:385] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.563374 28278 raft_consensus.cc:740] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.564275 28278 consensus_queue.cc:260] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:51.566584 28278 ts_tablet_manager.cc:1434] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:21:51.577807 28277 tablet_bootstrap.cc:654] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.580418 28280 tablet_bootstrap.cc:654] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.581166 28291 raft_consensus.cc:515] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:51.584311 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964725f81fe44ec98f509298316722b" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:51.584944 28009 raft_consensus.cc:3060] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.577426 28278 tablet_bootstrap.cc:492] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:51.581164 28067 tablet_service.cc:1511] Processing CreateTablet for tablet a8feb7220d3845768a841d7df788966e (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:51.587249 28067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8feb7220d3845768a841d7df788966e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.592129 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964725f81fe44ec98f509298316722b" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:51.592881 28157 raft_consensus.cc:3060] T 2964725f81fe44ec98f509298316722b P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.584792 28217 tablet_service.cc:1511] Processing CreateTablet for tablet 81f6ad6d00d44eb5b9914641b6da9ae5 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:51.594825 28291 leader_election.cc:290] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:51.595103 28217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f6ad6d00d44eb5b9914641b6da9ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.596589 28141 tablet_service.cc:1511] Processing CreateTablet for tablet a8feb7220d3845768a841d7df788966e (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:51.598467 28009 raft_consensus.cc:2468] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:51.600069 28196 leader_election.cc:304] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28; no voters: 
I20260709 13:21:51.601133 28291 raft_consensus.cc:2804] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:51.601821 28291 raft_consensus.cc:697] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:21:51.602095 28218 tablet_service.cc:1511] Processing CreateTablet for tablet a8feb7220d3845768a841d7df788966e (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:51.603130 28141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8feb7220d3845768a841d7df788966e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.602909 28291 consensus_queue.cc:237] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:51.603657 28218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8feb7220d3845768a841d7df788966e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.609177 28157 raft_consensus.cc:2468] T 2964725f81fe44ec98f509298316722b P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:51.616078 28277 tablet_bootstrap.cc:492] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:51.616737 28277 ts_tablet_manager.cc:1403] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.057s	user 0.007s	sys 0.004s
I20260709 13:21:51.617486 27995 tablet_service.cc:1511] Processing CreateTablet for tablet ec29c7c5037f4fe79d9681c5b1c7b53b (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:51.619028 27995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec29c7c5037f4fe79d9681c5b1c7b53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.620206 28278 tablet_bootstrap.cc:654] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.620456 28277 raft_consensus.cc:359] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:51.621351 28277 raft_consensus.cc:385] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.622829 28277 raft_consensus.cc:740] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.623955 28280 tablet_bootstrap.cc:492] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:51.624508 28280 ts_tablet_manager.cc:1403] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.082s	user 0.004s	sys 0.008s
I20260709 13:21:51.631425 28219 tablet_service.cc:1511] Processing CreateTablet for tablet 55a66e81e89d46308972b6fbc0328b74 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:51.633812 28277 consensus_queue.cc:260] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:51.634521 28143 tablet_service.cc:1511] Processing CreateTablet for tablet ec29c7c5037f4fe79d9681c5b1c7b53b (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:51.636356 28277 ts_tablet_manager.cc:1434] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:21:51.636456 28143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec29c7c5037f4fe79d9681c5b1c7b53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.637451 28277 tablet_bootstrap.cc:492] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:51.639876 28280 raft_consensus.cc:359] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:51.640748 28280 raft_consensus.cc:385] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.641055 28280 raft_consensus.cc:740] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.643180 28071 tablet_service.cc:1511] Processing CreateTablet for tablet ec29c7c5037f4fe79d9681c5b1c7b53b (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:51.645159 28071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec29c7c5037f4fe79d9681c5b1c7b53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.645533 27992 tablet_service.cc:1511] Processing CreateTablet for tablet 55a66e81e89d46308972b6fbc0328b74 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:51.633411 28219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a66e81e89d46308972b6fbc0328b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.646931 27992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a66e81e89d46308972b6fbc0328b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.649945 28146 tablet_service.cc:1511] Processing CreateTablet for tablet 9815241ff06642b59c8d28aaeb390d8e (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:51.651309 28146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9815241ff06642b59c8d28aaeb390d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.654999 28069 tablet_service.cc:1511] Processing CreateTablet for tablet 55a66e81e89d46308972b6fbc0328b74 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:51.655004 27998 tablet_service.cc:1511] Processing CreateTablet for tablet 9815241ff06642b59c8d28aaeb390d8e (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:51.658104 28068 tablet_service.cc:1511] Processing CreateTablet for tablet 96c01bb7a8b84db7b8b44098cd5602a2 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:51.658640 27998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9815241ff06642b59c8d28aaeb390d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.658598 28140 tablet_service.cc:1511] Processing CreateTablet for tablet 96c01bb7a8b84db7b8b44098cd5602a2 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:51.662905 28140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96c01bb7a8b84db7b8b44098cd5602a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.669523 28279 tablet_bootstrap.cc:492] T 35b5e77de8ab4ce39569a347a84ed651 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:51.670717 28279 ts_tablet_manager.cc:1403] T 35b5e77de8ab4ce39569a347a84ed651 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.192s	user 0.015s	sys 0.010s
I20260709 13:21:51.674191 28069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a66e81e89d46308972b6fbc0328b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.674888 28068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96c01bb7a8b84db7b8b44098cd5602a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.682394 28222 tablet_service.cc:1511] Processing CreateTablet for tablet 9815241ff06642b59c8d28aaeb390d8e (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:51.683930 28222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9815241ff06642b59c8d28aaeb390d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.680712 28280 consensus_queue.cc:260] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:51.687497 28216 tablet_service.cc:1511] Processing CreateTablet for tablet 96c01bb7a8b84db7b8b44098cd5602a2 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:51.688869 28216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96c01bb7a8b84db7b8b44098cd5602a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.695716 28277 tablet_bootstrap.cc:654] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.697642 28280 ts_tablet_manager.cc:1434] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.002s
I20260709 13:21:51.707094 27995 tablet_service.cc:1511] Processing CreateTablet for tablet 7e87d83bcd69480ca50f5ea54a73cead (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:51.708962 27995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e87d83bcd69480ca50f5ea54a73cead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.710345 28278 tablet_bootstrap.cc:492] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:51.710927 28278 ts_tablet_manager.cc:1403] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.134s	user 0.014s	sys 0.000s
I20260709 13:21:51.712414 27907 catalog_manager.cc:5697] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 1 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:51.715672 28278 raft_consensus.cc:359] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:51.740206 28278 raft_consensus.cc:385] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.740583 28278 raft_consensus.cc:740] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.741441 28278 consensus_queue.cc:260] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:51.743723 28278 ts_tablet_manager.cc:1434] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:21:51.744027 28073 tablet_service.cc:1511] Processing CreateTablet for tablet 115ec4e7eaff44c191ebb3618716383c (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:51.744979 28278 tablet_bootstrap.cc:492] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:51.745419 28073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115ec4e7eaff44c191ebb3618716383c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.751915 28277 tablet_bootstrap.cc:492] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:51.752151 28278 tablet_bootstrap.cc:654] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.752537 28277 ts_tablet_manager.cc:1403] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.001s
I20260709 13:21:51.755784 28067 tablet_service.cc:1511] Processing CreateTablet for tablet 7e87d83bcd69480ca50f5ea54a73cead (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:51.757329 28067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e87d83bcd69480ca50f5ea54a73cead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.727450 28280 tablet_bootstrap.cc:492] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:51.733954 28147 tablet_service.cc:1511] Processing CreateTablet for tablet 7e87d83bcd69480ca50f5ea54a73cead (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:51.772250 28147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e87d83bcd69480ca50f5ea54a73cead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.736994 28221 tablet_service.cc:1511] Processing CreateTablet for tablet 115ec4e7eaff44c191ebb3618716383c (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:51.761263 28143 tablet_service.cc:1511] Processing CreateTablet for tablet 1e3da7f8304442df89580b5f02ed1bcf (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:51.763626 27992 tablet_service.cc:1511] Processing CreateTablet for tablet 1e3da7f8304442df89580b5f02ed1bcf (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:51.774603 27992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e3da7f8304442df89580b5f02ed1bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.774669 28221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115ec4e7eaff44c191ebb3618716383c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.776605 27995 tablet_service.cc:1511] Processing CreateTablet for tablet 115ec4e7eaff44c191ebb3618716383c (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:51.777308 28143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e3da7f8304442df89580b5f02ed1bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.784610 27995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115ec4e7eaff44c191ebb3618716383c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.797094 28141 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7df1c61b2348668e7022bfc34d7886 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:51.798542 28141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7df1c61b2348668e7022bfc34d7886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.799322 28217 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7df1c61b2348668e7022bfc34d7886 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:51.800616 28217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7df1c61b2348668e7022bfc34d7886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.764349 28218 tablet_service.cc:1511] Processing CreateTablet for tablet 1e3da7f8304442df89580b5f02ed1bcf (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:51.766386 28074 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7df1c61b2348668e7022bfc34d7886 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:51.802251 28074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7df1c61b2348668e7022bfc34d7886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.809216 28280 tablet_bootstrap.cc:654] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.810736 28291 raft_consensus.cc:493] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.811267 28291 raft_consensus.cc:515] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:51.813525 28291 leader_election.cc:290] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:51.814411 28084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2ec8b6b6234ee6b530a1c4b7e18618" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:51.768203 28277 raft_consensus.cc:359] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:51.703428 28279 raft_consensus.cc:359] T 35b5e77de8ab4ce39569a347a84ed651 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:51.815146 28084 raft_consensus.cc:2468] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:21:51.815158 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2ec8b6b6234ee6b530a1c4b7e18618" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:51.815231 28279 raft_consensus.cc:385] T 35b5e77de8ab4ce39569a347a84ed651 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.816115 28279 raft_consensus.cc:740] T 35b5e77de8ab4ce39569a347a84ed651 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.816794 28197 leader_election.cc:304] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:51.817065 28279 consensus_queue.cc:260] T 35b5e77de8ab4ce39569a347a84ed651 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
W20260709 13:21:51.817950 28198 leader_election.cc:343] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.819914 28279 ts_tablet_manager.cc:1434] T 35b5e77de8ab4ce39569a347a84ed651 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.149s	user 0.006s	sys 0.001s
I20260709 13:21:51.821205 28279 tablet_bootstrap.cc:492] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:51.821650 28291 raft_consensus.cc:2804] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:51.822083 28291 raft_consensus.cc:493] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:51.822463 28291 raft_consensus.cc:3060] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.825731 28277 raft_consensus.cc:385] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.826191 28277 raft_consensus.cc:740] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.827106 28277 consensus_queue.cc:260] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:51.829888 28277 ts_tablet_manager.cc:1434] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.002s
I20260709 13:21:51.834161 27994 tablet_service.cc:1511] Processing CreateTablet for tablet b1785087e0e647aebaa4e56a6c11482e (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:51.834924 28073 tablet_service.cc:1511] Processing CreateTablet for tablet b1785087e0e647aebaa4e56a6c11482e (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:51.838013 28218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e3da7f8304442df89580b5f02ed1bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.839203 28291 raft_consensus.cc:515] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:51.847445 27994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1785087e0e647aebaa4e56a6c11482e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.853176 28220 tablet_service.cc:1511] Processing CreateTablet for tablet 44f20c0135d64866abcf710b9b331281 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:51.854224 27992 tablet_service.cc:1511] Processing CreateTablet for tablet 44f20c0135d64866abcf710b9b331281 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:51.854707 28220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f20c0135d64866abcf710b9b331281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.855324 28284 raft_consensus.cc:493] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.855532 27992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f20c0135d64866abcf710b9b331281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.855857 28284 raft_consensus.cc:515] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:51.859462 28284 leader_election.cc:290] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:51.861687 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e12f9e1f649c19b7ba5bac1e051dd" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:51.861692 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e12f9e1f649c19b7ba5bac1e051dd" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
W20260709 13:21:51.863410 28048 leader_election.cc:343] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:51.863966 28050 leader_election.cc:343] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.864428 28050 leader_election.cc:304] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:51.865693 28284 raft_consensus.cc:2749] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:51.876643 28070 tablet_service.cc:1511] Processing CreateTablet for tablet 44f20c0135d64866abcf710b9b331281 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:51.878391 28297 raft_consensus.cc:493] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.878948 28297 raft_consensus.cc:515] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:51.881158 28297 leader_election.cc:290] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:51.883176 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b5e77de8ab4ce39569a347a84ed651" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:51.883419 28084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b5e77de8ab4ce39569a347a84ed651" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:51.883879 28009 raft_consensus.cc:2468] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:21:51.884092 28084 raft_consensus.cc:2468] T 35b5e77de8ab4ce39569a347a84ed651 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:21:51.885216 28196 leader_election.cc:304] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28; no voters: 
I20260709 13:21:51.886711 28297 raft_consensus.cc:2804] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:51.887090 28297 raft_consensus.cc:493] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:51.887424 28297 raft_consensus.cc:3060] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.905599 28084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2ec8b6b6234ee6b530a1c4b7e18618" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:51.906380 28084 raft_consensus.cc:3060] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.907461 28147 tablet_service.cc:1511] Processing CreateTablet for tablet 17389976f8e346dbb2fbc326a9e60396 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:51.908895 28147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17389976f8e346dbb2fbc326a9e60396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.901002 28277 tablet_bootstrap.cc:492] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:51.903272 28073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1785087e0e647aebaa4e56a6c11482e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.925649 28070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f20c0135d64866abcf710b9b331281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.928372 28218 tablet_service.cc:1511] Processing CreateTablet for tablet 17389976f8e346dbb2fbc326a9e60396 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:51.925901 28143 tablet_service.cc:1511] Processing CreateTablet for tablet b1785087e0e647aebaa4e56a6c11482e (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:51.930486 28143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1785087e0e647aebaa4e56a6c11482e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.932497 28279 tablet_bootstrap.cc:654] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.935600 28084 raft_consensus.cc:2468] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:51.937098 28197 leader_election.cc:304] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:51.932513 28218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17389976f8e346dbb2fbc326a9e60396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.947746 28278 tablet_bootstrap.cc:492] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:51.948319 28278 ts_tablet_manager.cc:1403] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.204s	user 0.034s	sys 0.030s
I20260709 13:21:51.944963 28291 leader_election.cc:290] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:51.980396 27998 tablet_service.cc:1511] Processing CreateTablet for tablet 17389976f8e346dbb2fbc326a9e60396 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:51.962322 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2ec8b6b6234ee6b530a1c4b7e18618" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:51.981796 27998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17389976f8e346dbb2fbc326a9e60396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.979269 28291 raft_consensus.cc:2804] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:51.994983 28068 tablet_service.cc:1511] Processing CreateTablet for tablet e7175e0071a54910af34661c079bcca4 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:51.996469 28068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7175e0071a54910af34661c079bcca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.995061 28140 tablet_service.cc:1511] Processing CreateTablet for tablet e7175e0071a54910af34661c079bcca4 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:51.998879 28140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7175e0071a54910af34661c079bcca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.003901 28277 tablet_bootstrap.cc:654] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.990161 28297 raft_consensus.cc:515] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:52.015727 28323 raft_consensus.cc:493] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.016382 28323 raft_consensus.cc:515] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:52.016655 28084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b5e77de8ab4ce39569a347a84ed651" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:52.014994 28278 raft_consensus.cc:359] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:52.017318 28084 raft_consensus.cc:3060] T 35b5e77de8ab4ce39569a347a84ed651 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.017498 28278 raft_consensus.cc:385] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.017959 28278 raft_consensus.cc:740] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.018723 28323 leader_election.cc:290] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:52.022610 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755b1458334b47b2ae9a71fb44952d95" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:52.023200 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755b1458334b47b2ae9a71fb44952d95" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:52.023269 28009 raft_consensus.cc:2468] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:21:52.023972 28157 raft_consensus.cc:2468] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:21:52.025010 28196 leader_election.cc:304] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28; no voters: 
W20260709 13:21:52.025771 28198 leader_election.cc:343] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.021272 28280 tablet_bootstrap.cc:492] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:52.030334 28280 ts_tablet_manager.cc:1403] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.303s	user 0.018s	sys 0.003s
I20260709 13:21:52.029171 27995 tablet_service.cc:1511] Processing CreateTablet for tablet e63f258079e143c89ee02598a5df4701 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:52.031723 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b5e77de8ab4ce39569a347a84ed651" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:52.032617 28324 raft_consensus.cc:2804] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.032725 28009 raft_consensus.cc:3060] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.033141 28324 raft_consensus.cc:493] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.033548 28324 raft_consensus.cc:3060] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.033962 28280 raft_consensus.cc:359] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.034719 28280 raft_consensus.cc:385] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.035017 28280 raft_consensus.cc:740] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.035697 27995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63f258079e143c89ee02598a5df4701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.040709 28009 raft_consensus.cc:2468] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:52.031951 28291 raft_consensus.cc:697] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:21:52.041708 28297 leader_election.cc:290] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:52.047534 28291 consensus_queue.cc:237] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.048904 28220 tablet_service.cc:1511] Processing CreateTablet for tablet e7175e0071a54910af34661c079bcca4 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:52.050442 28220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7175e0071a54910af34661c079bcca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.051821 28084 raft_consensus.cc:2468] T 35b5e77de8ab4ce39569a347a84ed651 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:52.041859 28278 consensus_queue.cc:260] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:52.040730 28280 consensus_queue.cc:260] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.055958 28197 leader_election.cc:304] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:52.058140 28297 raft_consensus.cc:2804] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.058804 28297 raft_consensus.cc:697] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:21:52.059762 28297 consensus_queue.cc:237] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:52.062765 28324 raft_consensus.cc:515] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:52.063207 28280 ts_tablet_manager.cc:1434] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:21:52.064159 28070 tablet_service.cc:1511] Processing CreateTablet for tablet e63f258079e143c89ee02598a5df4701 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:52.073559 28070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63f258079e143c89ee02598a5df4701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.078917 28147 tablet_service.cc:1511] Processing CreateTablet for tablet e63f258079e143c89ee02598a5df4701 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:52.080338 28147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63f258079e143c89ee02598a5df4701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.073808 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755b1458334b47b2ae9a71fb44952d95" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:52.082309 28157 raft_consensus.cc:3060] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.075893 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755b1458334b47b2ae9a71fb44952d95" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:52.085145 28279 tablet_bootstrap.cc:492] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:52.085669 28008 raft_consensus.cc:3060] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.085923 28279 ts_tablet_manager.cc:1403] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.265s	user 0.008s	sys 0.006s
I20260709 13:21:52.074227 28324 leader_election.cc:290] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:52.089807 28279 raft_consensus.cc:359] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.090646 28310 raft_consensus.cc:493] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.090723 28279 raft_consensus.cc:385] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.091279 28310 raft_consensus.cc:515] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.097069 28277 tablet_bootstrap.cc:492] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:52.097779 28277 ts_tablet_manager.cc:1403] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.226s	user 0.009s	sys 0.014s
I20260709 13:21:52.100797 28277 raft_consensus.cc:359] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:52.101516 28277 raft_consensus.cc:385] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.102602 28277 raft_consensus.cc:740] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.103497 28278 ts_tablet_manager.cc:1434] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.155s	user 0.008s	sys 0.001s
I20260709 13:21:52.103515 28277 consensus_queue.cc:260] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:52.107153 28310 leader_election.cc:290] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:52.108575 28157 raft_consensus.cc:2468] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:52.110110 28277 ts_tablet_manager.cc:1434] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.005s
I20260709 13:21:52.110484 28280 tablet_bootstrap.cc:492] T dc2ec8b6b6234ee6b530a1c4b7e18618 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:52.111855 28277 tablet_bootstrap.cc:492] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:52.091307 28279 raft_consensus.cc:740] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.104813 28278 tablet_bootstrap.cc:492] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:52.120890 28198 leader_election.cc:304] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:52.117892 28008 raft_consensus.cc:2468] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:52.106649 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b8050a4f374a91b8993cd0d6ed3dbd" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:52.130497 27995 tablet_service.cc:1511] Processing CreateTablet for tablet 82f55c4d42a545aabd60f9579818ff2b (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:52.178164 28232 raft_consensus.cc:2468] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:21:52.150219 28220 tablet_service.cc:1511] Processing CreateTablet for tablet 82f55c4d42a545aabd60f9579818ff2b (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:52.179600 28121 leader_election.cc:304] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:52.170202 28279 consensus_queue.cc:260] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.179989 28221 tablet_service.cc:1511] Processing CreateTablet for tablet 1c653748b39e457aab513022ae1306f5 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:52.181499 27995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f55c4d42a545aabd60f9579818ff2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.147188 28297 consensus_queue.cc:1048] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 13:21:52.144794 28324 raft_consensus.cc:2804] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.186187 28324 raft_consensus.cc:697] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:21:52.187076 28324 consensus_queue.cc:237] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:52.176543 28280 tablet_bootstrap.cc:654] T dc2ec8b6b6234ee6b530a1c4b7e18618 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.143631 28310 raft_consensus.cc:493] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.199280 28220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f55c4d42a545aabd60f9579818ff2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.197891 27998 tablet_service.cc:1511] Processing CreateTablet for tablet 1c653748b39e457aab513022ae1306f5 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:52.173666 28143 tablet_service.cc:1511] Processing CreateTablet for tablet 1c653748b39e457aab513022ae1306f5 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:52.200984 28284 raft_consensus.cc:493] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.207258 28073 tablet_service.cc:1511] Processing CreateTablet for tablet dc8f779373b044c2b2e3d0e781f4d04f (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:52.215605 28331 raft_consensus.cc:2804] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.220319 27998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c653748b39e457aab513022ae1306f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.229068 28278 tablet_bootstrap.cc:654] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.222201 28222 tablet_service.cc:1511] Processing CreateTablet for tablet dc8f779373b044c2b2e3d0e781f4d04f (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:52.222824 28277 tablet_bootstrap.cc:654] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.222345 28143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c653748b39e457aab513022ae1306f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.234160 27992 tablet_service.cc:1511] Processing CreateTablet for tablet cbe7aa856d09405fbb13f70607e0d3e9 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:52.235261 28279 ts_tablet_manager.cc:1434] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.149s	user 0.005s	sys 0.004s
I20260709 13:21:52.235710 27992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe7aa856d09405fbb13f70607e0d3e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.236894 28279 tablet_bootstrap.cc:492] T 88b8050a4f374a91b8993cd0d6ed3dbd P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:52.218616 28284 raft_consensus.cc:515] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.240175 28284 leader_election.cc:290] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:52.156141 28070 tablet_service.cc:1511] Processing CreateTablet for tablet 82f55c4d42a545aabd60f9579818ff2b (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:52.242477 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f95034322d746e4aaf06b06873de375" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:21:52.244181 28048 leader_election.cc:343] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.226478 28073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc8f779373b044c2b2e3d0e781f4d04f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.246817 28068 tablet_service.cc:1511] Processing CreateTablet for tablet cbe7aa856d09405fbb13f70607e0d3e9 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:52.248291 28068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe7aa856d09405fbb13f70607e0d3e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.226938 28297 consensus_queue.cc:1048] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.227774 28147 tablet_service.cc:1511] Processing CreateTablet for tablet dc8f779373b044c2b2e3d0e781f4d04f (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:52.213701 28310 raft_consensus.cc:515] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.123443 27906 catalog_manager.cc:5697] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 1 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:52.250344 28221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c653748b39e457aab513022ae1306f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.253171 28222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc8f779373b044c2b2e3d0e781f4d04f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.254841 28070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f55c4d42a545aabd60f9579818ff2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.261377 28331 raft_consensus.cc:493] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.261962 28331 raft_consensus.cc:3060] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.286376 28218 tablet_service.cc:1511] Processing CreateTablet for tablet fff4d26a60a64a959845d8a267925536 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:52.288281 28218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff4d26a60a64a959845d8a267925536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.293316 28067 tablet_service.cc:1511] Processing CreateTablet for tablet fff4d26a60a64a959845d8a267925536 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:52.294838 28067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff4d26a60a64a959845d8a267925536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.300546 28310 leader_election.cc:290] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:52.303217 27995 tablet_service.cc:1511] Processing CreateTablet for tablet fff4d26a60a64a959845d8a267925536 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:52.303849 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c61eea3984e50916353d4844fe718" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:52.304639 27995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff4d26a60a64a959845d8a267925536. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:52.305604 28122 leader_election.cc:343] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.309576 27907 catalog_manager.cc:5697] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 1 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.311739 27907 catalog_manager.cc:5697] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 1 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.318960 28331 raft_consensus.cc:515] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.325353 28140 tablet_service.cc:1511] Processing CreateTablet for tablet cbe7aa856d09405fbb13f70607e0d3e9 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:52.325801 28084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b8050a4f374a91b8993cd0d6ed3dbd" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:52.326470 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c61eea3984e50916353d4844fe718" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
W20260709 13:21:52.333195 28123 leader_election.cc:343] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.333215 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f95034322d746e4aaf06b06873de375" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:52.333237 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b8050a4f374a91b8993cd0d6ed3dbd" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
W20260709 13:21:52.334468 28123 leader_election.cc:343] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.334951 28123 leader_election.cc:304] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651
W20260709 13:21:52.336324 28123 leader_election.cc:343] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.336483 28280 tablet_bootstrap.cc:492] T dc2ec8b6b6234ee6b530a1c4b7e18618 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:52.336994 28280 ts_tablet_manager.cc:1403] T dc2ec8b6b6234ee6b530a1c4b7e18618 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.227s	user 0.013s	sys 0.006s
I20260709 13:21:52.337175 28334 raft_consensus.cc:2749] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.334954 27992 tablet_service.cc:1511] Processing CreateTablet for tablet 798271eb9117496ab0d95ece523d5268 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:21:52.338665 28050 leader_election.cc:343] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.339000 27992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798271eb9117496ab0d95ece523d5268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.339147 28050 leader_election.cc:304] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:52.339218 28146 tablet_service.cc:1511] Processing CreateTablet for tablet 798271eb9117496ab0d95ece523d5268 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:52.340591 28332 raft_consensus.cc:2749] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.340207 28280 raft_consensus.cc:359] T dc2ec8b6b6234ee6b530a1c4b7e18618 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.334233 28216 tablet_service.cc:1511] Processing CreateTablet for tablet 798271eb9117496ab0d95ece523d5268 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:52.342991 28216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798271eb9117496ab0d95ece523d5268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.332291 28147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc8f779373b044c2b2e3d0e781f4d04f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.349318 28146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798271eb9117496ab0d95ece523d5268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.355710 28067 tablet_service.cc:1511] Processing CreateTablet for tablet a1c8db979236426c88754a4d4d46e147 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:52.357154 28067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c8db979236426c88754a4d4d46e147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.357867 28140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe7aa856d09405fbb13f70607e0d3e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.352847 28280 raft_consensus.cc:385] T dc2ec8b6b6234ee6b530a1c4b7e18618 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.361927 28280 raft_consensus.cc:740] T dc2ec8b6b6234ee6b530a1c4b7e18618 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.362874 28280 consensus_queue.cc:260] T dc2ec8b6b6234ee6b530a1c4b7e18618 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.365504 28280 ts_tablet_manager.cc:1434] T dc2ec8b6b6234ee6b530a1c4b7e18618 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.004s
I20260709 13:21:52.366696 28280 tablet_bootstrap.cc:492] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:52.368076 28278 tablet_bootstrap.cc:492] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:52.368623 28278 ts_tablet_manager.cc:1403] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.264s	user 0.013s	sys 0.014s
I20260709 13:21:52.374895 28278 raft_consensus.cc:359] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.377830 28278 raft_consensus.cc:385] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.379070 28293 raft_consensus.cc:493] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.379845 28293 raft_consensus.cc:515] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:52.381321 28279 tablet_bootstrap.cc:654] T 88b8050a4f374a91b8993cd0d6ed3dbd P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.383934 28277 tablet_bootstrap.cc:492] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:52.384498 28277 ts_tablet_manager.cc:1403] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.273s	user 0.020s	sys 0.007s
I20260709 13:21:52.384522 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90c9f452bac4ef0b959ca0e78ab475f" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:52.386695 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90c9f452bac4ef0b959ca0e78ab475f" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:52.387547 28232 raft_consensus.cc:2468] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 0.
I20260709 13:21:52.387820 28277 raft_consensus.cc:359] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:52.388603 28277 raft_consensus.cc:385] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.388911 28277 raft_consensus.cc:740] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.389066 28293 leader_election.cc:290] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:52.389690 28277 consensus_queue.cc:260] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:52.389951 28082 raft_consensus.cc:2468] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 0.
I20260709 13:21:52.391222 27972 leader_election.cc:304] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28; no voters: 
I20260709 13:21:52.395121 28293 raft_consensus.cc:2804] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.395757 28293 raft_consensus.cc:493] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.396275 28293 raft_consensus.cc:3060] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.399457 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b8050a4f374a91b8993cd0d6ed3dbd" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:52.400131 28232 raft_consensus.cc:3060] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.378345 28278 raft_consensus.cc:740] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.410993 28141 tablet_service.cc:1511] Processing CreateTablet for tablet a1c8db979236426c88754a4d4d46e147 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:52.412490 28141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c8db979236426c88754a4d4d46e147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.420804 28221 tablet_service.cc:1511] Processing CreateTablet for tablet a1c8db979236426c88754a4d4d46e147 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:52.422272 28221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c8db979236426c88754a4d4d46e147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.423251 28071 tablet_service.cc:1511] Processing CreateTablet for tablet 922beb15151e447cbbc0eaee6dc5266d (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:52.424604 28071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 922beb15151e447cbbc0eaee6dc5266d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.430222 27995 tablet_service.cc:1511] Processing CreateTablet for tablet 922beb15151e447cbbc0eaee6dc5266d (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:52.431396 27995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 922beb15151e447cbbc0eaee6dc5266d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.402671 28331 leader_election.cc:290] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:52.450665 28277 ts_tablet_manager.cc:1434] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.066s	user 0.004s	sys 0.005s
I20260709 13:21:52.451901 28277 tablet_bootstrap.cc:492] T 251228d678dc4ab7887704367c7bd62a P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:52.456604 28140 tablet_service.cc:1511] Processing CreateTablet for tablet 922beb15151e447cbbc0eaee6dc5266d (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:52.457784 28291 consensus_queue.cc:1048] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.461223 28140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 922beb15151e447cbbc0eaee6dc5266d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.462193 28218 tablet_service.cc:1511] Processing CreateTablet for tablet d72f52140be74d50aeccec9aebfd2f5b (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:52.463387 28218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72f52140be74d50aeccec9aebfd2f5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.486452 27992 tablet_service.cc:1511] Processing CreateTablet for tablet d72f52140be74d50aeccec9aebfd2f5b (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:52.487975 27992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72f52140be74d50aeccec9aebfd2f5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.488628 28143 tablet_service.cc:1511] Processing CreateTablet for tablet 19150adcadcf4e14beef1b948b754f04 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:52.489413 28277 tablet_bootstrap.cc:654] T 251228d678dc4ab7887704367c7bd62a P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.494701 28070 tablet_service.cc:1511] Processing CreateTablet for tablet d72f52140be74d50aeccec9aebfd2f5b (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:52.496335 28070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72f52140be74d50aeccec9aebfd2f5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.497231 28222 tablet_service.cc:1511] Processing CreateTablet for tablet 19150adcadcf4e14beef1b948b754f04 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:52.490118 28143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19150adcadcf4e14beef1b948b754f04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.482971 28278 consensus_queue.cc:260] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.499913 28280 tablet_bootstrap.cc:654] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.500525 28278 ts_tablet_manager.cc:1434] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.132s	user 0.011s	sys 0.000s
I20260709 13:21:52.501745 28278 tablet_bootstrap.cc:492] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:52.495007 27994 tablet_service.cc:1511] Processing CreateTablet for tablet 19150adcadcf4e14beef1b948b754f04 (DEFAULT_TABLE table=test-workload [id=eb3a623d25e14cfe9428aee612d59a14]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260709 13:21:52.490067 27954 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:52.502130 28232 raft_consensus.cc:2468] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:21:52.503245 27994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19150adcadcf4e14beef1b948b754f04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.503804 28121 leader_election.cc:304] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: d80a443d06244116ae813b77fc539651
I20260709 13:21:52.505095 28331 raft_consensus.cc:2804] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.505542 28331 raft_consensus.cc:697] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:21:52.506553 28331 consensus_queue.cc:237] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.508441 28222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19150adcadcf4e14beef1b948b754f04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.510843 28279 tablet_bootstrap.cc:492] T 88b8050a4f374a91b8993cd0d6ed3dbd P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:52.520577 28279 ts_tablet_manager.cc:1403] T 88b8050a4f374a91b8993cd0d6ed3dbd P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.284s	user 0.023s	sys 0.003s
I20260709 13:21:52.524058 28279 raft_consensus.cc:359] T 88b8050a4f374a91b8993cd0d6ed3dbd P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.524807 28279 raft_consensus.cc:385] T 88b8050a4f374a91b8993cd0d6ed3dbd P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.525115 28279 raft_consensus.cc:740] T 88b8050a4f374a91b8993cd0d6ed3dbd P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.527850 28293 raft_consensus.cc:515] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:52.544310 28293 leader_election.cc:290] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:52.546414 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90c9f452bac4ef0b959ca0e78ab475f" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:52.548520 28082 raft_consensus.cc:3060] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.547684 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90c9f452bac4ef0b959ca0e78ab475f" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:52.549995 28232 raft_consensus.cc:3060] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.551554 28158 raft_consensus.cc:3060] T dc2ec8b6b6234ee6b530a1c4b7e18618 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.564030 27907 catalog_manager.cc:5697] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b reported cstate change: term changed from 0 to 1, leader changed from <none> to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 1 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.543036 28279 consensus_queue.cc:260] T 88b8050a4f374a91b8993cd0d6ed3dbd P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.572767 28279 ts_tablet_manager.cc:1434] T 88b8050a4f374a91b8993cd0d6ed3dbd P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.001s
I20260709 13:21:52.592959 28277 tablet_bootstrap.cc:492] T 251228d678dc4ab7887704367c7bd62a P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:52.593480 28277 ts_tablet_manager.cc:1403] T 251228d678dc4ab7887704367c7bd62a P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.142s	user 0.016s	sys 0.008s
I20260709 13:21:52.591809 28324 consensus_queue.cc:1048] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:21:52.596470 28277 raft_consensus.cc:359] T 251228d678dc4ab7887704367c7bd62a P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:52.597223 28277 raft_consensus.cc:385] T 251228d678dc4ab7887704367c7bd62a P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.597522 28277 raft_consensus.cc:740] T 251228d678dc4ab7887704367c7bd62a P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.599200 28277 consensus_queue.cc:260] T 251228d678dc4ab7887704367c7bd62a P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:52.600735 28232 raft_consensus.cc:2468] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 1.
I20260709 13:21:52.602309 27972 leader_election.cc:304] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28; no voters: 
I20260709 13:21:52.604259 28277 ts_tablet_manager.cc:1434] T 251228d678dc4ab7887704367c7bd62a P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 13:21:52.605124 28277 tablet_bootstrap.cc:492] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:52.603737 28293 raft_consensus.cc:2804] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.607756 28279 tablet_bootstrap.cc:492] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:52.608103 28293 raft_consensus.cc:697] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:21:52.609020 28293 consensus_queue.cc:237] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:52.615523 28279 tablet_bootstrap.cc:654] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.618980 28278 tablet_bootstrap.cc:654] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.628387 28082 raft_consensus.cc:2468] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 1.
I20260709 13:21:52.643321 28324 consensus_queue.cc:1048] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:52.651302 28278 tablet_bootstrap.cc:492] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:52.654147 28353 consensus_queue.cc:1048] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:52.654276 28324 consensus_queue.cc:1048] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:52.671810 28279 tablet_bootstrap.cc:492] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:52.672578 28279 ts_tablet_manager.cc:1403] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.005s
I20260709 13:21:52.675081 28278 ts_tablet_manager.cc:1403] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.174s	user 0.004s	sys 0.011s
I20260709 13:21:52.682540 28280 tablet_bootstrap.cc:492] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:52.683109 28280 ts_tablet_manager.cc:1403] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.317s	user 0.007s	sys 0.013s
I20260709 13:21:52.684003 28279 raft_consensus.cc:359] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.684796 28279 raft_consensus.cc:385] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.685086 28279 raft_consensus.cc:740] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.706339 28291 raft_consensus.cc:493] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.706542 28278 raft_consensus.cc:359] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.707019 28291 raft_consensus.cc:515] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:52.707569 28278 raft_consensus.cc:385] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.708031 28278 raft_consensus.cc:740] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.709327 28291 leader_election.cc:290] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:52.708967 28278 consensus_queue.cc:260] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.710922 27905 catalog_manager.cc:5697] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.712147 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34330356e21a4098a1c12380085e120f" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:52.712899 28277 tablet_bootstrap.cc:654] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.713541 28278 ts_tablet_manager.cc:1434] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
W20260709 13:21:52.714006 28196 leader_election.cc:343] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.711380 28156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34330356e21a4098a1c12380085e120f" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:52.695286 28279 consensus_queue.cc:260] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.714709 28278 tablet_bootstrap.cc:492] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
W20260709 13:21:52.715895 28198 leader_election.cc:343] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.716391 28198 leader_election.cc:304] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:52.716990 28280 raft_consensus.cc:359] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.717543 28291 raft_consensus.cc:2749] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.717877 28280 raft_consensus.cc:385] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.718501 28280 raft_consensus.cc:740] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.725055 28279 ts_tablet_manager.cc:1434] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.003s
I20260709 13:21:52.726311 28279 tablet_bootstrap.cc:492] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:52.730621 28280 consensus_queue.cc:260] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.738219 28278 tablet_bootstrap.cc:654] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.742457 28279 tablet_bootstrap.cc:654] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.744659 28280 ts_tablet_manager.cc:1434] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.002s
I20260709 13:21:52.752452 28280 tablet_bootstrap.cc:492] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:52.759893 28297 consensus_queue.cc:1048] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.765687 28280 tablet_bootstrap.cc:654] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.770295 28279 tablet_bootstrap.cc:492] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:52.770838 28279 ts_tablet_manager.cc:1403] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.011s
I20260709 13:21:52.778228 28279 raft_consensus.cc:359] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:52.779207 28279 raft_consensus.cc:385] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.779556 28279 raft_consensus.cc:740] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.785125 28277 tablet_bootstrap.cc:492] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:52.785595 28277 ts_tablet_manager.cc:1403] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.181s	user 0.012s	sys 0.001s
I20260709 13:21:52.788210 28277 raft_consensus.cc:359] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.788740 28277 raft_consensus.cc:385] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.788968 28277 raft_consensus.cc:740] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.789542 28277 consensus_queue.cc:260] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.791756 28277 ts_tablet_manager.cc:1434] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:21:52.792970 28277 tablet_bootstrap.cc:492] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:52.783610 28279 consensus_queue.cc:260] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:52.799517 28279 ts_tablet_manager.cc:1434] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 13:21:52.800727 28279 tablet_bootstrap.cc:492] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:52.800952 28293 raft_consensus.cc:493] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.807353 28280 tablet_bootstrap.cc:492] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:52.807684 28277 tablet_bootstrap.cc:654] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.808166 28280 ts_tablet_manager.cc:1403] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.063s	user 0.005s	sys 0.020s
I20260709 13:21:52.810850 28279 tablet_bootstrap.cc:654] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.811515 28280 raft_consensus.cc:359] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.812419 28280 raft_consensus.cc:385] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.812805 28280 raft_consensus.cc:740] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.801923 28293 raft_consensus.cc:515] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.819195 28293 leader_election.cc:290] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:52.819940 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f95034322d746e4aaf06b06873de375" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:52.820669 28082 raft_consensus.cc:2468] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 0.
I20260709 13:21:52.821949 27974 leader_election.cc:304] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:52.815750 28278 tablet_bootstrap.cc:492] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:52.825897 28293 raft_consensus.cc:2804] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.827147 28293 raft_consensus.cc:493] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.830636 28278 ts_tablet_manager.cc:1403] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.116s	user 0.015s	sys 0.002s
I20260709 13:21:52.834101 28278 raft_consensus.cc:359] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.835258 28278 raft_consensus.cc:385] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.835667 28278 raft_consensus.cc:740] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.829666 28293 raft_consensus.cc:3060] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.823000 28280 consensus_queue.cc:260] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.842562 28280 ts_tablet_manager.cc:1434] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:21:52.843647 28278 consensus_queue.cc:260] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.843704 28280 tablet_bootstrap.cc:492] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:52.856809 28342 raft_consensus.cc:493] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.857191 28278 ts_tablet_manager.cc:1434] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.005s
I20260709 13:21:52.857375 28342 raft_consensus.cc:515] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.858423 28277 tablet_bootstrap.cc:492] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:52.858788 28278 tablet_bootstrap.cc:492] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:52.858968 28277 ts_tablet_manager.cc:1403] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.066s	user 0.027s	sys 0.014s
I20260709 13:21:52.860203 28342 leader_election.cc:290] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:52.861976 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e12f9e1f649c19b7ba5bac1e051dd" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:52.862711 28082 raft_consensus.cc:2468] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 0.
I20260709 13:21:52.863951 27974 leader_election.cc:304] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:52.864930 28342 raft_consensus.cc:2804] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.865329 28342 raft_consensus.cc:493] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.865697 28342 raft_consensus.cc:3060] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.868711 28331 raft_consensus.cc:493] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.869300 28331 raft_consensus.cc:515] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.871713 28331 leader_election.cc:290] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:52.872558 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e12f9e1f649c19b7ba5bac1e051dd" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:52.873472 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e12f9e1f649c19b7ba5bac1e051dd" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:52.876166 28082 raft_consensus.cc:2468] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:21:52.877544 28123 leader_election.cc:304] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:52.878032 28280 tablet_bootstrap.cc:654] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.878547 28331 raft_consensus.cc:2804] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.878995 28331 raft_consensus.cc:493] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.879451 28331 raft_consensus.cc:3060] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.883843 28293 raft_consensus.cc:515] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.875327 28277 raft_consensus.cc:359] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:52.885855 28277 raft_consensus.cc:385] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.886201 28342 raft_consensus.cc:515] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.886236 28277 raft_consensus.cc:740] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.887514 28009 raft_consensus.cc:2393] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afb0dc4e88ca4275975541dfe077b38b in current term 1: Already voted for candidate 6b1d1aefe48e42119ca040c70045fe28 in this term.
I20260709 13:21:52.888058 28277 consensus_queue.cc:260] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:52.891549 28331 raft_consensus.cc:515] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.893255 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e12f9e1f649c19b7ba5bac1e051dd" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:52.893949 28082 raft_consensus.cc:3060] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.894419 28277 ts_tablet_manager.cc:1434] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.002s
I20260709 13:21:52.895525 28277 tablet_bootstrap.cc:492] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:52.897652 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f95034322d746e4aaf06b06873de375" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:52.897903 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f95034322d746e4aaf06b06873de375" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:52.898447 28083 raft_consensus.cc:3060] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.898370 28157 raft_consensus.cc:2468] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 0.
I20260709 13:21:52.899150 28156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f95034322d746e4aaf06b06873de375" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:52.899969 28156 raft_consensus.cc:3060] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.896737 28293 leader_election.cc:290] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:52.898397 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e12f9e1f649c19b7ba5bac1e051dd" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:52.898854 28279 tablet_bootstrap.cc:492] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:52.906610 28279 ts_tablet_manager.cc:1403] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.009s
I20260709 13:21:52.906740 28158 raft_consensus.cc:2393] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b1d1aefe48e42119ca040c70045fe28 in current term 1: Already voted for candidate afb0dc4e88ca4275975541dfe077b38b in this term.
I20260709 13:21:52.911209 28279 raft_consensus.cc:359] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.912781 28279 raft_consensus.cc:385] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.913169 28279 raft_consensus.cc:740] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.912421 28277 tablet_bootstrap.cc:654] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.914026 28279 consensus_queue.cc:260] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.921772 28332 raft_consensus.cc:493] T 88b8050a4f374a91b8993cd0d6ed3dbd P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.922328 28332 raft_consensus.cc:515] T 88b8050a4f374a91b8993cd0d6ed3dbd P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.924705 28332 leader_election.cc:290] T 88b8050a4f374a91b8993cd0d6ed3dbd P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:52.927635 28279 ts_tablet_manager.cc:1434] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:21:52.929327 28156 raft_consensus.cc:2468] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 1.
I20260709 13:21:52.930745 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b8050a4f374a91b8993cd0d6ed3dbd" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:52.931908 28232 raft_consensus.cc:2393] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d80a443d06244116ae813b77fc539651 in current term 1: Already voted for candidate afb0dc4e88ca4275975541dfe077b38b in this term.
I20260709 13:21:52.932138 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b8050a4f374a91b8993cd0d6ed3dbd" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:52.937004 28279 tablet_bootstrap.cc:492] T 01b35f8e5efb4b2194c44623574d41e4 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:52.937991 28332 raft_consensus.cc:493] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.938556 28332 raft_consensus.cc:515] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:52.940044 28280 tablet_bootstrap.cc:492] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:52.940840 28280 ts_tablet_manager.cc:1403] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.097s	user 0.025s	sys 0.030s
I20260709 13:21:52.917348 28278 tablet_bootstrap.cc:654] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.945039 28332 leader_election.cc:290] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:52.945225 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251228d678dc4ab7887704367c7bd62a" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:52.945888 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251228d678dc4ab7887704367c7bd62a" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:52.946134 28231 raft_consensus.cc:2468] T 251228d678dc4ab7887704367c7bd62a P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:21:52.946729 28342 leader_election.cc:290] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:52.907065 28083 raft_consensus.cc:2468] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 1.
W20260709 13:21:52.947530 28048 leader_election.cc:343] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.944348 28280 raft_consensus.cc:359] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:52.948228 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e12f9e1f649c19b7ba5bac1e051dd" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:52.948251 28277 tablet_bootstrap.cc:492] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:52.948786 28280 raft_consensus.cc:385] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.950342 28277 ts_tablet_manager.cc:1403] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.001s
I20260709 13:21:52.950237 28280 raft_consensus.cc:740] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.948576 27974 leader_election.cc:304] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:52.951263 28155 raft_consensus.cc:2393] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b1d1aefe48e42119ca040c70045fe28 in current term 1: Already voted for candidate afb0dc4e88ca4275975541dfe077b38b in this term.
I20260709 13:21:52.951504 28280 consensus_queue.cc:260] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:52.952112 28334 consensus_queue.cc:1048] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.925339 28082 raft_consensus.cc:2468] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 1.
I20260709 13:21:52.956707 28277 raft_consensus.cc:359] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.957477 28277 raft_consensus.cc:385] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.957787 28277 raft_consensus.cc:740] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.958124 28047 leader_election.cc:304] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:52.958722 28279 tablet_bootstrap.cc:654] T 01b35f8e5efb4b2194c44623574d41e4 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.961750 28277 consensus_queue.cc:260] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.962028 28291 raft_consensus.cc:493] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.962765 28291 raft_consensus.cc:515] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.964658 28050 leader_election.cc:304] T 88b8050a4f374a91b8993cd0d6ed3dbd P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:52.964885 28291 leader_election.cc:290] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:52.968385 28277 ts_tablet_manager.cc:1434] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.003s
I20260709 13:21:52.967221 28332 raft_consensus.cc:2804] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.979589 28342 raft_consensus.cc:2804] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.979686 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fae586ea8f4cc8a5e968c2e41f2e8d" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:52.980120 27974 leader_election.cc:304] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:52.980473 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e12f9e1f649c19b7ba5bac1e051dd" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:52.978305 28280 ts_tablet_manager.cc:1434] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.022s
I20260709 13:21:52.971160 28277 tablet_bootstrap.cc:492] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:52.980297 28342 raft_consensus.cc:697] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:21:52.979140 28372 raft_consensus.cc:3060] T 88b8050a4f374a91b8993cd0d6ed3dbd P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.979645 28332 raft_consensus.cc:493] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.982563 28280 tablet_bootstrap.cc:492] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:52.982695 28331 leader_election.cc:290] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:52.983774 28293 raft_consensus.cc:2804] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:21:52.984264 28198 leader_election.cc:343] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.985783 28082 raft_consensus.cc:2393] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate afb0dc4e88ca4275975541dfe077b38b in current term 1: Already voted for candidate 6b1d1aefe48e42119ca040c70045fe28 in this term.
I20260709 13:21:52.989173 28291 raft_consensus.cc:493] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.989724 28293 raft_consensus.cc:697] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:21:52.995783 28291 raft_consensus.cc:515] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:52.996233 28293 consensus_queue.cc:237] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:52.997036 28280 tablet_bootstrap.cc:654] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.998169 28291 leader_election.cc:290] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:52.980083 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fae586ea8f4cc8a5e968c2e41f2e8d" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:52.999159 28083 raft_consensus.cc:2468] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:21:53.000478 28197 leader_election.cc:304] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:52.988270 28332 raft_consensus.cc:3060] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.000875 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b91d5539ce0478a92a005af25d828a6" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:53.004343 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e12f9e1f649c19b7ba5bac1e051dd" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:53.005677 28291 raft_consensus.cc:2804] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:53.006119 28291 raft_consensus.cc:493] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:53.006449 28291 raft_consensus.cc:3060] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.008025 28279 tablet_bootstrap.cc:492] T 01b35f8e5efb4b2194c44623574d41e4 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:53.008183 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b91d5539ce0478a92a005af25d828a6" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:53.008551 28279 ts_tablet_manager.cc:1403] T 01b35f8e5efb4b2194c44623574d41e4 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.072s	user 0.028s	sys 0.005s
I20260709 13:21:53.010946 28277 tablet_bootstrap.cc:654] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:53.011607 28198 leader_election.cc:343] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.011950 28123 leader_election.cc:304] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651
I20260709 13:21:53.012850 28342 consensus_queue.cc:237] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
W20260709 13:21:53.016557 28197 leader_election.cc:343] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.018222 28197 leader_election.cc:304] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651
I20260709 13:21:53.019464 28324 raft_consensus.cc:2749] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.019598 28279 raft_consensus.cc:359] T 01b35f8e5efb4b2194c44623574d41e4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.020663 28279 raft_consensus.cc:385] T 01b35f8e5efb4b2194c44623574d41e4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.021029 28279 raft_consensus.cc:740] T 01b35f8e5efb4b2194c44623574d41e4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.021770 28334 raft_consensus.cc:2749] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.021853 28279 consensus_queue.cc:260] T 01b35f8e5efb4b2194c44623574d41e4 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.029266 28278 tablet_bootstrap.cc:492] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:53.029841 28278 ts_tablet_manager.cc:1403] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.171s	user 0.020s	sys 0.006s
I20260709 13:21:53.030052 28372 raft_consensus.cc:2749] T 88b8050a4f374a91b8993cd0d6ed3dbd P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.032805 28278 raft_consensus.cc:359] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.033574 28278 raft_consensus.cc:385] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.033883 28278 raft_consensus.cc:740] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.033735 28332 raft_consensus.cc:515] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.035166 28278 consensus_queue.cc:260] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.036813 28332 leader_election.cc:290] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:53.037379 28278 ts_tablet_manager.cc:1434] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:53.038380 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251228d678dc4ab7887704367c7bd62a" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:53.038403 28278 tablet_bootstrap.cc:492] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:53.039079 28232 raft_consensus.cc:3060] T 251228d678dc4ab7887704367c7bd62a P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.022653 28291 raft_consensus.cc:515] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.043882 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fae586ea8f4cc8a5e968c2e41f2e8d" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:53.044498 28083 raft_consensus.cc:3060] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.047629 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251228d678dc4ab7887704367c7bd62a" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:53.048291 28009 raft_consensus.cc:3060] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.048695 28370 consensus_queue.cc:1048] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.067682 28232 raft_consensus.cc:2468] T 251228d678dc4ab7887704367c7bd62a P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:21:53.068907 28083 raft_consensus.cc:2468] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:53.070009 28047 leader_election.cc:304] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:53.070101 28197 leader_election.cc:304] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:53.070931 28324 raft_consensus.cc:2804] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:53.071318 28332 raft_consensus.cc:2804] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:53.072122 28332 raft_consensus.cc:697] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:21:53.071447 28324 raft_consensus.cc:697] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:21:53.068818 28279 ts_tablet_manager.cc:1434] T 01b35f8e5efb4b2194c44623574d41e4 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.060s	user 0.014s	sys 0.023s
I20260709 13:21:53.073148 28324 consensus_queue.cc:237] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.072197 28293 raft_consensus.cc:493] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.074362 28279 tablet_bootstrap.cc:492] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:53.074512 28293 raft_consensus.cc:515] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.076223 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fae586ea8f4cc8a5e968c2e41f2e8d" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:53.076510 28291 leader_election.cc:290] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:53.076738 28293 leader_election.cc:290] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:53.068091 28278 tablet_bootstrap.cc:654] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.058983 28372 raft_consensus.cc:493] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.087826 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c61eea3984e50916353d4844fe718" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:53.088871 28157 raft_consensus.cc:2468] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 0.
W20260709 13:21:53.089782 28198 leader_election.cc:343] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.094030 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c61eea3984e50916353d4844fe718" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:53.073148 28332 consensus_queue.cc:237] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.100235 27975 leader_election.cc:304] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:53.101472 28342 raft_consensus.cc:2804] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:53.104398 28342 raft_consensus.cc:493] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:53.104790 28342 raft_consensus.cc:3060] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.106088 28009 raft_consensus.cc:2468] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:21:53.098869 28372 raft_consensus.cc:515] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.110285 28083 raft_consensus.cc:2468] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 0.
I20260709 13:21:53.110067 27906 catalog_manager.cc:5697] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:53.111099 28279 tablet_bootstrap.cc:654] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.113606 28280 tablet_bootstrap.cc:492] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:53.114481 28280 ts_tablet_manager.cc:1403] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.132s	user 0.019s	sys 0.007s
I20260709 13:21:53.113651 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c61eea3984e50916353d4844fe718" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:53.116250 28372 leader_election.cc:290] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:53.117426 28280 raft_consensus.cc:359] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.121480 28280 raft_consensus.cc:385] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.117430 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c61eea3984e50916353d4844fe718" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:53.125051 28293 consensus_queue.cc:1048] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.125706 28157 raft_consensus.cc:2468] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:21:53.119493 28342 raft_consensus.cc:515] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.121981 28280 raft_consensus.cc:740] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.127900 28050 leader_election.cc:304] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:53.128142 28008 raft_consensus.cc:2393] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d80a443d06244116ae813b77fc539651 in current term 1: Already voted for candidate 6b1d1aefe48e42119ca040c70045fe28 in this term.
I20260709 13:21:53.128681 28280 consensus_queue.cc:260] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.129982 28342 leader_election.cc:290] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:53.125475 28277 tablet_bootstrap.cc:492] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:53.132676 28084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c61eea3984e50916353d4844fe718" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:53.134269 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c61eea3984e50916353d4844fe718" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:53.143025 28157 raft_consensus.cc:3060] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.139192 28277 ts_tablet_manager.cc:1403] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.170s	user 0.019s	sys 0.010s
I20260709 13:21:53.139809 28372 raft_consensus.cc:2804] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:53.144596 28372 raft_consensus.cc:493] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:53.145166 28372 raft_consensus.cc:3060] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.138237 27905 catalog_manager.cc:5697] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:53.152043 28277 raft_consensus.cc:359] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.152828 28277 raft_consensus.cc:385] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.153088 28277 raft_consensus.cc:740] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.153945 28277 consensus_queue.cc:260] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.137354 27904 catalog_manager.cc:5697] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 1 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:53.156772 28277 ts_tablet_manager.cc:1434] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:21:53.157796 28277 tablet_bootstrap.cc:492] T 8733000b90a544ba82435f9b7f6e5403 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:53.160861 28157 raft_consensus.cc:2468] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 1.
I20260709 13:21:53.162552 27975 leader_election.cc:304] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:53.163571 28342 raft_consensus.cc:2804] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:53.163841 28277 tablet_bootstrap.cc:654] T 8733000b90a544ba82435f9b7f6e5403 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.164191 28342 raft_consensus.cc:697] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:21:53.165127 28342 consensus_queue.cc:237] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.167927 28372 raft_consensus.cc:515] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.173182 28084 raft_consensus.cc:2393] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b1d1aefe48e42119ca040c70045fe28 in current term 1: Already voted for candidate d80a443d06244116ae813b77fc539651 in this term.
I20260709 13:21:53.173491 28277 tablet_bootstrap.cc:492] T 8733000b90a544ba82435f9b7f6e5403 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:53.174108 28277 ts_tablet_manager.cc:1403] T 8733000b90a544ba82435f9b7f6e5403 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.002s
I20260709 13:21:53.168673 28279 tablet_bootstrap.cc:492] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:53.176430 28279 ts_tablet_manager.cc:1403] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.013s
I20260709 13:21:53.178791 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c61eea3984e50916353d4844fe718" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:53.180701 28277 raft_consensus.cc:359] T 8733000b90a544ba82435f9b7f6e5403 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.181437 28277 raft_consensus.cc:385] T 8733000b90a544ba82435f9b7f6e5403 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.181764 28277 raft_consensus.cc:740] T 8733000b90a544ba82435f9b7f6e5403 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.179389 28279 raft_consensus.cc:359] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.183189 28279 raft_consensus.cc:385] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.183260 28372 leader_election.cc:290] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:53.183506 28279 raft_consensus.cc:740] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.184334 28279 consensus_queue.cc:260] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.186527 28279 ts_tablet_manager.cc:1434] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:21:53.187480 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c61eea3984e50916353d4844fe718" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:53.187455 28277 consensus_queue.cc:260] T 8733000b90a544ba82435f9b7f6e5403 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.188462 28157 raft_consensus.cc:2393] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d80a443d06244116ae813b77fc539651 in current term 1: Already voted for candidate 6b1d1aefe48e42119ca040c70045fe28 in this term.
I20260709 13:21:53.189917 28277 ts_tablet_manager.cc:1434] T 8733000b90a544ba82435f9b7f6e5403 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:21:53.190182 28050 leader_election.cc:304] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:53.190618 28291 raft_consensus.cc:493] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.190959 28277 tablet_bootstrap.cc:492] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:53.191314 28332 raft_consensus.cc:2749] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.191097 28291 raft_consensus.cc:515] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.194345 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b35f8e5efb4b2194c44623574d41e4" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:53.194223 28293 consensus_queue.cc:1048] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:53.196398 28196 leader_election.cc:343] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.198014 28279 tablet_bootstrap.cc:492] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:53.172087 28278 tablet_bootstrap.cc:492] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:53.173094 28377 raft_consensus.cc:493] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.198887 28377 raft_consensus.cc:515] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.200131 27905 catalog_manager.cc:5697] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:53.202948 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34330356e21a4098a1c12380085e120f" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:53.203637 28231 raft_consensus.cc:2468] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:21:53.204232 28291 leader_election.cc:290] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:53.204916 28121 leader_election.cc:304] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:53.205763 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b35f8e5efb4b2194c44623574d41e4" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:53.206666 28083 raft_consensus.cc:2468] T 01b35f8e5efb4b2194c44623574d41e4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:21:53.206821 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34330356e21a4098a1c12380085e120f" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:53.206845 28331 raft_consensus.cc:2804] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:53.208209 28331 raft_consensus.cc:493] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:53.208629 28331 raft_consensus.cc:3060] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.211585 28279 tablet_bootstrap.cc:654] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.208278 28197 leader_election.cc:304] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:53.215113 28277 tablet_bootstrap.cc:654] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.215297 28291 raft_consensus.cc:2804] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:53.215829 28291 raft_consensus.cc:493] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:53.216195 28291 raft_consensus.cc:3060] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:53.215138 28122 leader_election.cc:343] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.198881 28278 ts_tablet_manager.cc:1403] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.161s	user 0.013s	sys 0.010s
I20260709 13:21:53.201220 28377 leader_election.cc:290] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:53.221751 28279 tablet_bootstrap.cc:492] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:53.222462 28279 ts_tablet_manager.cc:1403] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 13:21:53.169909 28280 ts_tablet_manager.cc:1434] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 13:21:53.226140 28279 raft_consensus.cc:359] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.227118 28279 raft_consensus.cc:385] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.227465 28279 raft_consensus.cc:740] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.228344 28279 consensus_queue.cc:260] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.231585 28280 tablet_bootstrap.cc:492] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:53.231833 28277 tablet_bootstrap.cc:492] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:53.232395 28277 ts_tablet_manager.cc:1403] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.000s
I20260709 13:21:53.221237 28278 raft_consensus.cc:359] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.233336 28278 raft_consensus.cc:385] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.233690 28278 raft_consensus.cc:740] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.235360 28277 raft_consensus.cc:359] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.243615 28277 raft_consensus.cc:385] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.244045 28277 raft_consensus.cc:740] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.241951 28331 raft_consensus.cc:515] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.244829 28277 consensus_queue.cc:260] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.246881 28277 ts_tablet_manager.cc:1434] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:21:53.236464 28279 ts_tablet_manager.cc:1434] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:21:53.247860 28277 tablet_bootstrap.cc:492] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:53.248014 28279 tablet_bootstrap.cc:492] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:53.247979 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34330356e21a4098a1c12380085e120f" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:53.249148 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34330356e21a4098a1c12380085e120f" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:53.249817 28232 raft_consensus.cc:3060] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.240192 28291 raft_consensus.cc:515] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.253139 28279 tablet_bootstrap.cc:654] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.234423 28278 consensus_queue.cc:260] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.240466 27905 catalog_manager.cc:5697] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:53.254333 28009 raft_consensus.cc:3060] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.255955 28278 ts_tablet_manager.cc:1434] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:21:53.256984 28278 tablet_bootstrap.cc:492] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:53.257835 28291 leader_election.cc:290] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:53.260288 28291 raft_consensus.cc:493] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.261075 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b35f8e5efb4b2194c44623574d41e4" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:53.259084 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b35f8e5efb4b2194c44623574d41e4" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:53.261873 28083 raft_consensus.cc:3060] T 01b35f8e5efb4b2194c44623574d41e4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.264285 28277 tablet_bootstrap.cc:654] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:53.266870 28196 leader_election.cc:343] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.253193 28280 tablet_bootstrap.cc:654] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.273056 28278 tablet_bootstrap.cc:654] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.253005 28331 leader_election.cc:290] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:53.271659 28009 raft_consensus.cc:2468] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:21:53.281399 28083 raft_consensus.cc:2468] T 01b35f8e5efb4b2194c44623574d41e4 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:53.283039 28122 leader_election.cc:304] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:53.284107 28197 leader_election.cc:304] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:53.261029 28291 raft_consensus.cc:515] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.285265 28297 raft_consensus.cc:2804] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:53.285786 28297 raft_consensus.cc:697] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:21:53.286675 28297 consensus_queue.cc:237] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.287822 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb17cd0859ea43a5b7c93c90f172a611" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:53.291280 28331 raft_consensus.cc:2804] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:21:53.291258 28198 leader_election.cc:343] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.292764 28331 raft_consensus.cc:697] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:21:53.293857 28331 consensus_queue.cc:237] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.280848 28232 raft_consensus.cc:2468] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:21:53.297329 28291 leader_election.cc:290] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:53.302115 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb17cd0859ea43a5b7c93c90f172a611" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:21:53.307518 28196 leader_election.cc:343] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.308053 28196 leader_election.cc:304] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:53.310223 28291 raft_consensus.cc:2749] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.310454 28279 tablet_bootstrap.cc:492] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:53.311395 28277 tablet_bootstrap.cc:492] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:53.314720 28279 ts_tablet_manager.cc:1403] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.067s	user 0.017s	sys 0.023s
I20260709 13:21:53.314862 28277 ts_tablet_manager.cc:1403] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.001s
I20260709 13:21:53.315604 28280 tablet_bootstrap.cc:492] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:53.316120 28280 ts_tablet_manager.cc:1403] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.002s
I20260709 13:21:53.319002 28279 raft_consensus.cc:359] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.319118 28277 raft_consensus.cc:359] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.320010 28279 raft_consensus.cc:385] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.320281 28277 raft_consensus.cc:385] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.320353 28279 raft_consensus.cc:740] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.320797 28277 raft_consensus.cc:740] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.321341 28279 consensus_queue.cc:260] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.321785 28277 consensus_queue.cc:260] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.332109 28279 ts_tablet_manager.cc:1434] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:21:53.333221 28279 tablet_bootstrap.cc:492] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:53.335202 28278 tablet_bootstrap.cc:492] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:53.335789 28278 ts_tablet_manager.cc:1403] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.017s
I20260709 13:21:53.338935 28278 raft_consensus.cc:359] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.339694 28278 raft_consensus.cc:385] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.339941 28279 tablet_bootstrap.cc:654] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.339979 28278 raft_consensus.cc:740] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.341218 28278 consensus_queue.cc:260] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.341722 28280 raft_consensus.cc:359] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.342460 28280 raft_consensus.cc:385] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.342730 28280 raft_consensus.cc:740] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.343922 28278 ts_tablet_manager.cc:1434] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:21:53.347797 28278 tablet_bootstrap.cc:492] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:53.346702 27907 catalog_manager.cc:5697] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 1 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:53.353114 27905 catalog_manager.cc:5697] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b reported cstate change: term changed from 0 to 1, leader changed from <none> to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 1 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:53.345362 28280 consensus_queue.cc:260] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.365633 28280 ts_tablet_manager.cc:1434] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.002s
I20260709 13:21:53.366484 28280 tablet_bootstrap.cc:492] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:53.344910 28277 ts_tablet_manager.cc:1434] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:21:53.370702 28277 tablet_bootstrap.cc:492] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:53.359877 28278 tablet_bootstrap.cc:654] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.360462 28372 raft_consensus.cc:493] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.371781 28280 tablet_bootstrap.cc:654] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.371996 28372 raft_consensus.cc:515] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.376719 28331 raft_consensus.cc:493] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.377130 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ed080f456b4849b44145557b5889b1" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:53.377346 28331 raft_consensus.cc:515] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
W20260709 13:21:53.379853 28048 leader_election.cc:343] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.380008 28331 leader_election.cc:290] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:53.382608 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fae586ea8f4cc8a5e968c2e41f2e8d" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:53.383508 28277 tablet_bootstrap.cc:654] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.384759 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fae586ea8f4cc8a5e968c2e41f2e8d" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:53.386032 28083 raft_consensus.cc:2393] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afb0dc4e88ca4275975541dfe077b38b in current term 1: Already voted for candidate 2e2f737d674147808bb32783de176848 in this term.
I20260709 13:21:53.386467 28280 tablet_bootstrap.cc:492] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:53.387073 28280 ts_tablet_manager.cc:1403] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.003s
I20260709 13:21:53.389055 28121 leader_election.cc:304] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651
I20260709 13:21:53.390913 28331 raft_consensus.cc:3060] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.393083 28279 tablet_bootstrap.cc:492] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:53.393680 28279 ts_tablet_manager.cc:1403] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.061s	user 0.036s	sys 0.019s
I20260709 13:21:53.396431 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ed080f456b4849b44145557b5889b1" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:53.396689 28279 raft_consensus.cc:359] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.397449 28279 raft_consensus.cc:385] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.397830 28279 raft_consensus.cc:740] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.397573 28372 leader_election.cc:290] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:53.401274 28279 consensus_queue.cc:260] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.403678 28279 ts_tablet_manager.cc:1434] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:21:53.404678 28279 tablet_bootstrap.cc:492] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
W20260709 13:21:53.404393 28050 leader_election.cc:343] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.405227 28050 leader_election.cc:304] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:53.410702 28332 raft_consensus.cc:2749] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.410735 28331 raft_consensus.cc:2749] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.413782 28279 tablet_bootstrap.cc:654] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.423985 28280 raft_consensus.cc:359] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.425333 28280 raft_consensus.cc:385] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.425901 28280 raft_consensus.cc:740] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.427105 28280 consensus_queue.cc:260] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.430533 28342 consensus_queue.cc:1048] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.436827 28277 tablet_bootstrap.cc:492] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:53.437451 28277 ts_tablet_manager.cc:1403] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.067s	user 0.021s	sys 0.030s
I20260709 13:21:53.438392 28280 ts_tablet_manager.cc:1434] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 13:21:53.439726 28280 tablet_bootstrap.cc:492] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:53.440562 28277 raft_consensus.cc:359] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.441362 28277 raft_consensus.cc:385] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.441679 28277 raft_consensus.cc:740] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.442433 28277 consensus_queue.cc:260] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.445155 28277 ts_tablet_manager.cc:1434] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:53.451269 28297 raft_consensus.cc:493] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.452262 28277 tablet_bootstrap.cc:492] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:53.451881 28297 raft_consensus.cc:515] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.456749 28280 tablet_bootstrap.cc:654] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.457113 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a85c97f3d564240a87737e17e8b536e" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
W20260709 13:21:53.459148 28197 leader_election.cc:343] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.460628 28297 leader_election.cc:290] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:53.457551 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a85c97f3d564240a87737e17e8b536e" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:53.462347 28332 raft_consensus.cc:493] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:53.462911 28198 leader_election.cc:343] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.462929 28332 raft_consensus.cc:515] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.463807 28198 leader_election.cc:304] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651
I20260709 13:21:53.465070 28297 raft_consensus.cc:2749] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.467126 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8733000b90a544ba82435f9b7f6e5403" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:53.467955 28232 raft_consensus.cc:2468] T 8733000b90a544ba82435f9b7f6e5403 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:21:53.468331 28278 tablet_bootstrap.cc:492] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:53.468864 28278 ts_tablet_manager.cc:1403] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.121s	user 0.020s	sys 0.019s
I20260709 13:21:53.470213 28279 tablet_bootstrap.cc:492] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:53.470732 28279 ts_tablet_manager.cc:1403] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.004s
I20260709 13:21:53.471252 28047 leader_election.cc:304] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:53.472163 28372 raft_consensus.cc:2804] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:53.472519 28372 raft_consensus.cc:493] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:53.472853 28372 raft_consensus.cc:3060] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.465466 28277 tablet_bootstrap.cc:654] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.470259 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8733000b90a544ba82435f9b7f6e5403" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:21:53.479297 28048 leader_election.cc:343] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.483453 28293 consensus_queue.cc:1048] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.494801 28279 raft_consensus.cc:359] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.495596 28279 raft_consensus.cc:385] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.495882 28279 raft_consensus.cc:740] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.494832 28278 raft_consensus.cc:359] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.496605 28279 consensus_queue.cc:260] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.465570 28332 leader_election.cc:290] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:53.498370 28280 tablet_bootstrap.cc:492] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:53.499104 28279 ts_tablet_manager.cc:1434] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.001s
I20260709 13:21:53.499328 28280 ts_tablet_manager.cc:1403] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.060s	user 0.021s	sys 0.013s
I20260709 13:21:53.500155 28279 tablet_bootstrap.cc:492] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:53.497059 28278 raft_consensus.cc:385] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.504158 28280 raft_consensus.cc:359] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.504812 28278 raft_consensus.cc:740] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.505242 28280 raft_consensus.cc:385] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.505702 28280 raft_consensus.cc:740] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.506693 28280 consensus_queue.cc:260] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.509534 28280 ts_tablet_manager.cc:1434] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:21:53.510811 28280 tablet_bootstrap.cc:492] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:53.505019 28372 raft_consensus.cc:515] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.516039 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8733000b90a544ba82435f9b7f6e5403" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:53.516794 28232 raft_consensus.cc:3060] T 8733000b90a544ba82435f9b7f6e5403 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.518713 28280 tablet_bootstrap.cc:654] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.521938 28278 consensus_queue.cc:260] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
W20260709 13:21:53.522852 27954 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:53.528064 28297 raft_consensus.cc:493] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.528683 28297 raft_consensus.cc:515] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.530936 28297 leader_election.cc:290] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:53.532675 28278 ts_tablet_manager.cc:1434] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 13:21:53.533387 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84d9e7845264be9b66bcd292aab7e1d" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:53.534044 28278 tablet_bootstrap.cc:492] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
W20260709 13:21:53.535264 28198 leader_election.cc:343] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.536345 28291 consensus_queue.cc:1048] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.533670 28279 tablet_bootstrap.cc:654] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.539565 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84d9e7845264be9b66bcd292aab7e1d" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:21:53.542788 28196 leader_election.cc:343] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.543354 28196 leader_election.cc:304] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:53.544571 28291 raft_consensus.cc:2749] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.546922 28332 consensus_queue.cc:1048] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:21:53.554104 28374 raft_consensus.cc:493] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.560439 28374 raft_consensus.cc:515] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.566908 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ed080f456b4849b44145557b5889b1" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:53.567035 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ed080f456b4849b44145557b5889b1" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:53.567781 28158 raft_consensus.cc:2468] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 0.
I20260709 13:21:53.567884 28083 raft_consensus.cc:2468] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 0.
I20260709 13:21:53.569413 27975 leader_election.cc:304] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:53.570555 28293 raft_consensus.cc:493] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.571187 28342 raft_consensus.cc:2804] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:53.571082 28293 raft_consensus.cc:515] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.571611 28342 raft_consensus.cc:493] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:53.571988 28342 raft_consensus.cc:3060] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.575155 28279 tablet_bootstrap.cc:492] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:53.575752 28279 ts_tablet_manager.cc:1403] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.003s
I20260709 13:21:53.576915 28156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb17cd0859ea43a5b7c93c90f172a611" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:53.565481 28374 leader_election.cc:290] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:53.577759 28156 raft_consensus.cc:2468] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 0.
I20260709 13:21:53.579169 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb17cd0859ea43a5b7c93c90f172a611" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:53.579499 27975 leader_election.cc:304] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:53.579994 28231 raft_consensus.cc:2468] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 0.
I20260709 13:21:53.569523 28332 raft_consensus.cc:493] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.581401 28374 raft_consensus.cc:2804] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:53.582227 28374 raft_consensus.cc:493] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:53.581152 28332 raft_consensus.cc:515] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.582751 28279 raft_consensus.cc:359] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.582791 28374 raft_consensus.cc:3060] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.585789 28332 leader_election.cc:290] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:53.587965 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f566c9bd364fbcbc859d1c30f0f793" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:53.583562 28279 raft_consensus.cc:385] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.588976 28279 raft_consensus.cc:740] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
W20260709 13:21:53.590157 28048 leader_election.cc:343] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.588076 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f566c9bd364fbcbc859d1c30f0f793" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
W20260709 13:21:53.592340 28050 leader_election.cc:343] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.592888 28050 leader_election.cc:304] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:53.573469 28293 leader_election.cc:290] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:53.589988 28279 consensus_queue.cc:260] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.594378 28332 raft_consensus.cc:2749] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.596918 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8733000b90a544ba82435f9b7f6e5403" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:53.597571 28279 ts_tablet_manager.cc:1434] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.003s
I20260709 13:21:53.598744 28279 tablet_bootstrap.cc:492] T a685a97179a94ca299d31636b789c516 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:53.600227 28280 tablet_bootstrap.cc:492] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:53.604858 28280 ts_tablet_manager.cc:1403] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.094s	user 0.022s	sys 0.016s
I20260709 13:21:53.605557 28374 raft_consensus.cc:515] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.602133 28293 consensus_queue.cc:1048] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.608000 28374 leader_election.cc:290] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:53.609566 28156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb17cd0859ea43a5b7c93c90f172a611" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:53.610347 28156 raft_consensus.cc:3060] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.615510 28279 tablet_bootstrap.cc:654] T a685a97179a94ca299d31636b789c516 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:53.617978 28048 leader_election.cc:343] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.618726 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb17cd0859ea43a5b7c93c90f172a611" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:53.619518 28231 raft_consensus.cc:3060] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.618605 28291 consensus_queue.cc:1048] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.620538 28372 leader_election.cc:290] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:53.594884 28278 tablet_bootstrap.cc:654] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.621412 28293 consensus_queue.cc:1048] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.626446 28280 raft_consensus.cc:359] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.636580 28280 raft_consensus.cc:385] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.629226 28378 consensus_queue.cc:1048] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.630292 28342 raft_consensus.cc:515] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.631381 28231 raft_consensus.cc:2468] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 1.
I20260709 13:21:53.629074 28156 raft_consensus.cc:2468] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 1.
I20260709 13:21:53.640393 28280 raft_consensus.cc:740] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.643852 28277 tablet_bootstrap.cc:492] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:53.644438 28277 ts_tablet_manager.cc:1403] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.192s	user 0.045s	sys 0.035s
I20260709 13:21:53.649771 28280 consensus_queue.cc:260] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.652828 27972 leader_election.cc:304] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28; no voters: 
I20260709 13:21:53.655743 28293 raft_consensus.cc:2804] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:53.658097 28342 leader_election.cc:290] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:53.567894 28232 raft_consensus.cc:2468] T 8733000b90a544ba82435f9b7f6e5403 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:21:53.659303 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ed080f456b4849b44145557b5889b1" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:53.661755 28280 ts_tablet_manager.cc:1434] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 13:21:53.665567 28280 tablet_bootstrap.cc:492] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:53.660013 28372 raft_consensus.cc:493] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.665642 28157 raft_consensus.cc:3060] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.670929 28277 raft_consensus.cc:359] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.672102 28277 raft_consensus.cc:385] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.672497 28277 raft_consensus.cc:740] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.673555 28277 consensus_queue.cc:260] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.679778 28278 tablet_bootstrap.cc:492] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:53.680246 28278 ts_tablet_manager.cc:1403] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.147s	user 0.011s	sys 0.007s
I20260709 13:21:53.680872 28293 raft_consensus.cc:697] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:21:53.681384 28411 consensus_queue.cc:1048] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:21:53.685669 28277 ts_tablet_manager.cc:1434] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.001s
I20260709 13:21:53.686782 28277 tablet_bootstrap.cc:492] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:53.687628 28047 leader_election.cc:304] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:53.689560 28332 raft_consensus.cc:493] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.690315 28332 raft_consensus.cc:515] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.695118 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "027980aba9e546578394bd75f01ffba4" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:53.699410 28378 raft_consensus.cc:2804] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:53.701007 28279 tablet_bootstrap.cc:492] T a685a97179a94ca299d31636b789c516 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:53.702279 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "027980aba9e546578394bd75f01ffba4" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
W20260709 13:21:53.704528 28050 leader_election.cc:343] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.705988 28279 ts_tablet_manager.cc:1403] T a685a97179a94ca299d31636b789c516 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.001s
I20260709 13:21:53.712631 28332 leader_election.cc:290] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:53.669390 28372 raft_consensus.cc:515] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
W20260709 13:21:53.714524 27974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:43901, user_credentials={real_user=slave}} blocked reactor thread for 56331.8us
I20260709 13:21:53.719794 28279 raft_consensus.cc:359] T a685a97179a94ca299d31636b789c516 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.720728 28279 raft_consensus.cc:385] T a685a97179a94ca299d31636b789c516 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.721279 28279 raft_consensus.cc:740] T a685a97179a94ca299d31636b789c516 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.722751 28279 consensus_queue.cc:260] T a685a97179a94ca299d31636b789c516 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.724472 28278 raft_consensus.cc:359] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.727048 28278 raft_consensus.cc:385] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.727341 28278 raft_consensus.cc:740] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.727955 28278 consensus_queue.cc:260] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.712678 28277 tablet_bootstrap.cc:654] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.736280 28008 raft_consensus.cc:2468] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:21:53.682060 28293 consensus_queue.cc:237] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:53.734529 28372 leader_election.cc:290] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:53.738912 28278 ts_tablet_manager.cc:1434] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.003s
I20260709 13:21:53.741093 28278 tablet_bootstrap.cc:492] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:53.738248 28156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25fa78648f943939c0b04e5ae654cdf" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:53.741196 28378 raft_consensus.cc:697] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:21:53.743240 28157 raft_consensus.cc:2468] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 1.
I20260709 13:21:53.755988 28378 consensus_queue.cc:237] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.757961 28331 raft_consensus.cc:493] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.763664 28081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ed080f456b4849b44145557b5889b1" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:53.764358 28081 raft_consensus.cc:3060] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.764123 28331 raft_consensus.cc:515] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.764635 28048 leader_election.cc:304] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:53.766139 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25fa78648f943939c0b04e5ae654cdf" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:53.766438 28331 leader_election.cc:290] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:53.768914 28421 raft_consensus.cc:493] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.769444 28421 raft_consensus.cc:515] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.772009 28421 leader_election.cc:290] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:53.773018 28421 raft_consensus.cc:2804] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:53.773612 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b91d5539ce0478a92a005af25d828a6" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:53.773661 28421 raft_consensus.cc:493] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:53.777145 28232 raft_consensus.cc:2468] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:21:53.777412 28279 ts_tablet_manager.cc:1434] T a685a97179a94ca299d31636b789c516 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.014s
W20260709 13:21:53.760861 28050 leader_election.cc:343] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.777168 28421 raft_consensus.cc:3060] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.778460 28279 tablet_bootstrap.cc:492] T 6a85c97f3d564240a87737e17e8b536e P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:53.778501 28047 leader_election.cc:304] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:53.779258 27975 leader_election.cc:304] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:53.779366 28084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b91d5539ce0478a92a005af25d828a6" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:53.780349 28084 raft_consensus.cc:2468] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:21:53.781241 28419 raft_consensus.cc:2804] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:53.781790 28419 raft_consensus.cc:697] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:21:53.782020 28123 leader_election.cc:304] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:53.782732 28419 consensus_queue.cc:237] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.783615 28331 raft_consensus.cc:2804] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:53.784204 28331 raft_consensus.cc:493] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:53.784662 28331 raft_consensus.cc:3060] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.785351 28279 tablet_bootstrap.cc:654] T 6a85c97f3d564240a87737e17e8b536e P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.792590 28377 consensus_queue.cc:1048] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.798002 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b91d5539ce0478a92a005af25d828a6" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:53.801393 28378 raft_consensus.cc:2804] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:53.801932 28378 raft_consensus.cc:493] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:53.802282 28378 raft_consensus.cc:3060] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:53.802695 28196 consensus_peers.cc:597] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:53.808207 28048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 43684.2us
I20260709 13:21:53.818691 28374 consensus_queue.cc:1048] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.822443 28377 consensus_queue.cc:1048] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.828184 28081 raft_consensus.cc:2468] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 1.
I20260709 13:21:53.828743 28297 raft_consensus.cc:493] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.829437 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b91d5539ce0478a92a005af25d828a6" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:53.829262 28297 raft_consensus.cc:515] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.830176 28229 raft_consensus.cc:2468] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:21:53.832998 28297 leader_election.cc:290] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
W20260709 13:21:53.833307 28048 leader_election.cc:343] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.834487 28048 leader_election.cc:304] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:53.836586 28426 raft_consensus.cc:2749] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.846450 28280 tablet_bootstrap.cc:654] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.847711 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a685a97179a94ca299d31636b789c516" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:21:53.849454 28196 leader_election.cc:343] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.861687 28278 tablet_bootstrap.cc:654] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.874454 28421 raft_consensus.cc:515] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:53.878945 28279 tablet_bootstrap.cc:492] T 6a85c97f3d564240a87737e17e8b536e P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:53.879536 28279 ts_tablet_manager.cc:1403] T 6a85c97f3d564240a87737e17e8b536e P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.101s	user 0.014s	sys 0.001s
I20260709 13:21:53.881647 28291 consensus_queue.cc:1048] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.882493 28279 raft_consensus.cc:359] T 6a85c97f3d564240a87737e17e8b536e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.883278 28279 raft_consensus.cc:385] T 6a85c97f3d564240a87737e17e8b536e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.870043 28081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a685a97179a94ca299d31636b789c516" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:53.892711 28081 raft_consensus.cc:2468] T a685a97179a94ca299d31636b789c516 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:21:53.891281 27907 catalog_manager.cc:5697] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:53.896348 28279 raft_consensus.cc:740] T 6a85c97f3d564240a87737e17e8b536e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.897423 28279 consensus_queue.cc:260] T 6a85c97f3d564240a87737e17e8b536e P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.889309 28331 raft_consensus.cc:515] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.906077 28279 ts_tablet_manager.cc:1434] T 6a85c97f3d564240a87737e17e8b536e P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:21:53.908018 28279 tablet_bootstrap.cc:492] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:53.918737 28277 tablet_bootstrap.cc:492] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:53.919446 28277 ts_tablet_manager.cc:1403] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.233s	user 0.011s	sys 0.010s
I20260709 13:21:53.912209 28157 raft_consensus.cc:2393] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d80a443d06244116ae813b77fc539651 in current term 1: Already voted for candidate afb0dc4e88ca4275975541dfe077b38b in this term.
I20260709 13:21:53.921398 28378 raft_consensus.cc:515] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.923274 28277 raft_consensus.cc:359] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.924263 28277 raft_consensus.cc:385] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.924639 28277 raft_consensus.cc:740] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.907732 28197 leader_election.cc:304] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:53.924923 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b91d5539ce0478a92a005af25d828a6" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:53.925513 28229 raft_consensus.cc:3060] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.925998 28297 raft_consensus.cc:2804] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:53.926461 28297 raft_consensus.cc:493] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:53.926092 28277 consensus_queue.cc:260] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.926847 28297 raft_consensus.cc:3060] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.929001 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b91d5539ce0478a92a005af25d828a6" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:53.929860 28157 raft_consensus.cc:2393] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d80a443d06244116ae813b77fc539651 in current term 1: Already voted for candidate afb0dc4e88ca4275975541dfe077b38b in this term.
I20260709 13:21:53.941569 28331 leader_election.cc:290] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
W20260709 13:21:53.941833 28433 log.cc:927] Time spent T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:21:53.943005 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b91d5539ce0478a92a005af25d828a6" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:53.945286 28324 raft_consensus.cc:493] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.945809 28324 raft_consensus.cc:515] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:53.953496 28277 ts_tablet_manager.cc:1434] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.001s
I20260709 13:21:53.954906 28277 tablet_bootstrap.cc:492] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:53.955693 28324 leader_election.cc:290] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:53.958521 28421 leader_election.cc:290] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:53.960408 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "027980aba9e546578394bd75f01ffba4" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:53.961006 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd28360227f4dca8286a91d1be17d04" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:53.946434 28229 raft_consensus.cc:2468] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:21:53.962167 28277 tablet_bootstrap.cc:654] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.957414 28297 raft_consensus.cc:515] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:53.963263 28047 leader_election.cc:304] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:53.964309 28421 raft_consensus.cc:2804] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:53.964531 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd28360227f4dca8286a91d1be17d04" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:53.964861 28421 raft_consensus.cc:697] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:21:53.964663 28297 leader_election.cc:290] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:53.946877 28378 leader_election.cc:290] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:53.961134 28009 raft_consensus.cc:3060] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.970422 28084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a685a97179a94ca299d31636b789c516" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:53.971087 28084 raft_consensus.cc:3060] T a685a97179a94ca299d31636b789c516 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.971652 28421 consensus_queue.cc:237] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
W20260709 13:21:53.969779 28198 leader_election.cc:343] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.973897 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a685a97179a94ca299d31636b789c516" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:53.977466 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "027980aba9e546578394bd75f01ffba4" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
W20260709 13:21:53.975683 28197 leader_election.cc:343] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:53.979655 28050 leader_election.cc:343] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.974639 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b91d5539ce0478a92a005af25d828a6" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:53.982760 28123 leader_election.cc:304] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651
I20260709 13:21:53.985435 28279 tablet_bootstrap.cc:654] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.980268 28197 leader_election.cc:304] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651
I20260709 13:21:53.989795 28297 raft_consensus.cc:2749] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.997351 28278 tablet_bootstrap.cc:492] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:53.998077 28278 ts_tablet_manager.cc:1403] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.257s	user 0.019s	sys 0.000s
I20260709 13:21:54.001121 28280 tablet_bootstrap.cc:492] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:54.058136 28434 raft_consensus.cc:2749] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:21:54.049602 28121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:36151, user_credentials={real_user=slave}} blocked reactor thread for 63757.2us
W20260709 13:21:54.062155 28123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.130:43901, user_credentials={real_user=slave}} blocked reactor thread for 79364.8us
I20260709 13:21:54.075376 28324 raft_consensus.cc:493] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.077023 28277 tablet_bootstrap.cc:492] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:54.077170 28280 ts_tablet_manager.cc:1403] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.414s	user 0.020s	sys 0.002s
I20260709 13:21:54.076424 28324 raft_consensus.cc:515] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:54.080229 28277 ts_tablet_manager.cc:1403] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.126s	user 0.025s	sys 0.024s
I20260709 13:21:54.080621 28324 leader_election.cc:290] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
W20260709 13:21:54.081884 28196 leader_election.cc:343] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.086162 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8359246c5ff428e89f3b5c15a65aa98" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:54.085554 28277 raft_consensus.cc:359] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.087486 28277 raft_consensus.cc:385] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.087930 28277 raft_consensus.cc:740] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.088186 28434 raft_consensus.cc:493] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:54.088725 28196 leader_election.cc:343] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.089103 28277 consensus_queue.cc:260] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.099346 27906 catalog_manager.cc:5697] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:54.109681 28434 raft_consensus.cc:515] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:54.114770 28278 raft_consensus.cc:359] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.116541 28278 raft_consensus.cc:385] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.116973 28278 raft_consensus.cc:740] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.118224 28278 consensus_queue.cc:260] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.118062 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a85c97f3d564240a87737e17e8b536e" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:54.113040 28434 leader_election.cc:290] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:54.126101 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8359246c5ff428e89f3b5c15a65aa98" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:54.126418 28229 raft_consensus.cc:2468] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:21:54.132634 28121 leader_election.cc:304] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:54.135663 28279 tablet_bootstrap.cc:492] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:54.136384 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a85c97f3d564240a87737e17e8b536e" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:54.136775 28009 raft_consensus.cc:2468] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:21:54.137547 28082 raft_consensus.cc:2468] T 6a85c97f3d564240a87737e17e8b536e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:21:54.136786 28279 ts_tablet_manager.cc:1403] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.229s	user 0.015s	sys 0.003s
I20260709 13:21:54.137964 28280 raft_consensus.cc:359] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:54.139225 28280 raft_consensus.cc:385] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.139640 28280 raft_consensus.cc:740] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.140707 28280 consensus_queue.cc:260] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:54.141971 28048 leader_election.cc:304] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:54.143214 28279 raft_consensus.cc:359] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:54.144407 28279 raft_consensus.cc:385] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.144801 28279 raft_consensus.cc:740] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.145344 28280 ts_tablet_manager.cc:1434] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.000s
I20260709 13:21:54.145776 28370 raft_consensus.cc:2804] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.146243 28370 raft_consensus.cc:493] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.146642 28370 raft_consensus.cc:3060] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.147665 28280 tablet_bootstrap.cc:492] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:54.148656 28277 ts_tablet_manager.cc:1434] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.068s	user 0.010s	sys 0.000s
I20260709 13:21:54.150249 28278 ts_tablet_manager.cc:1434] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.149s	user 0.012s	sys 0.000s
I20260709 13:21:54.151695 28421 raft_consensus.cc:2804] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.152427 28421 raft_consensus.cc:697] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:21:54.156685 28421 consensus_queue.cc:237] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:54.151362 28279 consensus_queue.cc:260] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
W20260709 13:21:54.166822 28198 leader_election.cc:343] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.167537 28198 leader_election.cc:304] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:54.168918 28297 raft_consensus.cc:2749] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.171036 27907 catalog_manager.cc:5697] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.173326 28278 tablet_bootstrap.cc:492] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:54.179785 28378 raft_consensus.cc:493] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.180832 28277 tablet_bootstrap.cc:492] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:54.180416 28378 raft_consensus.cc:515] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:54.182142 28293 raft_consensus.cc:493] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.182767 28293 raft_consensus.cc:515] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.188401 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b35f8e5efb4b2194c44623574d41e4" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:54.188966 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd28360227f4dca8286a91d1be17d04" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:54.191054 28378 leader_election.cc:290] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
W20260709 13:21:54.196904 28050 leader_election.cc:343] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.197229 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b35f8e5efb4b2194c44623574d41e4" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:54.205911 28084 raft_consensus.cc:2468] T a685a97179a94ca299d31636b789c516 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:54.199251 28374 consensus_queue.cc:1048] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:21:54.197877 28293 leader_election.cc:290] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:54.224417 28197 leader_election.cc:304] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
W20260709 13:21:54.217891 28048 consensus_peers.cc:597] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:54.197547 28370 raft_consensus.cc:515] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:54.227815 28280 tablet_bootstrap.cc:654] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.227735 28446 raft_consensus.cc:2804] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.229782 28446 raft_consensus.cc:697] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:21:54.231230 28446 consensus_queue.cc:237] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.205472 28278 tablet_bootstrap.cc:654] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.229112 28277 tablet_bootstrap.cc:654] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.237432 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a85c97f3d564240a87737e17e8b536e" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:54.238229 28232 raft_consensus.cc:3060] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.236744 28370 leader_election.cc:290] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:54.251029 28434 raft_consensus.cc:493] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.253834 28434 raft_consensus.cc:515] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:54.256285 28434 leader_election.cc:290] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:54.257099 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a85c97f3d564240a87737e17e8b536e" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:54.257843 28082 raft_consensus.cc:3060] T 6a85c97f3d564240a87737e17e8b536e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.258411 28230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84d9e7845264be9b66bcd292aab7e1d" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:54.259220 28230 raft_consensus.cc:2468] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:21:54.260691 28121 leader_election.cc:304] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:54.257863 28447 raft_consensus.cc:493] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.266887 28279 ts_tablet_manager.cc:1434] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.128s	user 0.011s	sys 0.000s
I20260709 13:21:54.268528 28279 tablet_bootstrap.cc:492] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:54.270005 28342 consensus_queue.cc:1048] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:54.251858 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd28360227f4dca8286a91d1be17d04" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:54.272203 28231 raft_consensus.cc:2468] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:21:54.274205 28447 raft_consensus.cc:515] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.276407 27974 leader_election.cc:304] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28; no voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651
I20260709 13:21:54.278468 28084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccc7022ab04f9a8ddc87ac37f31c7c" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:54.278942 28293 raft_consensus.cc:2749] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.278537 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84d9e7845264be9b66bcd292aab7e1d" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:54.280786 28279 tablet_bootstrap.cc:654] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:54.281556 28197 leader_election.cc:343] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:54.281931 28122 leader_election.cc:343] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.282270 28447 leader_election.cc:290] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:54.283401 28342 consensus_queue.cc:1048] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:54.288575 28331 raft_consensus.cc:2804] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.289076 28331 raft_consensus.cc:493] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.289435 28331 raft_consensus.cc:3060] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.299247 28047 leader_election.cc:304] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:54.299949 28232 raft_consensus.cc:2468] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:21:54.303436 28378 raft_consensus.cc:2804] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.288606 27905 catalog_manager.cc:5697] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.301257 28082 raft_consensus.cc:2468] T 6a85c97f3d564240a87737e17e8b536e P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:21:54.304013 28378 raft_consensus.cc:493] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.301690 28293 consensus_queue.cc:1048] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:21:54.307950 28121 leader_election.cc:304] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:54.326030 28434 raft_consensus.cc:2804] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.326316 28007 raft_consensus.cc:3060] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.326700 28434 raft_consensus.cc:697] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:21:54.327965 28434 consensus_queue.cc:237] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:54.313899 28378 raft_consensus.cc:3060] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.332281 28278 tablet_bootstrap.cc:492] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:54.332966 28278 ts_tablet_manager.cc:1403] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.167s	user 0.013s	sys 0.008s
I20260709 13:21:54.338881 27905 catalog_manager.cc:5697] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.345434 28280 tablet_bootstrap.cc:492] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:54.346359 28280 ts_tablet_manager.cc:1403] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.199s	user 0.018s	sys 0.012s
I20260709 13:21:54.347517 28278 raft_consensus.cc:359] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.348336 28278 raft_consensus.cc:385] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.348615 28278 raft_consensus.cc:740] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.350558 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccc7022ab04f9a8ddc87ac37f31c7c" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:54.351764 28280 raft_consensus.cc:359] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:54.370230 27907 catalog_manager.cc:5697] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 1 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.372473 28280 raft_consensus.cc:385] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:21:54.366858 28448 log.cc:927] Time spent T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:21:54.355381 28421 consensus_queue.cc:1048] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:54.367223 28196 leader_election.cc:343] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.372812 28280 raft_consensus.cc:740] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.375833 28278 consensus_queue.cc:260] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.380681 28196 leader_election.cc:304] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651
I20260709 13:21:54.383864 28421 consensus_queue.cc:1048] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:54.385057 28447 raft_consensus.cc:2749] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.385257 28278 ts_tablet_manager.cc:1434] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.004s
I20260709 13:21:54.386538 28278 tablet_bootstrap.cc:492] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:54.386181 28280 consensus_queue.cc:260] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:54.410310 28280 ts_tablet_manager.cc:1434] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.004s
I20260709 13:21:54.410357 28421 consensus_queue.cc:1048] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:54.414836 28280 tablet_bootstrap.cc:492] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:54.416723 28279 tablet_bootstrap.cc:492] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:54.417290 28279 ts_tablet_manager.cc:1403] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.149s	user 0.030s	sys 0.036s
I20260709 13:21:54.410750 28277 tablet_bootstrap.cc:492] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:54.419117 28277 ts_tablet_manager.cc:1403] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.269s	user 0.020s	sys 0.013s
I20260709 13:21:54.424019 28378 raft_consensus.cc:515] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:54.395886 28331 raft_consensus.cc:515] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:54.427379 28277 raft_consensus.cc:359] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:54.429198 28277 raft_consensus.cc:385] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.429476 28277 raft_consensus.cc:740] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.438417 28331 leader_election.cc:290] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:54.439576 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84d9e7845264be9b66bcd292aab7e1d" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:54.440277 28232 raft_consensus.cc:3060] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.440312 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84d9e7845264be9b66bcd292aab7e1d" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
W20260709 13:21:54.442225 28122 leader_election.cc:343] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:54.445166 28454 log.cc:927] Time spent T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:21:54.448784 28279 raft_consensus.cc:359] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.450667 28279 raft_consensus.cc:385] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.451467 28279 raft_consensus.cc:740] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.464351 27907 catalog_manager.cc:5697] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b reported cstate change: term changed from 0 to 1, leader changed from <none> to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 1 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.468915 28278 tablet_bootstrap.cc:654] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.470655 28232 raft_consensus.cc:2468] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:21:54.473589 28121 leader_election.cc:304] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:54.472193 28280 tablet_bootstrap.cc:654] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.475628 28331 raft_consensus.cc:2804] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.476200 28331 raft_consensus.cc:697] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:21:54.477140 28331 consensus_queue.cc:237] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:54.479058 28277 consensus_queue.cc:260] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:54.485602 28279 consensus_queue.cc:260] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.503646 28378 leader_election.cc:290] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:54.509903 28277 ts_tablet_manager.cc:1434] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.090s	user 0.008s	sys 0.000s
I20260709 13:21:54.504213 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd28360227f4dca8286a91d1be17d04" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
W20260709 13:21:54.527665 28050 leader_election.cc:343] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.532496 28279 ts_tablet_manager.cc:1434] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.115s	user 0.011s	sys 0.000s
W20260709 13:21:54.534384 28460 log.cc:927] Time spent T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:21:54.543768 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd28360227f4dca8286a91d1be17d04" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:54.544601 28232 raft_consensus.cc:3060] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.554143 28419 raft_consensus.cc:493] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.556876 28419 raft_consensus.cc:515] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.587321 28279 tablet_bootstrap.cc:492] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:54.590844 28278 tablet_bootstrap.cc:492] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:54.591681 28278 ts_tablet_manager.cc:1403] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.205s	user 0.019s	sys 0.002s
I20260709 13:21:54.601033 28277 tablet_bootstrap.cc:492] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
W20260709 13:21:54.601514 28196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 54366.3us
I20260709 13:21:54.609004 28426 consensus_queue.cc:1048] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:21:54.625995 28280 tablet_bootstrap.cc:492] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:54.626803 28280 ts_tablet_manager.cc:1403] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.212s	user 0.013s	sys 0.018s
W20260709 13:21:54.641024 28050 consensus_peers.cc:597] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 -> Peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Couldn't send request to peer afb0dc4e88ca4275975541dfe077b38b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:54.641479 28277 tablet_bootstrap.cc:654] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.642241 28419 leader_election.cc:290] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:54.630879 27904 catalog_manager.cc:5697] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b reported cstate change: term changed from 0 to 1, leader changed from <none> to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 1 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.646862 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8733000b90a544ba82435f9b7f6e5403" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
W20260709 13:21:54.644105 28196 consensus_peers.cc:597] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:54.686167 28232 raft_consensus.cc:2468] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:21:54.688488 28278 raft_consensus.cc:359] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:54.689267 28278 raft_consensus.cc:385] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.689535 28278 raft_consensus.cc:740] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.690260 28278 consensus_queue.cc:260] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:54.691354 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8733000b90a544ba82435f9b7f6e5403" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:54.691931 28278 ts_tablet_manager.cc:1434] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.100s	user 0.006s	sys 0.000s
I20260709 13:21:54.693141 28278 tablet_bootstrap.cc:492] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:54.693888 28280 raft_consensus.cc:359] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:54.694659 28280 raft_consensus.cc:385] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.694737 28279 tablet_bootstrap.cc:654] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.694964 28280 raft_consensus.cc:740] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.699375 28446 consensus_queue.cc:1048] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:54.703969 28009 raft_consensus.cc:3060] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.711556 28047 leader_election.cc:304] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:54.713913 28426 raft_consensus.cc:2804] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.714699 28426 raft_consensus.cc:697] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:21:54.715870 28426 consensus_queue.cc:237] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:54.719131 28280 consensus_queue.cc:260] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:54.721597 28280 ts_tablet_manager.cc:1434] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.000s
I20260709 13:21:54.733740 28280 tablet_bootstrap.cc:492] T 6dd28360227f4dca8286a91d1be17d04 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
W20260709 13:21:54.744024 27954 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:54.724692 28278 tablet_bootstrap.cc:654] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.728602 27974 leader_election.cc:304] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28; no voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651
I20260709 13:21:54.756428 28280 tablet_bootstrap.cc:654] T 6dd28360227f4dca8286a91d1be17d04 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.775682 28278 tablet_bootstrap.cc:492] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:54.776171 28278 ts_tablet_manager.cc:1403] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.003s
I20260709 13:21:54.783380 27904 catalog_manager.cc:5697] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.777905 28342 raft_consensus.cc:2749] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.787531 28277 tablet_bootstrap.cc:492] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:54.788271 28277 ts_tablet_manager.cc:1403] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.246s	user 0.036s	sys 0.038s
I20260709 13:21:54.787531 28279 tablet_bootstrap.cc:492] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:54.789290 28426 raft_consensus.cc:493] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.790261 28279 ts_tablet_manager.cc:1403] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.203s	user 0.016s	sys 0.025s
I20260709 13:21:54.789984 28426 raft_consensus.cc:515] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.794807 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccc7022ab04f9a8ddc87ac37f31c7c" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:54.795516 28232 raft_consensus.cc:2468] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:21:54.796914 28047 leader_election.cc:304] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:54.797731 28331 consensus_queue.cc:1048] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:54.798530 28463 raft_consensus.cc:2804] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.798995 28463 raft_consensus.cc:493] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.799430 28463 raft_consensus.cc:3060] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.801083 28277 raft_consensus.cc:359] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:54.799089 28426 leader_election.cc:290] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:54.801851 28277 raft_consensus.cc:385] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.803131 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccc7022ab04f9a8ddc87ac37f31c7c" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:54.803388 28277 raft_consensus.cc:740] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.805101 28277 consensus_queue.cc:260] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
W20260709 13:21:54.806738 28048 leader_election.cc:343] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.811879 28463 raft_consensus.cc:515] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.814659 28463 leader_election.cc:290] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:54.818332 28279 raft_consensus.cc:359] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.819167 28279 raft_consensus.cc:385] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.819451 28279 raft_consensus.cc:740] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.822227 28279 consensus_queue.cc:260] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.828091 28279 ts_tablet_manager.cc:1434] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.004s
I20260709 13:21:54.826814 28278 raft_consensus.cc:359] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.833333 28278 raft_consensus.cc:385] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.833670 28278 raft_consensus.cc:740] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.837666 28277 ts_tablet_manager.cc:1434] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:21:54.838080 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccc7022ab04f9a8ddc87ac37f31c7c" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:54.838410 28280 tablet_bootstrap.cc:492] T 6dd28360227f4dca8286a91d1be17d04 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:54.838729 28232 raft_consensus.cc:3060] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.839010 28280 ts_tablet_manager.cc:1403] T 6dd28360227f4dca8286a91d1be17d04 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.106s	user 0.018s	sys 0.008s
I20260709 13:21:54.835292 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccc7022ab04f9a8ddc87ac37f31c7c" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:54.839035 28277 tablet_bootstrap.cc:492] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:54.844478 28280 raft_consensus.cc:359] T 6dd28360227f4dca8286a91d1be17d04 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:54.845247 28280 raft_consensus.cc:385] T 6dd28360227f4dca8286a91d1be17d04 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:21:54.842756 28048 leader_election.cc:343] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.849788 28463 raft_consensus.cc:493] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.850243 28463 raft_consensus.cc:515] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.851996 28463 leader_election.cc:290] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:54.853142 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ce0cdf347247538a4b952da2421761" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:54.854185 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ce0cdf347247538a4b952da2421761" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
W20260709 13:21:54.855901 28047 leader_election.cc:343] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2f737d674147808bb32783de176848 (127.17.251.132:36151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.858971 28279 tablet_bootstrap.cc:492] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:54.845544 28280 raft_consensus.cc:740] T 6dd28360227f4dca8286a91d1be17d04 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.861713 28278 consensus_queue.cc:260] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
W20260709 13:21:54.863021 28048 leader_election.cc:343] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.864033 28278 ts_tablet_manager.cc:1434] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.000s
I20260709 13:21:54.865130 28469 raft_consensus.cc:493] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.866174 28048 leader_election.cc:304] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:54.866371 28469 raft_consensus.cc:515] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:54.867384 28377 consensus_queue.cc:1048] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:54.869889 28156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84d9e7845264be9b66bcd292aab7e1d" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:54.871557 28342 raft_consensus.cc:493] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.872102 28342 raft_consensus.cc:515] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.872607 28280 consensus_queue.cc:260] T 6dd28360227f4dca8286a91d1be17d04 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:54.874346 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84d9e7845264be9b66bcd292aab7e1d" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:54.875188 28231 raft_consensus.cc:2393] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b1d1aefe48e42119ca040c70045fe28 in current term 1: Already voted for candidate afb0dc4e88ca4275975541dfe077b38b in this term.
I20260709 13:21:54.876430 28280 ts_tablet_manager.cc:1434] T 6dd28360227f4dca8286a91d1be17d04 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:21:54.876514 27972 leader_election.cc:304] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28; no voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:54.877696 28374 raft_consensus.cc:3060] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.879681 28342 leader_election.cc:290] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:54.879537 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a685a97179a94ca299d31636b789c516" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:54.881340 28232 raft_consensus.cc:2468] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:21:54.882009 28463 raft_consensus.cc:2749] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.882726 28469 leader_election.cc:290] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:54.882792 28047 leader_election.cc:304] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:54.884606 28463 raft_consensus.cc:2804] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.885919 28377 raft_consensus.cc:493] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.886557 28463 raft_consensus.cc:697] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:21:54.886451 28377 raft_consensus.cc:515] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:54.890512 28278 tablet_bootstrap.cc:492] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:54.891659 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a685a97179a94ca299d31636b789c516" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:54.893558 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f566c9bd364fbcbc859d1c30f0f793" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:21:54.895478 28122 leader_election.cc:343] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.896849 28374 raft_consensus.cc:2749] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.897199 28278 tablet_bootstrap.cc:654] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.896977 27974 leader_election.cc:304] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28; no voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651
I20260709 13:21:54.898480 28469 raft_consensus.cc:2749] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.899081 28277 tablet_bootstrap.cc:654] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.902662 28377 leader_election.cc:290] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:54.906431 28279 tablet_bootstrap.cc:654] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.877780 28280 tablet_bootstrap.cc:492] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:54.910518 28446 raft_consensus.cc:493] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.911094 28446 raft_consensus.cc:515] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:54.917815 28446 leader_election.cc:290] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:54.919541 28156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4edfd4e5ea7461eaa8917755dff8c60" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:54.918543 28280 tablet_bootstrap.cc:654] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.921541 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4edfd4e5ea7461eaa8917755dff8c60" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:21:54.923846 28196 leader_election.cc:343] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.919914 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f566c9bd364fbcbc859d1c30f0f793" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:54.925279 28463 consensus_queue.cc:237] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.926213 28082 raft_consensus.cc:2468] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:21:54.924531 28279 tablet_bootstrap.cc:492] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:54.927393 28123 leader_election.cc:304] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:54.910686 28278 tablet_bootstrap.cc:492] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
W20260709 13:21:54.925932 28198 leader_election.cc:343] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.928335 28278 ts_tablet_manager.cc:1403] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.004s
I20260709 13:21:54.928272 28377 raft_consensus.cc:2804] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.929267 28377 raft_consensus.cc:493] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.929711 28377 raft_consensus.cc:3060] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.931712 28278 raft_consensus.cc:359] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:54.932502 28278 raft_consensus.cc:385] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.932824 28278 raft_consensus.cc:740] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.928260 28198 leader_election.cc:304] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:54.927742 28279 ts_tablet_manager.cc:1403] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.087s	user 0.011s	sys 0.002s
I20260709 13:21:54.934655 28446 raft_consensus.cc:2749] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.937279 28279 raft_consensus.cc:359] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:54.938050 28279 raft_consensus.cc:385] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.938319 28279 raft_consensus.cc:740] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.939112 28279 consensus_queue.cc:260] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:54.933684 28278 consensus_queue.cc:260] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:54.941421 28279 ts_tablet_manager.cc:1434] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:21:54.942581 28279 tablet_bootstrap.cc:492] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:54.943320 28278 ts_tablet_manager.cc:1434] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:21:54.951874 28277 tablet_bootstrap.cc:492] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:54.952457 28277 ts_tablet_manager.cc:1403] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.114s	user 0.010s	sys 0.000s
I20260709 13:21:54.952744 28278 tablet_bootstrap.cc:492] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:54.955385 28277 raft_consensus.cc:359] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.956115 28277 raft_consensus.cc:385] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.956511 28277 raft_consensus.cc:740] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.957638 28277 consensus_queue.cc:260] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:54.961968 28278 tablet_bootstrap.cc:654] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.962301 28331 consensus_queue.cc:1048] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:54.956337 28377 raft_consensus.cc:515] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:54.977523 28377 leader_election.cc:290] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:54.977778 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f566c9bd364fbcbc859d1c30f0f793" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:54.970921 28279 tablet_bootstrap.cc:654] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.980167 28082 raft_consensus.cc:3060] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.979467 28277 ts_tablet_manager.cc:1434] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:21:54.982507 27905 catalog_manager.cc:5697] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:54.979065 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f566c9bd364fbcbc859d1c30f0f793" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:54.986125 28007 raft_consensus.cc:3060] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.995493 28331 raft_consensus.cc:493] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.996124 28331 raft_consensus.cc:515] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:54.998412 28331 leader_election.cc:290] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:54.999878 28081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "027980aba9e546578394bd75f01ffba4" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:55.002559 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "027980aba9e546578394bd75f01ffba4" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:55.003219 28007 raft_consensus.cc:2468] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:21:55.006507 28122 leader_election.cc:304] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651
I20260709 13:21:55.007846 28122 leader_election.cc:304] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:55.008561 28370 consensus_queue.cc:1048] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.009783 28377 raft_consensus.cc:2749] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.010036 28370 raft_consensus.cc:2804] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.010589 28370 raft_consensus.cc:697] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:21:55.011358 28277 tablet_bootstrap.cc:492] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:55.011454 28370 consensus_queue.cc:237] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.012306 28082 raft_consensus.cc:2468] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:21:55.015444 28280 tablet_bootstrap.cc:492] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:55.015954 28280 ts_tablet_manager.cc:1403] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.139s	user 0.030s	sys 0.021s
I20260709 13:21:55.018821 28277 tablet_bootstrap.cc:654] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.018736 28280 raft_consensus.cc:359] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.019492 28280 raft_consensus.cc:385] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.019788 28280 raft_consensus.cc:740] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.020428 28280 consensus_queue.cc:260] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.021018 28279 tablet_bootstrap.cc:492] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:55.021494 28279 ts_tablet_manager.cc:1403] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.000s
I20260709 13:21:55.023759 28008 raft_consensus.cc:3060] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.041476 28280 ts_tablet_manager.cc:1434] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:21:55.058257 28279 raft_consensus.cc:359] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:55.062287 28279 raft_consensus.cc:385] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.062723 28279 raft_consensus.cc:740] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.061841 28280 tablet_bootstrap.cc:492] T f3a25078ad8448a485e557a6edaf0118 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:55.073462 28278 tablet_bootstrap.cc:492] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:55.073822 28277 tablet_bootstrap.cc:492] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:55.074298 28278 ts_tablet_manager.cc:1403] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.122s	user 0.019s	sys 0.000s
I20260709 13:21:55.076682 28279 consensus_queue.cc:260] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:55.074358 28277 ts_tablet_manager.cc:1403] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.014s
I20260709 13:21:55.076900 27907 catalog_manager.cc:5697] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b reported cstate change: term changed from 0 to 1, leader changed from <none> to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 1 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:55.080190 28278 raft_consensus.cc:359] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.086269 28278 raft_consensus.cc:385] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.086735 28278 raft_consensus.cc:740] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.087647 28278 consensus_queue.cc:260] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.090236 28278 ts_tablet_manager.cc:1434] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:21:55.090682 28280 tablet_bootstrap.cc:654] T f3a25078ad8448a485e557a6edaf0118 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.092383 28278 tablet_bootstrap.cc:492] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:55.094731 28277 raft_consensus.cc:359] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:55.095476 28277 raft_consensus.cc:385] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.095781 28277 raft_consensus.cc:740] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.096642 28277 consensus_queue.cc:260] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:55.099560 28277 ts_tablet_manager.cc:1434] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:21:55.100720 28277 tablet_bootstrap.cc:492] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:55.101967 28278 tablet_bootstrap.cc:654] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.107676 28277 tablet_bootstrap.cc:654] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.117909 28279 ts_tablet_manager.cc:1434] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.096s	user 0.003s	sys 0.005s
I20260709 13:21:55.119270 28279 tablet_bootstrap.cc:492] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:55.127709 28278 tablet_bootstrap.cc:492] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:55.128361 28278 ts_tablet_manager.cc:1403] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.012s
I20260709 13:21:55.128710 28279 tablet_bootstrap.cc:654] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.131707 28446 raft_consensus.cc:493] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.132500 28446 raft_consensus.cc:515] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:55.136664 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ce0cdf347247538a4b952da2421761" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:55.138221 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ce0cdf347247538a4b952da2421761" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:55.139169 28082 raft_consensus.cc:2468] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:21:55.140764 28197 leader_election.cc:304] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
W20260709 13:21:55.141593 28196 leader_election.cc:343] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.141948 28291 raft_consensus.cc:2804] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.142299 28291 raft_consensus.cc:493] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.142604 28291 raft_consensus.cc:3060] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.142627 28446 leader_election.cc:290] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:55.144459 28278 raft_consensus.cc:359] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:55.145537 28278 raft_consensus.cc:385] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.145948 28278 raft_consensus.cc:740] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.146304 28280 tablet_bootstrap.cc:492] T f3a25078ad8448a485e557a6edaf0118 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:55.146952 28280 ts_tablet_manager.cc:1403] T f3a25078ad8448a485e557a6edaf0118 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.086s	user 0.017s	sys 0.000s
I20260709 13:21:55.146926 28278 consensus_queue.cc:260] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:55.150385 28280 raft_consensus.cc:359] T f3a25078ad8448a485e557a6edaf0118 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.151147 28280 raft_consensus.cc:385] T f3a25078ad8448a485e557a6edaf0118 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.151480 28280 raft_consensus.cc:740] T f3a25078ad8448a485e557a6edaf0118 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.152400 28280 consensus_queue.cc:260] T f3a25078ad8448a485e557a6edaf0118 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.153157 28291 raft_consensus.cc:515] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:55.156646 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ce0cdf347247538a4b952da2421761" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:55.157281 28008 raft_consensus.cc:3060] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.157816 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ce0cdf347247538a4b952da2421761" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:55.158416 28082 raft_consensus.cc:3060] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.166213 28280 ts_tablet_manager.cc:1434] T f3a25078ad8448a485e557a6edaf0118 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:21:55.167337 28082 raft_consensus.cc:2468] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:55.167440 28278 ts_tablet_manager.cc:1434] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:21:55.168711 28197 leader_election.cc:304] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:55.169559 28278 tablet_bootstrap.cc:492] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:55.169598 28370 raft_consensus.cc:493] T 6dd28360227f4dca8286a91d1be17d04 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.169728 28291 leader_election.cc:290] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:55.170616 28370 raft_consensus.cc:515] T 6dd28360227f4dca8286a91d1be17d04 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:55.169808 28446 raft_consensus.cc:2804] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.173117 28370 leader_election.cc:290] T 6dd28360227f4dca8286a91d1be17d04 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:55.175141 28446 raft_consensus.cc:697] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:21:55.176497 28374 raft_consensus.cc:493] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.181298 28280 tablet_bootstrap.cc:492] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:55.181638 28374 raft_consensus.cc:515] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.181674 28446 consensus_queue.cc:237] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:55.176945 28279 tablet_bootstrap.cc:492] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:55.176374 28155 raft_consensus.cc:3060] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.184010 28374 leader_election.cc:290] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:55.177976 28277 tablet_bootstrap.cc:492] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:55.185983 28277 ts_tablet_manager.cc:1403] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.012s
I20260709 13:21:55.184199 28279 ts_tablet_manager.cc:1403] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.021s
I20260709 13:21:55.175083 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd28360227f4dca8286a91d1be17d04" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:55.175829 28008 raft_consensus.cc:2468] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:55.183609 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd28360227f4dca8286a91d1be17d04" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:55.187470 28229 raft_consensus.cc:2393] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afb0dc4e88ca4275975541dfe077b38b in current term 1: Already voted for candidate d80a443d06244116ae813b77fc539651 in this term.
I20260709 13:21:55.189227 28279 raft_consensus.cc:359] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.185775 28156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25fa78648f943939c0b04e5ae654cdf" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:55.189807 28280 tablet_bootstrap.cc:654] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.186710 28081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25fa78648f943939c0b04e5ae654cdf" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:55.190681 28081 raft_consensus.cc:2468] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 0.
W20260709 13:21:55.191381 27975 leader_election.cc:343] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.192035 28279 raft_consensus.cc:385] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.192095 27974 leader_election.cc:304] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:55.192411 28279 raft_consensus.cc:740] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.193567 28279 consensus_queue.cc:260] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.194804 28277 raft_consensus.cc:359] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.195513 28277 raft_consensus.cc:385] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.195780 28277 raft_consensus.cc:740] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.196583 28277 consensus_queue.cc:260] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.197950 28374 raft_consensus.cc:2804] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.198768 28374 raft_consensus.cc:493] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.200858 28374 raft_consensus.cc:3060] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.201645 28279 ts_tablet_manager.cc:1434] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:21:55.204705 28278 tablet_bootstrap.cc:654] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.208698 28279 tablet_bootstrap.cc:492] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:55.199090 28277 ts_tablet_manager.cc:1434] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:21:55.189736 28123 leader_election.cc:304] T 6dd28360227f4dca8286a91d1be17d04 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651
I20260709 13:21:55.215142 28370 raft_consensus.cc:3060] T 6dd28360227f4dca8286a91d1be17d04 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.226178 28370 raft_consensus.cc:2749] T 6dd28360227f4dca8286a91d1be17d04 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.216481 28277 tablet_bootstrap.cc:492] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:55.226217 27906 catalog_manager.cc:5697] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 1 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.228742 28278 tablet_bootstrap.cc:492] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:55.229302 28278 ts_tablet_manager.cc:1403] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.004s
I20260709 13:21:55.213557 28374 raft_consensus.cc:515] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.232249 28278 raft_consensus.cc:359] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.232901 28278 raft_consensus.cc:385] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.233906 28374 leader_election.cc:290] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:55.217053 28279 tablet_bootstrap.cc:654] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.234822 28446 raft_consensus.cc:493] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.235342 28446 raft_consensus.cc:515] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.236153 28081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25fa78648f943939c0b04e5ae654cdf" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:55.236801 28081 raft_consensus.cc:3060] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.237586 28446 leader_election.cc:290] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:55.239362 28277 tablet_bootstrap.cc:654] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.242187 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ff8ad68e8c484084ae9ff0160e712f" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:55.244498 28156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ff8ad68e8c484084ae9ff0160e712f" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:55.246131 28378 raft_consensus.cc:493] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.246829 28378 raft_consensus.cc:515] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:55.248972 28378 leader_election.cc:290] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:55.250216 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25fa78648f943939c0b04e5ae654cdf" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
W20260709 13:21:55.250957 28198 leader_election.cc:343] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:55.252295 27975 leader_election.cc:343] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.252564 28156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3758e0f5638b496dbea84f0014c5e6a5" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:55.253921 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3758e0f5638b496dbea84f0014c5e6a5" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:55.254611 28229 raft_consensus.cc:2468] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
W20260709 13:21:55.255837 28050 leader_election.cc:343] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:55.253955 28196 leader_election.cc:343] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.256878 28196 leader_election.cc:304] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:55.258356 28291 raft_consensus.cc:2749] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.259527 28047 leader_election.cc:304] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:55.261960 28421 raft_consensus.cc:2804] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.262578 28421 raft_consensus.cc:493] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.263059 28421 raft_consensus.cc:3060] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.233168 28278 raft_consensus.cc:740] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.269673 28278 consensus_queue.cc:260] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.279975 28280 tablet_bootstrap.cc:492] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:55.280663 28280 ts_tablet_manager.cc:1403] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.100s	user 0.022s	sys 0.025s
I20260709 13:21:55.285917 28426 consensus_queue.cc:1048] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:55.295764 28446 raft_consensus.cc:493] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.296586 28446 raft_consensus.cc:515] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:55.327821 28434 raft_consensus.cc:493] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.328657 28434 raft_consensus.cc:515] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.333117 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4edfd4e5ea7461eaa8917755dff8c60" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:55.334136 28232 raft_consensus.cc:2468] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:21:55.340160 28121 leader_election.cc:304] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:55.343153 28331 raft_consensus.cc:2804] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.343791 28331 raft_consensus.cc:493] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.344274 28331 raft_consensus.cc:3060] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.348400 28280 raft_consensus.cc:359] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.349761 28280 raft_consensus.cc:385] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.350104 28280 raft_consensus.cc:740] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.350891 28280 consensus_queue.cc:260] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.352586 28278 ts_tablet_manager.cc:1434] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.123s	user 0.011s	sys 0.010s
I20260709 13:21:55.354176 28278 tablet_bootstrap.cc:492] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:55.355067 28277 tablet_bootstrap.cc:492] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:55.355631 28277 ts_tablet_manager.cc:1403] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.139s	user 0.011s	sys 0.043s
I20260709 13:21:55.356384 28421 raft_consensus.cc:515] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:55.359135 28279 tablet_bootstrap.cc:492] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:55.359688 28279 ts_tablet_manager.cc:1403] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.157s	user 0.033s	sys 0.033s
I20260709 13:21:55.360428 28280 ts_tablet_manager.cc:1434] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.079s	user 0.018s	sys 0.016s
I20260709 13:21:55.360962 28278 tablet_bootstrap.cc:654] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.361933 28280 tablet_bootstrap.cc:492] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:55.358753 28277 raft_consensus.cc:359] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:55.364147 28277 raft_consensus.cc:385] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.364502 28277 raft_consensus.cc:740] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.365293 28434 leader_election.cc:290] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:55.365538 28277 consensus_queue.cc:260] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:55.365978 28081 raft_consensus.cc:2468] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 1.
W20260709 13:21:55.376148 28196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 51670.5us
I20260709 13:21:55.367255 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4edfd4e5ea7461eaa8917755dff8c60" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:55.371090 28279 raft_consensus.cc:359] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.373770 28280 tablet_bootstrap.cc:654] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.377509 28279 raft_consensus.cc:385] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.377952 28279 raft_consensus.cc:740] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.374604 28421 leader_election.cc:290] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:55.379345 28279 consensus_queue.cc:260] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.379798 28277 ts_tablet_manager.cc:1434] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 13:21:55.381640 28279 ts_tablet_manager.cc:1434] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 13:21:55.383409 28279 tablet_bootstrap.cc:492] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
W20260709 13:21:55.384425 28122 leader_election.cc:343] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.390924 28279 tablet_bootstrap.cc:654] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.391150 27974 leader_election.cc:304] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:55.392063 28374 raft_consensus.cc:2804] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.392632 28374 raft_consensus.cc:697] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:21:55.393572 28374 consensus_queue.cc:237] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.396479 28280 tablet_bootstrap.cc:492] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:55.397027 28280 ts_tablet_manager.cc:1403] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.009s
I20260709 13:21:55.400219 28278 tablet_bootstrap.cc:492] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:55.400805 28278 ts_tablet_manager.cc:1403] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.012s
I20260709 13:21:55.400518 28280 raft_consensus.cc:359] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.401228 28280 raft_consensus.cc:385] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.401537 28280 raft_consensus.cc:740] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.402379 28280 consensus_queue.cc:260] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.404372 28280 ts_tablet_manager.cc:1434] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:21:55.405443 28280 tablet_bootstrap.cc:492] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:55.410138 28278 raft_consensus.cc:359] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.410904 28278 raft_consensus.cc:385] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.411219 28278 raft_consensus.cc:740] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.413724 28280 tablet_bootstrap.cc:654] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:55.413595 28048 consensus_peers.cc:597] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:55.417594 28446 leader_election.cc:290] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:55.419041 28081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e62ca8c25e497bb3f7ad553ee4f3c2" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
W20260709 13:21:55.420915 28197 leader_election.cc:343] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.420854 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e62ca8c25e497bb3f7ad553ee4f3c2" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:55.423974 28278 consensus_queue.cc:260] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.424628 28279 tablet_bootstrap.cc:492] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:55.425145 28279 ts_tablet_manager.cc:1403] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.003s
I20260709 13:21:55.428030 28279 raft_consensus.cc:359] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:55.428156 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3758e0f5638b496dbea84f0014c5e6a5" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:55.429798 28279 raft_consensus.cc:385] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.430025 28278 ts_tablet_manager.cc:1434] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:21:55.430157 28279 raft_consensus.cc:740] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.431233 28278 tablet_bootstrap.cc:492] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:55.431113 28279 consensus_queue.cc:260] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:55.431500 28280 tablet_bootstrap.cc:492] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:55.431994 28421 raft_consensus.cc:493] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.432296 28280 ts_tablet_manager.cc:1403] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.005s
I20260709 13:21:55.432595 28421 raft_consensus.cc:515] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:55.435052 28421 leader_election.cc:290] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:55.435506 28280 raft_consensus.cc:359] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.436269 28280 raft_consensus.cc:385] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.436578 28280 raft_consensus.cc:740] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.437203 28280 consensus_queue.cc:260] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.438576 28278 tablet_bootstrap.cc:654] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.439266 28426 raft_consensus.cc:493] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.439814 28426 raft_consensus.cc:515] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.442620 28426 leader_election.cc:290] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:55.442831 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a25078ad8448a485e557a6edaf0118" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:21:55.443186 28050 leader_election.cc:343] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.443656 28008 raft_consensus.cc:2468] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:21:55.444308 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a25078ad8448a485e557a6edaf0118" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:55.445343 28279 ts_tablet_manager.cc:1434] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 13:21:55.444974 28048 leader_election.cc:304] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:55.447749 28277 tablet_bootstrap.cc:492] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:55.448325 28280 ts_tablet_manager.cc:1434] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:21:55.445035 28157 raft_consensus.cc:2468] T f3a25078ad8448a485e557a6edaf0118 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:21:55.449810 28280 tablet_bootstrap.cc:492] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:55.462889 28342 raft_consensus.cc:493] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.463550 28342 raft_consensus.cc:515] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.466255 28279 tablet_bootstrap.cc:492] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:55.466714 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8359246c5ff428e89f3b5c15a65aa98" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:55.468669 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3758e0f5638b496dbea84f0014c5e6a5" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:55.472057 28229 raft_consensus.cc:3060] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:55.468398 27975 leader_election.cc:343] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.467705 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8359246c5ff428e89f3b5c15a65aa98" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:55.481655 28232 raft_consensus.cc:2468] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 0.
I20260709 13:21:55.483484 28370 consensus_queue.cc:1048] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:55.486433 27972 leader_election.cc:304] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:55.487883 28469 raft_consensus.cc:2804] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.488485 28469 raft_consensus.cc:493] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.489074 28279 tablet_bootstrap.cc:654] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.488994 28469 raft_consensus.cc:3060] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.454862 28378 raft_consensus.cc:2804] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.467545 28156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7ccef5723d4614918b18c47b9dfa3a" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:55.492213 28378 raft_consensus.cc:493] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.492823 28378 raft_consensus.cc:3060] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.496799 28469 raft_consensus.cc:515] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.475643 27907 catalog_manager.cc:5697] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.500257 28370 raft_consensus.cc:493] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.500983 28370 raft_consensus.cc:515] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.503875 28370 leader_election.cc:290] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:55.467799 28342 leader_election.cc:290] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:55.504995 28081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1dc5fdce0d4a289fc84c10ecbcd2c7" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:55.505699 28081 raft_consensus.cc:2468] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:21:55.507053 28123 leader_election.cc:304] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:55.507977 28370 raft_consensus.cc:2804] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.508771 28277 tablet_bootstrap.cc:654] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.512123 28280 tablet_bootstrap.cc:654] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.512594 28434 raft_consensus.cc:493] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:55.515786 28050 leader_election.cc:343] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.515977 28434 raft_consensus.cc:515] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.517637 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1dc5fdce0d4a289fc84c10ecbcd2c7" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:55.518643 28434 leader_election.cc:290] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:55.518719 28377 raft_consensus.cc:493] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.511050 28370 raft_consensus.cc:493] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.525045 28229 raft_consensus.cc:2468] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:21:55.519872 28377 raft_consensus.cc:515] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.527402 28377 leader_election.cc:290] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:55.524333 28370 raft_consensus.cc:3060] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.530249 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25fa78648f943939c0b04e5ae654cdf" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:55.531083 28082 raft_consensus.cc:2393] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afb0dc4e88ca4275975541dfe077b38b in current term 1: Already voted for candidate 6b1d1aefe48e42119ca040c70045fe28 in this term.
I20260709 13:21:55.534145 28156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8359246c5ff428e89f3b5c15a65aa98" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
W20260709 13:21:55.535538 27975 leader_election.cc:343] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.536811 28469 leader_election.cc:290] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:55.541265 28278 tablet_bootstrap.cc:492] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:55.542042 28278 ts_tablet_manager.cc:1403] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.111s	user 0.019s	sys 0.022s
W20260709 13:21:55.535778 28196 leader_election.cc:343] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.552767 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8359246c5ff428e89f3b5c15a65aa98" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:55.553014 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ff8ad68e8c484084ae9ff0160e712f" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:55.553489 28231 raft_consensus.cc:3060] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.553608 28229 raft_consensus.cc:2468] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
W20260709 13:21:55.554333 28122 leader_election.cc:343] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.554468 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ff8ad68e8c484084ae9ff0160e712f" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:21:55.556075 28122 leader_election.cc:343] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.545670 28377 consensus_queue.cc:1048] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:21:55.556382 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25fa78648f943939c0b04e5ae654cdf" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:55.560011 28121 leader_election.cc:304] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:55.547125 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7ccef5723d4614918b18c47b9dfa3a" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:55.564275 28331 raft_consensus.cc:515] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.562043 28231 raft_consensus.cc:2468] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 1.
I20260709 13:21:55.568851 28278 raft_consensus.cc:359] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.570102 28278 raft_consensus.cc:385] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.570448 28278 raft_consensus.cc:740] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.571660 28278 consensus_queue.cc:260] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.568229 28434 raft_consensus.cc:2804] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.572899 28232 raft_consensus.cc:2468] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:21:55.575495 28123 leader_election.cc:304] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651
I20260709 13:21:55.576924 27972 leader_election.cc:304] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:55.549098 28196 leader_election.cc:304] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651
I20260709 13:21:55.580456 28507 raft_consensus.cc:2749] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.580736 28342 raft_consensus.cc:2804] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.581332 28342 raft_consensus.cc:697] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:21:55.575912 28434 raft_consensus.cc:493] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.588301 28278 ts_tablet_manager.cc:1434] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:21:55.589248 28434 raft_consensus.cc:3060] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.594223 28278 tablet_bootstrap.cc:492] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
W20260709 13:21:55.581396 28196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 45653.3us
I20260709 13:21:55.587797 28377 raft_consensus.cc:3060] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.582269 28342 consensus_queue.cc:237] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.610692 28047 leader_election.cc:304] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:55.612689 28421 consensus_queue.cc:1048] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.614166 28421 raft_consensus.cc:2804] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.614624 28421 raft_consensus.cc:697] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:21:55.614938 28426 consensus_queue.cc:1048] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.615725 28278 tablet_bootstrap.cc:654] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.615424 28421 consensus_queue.cc:237] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:55.630582 28279 tablet_bootstrap.cc:492] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:55.631115 28279 ts_tablet_manager.cc:1403] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.165s	user 0.009s	sys 0.021s
I20260709 13:21:55.631878 28434 raft_consensus.cc:515] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.634200 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4edfd4e5ea7461eaa8917755dff8c60" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:55.634816 28232 raft_consensus.cc:3060] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.634857 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ff8ad68e8c484084ae9ff0160e712f" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:55.636139 28231 raft_consensus.cc:3060] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:55.636696 28515 log.cc:927] Time spent T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:21:55.636859 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ff8ad68e8c484084ae9ff0160e712f" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
W20260709 13:21:55.638830 28122 leader_election.cc:343] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.656319 28279 raft_consensus.cc:359] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:55.657822 28279 raft_consensus.cc:385] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.658206 28279 raft_consensus.cc:740] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.659087 28279 consensus_queue.cc:260] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:55.637840 28434 leader_election.cc:290] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:55.661952 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4edfd4e5ea7461eaa8917755dff8c60" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:55.671208 27907 catalog_manager.cc:5697] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:55.691329 28279 ts_tablet_manager.cc:1434] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.003s
I20260709 13:21:55.685341 28291 consensus_queue.cc:1048] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:55.662678 28331 leader_election.cc:290] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
W20260709 13:21:55.663142 28047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:36151, user_credentials={real_user=slave}} blocked reactor thread for 50884.8us
I20260709 13:21:55.706262 28279 tablet_bootstrap.cc:492] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:55.707100 28277 tablet_bootstrap.cc:492] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
W20260709 13:21:55.695724 28123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:43901, user_credentials={real_user=slave}} blocked reactor thread for 57167.2us
I20260709 13:21:55.707620 28277 ts_tablet_manager.cc:1403] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.260s	user 0.019s	sys 0.015s
I20260709 13:21:55.693652 28009 raft_consensus.cc:3060] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.699563 28522 raft_consensus.cc:493] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.697000 28232 raft_consensus.cc:2468] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:21:55.714035 28279 tablet_bootstrap.cc:654] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.723114 28121 leader_election.cc:304] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:55.718118 28522 raft_consensus.cc:515] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:55.730414 28370 raft_consensus.cc:515] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.727053 28463 raft_consensus.cc:493] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.731885 28331 raft_consensus.cc:2804] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.732440 28331 raft_consensus.cc:697] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:21:55.733465 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e62ca8c25e497bb3f7ad553ee4f3c2" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:55.733294 28331 consensus_queue.cc:237] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.733356 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1dc5fdce0d4a289fc84c10ecbcd2c7" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
W20260709 13:21:55.735044 28048 leader_election.cc:343] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.731689 28463 raft_consensus.cc:515] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:55.735845 28378 raft_consensus.cc:515] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.737090 28463 leader_election.cc:290] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:55.737596 28446 consensus_queue.cc:1048] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.735906 28522 leader_election.cc:290] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:55.699218 28377 raft_consensus.cc:2749] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:55.736436 28122 leader_election.cc:343] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.748368 28277 raft_consensus.cc:359] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:55.749112 28277 raft_consensus.cc:385] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.749373 28277 raft_consensus.cc:740] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.750080 28277 consensus_queue.cc:260] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:55.752223 28277 ts_tablet_manager.cc:1434] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.044s	user 0.001s	sys 0.005s
I20260709 13:21:55.754320 28277 tablet_bootstrap.cc:492] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:55.755076 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a25078ad8448a485e557a6edaf0118" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:55.755705 28008 raft_consensus.cc:3060] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.764775 28008 raft_consensus.cc:2468] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:21:55.773896 28291 raft_consensus.cc:493] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.775846 28291 raft_consensus.cc:515] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:55.779052 27906 catalog_manager.cc:5697] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.766168 28277 tablet_bootstrap.cc:654] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.765784 28009 raft_consensus.cc:2468] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:21:55.738948 28047 leader_election.cc:304] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:55.790220 28231 raft_consensus.cc:2468] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:21:55.800824 28522 raft_consensus.cc:2804] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.801270 28522 raft_consensus.cc:493] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.801733 28522 raft_consensus.cc:3060] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.801649 28121 leader_election.cc:304] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:55.804636 28525 raft_consensus.cc:2804] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.805174 28291 leader_election.cc:290] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:55.805176 28525 raft_consensus.cc:697] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:21:55.806811 28525 consensus_queue.cc:237] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.766932 28378 leader_election.cc:290] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:55.768851 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8feb7220d3845768a841d7df788966e" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:55.812907 28277 tablet_bootstrap.cc:492] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:55.813529 28277 ts_tablet_manager.cc:1403] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.059s	user 0.008s	sys 0.002s
I20260709 13:21:55.769646 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a25078ad8448a485e557a6edaf0118" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
W20260709 13:21:55.822166 28047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:36151, user_credentials={real_user=slave}} blocked reactor thread for 95222.1us
I20260709 13:21:55.822880 28157 raft_consensus.cc:3060] T f3a25078ad8448a485e557a6edaf0118 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.769318 28370 leader_election.cc:290] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:55.793751 28280 tablet_bootstrap.cc:492] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:55.795079 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1dc5fdce0d4a289fc84c10ecbcd2c7" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:55.825040 28082 raft_consensus.cc:3060] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.796902 28084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8feb7220d3845768a841d7df788966e" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:55.829984 28084 raft_consensus.cc:2468] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:21:55.797792 28048 leader_election.cc:304] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: 
W20260709 13:21:55.813717 28050 leader_election.cc:343] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.832261 28157 raft_consensus.cc:2468] T f3a25078ad8448a485e557a6edaf0118 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:21:55.818790 27905 catalog_manager.cc:5697] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b reported cstate change: term changed from 0 to 1, leader changed from <none> to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 1 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.770656 28278 tablet_bootstrap.cc:492] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:55.837883 28278 ts_tablet_manager.cc:1403] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.245s	user 0.010s	sys 0.015s
I20260709 13:21:55.814392 28156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8feb7220d3845768a841d7df788966e" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:55.833793 28463 raft_consensus.cc:2804] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.839100 28463 raft_consensus.cc:697] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:21:55.840003 28463 consensus_queue.cc:237] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.837906 28280 ts_tablet_manager.cc:1403] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.388s	user 0.010s	sys 0.012s
I20260709 13:21:55.832633 28197 leader_election.cc:304] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:55.842908 28502 raft_consensus.cc:2804] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.843283 28502 raft_consensus.cc:493] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.843607 28502 raft_consensus.cc:3060] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.845031 28277 raft_consensus.cc:359] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.845827 28277 raft_consensus.cc:385] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.846138 28277 raft_consensus.cc:740] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.846843 28277 consensus_queue.cc:260] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.849835 28082 raft_consensus.cc:2468] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:21:55.852005 28277 ts_tablet_manager.cc:1434] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:21:55.853348 28277 tablet_bootstrap.cc:492] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:55.854867 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e62ca8c25e497bb3f7ad553ee4f3c2" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:55.855609 28229 raft_consensus.cc:2468] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:21:55.857051 28278 raft_consensus.cc:359] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.857829 28278 raft_consensus.cc:385] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.858155 28278 raft_consensus.cc:740] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.861742 28278 consensus_queue.cc:260] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
W20260709 13:21:55.862068 28198 leader_election.cc:343] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.860831 28280 raft_consensus.cc:359] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.863338 28280 raft_consensus.cc:385] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.863718 28280 raft_consensus.cc:740] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.864756 28280 consensus_queue.cc:260] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
W20260709 13:21:55.869210 27954 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:55.869501 28280 ts_tablet_manager.cc:1434] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.002s
I20260709 13:21:55.867293 28277 tablet_bootstrap.cc:654] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.867703 28278 ts_tablet_manager.cc:1434] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:21:55.870924 28280 tablet_bootstrap.cc:492] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:55.871513 28278 tablet_bootstrap.cc:492] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:55.871973 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8feb7220d3845768a841d7df788966e" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:55.877794 28280 tablet_bootstrap.cc:654] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.880564 28278 tablet_bootstrap.cc:654] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.881976 28123 leader_election.cc:304] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:55.882962 28331 raft_consensus.cc:2804] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.883453 28331 raft_consensus.cc:697] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:21:55.884297 28331 consensus_queue.cc:237] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:55.886659 28279 tablet_bootstrap.cc:492] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:55.887198 28279 ts_tablet_manager.cc:1403] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.181s	user 0.002s	sys 0.012s
I20260709 13:21:55.876250 28502 raft_consensus.cc:515] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:55.942317 28229 raft_consensus.cc:2393] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d80a443d06244116ae813b77fc539651 in current term 1: Already voted for candidate 2e2f737d674147808bb32783de176848 in this term.
I20260709 13:21:55.943583 28278 tablet_bootstrap.cc:492] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:55.944103 28278 ts_tablet_manager.cc:1403] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.010s
I20260709 13:21:55.946842 28278 raft_consensus.cc:359] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.947532 28278 raft_consensus.cc:385] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.947799 28278 raft_consensus.cc:740] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.948469 28278 consensus_queue.cc:260] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:55.950637 28047 leader_election.cc:304] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:55.951799 28536 raft_consensus.cc:2804] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.952232 28536 raft_consensus.cc:493] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.952554 28536 raft_consensus.cc:3060] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.954202 28522 raft_consensus.cc:515] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:55.961423 28522 leader_election.cc:290] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:55.967650 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7ccef5723d4614918b18c47b9dfa3a" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
W20260709 13:21:55.969285 28050 leader_election.cc:343] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.971943 28278 ts_tablet_manager.cc:1434] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:21:55.977999 28280 tablet_bootstrap.cc:492] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:55.978554 28280 ts_tablet_manager.cc:1403] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.032s
I20260709 13:21:55.972240 27905 catalog_manager.cc:5697] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b reported cstate change: term changed from 0 to 1, leader changed from <none> to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 1 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.988698 28280 raft_consensus.cc:359] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:55.989547 28280 raft_consensus.cc:385] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.989861 28280 raft_consensus.cc:740] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.933935 28331 raft_consensus.cc:493] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.990799 28280 consensus_queue.cc:260] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.002085 28516 raft_consensus.cc:493] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.003037 28278 tablet_bootstrap.cc:492] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:56.010944 28280 ts_tablet_manager.cc:1434] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:21:56.011541 28342 consensus_queue.cc:1048] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.012176 28280 tablet_bootstrap.cc:492] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:55.984072 28047 leader_election.cc:304] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:56.002719 28516 raft_consensus.cc:515] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:56.020707 28156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ff8ad68e8c484084ae9ff0160e712f" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:56.021752 28516 leader_election.cc:290] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:56.021698 28280 tablet_bootstrap.cc:654] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.026428 28279 raft_consensus.cc:359] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:56.027369 28279 raft_consensus.cc:385] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.027730 28279 raft_consensus.cc:740] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.030946 28279 consensus_queue.cc:260] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
W20260709 13:21:56.033775 28047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:36151, user_credentials={real_user=slave}} blocked reactor thread for 81445.9us
I20260709 13:21:56.003669 28331 raft_consensus.cc:515] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:56.039108 28156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8feb7220d3845768a841d7df788966e" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:56.039393 28277 tablet_bootstrap.cc:492] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:56.040023 28277 ts_tablet_manager.cc:1403] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.187s	user 0.028s	sys 0.035s
I20260709 13:21:56.041939 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8feb7220d3845768a841d7df788966e" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:56.042924 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8359246c5ff428e89f3b5c15a65aa98" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:21:56.049765 28198 leader_election.cc:343] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.052093 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ff8ad68e8c484084ae9ff0160e712f" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:56.052510 28516 consensus_queue.cc:1048] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:56.052997 28232 raft_consensus.cc:2393] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b1d1aefe48e42119ca040c70045fe28 in current term 1: Already voted for candidate afb0dc4e88ca4275975541dfe077b38b in this term.
I20260709 13:21:56.054791 28230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7ccef5723d4614918b18c47b9dfa3a" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:56.049266 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8359246c5ff428e89f3b5c15a65aa98" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:56.064893 28231 raft_consensus.cc:2393] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afb0dc4e88ca4275975541dfe077b38b in current term 1: Already voted for candidate 6b1d1aefe48e42119ca040c70045fe28 in this term.
I20260709 13:21:56.046885 28536 raft_consensus.cc:515] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:56.068819 28278 tablet_bootstrap.cc:654] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.059813 27907 catalog_manager.cc:5697] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:56.046964 28331 leader_election.cc:290] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:56.062163 28370 raft_consensus.cc:493] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.063351 28277 raft_consensus.cc:359] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:56.064018 28230 raft_consensus.cc:3060] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.077831 28370 raft_consensus.cc:515] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.080333 28370 leader_election.cc:290] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:56.066247 28121 leader_election.cc:304] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:56.045135 28522 raft_consensus.cc:3060] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.081980 28084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3758e0f5638b496dbea84f0014c5e6a5" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:56.083657 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3758e0f5638b496dbea84f0014c5e6a5" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:56.071789 28277 raft_consensus.cc:385] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.046610 28502 leader_election.cc:290] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:56.084515 28421 consensus_queue.cc:1048] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:56.084515 28229 raft_consensus.cc:2393] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afb0dc4e88ca4275975541dfe077b38b in current term 1: Already voted for candidate d80a443d06244116ae813b77fc539651 in this term.
I20260709 13:21:56.084667 28277 raft_consensus.cc:740] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.065182 27972 leader_election.cc:304] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28; no voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:56.080520 28279 ts_tablet_manager.cc:1434] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.193s	user 0.008s	sys 0.002s
I20260709 13:21:56.088347 28277 consensus_queue.cc:260] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:56.087723 28331 raft_consensus.cc:3060] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.102941 28279 tablet_bootstrap.cc:492] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:56.092188 28516 raft_consensus.cc:3060] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.115760 28121 leader_election.cc:304] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651
I20260709 13:21:56.120275 28525 raft_consensus.cc:3060] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.122010 28279 tablet_bootstrap.cc:654] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.128072 28277 ts_tablet_manager.cc:1434] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.088s	user 0.009s	sys 0.001s
I20260709 13:21:56.138381 28536 leader_election.cc:290] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:56.139132 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e62ca8c25e497bb3f7ad553ee4f3c2" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:56.139816 28232 raft_consensus.cc:3060] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.144006 28525 raft_consensus.cc:2749] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.146581 28230 raft_consensus.cc:2468] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:21:56.146773 28502 raft_consensus.cc:493] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.153828 28502 raft_consensus.cc:515] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:56.154330 28331 raft_consensus.cc:2749] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.156208 28502 leader_election.cc:290] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:56.158085 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f6ad6d00d44eb5b9914641b6da9ae5" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
W20260709 13:21:56.159715 28198 leader_election.cc:343] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.161476 28047 leader_election.cc:304] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:56.162627 28536 raft_consensus.cc:2804] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:56.163025 28232 raft_consensus.cc:2468] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:21:56.164104 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f6ad6d00d44eb5b9914641b6da9ae5" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:56.164340 28047 leader_election.cc:304] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:56.164870 28007 raft_consensus.cc:2468] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:21:56.163482 28536 raft_consensus.cc:697] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:21:56.166491 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e62ca8c25e497bb3f7ad553ee4f3c2" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:56.165244 28421 raft_consensus.cc:2804] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:56.166895 28536 consensus_queue.cc:237] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.166136 28196 leader_election.cc:304] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:56.167912 28421 raft_consensus.cc:697] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:21:56.169420 28421 consensus_queue.cc:237] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:56.170058 28502 raft_consensus.cc:2804] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:56.170511 28507 raft_consensus.cc:493] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.171063 28507 raft_consensus.cc:515] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:56.174400 28507 leader_election.cc:290] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:56.175356 28084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a66e81e89d46308972b6fbc0328b74" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:56.170540 28502 raft_consensus.cc:493] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:56.176692 28502 raft_consensus.cc:3060] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:56.179279 28197 leader_election.cc:343] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:56.180610 28048 leader_election.cc:343] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.181842 28280 tablet_bootstrap.cc:492] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:56.182343 28280 ts_tablet_manager.cc:1403] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.170s	user 0.028s	sys 0.026s
I20260709 13:21:56.186612 28277 tablet_bootstrap.cc:492] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:56.188524 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a66e81e89d46308972b6fbc0328b74" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:56.190078 28463 consensus_queue.cc:1048] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:56.192207 28196 leader_election.cc:343] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.195080 28522 raft_consensus.cc:2749] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.188855 28342 consensus_queue.cc:1048] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:21:56.199797 28516 raft_consensus.cc:2749] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.205657 28279 tablet_bootstrap.cc:492] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:56.209571 28279 ts_tablet_manager.cc:1403] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.107s	user 0.015s	sys 0.005s
I20260709 13:21:56.213838 27907 catalog_manager.cc:5697] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:56.214058 27905 catalog_manager.cc:5697] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b reported cstate change: term changed from 0 to 1, leader changed from <none> to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 1 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:56.209300 28331 consensus_queue.cc:1048] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:21:56.209592 28196 leader_election.cc:304] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651
I20260709 13:21:56.236931 28280 raft_consensus.cc:359] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.239670 28280 raft_consensus.cc:385] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.240136 28280 raft_consensus.cc:740] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.243830 28280 consensus_queue.cc:260] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.240199 28507 raft_consensus.cc:2749] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:56.239125 28196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 46948.9us
I20260709 13:21:56.253911 28280 ts_tablet_manager.cc:1434] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 13:21:56.265117 28277 tablet_bootstrap.cc:654] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.246307 28502 raft_consensus.cc:515] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:56.271347 28502 leader_election.cc:290] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:56.267199 28083 raft_consensus.cc:2468] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:56.274571 28516 consensus_queue.cc:1048] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:56.281925 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f6ad6d00d44eb5b9914641b6da9ae5" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
W20260709 13:21:56.284530 28198 leader_election.cc:343] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.288664 28279 raft_consensus.cc:359] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.289722 28279 raft_consensus.cc:385] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.290073 28279 raft_consensus.cc:740] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.290982 28279 consensus_queue.cc:260] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.307680 28278 tablet_bootstrap.cc:492] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:56.308509 28278 ts_tablet_manager.cc:1403] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.316s	user 0.005s	sys 0.015s
I20260709 13:21:56.309334 28279 ts_tablet_manager.cc:1434] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.001s
I20260709 13:21:56.310550 28280 tablet_bootstrap.cc:492] T 81f6ad6d00d44eb5b9914641b6da9ae5 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:56.314229 28378 consensus_queue.cc:1048] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:21:56.309897 28197 leader_election.cc:304] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
W20260709 13:21:56.297183 27974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:43901, user_credentials={real_user=slave}} blocked reactor thread for 66216.6us
I20260709 13:21:56.323536 28507 raft_consensus.cc:2804] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:56.324127 28507 raft_consensus.cc:697] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:21:56.324955 28507 consensus_queue.cc:237] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.340231 27904 catalog_manager.cc:5697] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:56.380702 28279 tablet_bootstrap.cc:492] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:56.376731 28278 raft_consensus.cc:359] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:56.389042 28278 raft_consensus.cc:385] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.389357 28278 raft_consensus.cc:740] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.391242 28280 tablet_bootstrap.cc:654] T 81f6ad6d00d44eb5b9914641b6da9ae5 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.393342 28278 consensus_queue.cc:260] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:56.392187 28421 consensus_queue.cc:1048] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:21:56.397562 28278 ts_tablet_manager.cc:1434] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.000s
I20260709 13:21:56.399968 28277 tablet_bootstrap.cc:492] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:56.400519 28277 ts_tablet_manager.cc:1403] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.249s	user 0.041s	sys 0.045s
I20260709 13:21:56.403426 28277 raft_consensus.cc:359] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:56.404122 28277 raft_consensus.cc:385] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.404430 28277 raft_consensus.cc:740] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.405959 28277 consensus_queue.cc:260] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:56.410808 28277 ts_tablet_manager.cc:1434] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:21:56.411909 28277 tablet_bootstrap.cc:492] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:56.412137 28370 consensus_queue.cc:1048] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:56.414853 28377 consensus_queue.cc:1048] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:56.424326 28370 consensus_queue.cc:1048] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:56.425503 28277 tablet_bootstrap.cc:654] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.433897 28378 raft_consensus.cc:493] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.433399 27906 catalog_manager.cc:5697] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 1 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:56.434419 28378 raft_consensus.cc:515] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:56.426610 28421 raft_consensus.cc:493] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.436004 28421 raft_consensus.cc:515] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.437252 28378 leader_election.cc:290] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:56.438020 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f6ad6d00d44eb5b9914641b6da9ae5" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:56.439894 28279 tablet_bootstrap.cc:654] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.461699 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7df1c61b2348668e7022bfc34d7886" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:56.462850 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115ec4e7eaff44c191ebb3618716383c" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:56.465945 28278 tablet_bootstrap.cc:492] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:56.454092 28007 raft_consensus.cc:3060] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:56.480222 28050 leader_election.cc:343] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.481985 28502 raft_consensus.cc:493] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.482756 28502 raft_consensus.cc:515] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
W20260709 13:21:56.477421 28047 leader_election.cc:343] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2f737d674147808bb32783de176848 (127.17.251.132:36151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.486662 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3da7f8304442df89580b5f02ed1bcf" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
W20260709 13:21:56.488344 28198 leader_election.cc:343] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.492830 28331 consensus_queue.cc:1048] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:56.494673 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115ec4e7eaff44c191ebb3618716383c" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:56.499014 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7df1c61b2348668e7022bfc34d7886" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
W20260709 13:21:56.499579 28048 leader_election.cc:343] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.500325 28048 leader_election.cc:304] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28
W20260709 13:21:56.500937 28047 leader_election.cc:343] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2f737d674147808bb32783de176848 (127.17.251.132:36151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.501489 28047 leader_election.cc:304] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:56.501943 28463 raft_consensus.cc:2749] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.502497 28426 raft_consensus.cc:2749] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.502825 28502 leader_election.cc:290] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:56.477252 28421 leader_election.cc:290] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:56.520072 28516 raft_consensus.cc:493] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.528825 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3da7f8304442df89580b5f02ed1bcf" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:56.538956 28516 raft_consensus.cc:515] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:56.546401 28516 leader_election.cc:290] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:56.548365 28280 tablet_bootstrap.cc:492] T 81f6ad6d00d44eb5b9914641b6da9ae5 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:56.548944 28280 ts_tablet_manager.cc:1403] T 81f6ad6d00d44eb5b9914641b6da9ae5 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.252s	user 0.031s	sys 0.043s
I20260709 13:21:56.549564 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccc7022ab04f9a8ddc87ac37f31c7c" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:56.554934 28277 tablet_bootstrap.cc:492] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
W20260709 13:21:56.564388 28196 leader_election.cc:343] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.589371 28196 leader_election.cc:304] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:56.590605 28566 raft_consensus.cc:2749] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:56.564872 28122 consensus_peers.cc:597] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:56.566109 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccc7022ab04f9a8ddc87ac37f31c7c" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:56.566321 28007 raft_consensus.cc:2468] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:56.571799 28280 raft_consensus.cc:359] T 81f6ad6d00d44eb5b9914641b6da9ae5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:56.594342 28280 raft_consensus.cc:385] T 81f6ad6d00d44eb5b9914641b6da9ae5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.594671 28280 raft_consensus.cc:740] T 81f6ad6d00d44eb5b9914641b6da9ae5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.595391 28280 consensus_queue.cc:260] T 81f6ad6d00d44eb5b9914641b6da9ae5 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:56.579089 28331 raft_consensus.cc:493] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.581954 28279 tablet_bootstrap.cc:492] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:56.597671 28280 ts_tablet_manager.cc:1434] T 81f6ad6d00d44eb5b9914641b6da9ae5 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:21:56.597930 28279 ts_tablet_manager.cc:1403] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.217s	user 0.012s	sys 0.003s
I20260709 13:21:56.597690 28331 raft_consensus.cc:515] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.598748 28280 tablet_bootstrap.cc:492] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:56.601276 28196 leader_election.cc:304] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:56.583662 28278 tablet_bootstrap.cc:654] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.602695 28566 raft_consensus.cc:2804] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:56.603260 28566 raft_consensus.cc:697] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:21:56.601047 28279 raft_consensus.cc:359] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:56.604610 28279 raft_consensus.cc:385] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.604180 28566 consensus_queue.cc:237] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:56.604911 28279 raft_consensus.cc:740] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.604979 28331 leader_election.cc:290] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:56.606859 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7ccef5723d4614918b18c47b9dfa3a" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:56.611315 28231 raft_consensus.cc:2393] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afb0dc4e88ca4275975541dfe077b38b in current term 1: Already voted for candidate d80a443d06244116ae813b77fc539651 in this term.
I20260709 13:21:56.605535 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7ccef5723d4614918b18c47b9dfa3a" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:56.605671 28279 consensus_queue.cc:260] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:56.610356 28280 tablet_bootstrap.cc:654] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.614735 28123 leader_election.cc:304] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651
I20260709 13:21:56.615667 28279 ts_tablet_manager.cc:1434] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:21:56.616189 28331 raft_consensus.cc:3060] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.616878 28279 tablet_bootstrap.cc:492] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:56.619563 27974 leader_election.cc:304] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28; no voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651
I20260709 13:21:56.613790 28277 ts_tablet_manager.cc:1403] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.202s	user 0.038s	sys 0.020s
I20260709 13:21:56.621230 28342 raft_consensus.cc:2749] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.629941 28279 tablet_bootstrap.cc:654] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.639254 28331 raft_consensus.cc:2749] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.640679 28278 tablet_bootstrap.cc:492] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:56.641211 28278 ts_tablet_manager.cc:1403] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.192s	user 0.012s	sys 0.006s
I20260709 13:21:56.667527 28278 raft_consensus.cc:359] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:56.670323 28278 raft_consensus.cc:385] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.670989 28278 raft_consensus.cc:740] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.673275 28278 consensus_queue.cc:260] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:56.680176 28007 raft_consensus.cc:3060] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.682077 28280 tablet_bootstrap.cc:492] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:56.682632 28280 ts_tablet_manager.cc:1403] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.084s	user 0.028s	sys 0.014s
I20260709 13:21:56.680322 28421 consensus_queue.cc:1048] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:21:56.688639 28279 tablet_bootstrap.cc:492] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:56.689503 28279 ts_tablet_manager.cc:1403] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.001s
I20260709 13:21:56.692500 28279 raft_consensus.cc:359] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.686985 28280 raft_consensus.cc:359] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:56.693368 28280 raft_consensus.cc:385] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.693763 28280 raft_consensus.cc:740] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.693904 28277 raft_consensus.cc:359] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:56.694628 28277 raft_consensus.cc:385] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.694914 28277 raft_consensus.cc:740] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.694749 28280 consensus_queue.cc:260] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:56.697751 28280 ts_tablet_manager.cc:1434] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:21:56.699134 28280 tablet_bootstrap.cc:492] T a8feb7220d3845768a841d7df788966e P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:56.698563 27907 catalog_manager.cc:5697] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 1 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:56.677978 28278 ts_tablet_manager.cc:1434] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.036s	user 0.002s	sys 0.007s
I20260709 13:21:56.699579 28378 consensus_queue.cc:1048] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.700872 28278 tablet_bootstrap.cc:492] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:56.701187 28426 consensus_queue.cc:1048] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.701452 28277 consensus_queue.cc:260] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:56.703938 28277 ts_tablet_manager.cc:1434] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.076s	user 0.004s	sys 0.003s
I20260709 13:21:56.705011 28277 tablet_bootstrap.cc:492] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:56.707600 28278 tablet_bootstrap.cc:654] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.707810 28378 consensus_queue.cc:1048] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.721077 28279 raft_consensus.cc:385] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.722024 28279 raft_consensus.cc:740] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.723253 28279 consensus_queue.cc:260] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.729082 28280 tablet_bootstrap.cc:654] T a8feb7220d3845768a841d7df788966e P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.739806 28279 ts_tablet_manager.cc:1434] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.001s
I20260709 13:21:56.744237 28279 tablet_bootstrap.cc:492] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651: Bootstrap starting.
W20260709 13:21:56.748965 28198 consensus_peers.cc:597] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 -> Peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Couldn't send request to peer afb0dc4e88ca4275975541dfe077b38b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:56.750459 28279 tablet_bootstrap.cc:654] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.763651 28279 tablet_bootstrap.cc:492] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:56.764520 28278 tablet_bootstrap.cc:492] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:56.765249 28278 ts_tablet_manager.cc:1403] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.005s
I20260709 13:21:56.767877 28278 raft_consensus.cc:359] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:56.768666 28278 raft_consensus.cc:385] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.768983 28278 raft_consensus.cc:740] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.769812 28278 consensus_queue.cc:260] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:56.772701 28278 ts_tablet_manager.cc:1434] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:21:56.774356 28278 tablet_bootstrap.cc:492] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:56.773303 28279 ts_tablet_manager.cc:1403] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.002s
I20260709 13:21:56.777781 28279 raft_consensus.cc:359] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:56.783937 28279 raft_consensus.cc:385] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.784324 28279 raft_consensus.cc:740] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.785495 28277 tablet_bootstrap.cc:654] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.785017 28279 consensus_queue.cc:260] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:56.787946 28279 ts_tablet_manager.cc:1434] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:21:56.789141 28279 tablet_bootstrap.cc:492] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:56.783576 28278 tablet_bootstrap.cc:654] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.798060 28277 tablet_bootstrap.cc:492] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:56.798580 28279 tablet_bootstrap.cc:654] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.798920 28277 ts_tablet_manager.cc:1403] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.003s
I20260709 13:21:56.798219 28280 tablet_bootstrap.cc:492] T a8feb7220d3845768a841d7df788966e P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:56.801584 28280 ts_tablet_manager.cc:1403] T a8feb7220d3845768a841d7df788966e P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.103s	user 0.009s	sys 0.008s
I20260709 13:21:56.802307 28277 raft_consensus.cc:359] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.803340 28277 raft_consensus.cc:385] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.803692 28277 raft_consensus.cc:740] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.804250 28280 raft_consensus.cc:359] T a8feb7220d3845768a841d7df788966e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.804950 28280 raft_consensus.cc:385] T a8feb7220d3845768a841d7df788966e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.805258 28280 raft_consensus.cc:740] T a8feb7220d3845768a841d7df788966e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.806195 28280 consensus_queue.cc:260] T a8feb7220d3845768a841d7df788966e P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.808729 28280 ts_tablet_manager.cc:1434] T a8feb7220d3845768a841d7df788966e P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 13:21:56.804565 28277 consensus_queue.cc:260] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.810237 28280 tablet_bootstrap.cc:492] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:56.812680 28277 ts_tablet_manager.cc:1434] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:21:56.815783 28277 tablet_bootstrap.cc:492] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:56.820190 28279 tablet_bootstrap.cc:492] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:56.820868 28279 ts_tablet_manager.cc:1403] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.003s
I20260709 13:21:56.821992 28280 tablet_bootstrap.cc:654] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.823583 28277 tablet_bootstrap.cc:654] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.828068 28278 tablet_bootstrap.cc:492] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:56.828671 28278 ts_tablet_manager.cc:1403] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.009s
I20260709 13:21:56.831245 28278 raft_consensus.cc:359] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:56.832767 28278 raft_consensus.cc:385] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.833115 28278 raft_consensus.cc:740] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.835018 28279 raft_consensus.cc:359] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:56.835798 28279 raft_consensus.cc:385] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.836113 28279 raft_consensus.cc:740] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.834347 28278 consensus_queue.cc:260] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:56.836875 28279 consensus_queue.cc:260] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:56.837325 28280 tablet_bootstrap.cc:492] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:56.842505 28278 ts_tablet_manager.cc:1434] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:21:56.842785 28280 ts_tablet_manager.cc:1403] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.007s
I20260709 13:21:56.843564 28278 tablet_bootstrap.cc:492] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:56.846406 28280 raft_consensus.cc:359] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.847277 28280 raft_consensus.cc:385] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.848745 28277 tablet_bootstrap.cc:492] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:56.849428 28280 raft_consensus.cc:740] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.849691 28277 ts_tablet_manager.cc:1403] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.002s
I20260709 13:21:56.849979 28278 tablet_bootstrap.cc:654] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.850425 28280 consensus_queue.cc:260] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.849057 28279 ts_tablet_manager.cc:1434] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.028s	user 0.001s	sys 0.004s
I20260709 13:21:56.852634 28277 raft_consensus.cc:359] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.854561 28277 raft_consensus.cc:385] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.854837 28277 raft_consensus.cc:740] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.855655 28277 consensus_queue.cc:260] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.857442 28279 tablet_bootstrap.cc:492] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:56.858475 28277 ts_tablet_manager.cc:1434] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:21:56.860448 28280 ts_tablet_manager.cc:1434] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:21:56.864395 28277 tablet_bootstrap.cc:492] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:56.864446 28280 tablet_bootstrap.cc:492] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:56.871762 28277 tablet_bootstrap.cc:654] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.884358 28507 consensus_queue.cc:1048] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.884956 28279 tablet_bootstrap.cc:654] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.896908 28280 tablet_bootstrap.cc:654] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.905794 28463 raft_consensus.cc:493] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.906391 28463 raft_consensus.cc:515] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:56.908638 28463 leader_election.cc:290] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:56.910597 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a66e81e89d46308972b6fbc0328b74" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:56.911603 28229 raft_consensus.cc:2468] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:21:56.916867 28277 tablet_bootstrap.cc:492] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:56.917452 28277 ts_tablet_manager.cc:1403] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.007s
I20260709 13:21:56.921855 28277 raft_consensus.cc:359] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:56.922566 28277 raft_consensus.cc:385] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.922851 28277 raft_consensus.cc:740] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.925267 28278 tablet_bootstrap.cc:492] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:56.925948 28278 ts_tablet_manager.cc:1403] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.024s
I20260709 13:21:56.929117 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a66e81e89d46308972b6fbc0328b74" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:21:56.938696 28048 leader_election.cc:343] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.941422 28277 consensus_queue.cc:260] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:56.944135 28277 ts_tablet_manager.cc:1434] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:21:56.947573 28277 tablet_bootstrap.cc:492] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:56.949936 28279 tablet_bootstrap.cc:492] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:56.950569 28279 ts_tablet_manager.cc:1403] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.094s	user 0.010s	sys 0.034s
I20260709 13:21:56.950881 28280 tablet_bootstrap.cc:492] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:56.951437 28280 ts_tablet_manager.cc:1403] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.087s	user 0.020s	sys 0.004s
I20260709 13:21:56.953349 28278 raft_consensus.cc:359] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:56.954170 28278 raft_consensus.cc:385] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.953799 28279 raft_consensus.cc:359] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:56.954442 28278 raft_consensus.cc:740] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.954635 28279 raft_consensus.cc:385] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.984848 28378 raft_consensus.cc:493] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.954466 28280 raft_consensus.cc:359] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:56.993827 28279 raft_consensus.cc:740] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.994246 28280 raft_consensus.cc:385] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.994220 28378 raft_consensus.cc:515] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.994760 28280 raft_consensus.cc:740] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.994740 28279 consensus_queue.cc:260] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:56.955982 28331 raft_consensus.cc:493] T a8feb7220d3845768a841d7df788966e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.995950 28280 consensus_queue.cc:260] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:56.996217 28331 raft_consensus.cc:515] T a8feb7220d3845768a841d7df788966e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.997074 28378 leader_election.cc:290] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:56.997821 28007 raft_consensus.cc:3060] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.000291 28279 ts_tablet_manager.cc:1434] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:21:57.001349 28377 raft_consensus.cc:493] T 81f6ad6d00d44eb5b9914641b6da9ae5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.998220 28331 leader_election.cc:290] T a8feb7220d3845768a841d7df788966e P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:56.992466 28277 tablet_bootstrap.cc:654] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.960202 28507 raft_consensus.cc:493] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.001896 28377 raft_consensus.cc:515] T 81f6ad6d00d44eb5b9914641b6da9ae5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:57.002120 28507 raft_consensus.cc:515] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:56.999534 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8feb7220d3845768a841d7df788966e" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:57.004082 28377 leader_election.cc:290] T 81f6ad6d00d44eb5b9914641b6da9ae5 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:57.005148 28507 leader_election.cc:290] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:57.007661 28280 ts_tablet_manager.cc:1434] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.056s	user 0.014s	sys 0.015s
I20260709 13:21:57.007781 28009 raft_consensus.cc:3060] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:57.008471 27954 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:57.001488 28279 tablet_bootstrap.cc:492] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:56.955219 28278 consensus_queue.cc:260] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:57.008816 28280 tablet_bootstrap.cc:492] T 96c01bb7a8b84db7b8b44098cd5602a2 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:57.010960 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f6ad6d00d44eb5b9914641b6da9ae5" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:57.012122 28008 raft_consensus.cc:2393] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afb0dc4e88ca4275975541dfe077b38b in current term 1: Already voted for candidate 2e2f737d674147808bb32783de176848 in this term.
I20260709 13:21:57.013510 28081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7df1c61b2348668e7022bfc34d7886" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:57.014389 28081 raft_consensus.cc:2468] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:21:57.015694 28197 leader_election.cc:304] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:57.016746 28566 raft_consensus.cc:2804] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.017239 28566 raft_consensus.cc:493] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.017681 28566 raft_consensus.cc:3060] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.021255 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f6ad6d00d44eb5b9914641b6da9ae5" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:57.023824 28278 ts_tablet_manager.cc:1434] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.098s	user 0.015s	sys 0.009s
I20260709 13:21:57.025041 28278 tablet_bootstrap.cc:492] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:57.030133 28121 leader_election.cc:304] T 81f6ad6d00d44eb5b9914641b6da9ae5 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:57.030990 28278 tablet_bootstrap.cc:654] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.031078 28525 raft_consensus.cc:3060] T 81f6ad6d00d44eb5b9914641b6da9ae5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.038322 28279 tablet_bootstrap.cc:654] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.051564 28507 raft_consensus.cc:493] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.052367 28507 raft_consensus.cc:515] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:57.054749 28280 tablet_bootstrap.cc:654] T 96c01bb7a8b84db7b8b44098cd5602a2 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.061507 28331 raft_consensus.cc:493] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.062074 28331 raft_consensus.cc:515] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:57.072078 28525 raft_consensus.cc:2749] T 81f6ad6d00d44eb5b9914641b6da9ae5 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:57.072346 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec29c7c5037f4fe79d9681c5b1c7b53b" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:57.073278 28008 raft_consensus.cc:2468] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:21:57.074965 28122 leader_election.cc:304] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:57.079165 28525 raft_consensus.cc:2804] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.079581 28525 raft_consensus.cc:493] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.079926 28525 raft_consensus.cc:3060] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.080905 28331 leader_election.cc:290] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:56.981740 28047 leader_election.cc:304] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:57.082856 28277 tablet_bootstrap.cc:492] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:57.066732 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7df1c61b2348668e7022bfc34d7886" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:57.083962 28155 raft_consensus.cc:2468] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:21:57.083418 28277 ts_tablet_manager.cc:1403] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.136s	user 0.034s	sys 0.018s
I20260709 13:21:57.098910 28507 leader_election.cc:290] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:57.100028 28156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c01bb7a8b84db7b8b44098cd5602a2" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:57.102875 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec29c7c5037f4fe79d9681c5b1c7b53b" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
W20260709 13:21:57.103071 28050 leader_election.cc:343] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.093266 28378 raft_consensus.cc:493] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.104523 28081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8feb7220d3845768a841d7df788966e" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:57.104667 28378 raft_consensus.cc:515] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
W20260709 13:21:57.106244 28047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:36151, user_credentials={real_user=slave}} blocked reactor thread for 124645us
I20260709 13:21:57.107376 28156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c01bb7a8b84db7b8b44098cd5602a2" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
W20260709 13:21:57.113925 28198 leader_election.cc:343] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.114348 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c01bb7a8b84db7b8b44098cd5602a2" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:57.115303 28229 raft_consensus.cc:2468] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:21:57.115473 28123 leader_election.cc:304] T a8feb7220d3845768a841d7df788966e P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651
I20260709 13:21:57.116654 28566 raft_consensus.cc:515] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:57.117264 28377 raft_consensus.cc:2749] T a8feb7220d3845768a841d7df788966e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:57.108203 28463 raft_consensus.cc:2804] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.118335 28463 raft_consensus.cc:493] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.118748 28463 raft_consensus.cc:3060] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.121809 28082 raft_consensus.cc:2468] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:21:57.108595 28081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c01bb7a8b84db7b8b44098cd5602a2" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:57.124800 28081 raft_consensus.cc:2468] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:21:57.123987 28084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7df1c61b2348668e7022bfc34d7886" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:57.122398 28378 leader_election.cc:290] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:57.132789 28197 leader_election.cc:304] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:57.127410 28084 raft_consensus.cc:3060] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.139732 28507 consensus_queue.cc:1048] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:57.141280 28507 raft_consensus.cc:2804] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.141714 28507 raft_consensus.cc:493] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.142069 28507 raft_consensus.cc:3060] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.142269 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec29c7c5037f4fe79d9681c5b1c7b53b" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:57.142959 28008 raft_consensus.cc:2468] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:21:57.143852 28446 raft_consensus.cc:493] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.144367 28446 raft_consensus.cc:515] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:57.147763 28047 leader_election.cc:304] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:57.148903 28426 raft_consensus.cc:2804] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.149293 28426 raft_consensus.cc:493] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.149637 28426 raft_consensus.cc:3060] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.181313 28463 raft_consensus.cc:515] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:57.183321 28084 raft_consensus.cc:2468] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:57.183749 28463 leader_election.cc:290] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:57.183456 28507 raft_consensus.cc:515] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:57.190910 28278 tablet_bootstrap.cc:492] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:57.191517 28278 ts_tablet_manager.cc:1403] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.167s	user 0.025s	sys 0.011s
I20260709 13:21:57.192309 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec29c7c5037f4fe79d9681c5b1c7b53b" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:57.205271 28566 leader_election.cc:290] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
W20260709 13:21:57.226621 28197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:43901, user_credentials={real_user=slave}} blocked reactor thread for 83837.5us
I20260709 13:21:57.229100 28048 leader_election.cc:304] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:57.240912 28278 raft_consensus.cc:359] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:57.241804 28278 raft_consensus.cc:385] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.242097 28278 raft_consensus.cc:740] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.203833 28426 raft_consensus.cc:515] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:57.245149 28421 raft_consensus.cc:2804] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.246411 28279 tablet_bootstrap.cc:492] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:57.254570 28279 ts_tablet_manager.cc:1403] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.253s	user 0.017s	sys 0.041s
W20260709 13:21:57.247004 28589 log.cc:927] Time spent T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:21:57.247756 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a66e81e89d46308972b6fbc0328b74" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:57.249419 28277 raft_consensus.cc:359] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:57.252058 28280 tablet_bootstrap.cc:492] T 96c01bb7a8b84db7b8b44098cd5602a2 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:57.220875 28525 raft_consensus.cc:515] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:57.253582 28278 consensus_queue.cc:260] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:57.256295 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a66e81e89d46308972b6fbc0328b74" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:57.258800 28280 ts_tablet_manager.cc:1403] T 96c01bb7a8b84db7b8b44098cd5602a2 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.250s	user 0.016s	sys 0.027s
I20260709 13:21:57.258422 28277 raft_consensus.cc:385] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.259425 28277 raft_consensus.cc:740] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.254208 28421 raft_consensus.cc:493] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.267585 28277 consensus_queue.cc:260] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:57.259858 28006 raft_consensus.cc:3060] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.272964 28278 ts_tablet_manager.cc:1434] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
I20260709 13:21:57.261484 28232 raft_consensus.cc:3060] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.265851 28463 raft_consensus.cc:493] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.276078 28463 raft_consensus.cc:515] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:57.278019 28446 leader_election.cc:290] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:57.278883 28463 leader_election.cc:290] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:57.279774 28507 leader_election.cc:290] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:57.280268 28084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c01bb7a8b84db7b8b44098cd5602a2" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:57.278053 28155 raft_consensus.cc:2393] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d80a443d06244116ae813b77fc539651 in current term 1: Already voted for candidate afb0dc4e88ca4275975541dfe077b38b in this term.
I20260709 13:21:57.281272 28084 raft_consensus.cc:2393] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e2f737d674147808bb32783de176848 in current term 1: Already voted for candidate d80a443d06244116ae813b77fc539651 in this term.
I20260709 13:21:57.283149 28005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e87d83bcd69480ca50f5ea54a73cead" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:57.283900 28005 raft_consensus.cc:2468] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:21:57.284485 28280 raft_consensus.cc:359] T 96c01bb7a8b84db7b8b44098cd5602a2 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:57.285269 28280 raft_consensus.cc:385] T 96c01bb7a8b84db7b8b44098cd5602a2 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.286810 28156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7df1c61b2348668e7022bfc34d7886" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:57.287508 28156 raft_consensus.cc:3060] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.288151 28048 leader_election.cc:304] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:57.288908 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9815241ff06642b59c8d28aaeb390d8e" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:57.289104 28378 raft_consensus.cc:2804] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.264782 28421 raft_consensus.cc:3060] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.285547 28280 raft_consensus.cc:740] T 96c01bb7a8b84db7b8b44098cd5602a2 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.292013 28280 consensus_queue.cc:260] T 96c01bb7a8b84db7b8b44098cd5602a2 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:57.293210 28278 tablet_bootstrap.cc:492] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:57.289561 28378 raft_consensus.cc:493] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.294452 28525 leader_election.cc:290] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:57.314217 28280 ts_tablet_manager.cc:1434] T 96c01bb7a8b84db7b8b44098cd5602a2 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.001s
I20260709 13:21:57.321038 28277 ts_tablet_manager.cc:1434] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.231s	user 0.008s	sys 0.000s
I20260709 13:21:57.308492 28378 raft_consensus.cc:3060] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:57.313606 28595 log.cc:927] Time spent T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 13:21:57.306303 28047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:36151, user_credentials={real_user=slave}} blocked reactor thread for 47368.5us
I20260709 13:21:57.318260 28197 leader_election.cc:304] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:57.333287 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e87d83bcd69480ca50f5ea54a73cead" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:57.333705 28507 raft_consensus.cc:2804] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:57.334311 28507 raft_consensus.cc:697] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:21:57.335168 28507 consensus_queue.cc:237] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:57.341861 28005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec29c7c5037f4fe79d9681c5b1c7b53b" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:57.342582 28005 raft_consensus.cc:3060] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:57.343098 28601 log.cc:927] Time spent T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:21:57.350744 28280 tablet_bootstrap.cc:492] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:57.350297 28232 raft_consensus.cc:2468] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:21:57.354564 28277 tablet_bootstrap.cc:492] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:57.355156 28004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9815241ff06642b59c8d28aaeb390d8e" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:57.371420 28157 raft_consensus.cc:3060] T a8feb7220d3845768a841d7df788966e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.372226 28279 raft_consensus.cc:359] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:57.373057 28279 raft_consensus.cc:385] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.373322 28279 raft_consensus.cc:740] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.373967 28006 raft_consensus.cc:2468] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
W20260709 13:21:57.375461 28050 leader_election.cc:343] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.375486 28048 leader_election.cc:304] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:57.377375 28279 consensus_queue.cc:260] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:57.380685 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c01bb7a8b84db7b8b44098cd5602a2" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:57.380812 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c01bb7a8b84db7b8b44098cd5602a2" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:57.359414 28605 raft_consensus.cc:493] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.362283 28426 leader_election.cc:290] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
W20260709 13:21:57.388414 28198 leader_election.cc:343] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.385499 28278 tablet_bootstrap.cc:654] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.381455 28155 raft_consensus.cc:3060] T 96c01bb7a8b84db7b8b44098cd5602a2 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.389959 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec29c7c5037f4fe79d9681c5b1c7b53b" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:57.393369 28463 raft_consensus.cc:2804] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:57.399372 28603 raft_consensus.cc:493] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.402436 28005 raft_consensus.cc:2468] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:21:57.408828 28566 raft_consensus.cc:493] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.414374 28280 tablet_bootstrap.cc:654] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:57.418802 28196 leader_election.cc:343] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.424248 28463 raft_consensus.cc:697] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:21:57.425194 28463 consensus_queue.cc:237] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:57.425709 28603 raft_consensus.cc:515] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:57.427582 28603 leader_election.cc:290] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:57.428339 28566 raft_consensus.cc:515] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
W20260709 13:21:57.435568 28048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 60170.1us
I20260709 13:21:57.435715 28377 raft_consensus.cc:493] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.458243 28566 leader_election.cc:290] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:57.430145 28198 leader_election.cc:304] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:57.418021 28605 raft_consensus.cc:515] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:57.464383 28279 ts_tablet_manager.cc:1434] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.209s	user 0.012s	sys 0.006s
I20260709 13:21:57.486534 28279 tablet_bootstrap.cc:492] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:57.452096 28377 raft_consensus.cc:515] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
W20260709 13:21:57.465848 28050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:44409, user_credentials={real_user=slave}} blocked reactor thread for 79708.9us
W20260709 13:21:57.504982 28198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:44409, user_credentials={real_user=slave}} blocked reactor thread for 116610us
I20260709 13:21:57.508808 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17389976f8e346dbb2fbc326a9e60396" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
W20260709 13:21:57.514344 28196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 122858us
I20260709 13:21:57.518554 28005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115ec4e7eaff44c191ebb3618716383c" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:57.519780 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17389976f8e346dbb2fbc326a9e60396" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:57.520092 28377 leader_election.cc:290] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:57.521775 28081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115ec4e7eaff44c191ebb3618716383c" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:57.522450 28081 raft_consensus.cc:2468] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:21:57.523430 28597 raft_consensus.cc:2749] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:57.524173 28598 consensus_queue.cc:1048] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:57.527810 28197 leader_election.cc:304] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:57.530354 28277 tablet_bootstrap.cc:654] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.537603 28598 raft_consensus.cc:2804] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.520716 28156 raft_consensus.cc:2468] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:57.544361 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3da7f8304442df89580b5f02ed1bcf" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:57.545049 28232 raft_consensus.cc:2468] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:21:57.541366 28598 raft_consensus.cc:493] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.546584 28598 raft_consensus.cc:3060] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.547564 28121 leader_election.cc:304] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:57.549088 28525 raft_consensus.cc:2804] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.549455 28525 raft_consensus.cc:493] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.549800 28525 raft_consensus.cc:3060] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:57.551932 28196 leader_election.cc:343] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:57.554811 28196 leader_election.cc:343] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.556774 28605 leader_election.cc:290] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:57.562709 28421 raft_consensus.cc:515] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:57.563222 28525 raft_consensus.cc:515] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:57.564204 28378 raft_consensus.cc:515] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:57.565528 28155 raft_consensus.cc:2468] T 96c01bb7a8b84db7b8b44098cd5602a2 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:57.567616 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1785087e0e647aebaa4e56a6c11482e" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:57.474059 28122 leader_election.cc:304] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:57.574656 28604 raft_consensus.cc:493] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.579141 27904 catalog_manager.cc:5697] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:57.582063 28198 leader_election.cc:343] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.604408 28198 leader_election.cc:304] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:57.610911 28604 raft_consensus.cc:515] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:57.602456 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c01bb7a8b84db7b8b44098cd5602a2" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:57.614558 28232 raft_consensus.cc:2393] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d80a443d06244116ae813b77fc539651 in current term 1: Already voted for candidate 2e2f737d674147808bb32783de176848 in this term.
I20260709 13:21:57.623433 28599 raft_consensus.cc:2749] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:57.620628 28377 raft_consensus.cc:2804] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:21:57.619669 28122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 152805us
I20260709 13:21:57.634245 28278 tablet_bootstrap.cc:492] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:57.635035 28278 ts_tablet_manager.cc:1403] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.347s	user 0.030s	sys 0.009s
I20260709 13:21:57.633033 28083 raft_consensus.cc:2393] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate afb0dc4e88ca4275975541dfe077b38b in current term 1: Already voted for candidate d80a443d06244116ae813b77fc539651 in this term.
W20260709 13:21:57.622542 27974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:43901, user_credentials={real_user=slave}} blocked reactor thread for 96262.3us
I20260709 13:21:57.637005 28377 raft_consensus.cc:697] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:21:57.638355 28598 raft_consensus.cc:515] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:57.661214 28377 consensus_queue.cc:237] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:57.663333 28525 leader_election.cc:290] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:57.663630 28598 leader_election.cc:290] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:57.657326 28421 leader_election.cc:290] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:57.669698 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3da7f8304442df89580b5f02ed1bcf" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:57.670163 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115ec4e7eaff44c191ebb3618716383c" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:57.670491 28229 raft_consensus.cc:3060] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.671079 28083 raft_consensus.cc:3060] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.673568 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e87d83bcd69480ca50f5ea54a73cead" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:57.653757 28378 leader_election.cc:290] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:57.646068 28604 leader_election.cc:290] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:57.656173 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1785087e0e647aebaa4e56a6c11482e" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
W20260709 13:21:57.643276 28048 leader_election.cc:343] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.658401 28198 leader_election.cc:304] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: d80a443d06244116ae813b77fc539651
I20260709 13:21:57.678447 28278 raft_consensus.cc:359] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:57.635942 28047 leader_election.cc:304] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:57.679358 28278 raft_consensus.cc:385] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.679816 28278 raft_consensus.cc:740] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.680058 28599 raft_consensus.cc:2804] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:57.680691 28599 raft_consensus.cc:697] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:21:57.652166 28279 tablet_bootstrap.cc:654] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.681684 28599 consensus_queue.cc:237] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
W20260709 13:21:57.685782 28047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:36151, user_credentials={real_user=slave}} blocked reactor thread for 55246.9us
I20260709 13:21:57.687902 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f20c0135d64866abcf710b9b331281" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:57.689404 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f20c0135d64866abcf710b9b331281" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:57.690879 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec29c7c5037f4fe79d9681c5b1c7b53b" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:57.673905 28277 tablet_bootstrap.cc:492] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:57.692035 28007 raft_consensus.cc:2393] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d80a443d06244116ae813b77fc539651 in current term 1: Already voted for candidate afb0dc4e88ca4275975541dfe077b38b in this term.
I20260709 13:21:57.692306 28277 ts_tablet_manager.cc:1403] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.353s	user 0.028s	sys 0.021s
I20260709 13:21:57.683348 28604 raft_consensus.cc:2749] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:57.696480 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e87d83bcd69480ca50f5ea54a73cead" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:57.683548 28278 consensus_queue.cc:260] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:57.704912 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec29c7c5037f4fe79d9681c5b1c7b53b" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:57.705020 28277 raft_consensus.cc:359] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:57.707603 28277 raft_consensus.cc:385] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.707929 28277 raft_consensus.cc:740] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.697250 28006 raft_consensus.cc:3060] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:57.705576 28048 leader_election.cc:343] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:57.717929 28047 leader_election.cc:343] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2f737d674147808bb32783de176848 (127.17.251.132:36151): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:57.718364 28050 leader_election.cc:343] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.722882 28278 ts_tablet_manager.cc:1434] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 13:21:57.723923 28083 raft_consensus.cc:2468] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:57.724243 28278 tablet_bootstrap.cc:492] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:57.725026 28047 leader_election.cc:304] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28
W20260709 13:21:57.728109 28050 leader_election.cc:343] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.728737 28050 leader_election.cc:304] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:57.730175 28197 leader_election.cc:304] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:57.731281 28604 raft_consensus.cc:2749] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:57.731104 27907 catalog_manager.cc:5697] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 1 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:57.732143 28005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115ec4e7eaff44c191ebb3618716383c" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:57.734014 28602 raft_consensus.cc:2804] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:57.734681 28602 raft_consensus.cc:697] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:21:57.735638 28602 consensus_queue.cc:237] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:57.736863 28378 raft_consensus.cc:2749] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:57.746181 28280 tablet_bootstrap.cc:492] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:57.747151 28280 ts_tablet_manager.cc:1403] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.423s	user 0.036s	sys 0.035s
I20260709 13:21:57.749107 28229 raft_consensus.cc:2468] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:21:57.750447 28277 consensus_queue.cc:260] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:57.760833 28005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3da7f8304442df89580b5f02ed1bcf" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:57.761461 28004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3da7f8304442df89580b5f02ed1bcf" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
W20260709 13:21:57.763505 28196 leader_election.cc:343] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.785735 28121 leader_election.cc:304] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:57.793327 28277 ts_tablet_manager.cc:1434] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.101s	user 0.008s	sys 0.001s
I20260709 13:21:57.769702 28050 leader_election.cc:304] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:57.802906 28277 tablet_bootstrap.cc:492] T e7175e0071a54910af34661c079bcca4 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:57.810396 28279 tablet_bootstrap.cc:492] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:57.811205 28279 ts_tablet_manager.cc:1403] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.325s	user 0.019s	sys 0.032s
I20260709 13:21:57.809777 28280 raft_consensus.cc:359] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:57.811702 28280 raft_consensus.cc:385] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.812031 28280 raft_consensus.cc:740] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
W20260709 13:21:57.812657 28050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.131:44409, user_credentials={real_user=slave}} blocked reactor thread for 54917.7us
I20260709 13:21:57.813934 28604 raft_consensus.cc:2749] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:57.812759 28280 consensus_queue.cc:260] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:57.817952 28280 ts_tablet_manager.cc:1434] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.070s	user 0.004s	sys 0.003s
I20260709 13:21:57.789363 28377 raft_consensus.cc:2804] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:57.826820 28279 raft_consensus.cc:359] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:57.827626 28279 raft_consensus.cc:385] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.827901 28279 raft_consensus.cc:740] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.828549 28279 consensus_queue.cc:260] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:57.830090 28600 raft_consensus.cc:493] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.830686 28600 raft_consensus.cc:515] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:57.832523 28598 consensus_queue.cc:1048] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:57.832934 28600 leader_election.cc:290] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:57.833743 28005 raft_consensus.cc:2468] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:21:57.835496 28279 ts_tablet_manager.cc:1434] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:21:57.836791 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3da7f8304442df89580b5f02ed1bcf" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:57.837823 28229 raft_consensus.cc:2393] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b1d1aefe48e42119ca040c70045fe28 in current term 1: Already voted for candidate afb0dc4e88ca4275975541dfe077b38b in this term.
I20260709 13:21:57.840101 28279 tablet_bootstrap.cc:492] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:57.840557 28006 raft_consensus.cc:2468] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:21:57.856704 28280 tablet_bootstrap.cc:492] T 7e87d83bcd69480ca50f5ea54a73cead P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:57.861181 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3da7f8304442df89580b5f02ed1bcf" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:57.862648 28048 leader_election.cc:304] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:57.865288 28279 tablet_bootstrap.cc:654] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.867691 28421 raft_consensus.cc:2804] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:57.870020 28421 raft_consensus.cc:697] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:21:57.847963 28377 raft_consensus.cc:697] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:21:57.873951 28377 consensus_queue.cc:237] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:57.870884 28421 consensus_queue.cc:237] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:57.848969 28507 consensus_queue.cc:1048] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 13:21:57.890539 28278 tablet_bootstrap.cc:654] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.900417 28277 tablet_bootstrap.cc:654] T e7175e0071a54910af34661c079bcca4 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.898526 28525 raft_consensus.cc:493] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.918133 28525 raft_consensus.cc:515] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:57.920675 28525 leader_election.cc:290] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:57.930032 28604 consensus_queue.cc:1048] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:57.931520 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9815241ff06642b59c8d28aaeb390d8e" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:21:57.934387 28122 leader_election.cc:343] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.907202 28602 raft_consensus.cc:493] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.947865 27975 leader_election.cc:304] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28; no voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:57.953720 28618 raft_consensus.cc:3060] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.964293 28618 raft_consensus.cc:2749] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:57.969974 28280 tablet_bootstrap.cc:654] T 7e87d83bcd69480ca50f5ea54a73cead P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.941903 28602 raft_consensus.cc:515] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
W20260709 13:21:57.971205 28121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:36151, user_credentials={real_user=slave}} blocked reactor thread for 72562.5us
I20260709 13:21:57.990147 28602 leader_election.cc:290] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:57.990859 28280 tablet_bootstrap.cc:492] T 7e87d83bcd69480ca50f5ea54a73cead P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:57.991422 28280 ts_tablet_manager.cc:1403] T 7e87d83bcd69480ca50f5ea54a73cead P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.135s	user 0.009s	sys 0.009s
I20260709 13:21:57.991364 28084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f20c0135d64866abcf710b9b331281" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:57.992241 28084 raft_consensus.cc:2468] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:21:57.992467 28279 tablet_bootstrap.cc:492] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:57.992983 28279 ts_tablet_manager.cc:1403] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.156s	user 0.009s	sys 0.021s
I20260709 13:21:57.993161 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f20c0135d64866abcf710b9b331281" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:57.993840 28197 leader_election.cc:304] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:57.994601 28280 raft_consensus.cc:359] T 7e87d83bcd69480ca50f5ea54a73cead P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:57.995412 28280 raft_consensus.cc:385] T 7e87d83bcd69480ca50f5ea54a73cead P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.995692 28280 raft_consensus.cc:740] T 7e87d83bcd69480ca50f5ea54a73cead P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.996451 28280 consensus_queue.cc:260] T 7e87d83bcd69480ca50f5ea54a73cead P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:57.998207 28280 ts_tablet_manager.cc:1434] T 7e87d83bcd69480ca50f5ea54a73cead P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:21:57.999176 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9815241ff06642b59c8d28aaeb390d8e" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:57.999543 28280 tablet_bootstrap.cc:492] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:57.999845 28232 raft_consensus.cc:2468] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
W20260709 13:21:57.994685 28196 leader_election.cc:343] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.006644 28280 tablet_bootstrap.cc:654] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.006493 27906 catalog_manager.cc:5697] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b reported cstate change: term changed from 0 to 1, leader changed from <none> to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 1 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:57.994853 28507 raft_consensus.cc:2804] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:58.010725 28507 raft_consensus.cc:493] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:58.011104 28507 raft_consensus.cc:3060] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.996578 28279 raft_consensus.cc:359] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:58.018319 28279 raft_consensus.cc:385] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.019161 28279 raft_consensus.cc:740] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.023018 28278 tablet_bootstrap.cc:492] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:58.023655 28278 ts_tablet_manager.cc:1403] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.300s	user 0.016s	sys 0.015s
I20260709 13:21:58.025156 28277 tablet_bootstrap.cc:492] T e7175e0071a54910af34661c079bcca4 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:58.026043 28277 ts_tablet_manager.cc:1403] T e7175e0071a54910af34661c079bcca4 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.232s	user 0.015s	sys 0.002s
I20260709 13:21:58.020211 28279 consensus_queue.cc:260] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:58.033120 28121 leader_election.cc:304] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:58.037868 28331 raft_consensus.cc:2804] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:58.038358 28331 raft_consensus.cc:493] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:58.038794 28331 raft_consensus.cc:3060] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.081945 28279 ts_tablet_manager.cc:1434] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.002s
I20260709 13:21:58.083310 28279 tablet_bootstrap.cc:492] T fff4d26a60a64a959845d8a267925536 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:58.085253 28421 consensus_queue.cc:1048] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:58.090444 28278 raft_consensus.cc:359] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:58.091712 28278 raft_consensus.cc:385] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.092198 28278 raft_consensus.cc:740] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.093230 28278 consensus_queue.cc:260] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:58.094213 28331 raft_consensus.cc:515] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:58.104269 28277 raft_consensus.cc:359] T e7175e0071a54910af34661c079bcca4 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:58.105113 28277 raft_consensus.cc:385] T e7175e0071a54910af34661c079bcca4 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.105406 28277 raft_consensus.cc:740] T e7175e0071a54910af34661c079bcca4 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.106138 28277 consensus_queue.cc:260] T e7175e0071a54910af34661c079bcca4 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:58.109972 28331 leader_election.cc:290] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:58.114101 28278 ts_tablet_manager.cc:1434] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.003s
I20260709 13:21:58.120519 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9815241ff06642b59c8d28aaeb390d8e" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:58.124625 28230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9815241ff06642b59c8d28aaeb390d8e" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:58.125406 28230 raft_consensus.cc:3060] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.129166 28277 ts_tablet_manager.cc:1434] T e7175e0071a54910af34661c079bcca4 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.103s	user 0.010s	sys 0.000s
I20260709 13:21:58.141083 27907 catalog_manager.cc:5697] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:58.147357 28507 raft_consensus.cc:515] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:58.150852 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f20c0135d64866abcf710b9b331281" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:58.151072 28080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f20c0135d64866abcf710b9b331281" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:58.151764 28080 raft_consensus.cc:3060] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.153750 28507 leader_election.cc:290] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
W20260709 13:21:58.158833 28122 leader_election.cc:343] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.160687 28525 consensus_queue.cc:1048] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:58.165169 28080 raft_consensus.cc:2468] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:58.166764 28197 leader_election.cc:304] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:58.167281 28278 tablet_bootstrap.cc:492] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:58.167757 28603 consensus_queue.cc:1048] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:58.170243 28566 raft_consensus.cc:2804] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:58.170923 28566 raft_consensus.cc:697] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:21:58.171824 28566 consensus_queue.cc:237] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
W20260709 13:21:58.195518 28196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 45359.6us
W20260709 13:21:58.196759 28196 leader_election.cc:343] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.189909 28597 consensus_queue.cc:1048] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:21:58.194598 28230 raft_consensus.cc:2468] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:21:58.213351 28278 tablet_bootstrap.cc:654] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.220345 27907 catalog_manager.cc:5697] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 1 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:58.216056 27954 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:58.224838 28277 tablet_bootstrap.cc:492] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:58.224505 27907 catalog_manager.cc:5697] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 1 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:58.227573 28280 tablet_bootstrap.cc:492] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:58.228128 28280 ts_tablet_manager.cc:1403] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.229s	user 0.031s	sys 0.050s
I20260709 13:21:58.221658 28525 consensus_queue.cc:1048] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:21:58.232147 28280 raft_consensus.cc:359] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:58.232986 28280 raft_consensus.cc:385] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.233264 28280 raft_consensus.cc:740] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.233935 28280 consensus_queue.cc:260] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:58.239996 28121 leader_election.cc:304] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:58.241457 28633 raft_consensus.cc:2804] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:58.244210 28603 consensus_queue.cc:1048] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:58.244807 28633 raft_consensus.cc:697] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:21:58.247265 28633 consensus_queue.cc:237] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:58.256639 27905 catalog_manager.cc:5697] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b reported cstate change: term changed from 0 to 1, leader changed from <none> to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 1 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:58.264921 28604 raft_consensus.cc:493] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:58.266321 28421 raft_consensus.cc:493] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:58.266897 28421 raft_consensus.cc:515] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:58.269003 28421 leader_election.cc:290] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:58.265537 28604 raft_consensus.cc:515] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:58.272341 28604 leader_election.cc:290] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:58.273893 28370 consensus_queue.cc:1048] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:58.291770 28280 ts_tablet_manager.cc:1434] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260709 13:21:58.299417 28005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63f258079e143c89ee02598a5df4701" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:58.307943 28280 tablet_bootstrap.cc:492] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:58.290184 28230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7175e0071a54910af34661c079bcca4" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:58.313274 28230 raft_consensus.cc:2468] T e7175e0071a54910af34661c079bcca4 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:21:58.317019 27907 catalog_manager.cc:5697] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 1 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:58.321319 28048 leader_election.cc:343] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.336133 28331 raft_consensus.cc:493] T 7e87d83bcd69480ca50f5ea54a73cead P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:58.336643 28331 raft_consensus.cc:515] T 7e87d83bcd69480ca50f5ea54a73cead P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:58.333244 28047 leader_election.cc:304] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:58.342636 28604 raft_consensus.cc:2804] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:58.343047 28604 raft_consensus.cc:493] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:58.353492 28279 tablet_bootstrap.cc:654] T fff4d26a60a64a959845d8a267925536 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.369060 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63f258079e143c89ee02598a5df4701" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:58.369974 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7175e0071a54910af34661c079bcca4" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:58.346167 28604 raft_consensus.cc:3060] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:58.378391 28196 consensus_peers.cc:597] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.382472 28605 consensus_queue.cc:1048] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:58.385411 28370 consensus_queue.cc:1048] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:58.404058 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e87d83bcd69480ca50f5ea54a73cead" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:58.405452 28006 raft_consensus.cc:2393] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afb0dc4e88ca4275975541dfe077b38b in current term 1: Already voted for candidate d80a443d06244116ae813b77fc539651 in this term.
W20260709 13:21:58.409279 28050 leader_election.cc:343] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.409857 28050 leader_election.cc:304] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
W20260709 13:21:58.411094 28050 leader_election.cc:343] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.412074 28611 raft_consensus.cc:2749] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:58.421610 28331 leader_election.cc:290] T 7e87d83bcd69480ca50f5ea54a73cead P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:58.424469 28081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e87d83bcd69480ca50f5ea54a73cead" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:58.426503 28123 leader_election.cc:304] T 7e87d83bcd69480ca50f5ea54a73cead P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651
I20260709 13:21:58.427932 28331 raft_consensus.cc:3060] T 7e87d83bcd69480ca50f5ea54a73cead P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.443492 28331 raft_consensus.cc:2749] T 7e87d83bcd69480ca50f5ea54a73cead P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:58.443969 28604 raft_consensus.cc:515] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:58.456073 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7175e0071a54910af34661c079bcca4" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:21:58.462272 28280 tablet_bootstrap.cc:654] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.445801 28278 tablet_bootstrap.cc:492] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:58.466380 28278 ts_tablet_manager.cc:1403] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.299s	user 0.028s	sys 0.009s
I20260709 13:21:58.469421 28604 leader_election.cc:290] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:58.471148 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7175e0071a54910af34661c079bcca4" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:58.477366 28277 tablet_bootstrap.cc:654] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:58.464352 28050 leader_election.cc:343] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.490988 28232 raft_consensus.cc:3060] T e7175e0071a54910af34661c079bcca4 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.497956 28600 raft_consensus.cc:493] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:58.498709 28600 raft_consensus.cc:515] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:58.500730 28278 raft_consensus.cc:359] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:58.501468 28278 raft_consensus.cc:385] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.501765 28278 raft_consensus.cc:740] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.501919 28080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1785087e0e647aebaa4e56a6c11482e" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:58.502600 28080 raft_consensus.cc:2468] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 0.
I20260709 13:21:58.502481 28278 consensus_queue.cc:260] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:58.503978 27974 leader_election.cc:304] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:58.504711 28516 raft_consensus.cc:2804] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:58.505275 28516 raft_consensus.cc:493] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:58.505599 28516 raft_consensus.cc:3060] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.506857 28604 consensus_queue.cc:1048] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:58.504734 28278 ts_tablet_manager.cc:1434] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.000s
I20260709 13:21:58.505828 27906 catalog_manager.cc:5697] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b reported cstate change: term changed from 0 to 1, leader changed from <none> to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 1 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:58.511118 28232 raft_consensus.cc:2468] T e7175e0071a54910af34661c079bcca4 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:21:58.518826 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1785087e0e647aebaa4e56a6c11482e" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:58.519488 28278 tablet_bootstrap.cc:492] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:58.520584 28516 raft_consensus.cc:515] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:58.509359 28600 leader_election.cc:290] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:58.524192 28047 leader_election.cc:304] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:58.524468 28516 leader_election.cc:290] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:58.525494 28421 raft_consensus.cc:2804] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:58.526015 28421 raft_consensus.cc:697] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:21:58.526778 28278 tablet_bootstrap.cc:654] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.526894 28421 consensus_queue.cc:237] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
W20260709 13:21:58.531695 27975 leader_election.cc:343] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.538441 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1785087e0e647aebaa4e56a6c11482e" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
W20260709 13:21:58.540403 27975 leader_election.cc:343] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.550614 28080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1785087e0e647aebaa4e56a6c11482e" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:58.551641 28080 raft_consensus.cc:3060] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.606520 28279 tablet_bootstrap.cc:492] T fff4d26a60a64a959845d8a267925536 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:58.607400 28279 ts_tablet_manager.cc:1403] T fff4d26a60a64a959845d8a267925536 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.524s	user 0.016s	sys 0.003s
I20260709 13:21:58.608049 28080 raft_consensus.cc:2468] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 1.
I20260709 13:21:58.617601 28600 raft_consensus.cc:493] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:58.634554 28277 tablet_bootstrap.cc:492] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:58.634442 28600 raft_consensus.cc:515] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:58.635203 28277 ts_tablet_manager.cc:1403] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.440s	user 0.013s	sys 0.000s
I20260709 13:21:58.639807 28280 tablet_bootstrap.cc:492] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:58.642414 28600 leader_election.cc:290] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:58.640559 28280 ts_tablet_manager.cc:1403] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.333s	user 0.022s	sys 0.021s
I20260709 13:21:58.643702 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9815241ff06642b59c8d28aaeb390d8e" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:58.648586 28370 raft_consensus.cc:493] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:58.649106 28370 raft_consensus.cc:515] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:58.651319 28370 leader_election.cc:290] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:58.653025 28230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9815241ff06642b59c8d28aaeb390d8e" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:58.653935 28230 raft_consensus.cc:2393] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b1d1aefe48e42119ca040c70045fe28 in current term 1: Already voted for candidate afb0dc4e88ca4275975541dfe077b38b in this term.
I20260709 13:21:58.654515 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17389976f8e346dbb2fbc326a9e60396" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:58.655221 28229 raft_consensus.cc:2468] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:21:58.655755 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17389976f8e346dbb2fbc326a9e60396" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:58.656839 27906 catalog_manager.cc:5697] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:58.657644 28122 leader_election.cc:343] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.659121 27972 leader_election.cc:304] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28; no voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:58.660913 28516 raft_consensus.cc:3060] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.665982 28121 leader_election.cc:304] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:58.666179 28279 raft_consensus.cc:359] T fff4d26a60a64a959845d8a267925536 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:58.666837 28279 raft_consensus.cc:385] T fff4d26a60a64a959845d8a267925536 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.667125 28279 raft_consensus.cc:740] T fff4d26a60a64a959845d8a267925536 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.668061 28331 raft_consensus.cc:2804] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:58.668503 28331 raft_consensus.cc:493] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:58.668808 28331 raft_consensus.cc:3060] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.668807 27974 leader_election.cc:304] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:58.670176 28600 raft_consensus.cc:2804] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:58.670851 28600 raft_consensus.cc:697] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:21:58.671809 28600 consensus_queue.cc:237] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:58.673749 28277 raft_consensus.cc:359] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:58.674494 28277 raft_consensus.cc:385] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.674757 28277 raft_consensus.cc:740] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.675412 28277 consensus_queue.cc:260] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:58.677690 28277 ts_tablet_manager.cc:1434] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:21:58.679057 28279 consensus_queue.cc:260] T fff4d26a60a64a959845d8a267925536 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:58.688452 28277 tablet_bootstrap.cc:492] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:58.690598 28377 consensus_queue.cc:1048] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:58.679649 28331 raft_consensus.cc:515] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:58.681025 28280 raft_consensus.cc:359] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:58.682209 28516 raft_consensus.cc:2749] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:58.701728 28280 raft_consensus.cc:385] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.701803 28279 ts_tablet_manager.cc:1434] T fff4d26a60a64a959845d8a267925536 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.003s
I20260709 13:21:58.702688 28278 tablet_bootstrap.cc:492] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:58.703382 28280 raft_consensus.cc:740] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.703872 28278 ts_tablet_manager.cc:1403] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.190s	user 0.023s	sys 0.023s
I20260709 13:21:58.709417 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17389976f8e346dbb2fbc326a9e60396" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:58.704254 28280 consensus_queue.cc:260] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:58.710083 28232 raft_consensus.cc:3060] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.700634 28277 tablet_bootstrap.cc:654] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.722173 28507 consensus_queue.cc:1048] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:58.726672 28232 raft_consensus.cc:2468] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:21:58.728353 28331 leader_election.cc:290] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:58.730258 28121 leader_election.cc:304] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:58.731343 28331 raft_consensus.cc:2804] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:58.731789 28331 raft_consensus.cc:697] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:21:58.733245 28005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17389976f8e346dbb2fbc326a9e60396" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:58.733451 28370 consensus_queue.cc:1048] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:58.734177 28280 ts_tablet_manager.cc:1434] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.000s
I20260709 13:21:58.735191 28280 tablet_bootstrap.cc:492] T e7175e0071a54910af34661c079bcca4 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:58.735529 28331 consensus_queue.cc:237] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
W20260709 13:21:58.738916 28122 leader_election.cc:343] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.745204 28278 raft_consensus.cc:359] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:58.747593 28278 raft_consensus.cc:385] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.748113 28278 raft_consensus.cc:740] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.760259 28278 consensus_queue.cc:260] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:58.764686 28278 ts_tablet_manager.cc:1434] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.001s
I20260709 13:21:58.746768 28280 tablet_bootstrap.cc:654] T e7175e0071a54910af34661c079bcca4 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.770673 28279 tablet_bootstrap.cc:492] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:58.778473 28603 raft_consensus.cc:493] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:58.788427 28603 raft_consensus.cc:515] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:58.790551 28603 leader_election.cc:290] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:58.800892 28277 tablet_bootstrap.cc:492] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:58.801486 28277 ts_tablet_manager.cc:1403] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.113s	user 0.015s	sys 0.004s
I20260709 13:21:58.802791 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff4d26a60a64a959845d8a267925536" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:58.797094 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff4d26a60a64a959845d8a267925536" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:58.806257 28083 raft_consensus.cc:2468] T fff4d26a60a64a959845d8a267925536 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:21:58.818871 28197 leader_election.cc:304] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:58.819870 28598 raft_consensus.cc:2804] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:58.820271 28598 raft_consensus.cc:493] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:58.820590 28598 raft_consensus.cc:3060] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.821553 28516 raft_consensus.cc:493] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:58.822090 28516 raft_consensus.cc:515] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:58.824294 28516 leader_election.cc:290] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:58.825460 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115ec4e7eaff44c191ebb3618716383c" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:58.827507 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115ec4e7eaff44c191ebb3618716383c" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:58.832448 28598 raft_consensus.cc:515] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:58.805989 28278 tablet_bootstrap.cc:492] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:58.833174 27906 catalog_manager.cc:5697] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:58.835378 27974 leader_election.cc:304] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28; no voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651
I20260709 13:21:58.815874 28279 tablet_bootstrap.cc:654] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:58.816002 28196 consensus_peers.cc:597] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:58.836694 28196 leader_election.cc:343] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.838819 28600 raft_consensus.cc:2749] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:58.836769 28277 raft_consensus.cc:359] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:58.840677 28277 raft_consensus.cc:385] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.840937 28277 raft_consensus.cc:740] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.845708 28598 leader_election.cc:290] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:58.848721 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff4d26a60a64a959845d8a267925536" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
W20260709 13:21:58.849922 28196 leader_election.cc:343] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.851361 28081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff4d26a60a64a959845d8a267925536" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:58.851995 28081 raft_consensus.cc:3060] T fff4d26a60a64a959845d8a267925536 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.862177 28081 raft_consensus.cc:2468] T fff4d26a60a64a959845d8a267925536 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:21:58.862123 27904 catalog_manager.cc:5697] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b reported cstate change: term changed from 0 to 1, leader changed from <none> to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 1 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:58.863584 28197 leader_election.cc:304] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:21:58.864035 28278 tablet_bootstrap.cc:654] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.877831 28603 raft_consensus.cc:2804] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:58.878585 28603 raft_consensus.cc:697] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:21:58.861173 28277 consensus_queue.cc:260] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:58.879469 28603 consensus_queue.cc:237] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:58.880446 28597 raft_consensus.cc:493] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:58.880892 28597 raft_consensus.cc:515] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:58.881767 28277 ts_tablet_manager.cc:1434] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.080s	user 0.009s	sys 0.001s
I20260709 13:21:58.882913 28277 tablet_bootstrap.cc:492] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:58.887957 28597 leader_election.cc:290] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:58.893767 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c653748b39e457aab513022ae1306f5" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:21:58.901885 28196 leader_election.cc:343] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.924141 28277 tablet_bootstrap.cc:654] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.917902 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c653748b39e457aab513022ae1306f5" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
W20260709 13:21:58.930498 28198 leader_election.cc:343] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.930976 28198 leader_election.cc:304] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:58.932075 28597 raft_consensus.cc:2749] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:58.933758 28279 tablet_bootstrap.cc:492] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:58.934276 28279 ts_tablet_manager.cc:1403] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.170s	user 0.020s	sys 0.006s
I20260709 13:21:58.935664 27905 catalog_manager.cc:5697] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 1 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:58.941386 28279 raft_consensus.cc:359] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:58.942210 28279 raft_consensus.cc:385] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.942479 28279 raft_consensus.cc:740] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.943156 28279 consensus_queue.cc:260] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:58.945657 28279 ts_tablet_manager.cc:1434] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:21:58.947089 28279 tablet_bootstrap.cc:492] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:58.951339 28278 tablet_bootstrap.cc:492] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:58.951839 28278 ts_tablet_manager.cc:1403] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.146s	user 0.010s	sys 0.026s
I20260709 13:21:58.958804 28278 raft_consensus.cc:359] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:58.959544 28278 raft_consensus.cc:385] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.959826 28278 raft_consensus.cc:740] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.961002 28278 consensus_queue.cc:260] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:58.963336 28278 ts_tablet_manager.cc:1434] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:21:58.965130 28280 tablet_bootstrap.cc:492] T e7175e0071a54910af34661c079bcca4 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:58.965694 28280 ts_tablet_manager.cc:1403] T e7175e0071a54910af34661c079bcca4 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.231s	user 0.019s	sys 0.006s
I20260709 13:21:58.968441 28280 raft_consensus.cc:359] T e7175e0071a54910af34661c079bcca4 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:58.969075 28280 raft_consensus.cc:385] T e7175e0071a54910af34661c079bcca4 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.969343 28280 raft_consensus.cc:740] T e7175e0071a54910af34661c079bcca4 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.970510 28280 consensus_queue.cc:260] T e7175e0071a54910af34661c079bcca4 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:58.972281 28278 tablet_bootstrap.cc:492] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:58.974900 28280 ts_tablet_manager.cc:1434] T e7175e0071a54910af34661c079bcca4 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:21:58.975224 28277 tablet_bootstrap.cc:492] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:58.975785 28277 ts_tablet_manager.cc:1403] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.029s
I20260709 13:21:58.978566 28280 tablet_bootstrap.cc:492] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:58.979521 28277 raft_consensus.cc:359] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:58.980290 28277 raft_consensus.cc:385] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.980506 28278 tablet_bootstrap.cc:654] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.980559 28277 raft_consensus.cc:740] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.981843 28277 consensus_queue.cc:260] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:58.983829 28279 tablet_bootstrap.cc:654] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.986972 28280 tablet_bootstrap.cc:654] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.990660 28277 ts_tablet_manager.cc:1434] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:21:58.991750 28277 tablet_bootstrap.cc:492] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:58.999220 28280 tablet_bootstrap.cc:492] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:59.002951 28280 ts_tablet_manager.cc:1403] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.000s
I20260709 13:21:59.006256 28005 raft_consensus.cc:3060] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:59.008102 28277 tablet_bootstrap.cc:654] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:59.010810 28278 tablet_bootstrap.cc:492] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:59.011304 28278 ts_tablet_manager.cc:1403] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.014s
I20260709 13:21:59.002242 28279 tablet_bootstrap.cc:492] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:59.025835 28279 ts_tablet_manager.cc:1403] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.003s
I20260709 13:21:59.028941 28279 raft_consensus.cc:359] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:59.040793 28279 raft_consensus.cc:385] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:59.041275 28279 raft_consensus.cc:740] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:59.034765 28278 raft_consensus.cc:359] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:59.039556 28280 raft_consensus.cc:359] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:59.042771 28278 raft_consensus.cc:385] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:59.042920 28280 raft_consensus.cc:385] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:59.043567 28278 raft_consensus.cc:740] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:59.043596 28280 raft_consensus.cc:740] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:21:59.044772 28278 consensus_queue.cc:260] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:59.042740 28279 consensus_queue.cc:260] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:59.052976 28370 raft_consensus.cc:493] T e7175e0071a54910af34661c079bcca4 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:59.051066 28277 tablet_bootstrap.cc:492] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:59.053560 28370 raft_consensus.cc:515] T e7175e0071a54910af34661c079bcca4 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:59.055500 28279 ts_tablet_manager.cc:1434] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.003s
I20260709 13:21:59.056257 28370 leader_election.cc:290] T e7175e0071a54910af34661c079bcca4 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:59.059180 28278 ts_tablet_manager.cc:1434] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.002s
I20260709 13:21:59.060055 28280 consensus_queue.cc:260] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:59.056936 28279 tablet_bootstrap.cc:492] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:59.053943 28277 ts_tablet_manager.cc:1403] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.005s
I20260709 13:21:59.057788 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7175e0071a54910af34661c079bcca4" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:59.061429 28080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7175e0071a54910af34661c079bcca4" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:59.063002 28232 raft_consensus.cc:2393] T e7175e0071a54910af34661c079bcca4 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afb0dc4e88ca4275975541dfe077b38b in current term 1: Already voted for candidate d80a443d06244116ae813b77fc539651 in this term.
I20260709 13:21:59.064365 28121 leader_election.cc:304] T e7175e0071a54910af34661c079bcca4 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651
I20260709 13:21:59.065579 28377 raft_consensus.cc:3060] T e7175e0071a54910af34661c079bcca4 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:59.065471 28277 raft_consensus.cc:359] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:59.066470 28277 raft_consensus.cc:385] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:59.067067 28277 raft_consensus.cc:740] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:59.067332 28280 ts_tablet_manager.cc:1434] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.001s
I20260709 13:21:59.067812 28277 consensus_queue.cc:260] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:59.068398 28280 tablet_bootstrap.cc:492] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:21:59.072266 28278 tablet_bootstrap.cc:492] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:21:59.074872 28277 ts_tablet_manager.cc:1434] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:21:59.075642 28377 raft_consensus.cc:2749] T e7175e0071a54910af34661c079bcca4 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:59.076150 28277 tablet_bootstrap.cc:492] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:59.087867 28370 raft_consensus.cc:493] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:59.088416 28370 raft_consensus.cc:515] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:59.090631 28370 leader_election.cc:290] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:59.091516 28597 raft_consensus.cc:493] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:59.092129 28597 raft_consensus.cc:515] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:59.093703 28370 raft_consensus.cc:493] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:59.080890 28278 tablet_bootstrap.cc:654] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:59.094183 28080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1785087e0e647aebaa4e56a6c11482e" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:59.094419 28370 raft_consensus.cc:515] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:59.099193 28597 leader_election.cc:290] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:59.099871 28154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8f779373b044c2b2e3d0e781f4d04f" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:59.099822 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1785087e0e647aebaa4e56a6c11482e" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:59.102392 28277 tablet_bootstrap.cc:654] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:59.106536 28198 leader_election.cc:343] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:59.110023 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63f258079e143c89ee02598a5df4701" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:21:59.111594 28122 leader_election.cc:343] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:59.104557 28279 tablet_bootstrap.cc:654] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:59.120319 28370 leader_election.cc:290] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:59.095191 28080 raft_consensus.cc:2393] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afb0dc4e88ca4275975541dfe077b38b in current term 1: Already voted for candidate 6b1d1aefe48e42119ca040c70045fe28 in this term.
I20260709 13:21:59.084344 28421 consensus_queue.cc:1048] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:59.125659 28605 consensus_queue.cc:1048] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:59.126770 28123 leader_election.cc:304] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651
I20260709 13:21:59.121464 28081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63f258079e143c89ee02598a5df4701" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:59.127686 28081 raft_consensus.cc:2468] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:21:59.128151 28370 raft_consensus.cc:3060] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:59.098090 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8f779373b044c2b2e3d0e781f4d04f" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:59.132751 28123 leader_election.cc:304] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
W20260709 13:21:59.132923 28197 leader_election.cc:343] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:59.138942 28197 leader_election.cc:304] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651
I20260709 13:21:59.085191 28280 tablet_bootstrap.cc:654] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:59.144425 28377 raft_consensus.cc:2804] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:59.144541 28597 raft_consensus.cc:2749] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:59.162856 28377 raft_consensus.cc:493] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:59.194361 28279 tablet_bootstrap.cc:492] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:59.195050 28279 ts_tablet_manager.cc:1403] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.138s	user 0.012s	sys 0.016s
I20260709 13:21:59.196954 28277 tablet_bootstrap.cc:492] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:59.197463 28277 ts_tablet_manager.cc:1403] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.122s	user 0.046s	sys 0.008s
I20260709 13:21:59.200320 28279 raft_consensus.cc:359] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:59.205549 28007 raft_consensus.cc:3060] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:59.180060 28377 raft_consensus.cc:3060] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:59.211704 28279 raft_consensus.cc:385] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:59.212100 28278 tablet_bootstrap.cc:492] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:59.212690 28278 ts_tablet_manager.cc:1403] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.141s	user 0.011s	sys 0.006s
I20260709 13:21:59.211055 28277 raft_consensus.cc:359] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:59.234664 28277 raft_consensus.cc:385] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:59.235239 28277 raft_consensus.cc:740] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:59.236238 28277 consensus_queue.cc:260] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:59.212049 28279 raft_consensus.cc:740] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:21:59.247362 28279 consensus_queue.cc:260] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:59.257589 28277 ts_tablet_manager.cc:1434] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 13:21:59.283694 28277 tablet_bootstrap.cc:492] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848: Bootstrap starting.
W20260709 13:21:59.292176 28121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:36151, user_credentials={real_user=slave}} blocked reactor thread for 74915.3us
I20260709 13:21:59.316058 28598 raft_consensus.cc:493] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:59.316769 28598 raft_consensus.cc:515] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:59.318694 28278 raft_consensus.cc:359] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:59.319173 28598 leader_election.cc:290] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:59.319451 28278 raft_consensus.cc:385] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:59.319815 28278 raft_consensus.cc:740] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:59.337450 28278 consensus_queue.cc:260] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
W20260709 13:21:59.316129 28679 log.cc:927] Time spent T e7175e0071a54910af34661c079bcca4 P 2e2f737d674147808bb32783de176848: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:21:59.346064 28370 raft_consensus.cc:2749] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:59.361058 27954 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:59.350198 28278 ts_tablet_manager.cc:1434] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.137s	user 0.009s	sys 0.000s
I20260709 13:21:59.356952 28618 raft_consensus.cc:493] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:59.362464 28516 consensus_queue.cc:1048] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:21:59.368613 28280 tablet_bootstrap.cc:492] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:21:59.369303 28280 ts_tablet_manager.cc:1403] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.301s	user 0.017s	sys 0.021s
I20260709 13:21:59.372063 28279 ts_tablet_manager.cc:1434] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.177s	user 0.030s	sys 0.040s
I20260709 13:21:59.376150 28278 tablet_bootstrap.cc:492] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
W20260709 13:21:59.365160 28050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:44409, user_credentials={real_user=slave}} blocked reactor thread for 64477.8us
W20260709 13:21:59.378669 28197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:43901, user_credentials={real_user=slave}} blocked reactor thread for 120964us
I20260709 13:21:59.381707 28154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798271eb9117496ab0d95ece523d5268" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:59.369202 28603 raft_consensus.cc:493] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:59.360066 28377 raft_consensus.cc:515] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:59.365708 28618 raft_consensus.cc:515] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:59.388798 28618 leader_election.cc:290] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:59.395292 28279 tablet_bootstrap.cc:492] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:21:59.402546 28005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798271eb9117496ab0d95ece523d5268" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:21:59.402778 28198 leader_election.cc:343] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:59.405748 28507 consensus_queue.cc:1048] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:59.409560 28277 tablet_bootstrap.cc:654] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:59.394191 28603 raft_consensus.cc:515] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:59.426729 28229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f20c0135d64866abcf710b9b331281" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
W20260709 13:21:59.430848 28196 leader_election.cc:343] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:59.431306 28196 leader_election.cc:304] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:59.417690 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f20c0135d64866abcf710b9b331281" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:59.420796 28421 raft_consensus.cc:493] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:59.439110 28005 raft_consensus.cc:3060] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:59.445418 28604 raft_consensus.cc:493] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:59.449091 28604 raft_consensus.cc:515] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:59.459441 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f55c4d42a545aabd60f9579818ff2b" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:59.459964 28232 raft_consensus.cc:2468] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:21:59.444445 28694 raft_consensus.cc:2749] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:59.461068 28047 leader_election.cc:304] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:59.446429 28421 raft_consensus.cc:515] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:59.473238 28331 consensus_queue.cc:1048] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:59.468703 28604 leader_election.cc:290] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:59.470520 28605 raft_consensus.cc:2804] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:59.466461 27972 leader_election.cc:304] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28; no voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651
I20260709 13:21:59.480211 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f55c4d42a545aabd60f9579818ff2b" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:59.496320 28278 tablet_bootstrap.cc:654] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:59.497229 28377 leader_election.cc:290] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:59.491925 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63f258079e143c89ee02598a5df4701" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:21:59.481344 28605 raft_consensus.cc:493] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:59.505159 28605 raft_consensus.cc:3060] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:59.489984 28280 raft_consensus.cc:359] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:59.511652 28280 raft_consensus.cc:385] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:59.512157 28280 raft_consensus.cc:740] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
W20260709 13:21:59.498622 28196 leader_election.cc:343] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:59.489602 28603 leader_election.cc:290] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:21:59.513154 28280 consensus_queue.cc:260] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:59.515717 28516 raft_consensus.cc:493] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:59.516808 27972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:36151, user_credentials={real_user=slave}} blocked reactor thread for 52612.8us
I20260709 13:21:59.522652 28516 raft_consensus.cc:515] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:59.524863 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f55c4d42a545aabd60f9579818ff2b" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:21:59.565091 28196 consensus_peers.cc:597] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:59.569482 28279 tablet_bootstrap.cc:654] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:59.551216 28151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7aa856d09405fbb13f70607e0d3e9" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:59.529690 28421 leader_election.cc:290] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:21:59.531383 28080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f55c4d42a545aabd60f9579818ff2b" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:21:59.516184 28007 raft_consensus.cc:3060] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:59.540567 28228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17389976f8e346dbb2fbc326a9e60396" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:59.610628 28280 ts_tablet_manager.cc:1434] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.241s	user 0.009s	sys 0.000s
I20260709 13:21:59.525482 28516 leader_election.cc:290] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:59.545468 28084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63f258079e143c89ee02598a5df4701" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:21:59.528854 28152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17389976f8e346dbb2fbc326a9e60396" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:59.536810 28618 consensus_queue.cc:1048] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.074s
I20260709 13:21:59.552865 28605 raft_consensus.cc:515] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:59.641151 28280 tablet_bootstrap.cc:492] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
W20260709 13:21:59.608922 28048 leader_election.cc:343] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:59.622071 27975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:44409, user_credentials={real_user=slave}} blocked reactor thread for 85807.6us
I20260709 13:21:59.659206 28277 tablet_bootstrap.cc:492] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:21:59.659788 28277 ts_tablet_manager.cc:1403] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.399s	user 0.022s	sys 0.003s
W20260709 13:21:59.662947 28048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 54958.9us
I20260709 13:21:59.626478 28084 raft_consensus.cc:3060] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:59.620817 28228 raft_consensus.cc:2468] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 1.
I20260709 13:21:59.700556 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7aa856d09405fbb13f70607e0d3e9" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:59.713555 28280 tablet_bootstrap.cc:654] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:59.730221 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f55c4d42a545aabd60f9579818ff2b" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:21:59.737129 28232 raft_consensus.cc:3060] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:59.724226 28277 raft_consensus.cc:359] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:59.741482 28277 raft_consensus.cc:385] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:59.741850 28277 raft_consensus.cc:740] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:21:59.742353 28007 raft_consensus.cc:2468] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
W20260709 13:21:59.693903 27974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:43901, user_credentials={real_user=slave}} blocked reactor thread for 81996.2us
I20260709 13:21:59.717818 28080 raft_consensus.cc:2393] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e2f737d674147808bb32783de176848 in current term 1: Already voted for candidate d80a443d06244116ae813b77fc539651 in this term.
I20260709 13:21:59.758852 28277 consensus_queue.cc:260] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:59.752517 28232 raft_consensus.cc:2468] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:21:59.762538 28047 leader_election.cc:304] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:21:59.719592 28605 leader_election.cc:290] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
W20260709 13:21:59.743080 27975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:44409, user_credentials={real_user=slave}} blocked reactor thread for 83971.4us
W20260709 13:21:59.767580 28050 leader_election.cc:343] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:59.783740 28277 ts_tablet_manager.cc:1434] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.124s	user 0.008s	sys 0.000s
I20260709 13:21:59.790604 28277 tablet_bootstrap.cc:492] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:21:59.793377 28278 tablet_bootstrap.cc:492] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:21:59.794305 28278 ts_tablet_manager.cc:1403] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.418s	user 0.008s	sys 0.026s
I20260709 13:21:59.770148 28692 raft_consensus.cc:2804] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:59.780966 28680 raft_consensus.cc:2749] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:59.765862 28048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 102160us
I20260709 13:21:59.805429 28692 raft_consensus.cc:697] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:21:59.807019 28084 raft_consensus.cc:2468] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:21:59.811532 28687 consensus_queue.cc:1048] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:59.837806 28692 consensus_queue.cc:237] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:59.855764 28279 tablet_bootstrap.cc:492] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:21:59.856554 28279 ts_tablet_manager.cc:1403] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.476s	user 0.021s	sys 0.010s
I20260709 13:21:59.866804 28197 leader_election.cc:304] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651
I20260709 13:21:59.868716 28695 raft_consensus.cc:2749] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:59.871729 28278 raft_consensus.cc:359] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:59.872890 28278 raft_consensus.cc:385] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:59.881963 28605 raft_consensus.cc:493] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:59.882845 28605 raft_consensus.cc:515] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:21:59.885561 28605 leader_election.cc:290] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:21:59.794720 28122 leader_election.cc:304] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b; no voters: 
W20260709 13:21:59.889560 28122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 106828us
I20260709 13:21:59.892066 28690 raft_consensus.cc:2804] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:59.892592 28690 raft_consensus.cc:697] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:21:59.893569 28690 consensus_queue.cc:237] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:21:59.897712 28151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8f779373b044c2b2e3d0e781f4d04f" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:21:59.873283 28278 raft_consensus.cc:740] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:21:59.906737 28278 consensus_queue.cc:260] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:59.908128 28277 tablet_bootstrap.cc:654] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:59.916960 27974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:43901, user_credentials={real_user=slave}} blocked reactor thread for 63763.4us
I20260709 13:21:59.921593 28688 raft_consensus.cc:493] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:59.922288 28688 raft_consensus.cc:515] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:21:59.929415 28688 leader_election.cc:290] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:21:59.932963 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c653748b39e457aab513022ae1306f5" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:59.934702 28232 raft_consensus.cc:2468] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:21:59.925005 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8f779373b044c2b2e3d0e781f4d04f" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:21:59.936233 28231 raft_consensus.cc:2468] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:21:59.938001 28121 leader_election.cc:304] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:21:59.938295 28279 raft_consensus.cc:359] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:59.939332 28684 raft_consensus.cc:2804] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:59.939908 28684 raft_consensus.cc:493] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:59.940335 28684 raft_consensus.cc:3060] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:59.940956 28706 raft_consensus.cc:493] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:59.941576 28706 raft_consensus.cc:515] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:21:59.944514 28706 leader_election.cc:290] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
W20260709 13:21:59.945279 28050 leader_election.cc:343] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:59.939378 28279 raft_consensus.cc:385] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:59.954805 28278 ts_tablet_manager.cc:1434] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.160s	user 0.010s	sys 0.000s
I20260709 13:21:59.956231 28278 tablet_bootstrap.cc:492] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
W20260709 13:21:59.965427 28122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 61419.8us
I20260709 13:21:59.969324 28005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c653748b39e457aab513022ae1306f5" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:21:59.952874 28279 raft_consensus.cc:740] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
W20260709 13:21:59.958840 28048 leader_election.cc:343] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:59.992973 28048 leader_election.cc:304] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:21:59.998148 28279 consensus_queue.cc:260] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
W20260709 13:22:00.009331 28048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 50516.3us
I20260709 13:22:00.010560 28047 leader_election.cc:304] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: afb0dc4e88ca4275975541dfe077b38b
W20260709 13:22:00.032038 28122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 52490.2us
I20260709 13:22:00.034448 28279 ts_tablet_manager.cc:1434] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.177s	user 0.009s	sys 0.000s
I20260709 13:22:00.007586 28080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f55c4d42a545aabd60f9579818ff2b" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:22:00.042562 28279 tablet_bootstrap.cc:492] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:22:00.028699 28604 raft_consensus.cc:2749] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:00.041085 27972 leader_election.cc:304] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28; no voters: afb0dc4e88ca4275975541dfe077b38b
I20260709 13:22:00.048520 28611 raft_consensus.cc:2804] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:00.057153 28611 raft_consensus.cc:493] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:00.066932 28611 raft_consensus.cc:3060] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.068058 28684 raft_consensus.cc:515] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:00.069810 28680 raft_consensus.cc:2804] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:00.057212 28603 raft_consensus.cc:493] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:22:00.087659 28047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:36151, user_credentials={real_user=slave}} blocked reactor thread for 77238.7us
I20260709 13:22:00.070317 28684 leader_election.cc:290] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:00.087267 28603 raft_consensus.cc:515] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:00.092896 28278 tablet_bootstrap.cc:654] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.070330 28680 raft_consensus.cc:493] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader afb0dc4e88ca4275975541dfe077b38b)
I20260709 13:22:00.102546 28277 tablet_bootstrap.cc:492] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:22:00.103335 28277 ts_tablet_manager.cc:1403] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.313s	user 0.021s	sys 0.014s
W20260709 13:22:00.077546 27972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:36151, user_credentials={real_user=slave}} blocked reactor thread for 45489.1us
I20260709 13:22:00.130532 28280 tablet_bootstrap.cc:492] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:22:00.131114 28280 ts_tablet_manager.cc:1403] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.498s	user 0.056s	sys 0.071s
I20260709 13:22:00.137800 28228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c653748b39e457aab513022ae1306f5" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:22:00.138599 28228 raft_consensus.cc:3060] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.144903 28603 leader_election.cc:290] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:00.105243 28680 raft_consensus.cc:3060] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:00.190393 28196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 125812us
I20260709 13:22:00.231006 28611 raft_consensus.cc:515] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:00.231331 28005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72f52140be74d50aeccec9aebfd2f5b" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:22:00.233572 28196 leader_election.cc:343] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:00.235945 28232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8f779373b044c2b2e3d0e781f4d04f" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:22:00.233285 28277 raft_consensus.cc:359] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
W20260709 13:22:00.234265 28122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 198218us
I20260709 13:22:00.236572 28232 raft_consensus.cc:3060] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.236984 28277 raft_consensus.cc:385] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.237402 28277 raft_consensus.cc:740] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.238813 28277 consensus_queue.cc:260] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
W20260709 13:22:00.237216 28122 leader_election.cc:343] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:00.233253 28611 leader_election.cc:290] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:22:00.249512 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c653748b39e457aab513022ae1306f5" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
W20260709 13:22:00.250921 28722 log.cc:927] Time spent T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 13:22:00.251431 28724 log.cc:927] Time spent T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:22:00.259187 28228 raft_consensus.cc:2468] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:22:00.259459 28277 ts_tablet_manager.cc:1434] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.156s	user 0.007s	sys 0.000s
I20260709 13:22:00.260916 28080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72f52140be74d50aeccec9aebfd2f5b" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:22:00.263029 28280 raft_consensus.cc:359] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:00.263785 28280 raft_consensus.cc:385] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.264050 28280 raft_consensus.cc:740] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.245968 28727 raft_consensus.cc:493] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:00.264650 28727 raft_consensus.cc:515] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:00.264735 28280 consensus_queue.cc:260] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:00.266754 28727 leader_election.cc:290] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:00.267144 28280 ts_tablet_manager.cc:1434] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.136s	user 0.005s	sys 0.002s
I20260709 13:22:00.268334 28280 tablet_bootstrap.cc:492] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:22:00.268266 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f55c4d42a545aabd60f9579818ff2b" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:22:00.269052 28007 raft_consensus.cc:3060] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.263039 28121 leader_election.cc:304] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:22:00.271605 28633 raft_consensus.cc:2804] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:00.272104 28633 raft_consensus.cc:697] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:22:00.272051 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72f52140be74d50aeccec9aebfd2f5b" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:22:00.272889 28231 raft_consensus.cc:2468] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:22:00.273188 28633 consensus_queue.cc:237] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:00.277014 28047 leader_election.cc:304] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:00.275631 28080 raft_consensus.cc:2468] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:22:00.261341 28278 tablet_bootstrap.cc:492] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:22:00.259246 28279 tablet_bootstrap.cc:654] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.325778 28278 ts_tablet_manager.cc:1403] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.370s	user 0.023s	sys 0.018s
I20260709 13:22:00.330265 28280 tablet_bootstrap.cc:654] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.332911 28228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f55c4d42a545aabd60f9579818ff2b" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:22:00.333969 28228 raft_consensus.cc:2393] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b1d1aefe48e42119ca040c70045fe28 in current term 1: Already voted for candidate d80a443d06244116ae813b77fc539651 in this term.
I20260709 13:22:00.335563 28232 raft_consensus.cc:2468] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:22:00.330281 28007 raft_consensus.cc:2468] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:22:00.281116 28686 raft_consensus.cc:2804] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:00.279744 28154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8f779373b044c2b2e3d0e781f4d04f" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:00.339622 28047 leader_election.cc:304] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
W20260709 13:22:00.342469 28122 leader_election.cc:343] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:00.343757 28277 tablet_bootstrap.cc:492] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848: Bootstrap starting.
I20260709 13:22:00.349864 28605 raft_consensus.cc:2804] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:22:00.368711 28050 leader_election.cc:343] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:00.358625 28686 raft_consensus.cc:493] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:22:00.362421 28197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:43901, user_credentials={real_user=slave}} blocked reactor thread for 89401.6us
W20260709 13:22:00.422279 28048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 57048.4us
W20260709 13:22:00.428092 28122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 59381.3us
I20260709 13:22:00.418123 28686 raft_consensus.cc:3060] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.367163 28421 consensus_queue.cc:1048] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.056s
I20260709 13:22:00.448850 28280 tablet_bootstrap.cc:492] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:22:00.449417 28280 ts_tablet_manager.cc:1403] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.181s	user 0.019s	sys 0.017s
W20260709 13:22:00.449946 27954 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:00.440131 28605 raft_consensus.cc:697] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:22:00.454787 28278 raft_consensus.cc:359] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:00.455554 28278 raft_consensus.cc:385] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.455828 28278 raft_consensus.cc:740] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.456542 28278 consensus_queue.cc:260] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:00.460419 28278 ts_tablet_manager.cc:1434] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.134s	user 0.005s	sys 0.001s
I20260709 13:22:00.461469 28278 tablet_bootstrap.cc:492] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:00.467031 28197 leader_election.cc:304] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:00.456200 28605 consensus_queue.cc:237] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:00.468256 28691 raft_consensus.cc:2804] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:00.468765 28691 raft_consensus.cc:493] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:00.469147 28691 raft_consensus.cc:3060] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.469341 28278 tablet_bootstrap.cc:654] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.497886 28277 tablet_bootstrap.cc:654] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.446069 27972 leader_election.cc:304] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28; no voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651
I20260709 13:22:00.476081 28680 raft_consensus.cc:515] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
W20260709 13:22:00.566970 28121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:36151, user_credentials={real_user=slave}} blocked reactor thread for 80917.8us
W20260709 13:22:00.568323 28732 log.cc:927] Time spent T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:22:00.576684 28122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 80983.6us
I20260709 13:22:00.582397 28686 raft_consensus.cc:515] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:00.585404 28280 raft_consensus.cc:359] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:00.596568 28280 raft_consensus.cc:385] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.598197 28711 raft_consensus.cc:2749] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:00.599697 28721 raft_consensus.cc:493] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:00.600322 28721 raft_consensus.cc:515] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:00.566300 28005 raft_consensus.cc:1240] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Rejecting Update request from peer afb0dc4e88ca4275975541dfe077b38b for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:00.501578 28377 consensus_queue.cc:1048] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.070s
I20260709 13:22:00.596990 28280 raft_consensus.cc:740] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.611727 28280 consensus_queue.cc:260] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
W20260709 13:22:00.617797 27972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:36151, user_credentials={real_user=slave}} blocked reactor thread for 175836us
I20260709 13:22:00.673031 28279 tablet_bootstrap.cc:492] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:22:00.673604 28279 ts_tablet_manager.cc:1403] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.631s	user 0.021s	sys 0.021s
I20260709 13:22:00.676486 28279 raft_consensus.cc:359] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:00.677130 28279 raft_consensus.cc:385] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.677362 28279 raft_consensus.cc:740] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.678925 28686 leader_election.cc:290] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:00.679847 28279 consensus_queue.cc:260] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:00.595062 28598 raft_consensus.cc:493] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:00.673275 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7aa856d09405fbb13f70607e0d3e9" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:22:00.701795 28278 tablet_bootstrap.cc:492] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:22:00.702507 28278 ts_tablet_manager.cc:1403] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.241s	user 0.023s	sys 0.059s
I20260709 13:22:00.705390 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72f52140be74d50aeccec9aebfd2f5b" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:22:00.713310 28279 ts_tablet_manager.cc:1434] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
W20260709 13:22:00.717967 28121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:36151, user_credentials={real_user=slave}} blocked reactor thread for 77746.8us
I20260709 13:22:00.707008 28598 raft_consensus.cc:515] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:00.730551 28598 leader_election.cc:290] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:00.734714 28691 raft_consensus.cc:515] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:00.736052 28278 raft_consensus.cc:359] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:00.736783 28278 raft_consensus.cc:385] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.736935 28231 raft_consensus.cc:2393] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d80a443d06244116ae813b77fc539651 in current term 1: Already voted for candidate 2e2f737d674147808bb32783de176848 in this term.
I20260709 13:22:00.737933 28721 leader_election.cc:290] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:00.743391 28280 ts_tablet_manager.cc:1434] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.293s	user 0.008s	sys 0.000s
I20260709 13:22:00.745065 28280 tablet_bootstrap.cc:492] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:22:00.745095 28003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72f52140be74d50aeccec9aebfd2f5b" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:22:00.714843 28008 raft_consensus.cc:2468] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:22:00.749953 28003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19150adcadcf4e14beef1b948b754f04" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:22:00.737068 28278 raft_consensus.cc:740] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
W20260709 13:22:00.766000 28198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:44409, user_credentials={real_user=slave}} blocked reactor thread for 151022us
I20260709 13:22:00.772363 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72f52140be74d50aeccec9aebfd2f5b" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:22:00.775496 28278 consensus_queue.cc:260] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:00.776901 28122 leader_election.cc:304] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b; no voters: 
W20260709 13:22:00.782341 28196 leader_election.cc:343] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:00.784678 28122 consensus_peers.cc:597] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:00.771597 28691 leader_election.cc:290] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:00.789064 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19150adcadcf4e14beef1b948b754f04" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
W20260709 13:22:00.793367 28198 leader_election.cc:343] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:00.793357 28078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7aa856d09405fbb13f70607e0d3e9" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:22:00.794481 28078 raft_consensus.cc:2468] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
W20260709 13:22:00.798542 28196 leader_election.cc:343] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:00.799057 28196 leader_election.cc:304] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:22:00.788553 28736 raft_consensus.cc:2804] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:00.821117 28733 consensus_queue.cc:1048] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:22:00.817289 28633 consensus_queue.cc:1048] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:22:00.825742 28736 raft_consensus.cc:493] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:00.826232 28736 raft_consensus.cc:3060] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.826820 28277 tablet_bootstrap.cc:492] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848: No bootstrap required, opened a new log
I20260709 13:22:00.848347 28277 ts_tablet_manager.cc:1403] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848: Time spent bootstrapping tablet: real 0.517s	user 0.025s	sys 0.049s
I20260709 13:22:00.830655 28747 raft_consensus.cc:2749] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:00.845275 28278 ts_tablet_manager.cc:1434] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.142s	user 0.007s	sys 0.001s
I20260709 13:22:00.851394 28278 tablet_bootstrap.cc:492] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
W20260709 13:22:00.864302 28048 leader_election.cc:343] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:00.872018 28278 tablet_bootstrap.cc:654] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.877044 28277 raft_consensus.cc:359] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:00.877911 28277 raft_consensus.cc:385] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.878208 28277 raft_consensus.cc:740] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.889408 28077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72f52140be74d50aeccec9aebfd2f5b" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:00.890702 28077 raft_consensus.cc:2393] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e2f737d674147808bb32783de176848 in current term 1: Already voted for candidate d80a443d06244116ae813b77fc539651 in this term.
I20260709 13:22:00.897588 28150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17389976f8e346dbb2fbc326a9e60396" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:00.902741 27906 catalog_manager.cc:5697] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:00.904558 28736 raft_consensus.cc:515] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:00.905458 28279 tablet_bootstrap.cc:492] T a1c8db979236426c88754a4d4d46e147 P d80a443d06244116ae813b77fc539651: Bootstrap starting.
I20260709 13:22:00.909940 28078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7aa856d09405fbb13f70607e0d3e9" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:00.910902 28078 raft_consensus.cc:3060] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.914577 28680 leader_election.cc:290] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:22:00.921066 28197 leader_election.cc:304] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651
I20260709 13:22:00.925141 28736 leader_election.cc:290] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:00.926386 28078 raft_consensus.cc:2468] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:22:00.926726 28694 raft_consensus.cc:2749] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:00.927695 28123 leader_election.cc:304] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:00.928746 28736 raft_consensus.cc:2804] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:00.929711 28736 raft_consensus.cc:697] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:22:00.930541 28280 tablet_bootstrap.cc:654] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.930953 28736 consensus_queue.cc:237] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:00.955066 28277 consensus_queue.cc:260] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:00.957036 28684 raft_consensus.cc:493] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:00.984998 28277 ts_tablet_manager.cc:1434] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848: Time spent starting tablet: real 0.136s	user 0.005s	sys 0.003s
I20260709 13:22:00.987654 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72f52140be74d50aeccec9aebfd2f5b" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:22:00.991132 28004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7aa856d09405fbb13f70607e0d3e9" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:22:00.980536 28684 raft_consensus.cc:515] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:00.991974 28004 raft_consensus.cc:3060] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.994267 28684 leader_election.cc:290] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:00.959566 28633 consensus_queue.cc:1059] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:22:01.003113 28230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798271eb9117496ab0d95ece523d5268" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:22:01.003829 28230 raft_consensus.cc:2468] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 0.
I20260709 13:22:01.002594 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798271eb9117496ab0d95ece523d5268" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:22:01.003916 28633 raft_consensus.cc:3055] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:01.015156 28278 tablet_bootstrap.cc:492] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:22:01.015717 28278 ts_tablet_manager.cc:1403] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.165s	user 0.018s	sys 0.021s
I20260709 13:22:01.019297 28121 leader_election.cc:304] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:22:01.021395 28721 raft_consensus.cc:2804] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:01.021852 28721 raft_consensus.cc:493] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:01.022224 28721 raft_consensus.cc:3060] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.012072 28633 raft_consensus.cc:740] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
W20260709 13:22:01.033104 28122 leader_election.cc:343] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:01.034247 28633 consensus_queue.cc:260] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:01.035604 28633 raft_consensus.cc:3060] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:01.042100 28754 log.cc:927] Time spent T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:22:01.042692 28279 tablet_bootstrap.cc:654] T a1c8db979236426c88754a4d4d46e147 P d80a443d06244116ae813b77fc539651: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.049157 28230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17389976f8e346dbb2fbc326a9e60396" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
W20260709 13:22:01.049280 28048 leader_election.cc:343] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:01.050971 28048 leader_election.cc:304] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:01.052609 28739 consensus_queue.cc:1048] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:01.051862 28740 raft_consensus.cc:2749] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:01.064208 28280 tablet_bootstrap.cc:492] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:22:01.064721 28280 ts_tablet_manager.cc:1403] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.320s	user 0.025s	sys 0.022s
I20260709 13:22:01.095746 28280 raft_consensus.cc:359] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:01.096494 28280 raft_consensus.cc:385] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.096783 28280 raft_consensus.cc:740] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.099495 28007 raft_consensus.cc:3060] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.101764 28278 raft_consensus.cc:359] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:01.103310 28278 raft_consensus.cc:385] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.103678 28278 raft_consensus.cc:740] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.097493 28280 consensus_queue.cc:260] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:01.051761 27972 leader_election.cc:304] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28; no voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b
W20260709 13:22:01.108168 27972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.132:36151, user_credentials={real_user=slave}} blocked reactor thread for 56533.5us
I20260709 13:22:01.110594 28278 consensus_queue.cc:260] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:01.110598 28751 raft_consensus.cc:2749] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:22:01.128579 28004 raft_consensus.cc:2468] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:22:01.130321 28280 ts_tablet_manager.cc:1434] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 13:22:01.127324 28278 ts_tablet_manager.cc:1434] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.107s	user 0.008s	sys 0.000s
I20260709 13:22:01.155004 28693 consensus_queue.cc:1048] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:01.156821 28278 tablet_bootstrap.cc:492] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
W20260709 13:22:01.163439 28050 consensus_peers.cc:597] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 -> Peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Couldn't send request to peer afb0dc4e88ca4275975541dfe077b38b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:01.166560 28280 tablet_bootstrap.cc:492] T dc8f779373b044c2b2e3d0e781f4d04f P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:22:01.185429 28279 tablet_bootstrap.cc:492] T a1c8db979236426c88754a4d4d46e147 P d80a443d06244116ae813b77fc539651: No bootstrap required, opened a new log
I20260709 13:22:01.186064 28279 ts_tablet_manager.cc:1403] T a1c8db979236426c88754a4d4d46e147 P d80a443d06244116ae813b77fc539651: Time spent bootstrapping tablet: real 0.281s	user 0.030s	sys 0.008s
I20260709 13:22:01.186298 28721 raft_consensus.cc:515] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:01.189038 28279 raft_consensus.cc:359] T a1c8db979236426c88754a4d4d46e147 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:01.198532 28279 raft_consensus.cc:385] T a1c8db979236426c88754a4d4d46e147 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.198936 28279 raft_consensus.cc:740] T a1c8db979236426c88754a4d4d46e147 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.189527 28721 leader_election.cc:290] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:01.205399 28278 tablet_bootstrap.cc:654] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.207162 28226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798271eb9117496ab0d95ece523d5268" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:22:01.198614 28693 raft_consensus.cc:493] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:01.207864 28226 raft_consensus.cc:3060] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.208245 28693 raft_consensus.cc:515] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:01.210937 28693 leader_election.cc:290] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:01.213850 28151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922beb15151e447cbbc0eaee6dc5266d" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:22:01.203190 28004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798271eb9117496ab0d95ece523d5268" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:22:01.214638 28151 raft_consensus.cc:2468] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 0.
I20260709 13:22:01.214772 28004 raft_consensus.cc:3060] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.216524 28050 leader_election.cc:304] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:01.218441 28005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922beb15151e447cbbc0eaee6dc5266d" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
W20260709 13:22:01.226052 28048 leader_election.cc:343] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:01.205837 28279 consensus_queue.cc:260] T a1c8db979236426c88754a4d4d46e147 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:01.228946 28693 raft_consensus.cc:2804] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:01.235270 28693 raft_consensus.cc:493] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:01.235688 28693 raft_consensus.cc:3060] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.238858 28226 raft_consensus.cc:2468] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:22:01.241073 28121 leader_election.cc:304] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:22:01.241398 28279 ts_tablet_manager.cc:1434] T a1c8db979236426c88754a4d4d46e147 P d80a443d06244116ae813b77fc539651: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.001s
I20260709 13:22:01.242434 28721 raft_consensus.cc:2804] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:01.243119 28721 raft_consensus.cc:697] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:22:01.246212 28721 consensus_queue.cc:237] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:01.260876 28280 tablet_bootstrap.cc:654] T dc8f779373b044c2b2e3d0e781f4d04f P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.316402 28693 raft_consensus.cc:515] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:01.319980 28002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922beb15151e447cbbc0eaee6dc5266d" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:22:01.303658 28004 raft_consensus.cc:2468] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:22:01.320708 28693 leader_election.cc:290] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
W20260709 13:22:01.321161 28048 leader_election.cc:343] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:01.325090 28278 tablet_bootstrap.cc:492] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:22:01.324890 28154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922beb15151e447cbbc0eaee6dc5266d" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:01.325661 28154 raft_consensus.cc:3060] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.327332 28280 tablet_bootstrap.cc:492] T dc8f779373b044c2b2e3d0e781f4d04f P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:22:01.327864 28280 ts_tablet_manager.cc:1403] T dc8f779373b044c2b2e3d0e781f4d04f P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.162s	user 0.019s	sys 0.007s
I20260709 13:22:01.340411 28278 ts_tablet_manager.cc:1403] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.184s	user 0.017s	sys 0.026s
I20260709 13:22:01.342374 28280 raft_consensus.cc:359] T dc8f779373b044c2b2e3d0e781f4d04f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:01.348106 28280 raft_consensus.cc:385] T dc8f779373b044c2b2e3d0e781f4d04f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.348402 28280 raft_consensus.cc:740] T dc8f779373b044c2b2e3d0e781f4d04f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.349102 28280 consensus_queue.cc:260] T dc8f779373b044c2b2e3d0e781f4d04f P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:01.343226 28278 raft_consensus.cc:359] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:01.346997 28154 raft_consensus.cc:2468] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:22:01.354554 28280 ts_tablet_manager.cc:1434] T dc8f779373b044c2b2e3d0e781f4d04f P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.002s
I20260709 13:22:01.354679 28050 leader_election.cc:304] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:01.355849 28280 tablet_bootstrap.cc:492] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:22:01.355940 28693 raft_consensus.cc:2804] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:01.356806 28693 raft_consensus.cc:697] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:22:01.358835 28693 consensus_queue.cc:237] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:01.362481 28278 raft_consensus.cc:385] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.362862 28278 raft_consensus.cc:740] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.364701 28278 consensus_queue.cc:260] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:01.367201 28278 ts_tablet_manager.cc:1434] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:22:01.368276 28278 tablet_bootstrap.cc:492] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:01.376494 28687 consensus_queue.cc:1048] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:01.377247 27906 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60560 (request call id 85) took 1243 ms. Trace:
I20260709 13:22:01.378509 28280 tablet_bootstrap.cc:654] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.381680 27906 rpcz_store.cc:276] 0709 13:22:00.133532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:22:00.133709 (+   177us) service_pool.cc:224] Handling call
0709 13:22:01.377159 (+1243450us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:22:01.119949 (+     0us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b5400a3fb28. stack: 00007f6c2e63b343 00007f6c2e63b240 00007f6c2dfca1d4 00007f6c37d08304 00007f6c37d08299 00007f6c37b169e1 00007f6c37b1564c 00007f6c351a4adc 00007f6c351900a6 00007f6c3518fd58 00007f6c351949f1 00007f6c351949a9 00007f6c35194939 00007f6c35194901 00007f6c35193b2d 000000000038f354
0709 13:22:01.120067 (+   118us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:22:01.120615 (+   548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:22:01.120650 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:22:01.120666 (+    16us) tablet.cc:662] Decoding operations
0709 13:22:01.120983 (+   317us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:22:01.121039 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:22:01.121069 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:22:01.121247 (+   178us) tablet.cc:701] Row locks acquired
0709 13:22:01.121264 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:22:01.121393 (+   129us) write_op.cc:270] Start()
0709 13:22:01.124577 (+  3184us) write_op.cc:276] Timestamp: P: 1783603321121356 usec, L: 0
0709 13:22:01.124644 (+    67us) op_driver.cc:348] REPLICATION: starting
0709 13:22:01.201577 (+ 76933us) log.cc:844] Serialized 543 byte log entry
0709 13:22:01.336212 (+134635us) op_driver.cc:464] REPLICATION: finished
0709 13:22:01.367560 (+ 31348us) write_op.cc:301] APPLY: starting
0709 13:22:01.367651 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:22:01.367749 (+    98us) tablet.cc:1370] finished BulkCheckPresence
0709 13:22:01.367770 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:22:01.368847 (+  1077us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:22:01.369058 (+   211us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:22:01.369104 (+    46us) write_op.cc:312] APPLY: finished
0709 13:22:01.369315 (+   211us) log.cc:844] Serialized 22 byte log entry
0709 13:22:01.370097 (+   782us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:22:01.370196 (+    99us) write_op.cc:454] Released schema lock
0709 13:22:01.370236 (+    40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":286699,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":31093,"num_ops":1,"prepare.queue_time_us":184184,"prepare.run_cpu_time_us":15385,"prepare.run_wall_time_us":189163,"raft.queue_time_us":24125,"raft.run_cpu_time_us":7592,"raft.run_wall_time_us":29226,"replication_time_us":209668,"spinlock_wait_cycles":13211008,"thread_start_us":163692,"threads_started":4,"wal-append.queue_time_us":105318}]]}
I20260709 13:22:01.386338 27905 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60566 (request call id 82) took 1135 ms. Trace:
I20260709 13:22:01.381218 28278 tablet_bootstrap.cc:654] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.388550 28695 raft_consensus.cc:493] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:01.389146 28695 raft_consensus.cc:515] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:01.391837 28695 leader_election.cc:290] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:01.392432 28080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c8db979236426c88754a4d4d46e147" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:22:01.393118 28080 raft_consensus.cc:2468] T a1c8db979236426c88754a4d4d46e147 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 0.
I20260709 13:22:01.394493 28197 leader_election.cc:304] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:01.396272 28154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c8db979236426c88754a4d4d46e147" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:22:01.386742 27905 rpcz_store.cc:276] 0709 13:22:00.251237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:22:00.251848 (+   611us) service_pool.cc:224] Handling call
0709 13:22:01.386269 (+1134421us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3}
I20260709 13:22:01.397360 28695 raft_consensus.cc:2804] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:01.398113 28695 raft_consensus.cc:493] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:22:01.398244 28198 leader_election.cc:343] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:01.398524 28695 raft_consensus.cc:3060] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.407219 28695 raft_consensus.cc:515] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:01.410245 28080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c8db979236426c88754a4d4d46e147" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:01.410923 28080 raft_consensus.cc:3060] T a1c8db979236426c88754a4d4d46e147 P d80a443d06244116ae813b77fc539651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.404819 27907 catalog_manager.cc:5697] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 0 to 1, leader changed from <none> to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 1 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } }
I20260709 13:22:01.413106 28687 raft_consensus.cc:493] T dc8f779373b044c2b2e3d0e781f4d04f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:01.415580 28687 raft_consensus.cc:515] T dc8f779373b044c2b2e3d0e781f4d04f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:01.425266 28080 raft_consensus.cc:2468] T a1c8db979236426c88754a4d4d46e147 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:22:01.432090 28197 leader_election.cc:304] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:01.433056 28597 raft_consensus.cc:2804] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:01.433599 28597 raft_consensus.cc:697] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:01.434486 28597 consensus_queue.cc:237] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:01.436153 28154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c8db979236426c88754a4d4d46e147" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:01.430684 28695 leader_election.cc:290] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
W20260709 13:22:01.439615 28198 leader_election.cc:343] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:01.445201 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8f779373b044c2b2e3d0e781f4d04f" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:22:01.449296 27906 catalog_manager.cc:5697] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:01.450675 28687 leader_election.cc:290] T dc8f779373b044c2b2e3d0e781f4d04f P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:22:01.451576 28080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8f779373b044c2b2e3d0e781f4d04f" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:22:01.452708 28633 consensus_queue.cc:1048] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:01.470819 28123 leader_election.cc:304] T dc8f779373b044c2b2e3d0e781f4d04f P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651
I20260709 13:22:01.472715 28633 raft_consensus.cc:2749] T dc8f779373b044c2b2e3d0e781f4d04f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:01.477161 28280 tablet_bootstrap.cc:492] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:22:01.467864 27906 catalog_manager.cc:5697] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:01.482489 27906 catalog_manager.cc:5697] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 0 to 1, leader changed from <none> to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 1 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } }
I20260709 13:22:01.516569 28278 tablet_bootstrap.cc:492] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:22:01.516757 28151 raft_consensus.cc:3060] T dc8f779373b044c2b2e3d0e781f4d04f P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.524771 27905 catalog_manager.cc:5697] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 1 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:01.527875 28278 ts_tablet_manager.cc:1403] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.160s	user 0.018s	sys 0.018s
I20260709 13:22:01.481298 28280 ts_tablet_manager.cc:1403] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.126s	user 0.020s	sys 0.018s
I20260709 13:22:01.532617 28278 raft_consensus.cc:359] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:01.538069 28280 raft_consensus.cc:359] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:01.538908 28280 raft_consensus.cc:385] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.539196 28280 raft_consensus.cc:740] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.539865 28280 consensus_queue.cc:260] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:01.542100 28280 ts_tablet_manager.cc:1434] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:22:01.541378 27904 catalog_manager.cc:5697] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 1 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } }
I20260709 13:22:01.543237 28280 tablet_bootstrap.cc:492] T a1c8db979236426c88754a4d4d46e147 P afb0dc4e88ca4275975541dfe077b38b: Bootstrap starting.
I20260709 13:22:01.533396 28278 raft_consensus.cc:385] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.545991 28278 raft_consensus.cc:740] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.547648 28278 consensus_queue.cc:260] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:01.555526 28278 ts_tablet_manager.cc:1434] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:22:01.556713 28278 tablet_bootstrap.cc:492] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:01.561913 28751 raft_consensus.cc:493] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:01.562538 28751 raft_consensus.cc:515] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:01.564838 28751 leader_election.cc:290] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:01.565907 28077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922beb15151e447cbbc0eaee6dc5266d" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:22:01.565907 28154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922beb15151e447cbbc0eaee6dc5266d" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:22:01.567485 28154 raft_consensus.cc:2393] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b1d1aefe48e42119ca040c70045fe28 in current term 1: Already voted for candidate d80a443d06244116ae813b77fc539651 in this term.
I20260709 13:22:01.568491 27975 leader_election.cc:304] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28; no voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651
I20260709 13:22:01.568953 28278 tablet_bootstrap.cc:654] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.569375 28751 raft_consensus.cc:3060] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.578213 28280 tablet_bootstrap.cc:654] T a1c8db979236426c88754a4d4d46e147 P afb0dc4e88ca4275975541dfe077b38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.579675 27907 catalog_manager.cc:5697] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b reported cstate change: term changed from 0 to 1, leader changed from <none> to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 1 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:01.630997 28751 raft_consensus.cc:2749] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:01.632472 27954 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:01.634789 28278 tablet_bootstrap.cc:492] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:22:01.635303 28278 ts_tablet_manager.cc:1403] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.079s	user 0.008s	sys 0.011s
I20260709 13:22:01.637408 28278 raft_consensus.cc:359] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:01.638105 28278 raft_consensus.cc:385] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.638371 28278 raft_consensus.cc:740] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.639495 28280 tablet_bootstrap.cc:492] T a1c8db979236426c88754a4d4d46e147 P afb0dc4e88ca4275975541dfe077b38b: No bootstrap required, opened a new log
I20260709 13:22:01.639175 28278 consensus_queue.cc:260] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:01.640291 28280 ts_tablet_manager.cc:1403] T a1c8db979236426c88754a4d4d46e147 P afb0dc4e88ca4275975541dfe077b38b: Time spent bootstrapping tablet: real 0.097s	user 0.017s	sys 0.003s
I20260709 13:22:01.644402 28280 raft_consensus.cc:359] T a1c8db979236426c88754a4d4d46e147 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:01.645186 28280 raft_consensus.cc:385] T a1c8db979236426c88754a4d4d46e147 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.645536 28280 raft_consensus.cc:740] T a1c8db979236426c88754a4d4d46e147 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.646443 28278 ts_tablet_manager.cc:1434] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:22:01.646312 28280 consensus_queue.cc:260] T a1c8db979236426c88754a4d4d46e147 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:01.647652 28278 tablet_bootstrap.cc:492] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:01.649020 28280 ts_tablet_manager.cc:1434] T a1c8db979236426c88754a4d4d46e147 P afb0dc4e88ca4275975541dfe077b38b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:01.656304 28278 tablet_bootstrap.cc:654] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.662056 28278 tablet_bootstrap.cc:492] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28: No bootstrap required, opened a new log
I20260709 13:22:01.663926 28278 ts_tablet_manager.cc:1403] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.002s
I20260709 13:22:01.666610 28278 raft_consensus.cc:359] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:01.667136 28278 raft_consensus.cc:385] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.667366 28278 raft_consensus.cc:740] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.668182 28278 consensus_queue.cc:260] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:01.670333 28278 ts_tablet_manager.cc:1434] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:22:01.678527 28684 consensus_queue.cc:1048] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:01.688625 28751 raft_consensus.cc:493] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:01.689170 28751 raft_consensus.cc:515] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:01.691601 28751 leader_election.cc:290] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:22:01.693190 28151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19150adcadcf4e14beef1b948b754f04" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:22:01.693850 28231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19150adcadcf4e14beef1b948b754f04" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:22:01.694089 28151 raft_consensus.cc:2468] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 0.
I20260709 13:22:01.694602 28231 raft_consensus.cc:2468] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 0.
I20260709 13:22:01.696098 27975 leader_election.cc:304] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:22:01.697711 28751 raft_consensus.cc:2804] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:01.699014 28751 raft_consensus.cc:493] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:01.699352 28751 raft_consensus.cc:3060] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.704341 28721 consensus_queue.cc:1048] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:01.707692 28751 raft_consensus.cc:515] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:01.708783 28711 raft_consensus.cc:493] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:01.709401 28711 raft_consensus.cc:515] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:01.711652 28711 leader_election.cc:290] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:22:01.717782 28226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c653748b39e457aab513022ae1306f5" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:22:01.718932 28230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19150adcadcf4e14beef1b948b754f04" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:22:01.719619 28230 raft_consensus.cc:3060] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.721057 28151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c653748b39e457aab513022ae1306f5" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:22:01.722522 28154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19150adcadcf4e14beef1b948b754f04" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:01.723192 28154 raft_consensus.cc:3060] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.726878 27975 leader_election.cc:304] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28; no voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:22:01.727897 28711 raft_consensus.cc:2749] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:01.727582 28751 leader_election.cc:290] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:22:01.730472 28230 raft_consensus.cc:2468] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 1.
I20260709 13:22:01.732201 27972 leader_election.cc:304] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28; no voters: 
I20260709 13:22:01.733140 28751 raft_consensus.cc:2804] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:01.733836 28751 raft_consensus.cc:697] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:22:01.734715 28751 consensus_queue.cc:237] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:01.738327 28154 raft_consensus.cc:2468] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 1.
I20260709 13:22:01.758314 27907 catalog_manager.cc:5697] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:01.800951 28710 consensus_queue.cc:1048] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:01.802033 28004 raft_consensus.cc:3060] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.820581 28693 consensus_queue.cc:1048] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:01.875555 28154 raft_consensus.cc:3060] T a1c8db979236426c88754a4d4d46e147 P afb0dc4e88ca4275975541dfe077b38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.882216 28597 consensus_queue.cc:1048] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:01.887503 28598 consensus_queue.cc:1048] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:01.934154 28711 raft_consensus.cc:493] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:01.934742 28711 raft_consensus.cc:515] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:01.936810 28711 leader_election.cc:290] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:01.937443 28226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72f52140be74d50aeccec9aebfd2f5b" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:22:01.938352 28226 raft_consensus.cc:2393] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b1d1aefe48e42119ca040c70045fe28 in current term 1: Already voted for candidate 2e2f737d674147808bb32783de176848 in this term.
I20260709 13:22:01.938810 28077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72f52140be74d50aeccec9aebfd2f5b" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:22:01.939721 28077 raft_consensus.cc:2393] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b1d1aefe48e42119ca040c70045fe28 in current term 1: Already voted for candidate d80a443d06244116ae813b77fc539651 in this term.
I20260709 13:22:01.940610 27974 leader_election.cc:304] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28; no voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651
I20260709 13:22:01.941223 28711 raft_consensus.cc:3060] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.946970 28711 raft_consensus.cc:2749] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:02.216642 28711 consensus_queue.cc:1048] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:02.236976 28711 consensus_queue.cc:1048] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:02.309741 28597 raft_consensus.cc:493] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afb0dc4e88ca4275975541dfe077b38b)
I20260709 13:22:02.310269 28597 raft_consensus.cc:515] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:02.312866 28597 leader_election.cc:290] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:02.314949 28154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17389976f8e346dbb2fbc326a9e60396" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:22:02.315714 28154 raft_consensus.cc:2468] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 2.
I20260709 13:22:02.316203 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17389976f8e346dbb2fbc326a9e60396" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:22:02.317031 28006 raft_consensus.cc:2393] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e2f737d674147808bb32783de176848 in current term 2: Already voted for candidate 6b1d1aefe48e42119ca040c70045fe28 in this term.
I20260709 13:22:02.316902 28198 leader_election.cc:304] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:22:02.317836 28597 raft_consensus.cc:2804] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:02.318214 28597 raft_consensus.cc:493] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election (detected failure of leader afb0dc4e88ca4275975541dfe077b38b)
I20260709 13:22:02.319306 28597 raft_consensus.cc:3060] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.325079 28597 raft_consensus.cc:515] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:02.327004 28597 leader_election.cc:290] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:02.328436 28154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17389976f8e346dbb2fbc326a9e60396" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:02.329211 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17389976f8e346dbb2fbc326a9e60396" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:22:02.330552 28006 raft_consensus.cc:2393] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e2f737d674147808bb32783de176848 in current term 2: Already voted for candidate 6b1d1aefe48e42119ca040c70045fe28 in this term.
I20260709 13:22:02.335216 28154 raft_consensus.cc:2468] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 2.
I20260709 13:22:02.336521 28198 leader_election.cc:304] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:02.337167 28598 raft_consensus.cc:2804] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:02.337662 28598 raft_consensus.cc:697] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:02.338361 28598 consensus_queue.cc:237] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:02.346879 27904 catalog_manager.cc:5697] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 1 to 2, leader changed from afb0dc4e88ca4275975541dfe077b38b (127.17.251.131) to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 2 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } }
W20260709 13:22:02.667675 27954 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:02.792639 28151 raft_consensus.cc:1275] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Refusing update from remote peer 2e2f737d674147808bb32783de176848: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:02.794108 28801 consensus_queue.cc:1048] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:02.806052 28006 raft_consensus.cc:1275] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Refusing update from remote peer 2e2f737d674147808bb32783de176848: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:02.807778 28801 consensus_queue.cc:1048] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:22:02.975935 28801 raft_consensus.cc:493] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:02.976758 28801 raft_consensus.cc:515] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:02.979732 28801 leader_election.cc:290] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:02.981154 28077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72f52140be74d50aeccec9aebfd2f5b" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:22:02.981946 28077 raft_consensus.cc:2468] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:22:02.982319 28004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72f52140be74d50aeccec9aebfd2f5b" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:22:02.983009 28004 raft_consensus.cc:2468] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:22:02.983398 28197 leader_election.cc:304] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:02.984226 28598 raft_consensus.cc:2804] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:02.984604 28598 raft_consensus.cc:493] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:02.984961 28598 raft_consensus.cc:3060] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.990972 28598 raft_consensus.cc:515] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:02.992404 28598 leader_election.cc:290] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:02.993251 28004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72f52140be74d50aeccec9aebfd2f5b" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:22:02.993441 28077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72f52140be74d50aeccec9aebfd2f5b" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:02.993850 28004 raft_consensus.cc:3060] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.994068 28077 raft_consensus.cc:3060] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.999948 28077 raft_consensus.cc:2468] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 2.
I20260709 13:22:03.000061 28004 raft_consensus.cc:2468] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 2.
I20260709 13:22:03.001339 28197 leader_election.cc:304] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:03.002058 28598 raft_consensus.cc:2804] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:03.003748 28598 raft_consensus.cc:697] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:03.009554 28598 consensus_queue.cc:237] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:03.020926 27904 catalog_manager.cc:5697] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 0 to 2, leader changed from <none> to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 2 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:03.512207 28004 raft_consensus.cc:1275] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Refusing update from remote peer 2e2f737d674147808bb32783de176848: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:22:03.513489 28598 consensus_queue.cc:1048] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:03.524085 28080 raft_consensus.cc:1275] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Refusing update from remote peer 2e2f737d674147808bb32783de176848: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:22:03.525985 28598 consensus_queue.cc:1048] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:04.491210 18414 tablet_server.cc:179] TabletServer@127.17.251.129:0 shutting down...
W20260709 13:22:04.495530 28196 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:22:04.500123 28196 consensus_peers.cc:597] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:04.509212 28122 consensus_peers.cc:597] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:04.514038 28196 consensus_peers.cc:597] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:04.552682 28122 consensus_peers.cc:597] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.563977 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:04.565199 18414 tablet_replica.cc:333] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.566659 18414 raft_consensus.cc:2243] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:04.568228 18414 raft_consensus.cc:2272] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.572017 18414 tablet_replica.cc:333] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.572877 18414 raft_consensus.cc:2243] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.573876 18414 raft_consensus.cc:2272] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.578051 18414 tablet_replica.cc:333] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
W20260709 13:22:04.579326 28048 consensus_peers.cc:597] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.579236 18414 raft_consensus.cc:2243] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.581314 18414 raft_consensus.cc:2272] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.584892 18414 tablet_replica.cc:333] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.585791 18414 raft_consensus.cc:2243] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.586359 18414 raft_consensus.cc:2272] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.590282 18414 tablet_replica.cc:333] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.591311 18414 raft_consensus.cc:2243] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:04.591347 28122 consensus_peers.cc:597] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.592048 18414 raft_consensus.cc:2272] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.594975 18414 tablet_replica.cc:333] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.595638 18414 raft_consensus.cc:2243] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.596212 18414 raft_consensus.cc:2272] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.599038 18414 tablet_replica.cc:333] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.599684 18414 raft_consensus.cc:2243] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:04.600682 18414 raft_consensus.cc:2272] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.603091 18414 tablet_replica.cc:333] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.603761 18414 raft_consensus.cc:2243] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.604326 18414 raft_consensus.cc:2272] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.608203 18414 tablet_replica.cc:333] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.609046 18414 raft_consensus.cc:2243] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.609860 18414 raft_consensus.cc:2272] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.612887 18414 tablet_replica.cc:333] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
W20260709 13:22:04.613005 28122 consensus_peers.cc:597] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.614107 18414 raft_consensus.cc:2243] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.614814 18414 raft_consensus.cc:2272] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:04.617267 28196 consensus_peers.cc:597] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.618026 18414 tablet_replica.cc:333] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.618752 18414 raft_consensus.cc:2243] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.619227 18414 raft_consensus.cc:2272] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.621563 18414 tablet_replica.cc:333] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.622253 18414 raft_consensus.cc:2243] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.622753 18414 raft_consensus.cc:2272] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.625268 18414 tablet_replica.cc:333] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.626168 18414 raft_consensus.cc:2243] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.626798 18414 raft_consensus.cc:2272] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.629822 18414 tablet_replica.cc:333] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.630417 18414 raft_consensus.cc:2243] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:04.631459 18414 raft_consensus.cc:2272] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.634013 18414 tablet_replica.cc:333] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.634699 18414 raft_consensus.cc:2243] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.635190 18414 raft_consensus.cc:2272] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.638015 18414 tablet_replica.cc:333] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.638626 18414 raft_consensus.cc:2243] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.639144 18414 raft_consensus.cc:2272] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.641595 18414 tablet_replica.cc:333] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.642742 18414 raft_consensus.cc:2243] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.643471 18414 raft_consensus.cc:2272] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.646821 18414 tablet_replica.cc:333] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.647604 18414 raft_consensus.cc:2243] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.648136 18414 raft_consensus.cc:2272] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.651103 18414 tablet_replica.cc:333] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.651964 18414 raft_consensus.cc:2243] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.652829 18414 raft_consensus.cc:2272] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:04.655897 28196 consensus_peers.cc:597] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.656234 18414 tablet_replica.cc:333] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.657673 18414 raft_consensus.cc:2243] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.658318 18414 raft_consensus.cc:2272] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:04.658901 28122 consensus_peers.cc:597] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.661748 18414 tablet_replica.cc:333] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.662451 18414 raft_consensus.cc:2243] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.663043 18414 raft_consensus.cc:2272] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.665198 18414 tablet_replica.cc:333] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.665818 18414 raft_consensus.cc:2243] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.666332 18414 raft_consensus.cc:2272] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.668627 18414 tablet_replica.cc:333] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.669252 18414 raft_consensus.cc:2243] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.669757 18414 raft_consensus.cc:2272] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.672083 18414 tablet_replica.cc:333] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.672647 18414 raft_consensus.cc:2243] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.673154 18414 raft_consensus.cc:2272] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.676137 18414 tablet_replica.cc:333] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.676750 18414 raft_consensus.cc:2243] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.677336 18414 raft_consensus.cc:2272] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:04.677929 28122 consensus_peers.cc:597] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.679790 18414 tablet_replica.cc:333] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.680482 18414 raft_consensus.cc:2243] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:04.681367 18414 raft_consensus.cc:2272] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.684159 18414 tablet_replica.cc:333] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.684810 18414 raft_consensus.cc:2243] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:04.685823 18414 raft_consensus.cc:2272] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.688678 18414 tablet_replica.cc:333] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.689642 18414 raft_consensus.cc:2243] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:04.690861 18414 raft_consensus.cc:2272] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.694321 18414 tablet_replica.cc:333] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.695302 18414 raft_consensus.cc:2243] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.695992 18414 raft_consensus.cc:2272] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.699915 18414 tablet_replica.cc:333] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
W20260709 13:22:04.699865 28122 consensus_peers.cc:597] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.701124 18414 raft_consensus.cc:2243] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:04.701247 28122 consensus_peers.cc:597] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.702105 18414 raft_consensus.cc:2272] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:04.704344 28122 consensus_peers.cc:597] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.705693 18414 tablet_replica.cc:333] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.706601 18414 raft_consensus.cc:2243] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:04.707641 18414 raft_consensus.cc:2272] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.711431 18414 tablet_replica.cc:333] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.712074 18414 raft_consensus.cc:2243] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.712594 18414 raft_consensus.cc:2272] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.715607 18414 tablet_replica.cc:333] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.716454 18414 raft_consensus.cc:2243] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.717046 18414 raft_consensus.cc:2272] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:04.720535 28196 consensus_peers.cc:597] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.720932 18414 tablet_replica.cc:333] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.721982 18414 raft_consensus.cc:2243] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.722792 18414 raft_consensus.cc:2272] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:04.723675 28122 consensus_peers.cc:597] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.725979 18414 tablet_replica.cc:333] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.726900 18414 raft_consensus.cc:2243] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:04.729964 28048 consensus_peers.cc:597] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:04.730866 28196 consensus_peers.cc:597] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.733958 18414 raft_consensus.cc:2272] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.737449 18414 tablet_replica.cc:333] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.738379 18414 raft_consensus.cc:2243] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.739215 18414 raft_consensus.cc:2272] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.743160 18414 tablet_replica.cc:333] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.743975 18414 raft_consensus.cc:2243] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:04.745357 18414 raft_consensus.cc:2272] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.748931 18414 tablet_replica.cc:333] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.750093 18414 raft_consensus.cc:2243] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.750780 18414 raft_consensus.cc:2272] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:04.751502 28196 consensus_peers.cc:597] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.753990 18414 tablet_replica.cc:333] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.754885 18414 raft_consensus.cc:2243] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.755630 18414 raft_consensus.cc:2272] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.759148 18414 tablet_replica.cc:333] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.760030 18414 raft_consensus.cc:2243] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.760700 18414 raft_consensus.cc:2272] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:04.762693 28048 consensus_peers.cc:597] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.763923 18414 tablet_replica.cc:333] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.764809 18414 raft_consensus.cc:2243] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.765504 18414 raft_consensus.cc:2272] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:04.767982 28122 consensus_peers.cc:597] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.768769 18414 tablet_replica.cc:333] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.769407 18414 raft_consensus.cc:2243] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.769925 18414 raft_consensus.cc:2272] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.772548 18414 tablet_replica.cc:333] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.773102 18414 raft_consensus.cc:2243] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:04.775200 18414 raft_consensus.cc:2272] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.778333 18414 tablet_replica.cc:333] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.778993 18414 raft_consensus.cc:2243] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:04.779582 18414 raft_consensus.cc:2272] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:04.782827 18414 tablet_replica.cc:333] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28: stopping tablet replica
I20260709 13:22:04.783540 18414 raft_consensus.cc:2243] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:04.785202 18414 raft_consensus.cc:2272] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:04.795617 28048 consensus_peers.cc:597] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:04.805332 28048 consensus_peers.cc:597] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:04.831636 28048 consensus_peers.cc:597] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:04.861182 28196 consensus_peers.cc:597] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:04.861936 28122 consensus_peers.cc:597] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:04.882562 28048 consensus_peers.cc:597] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.885195 18414 tablet_server.cc:196] TabletServer@127.17.251.129:0 shutdown complete.
W20260709 13:22:04.906826 28196 consensus_peers.cc:597] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:04.907384 28196 consensus_peers.cc:597] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:04.960391 28196 consensus_peers.cc:597] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:04.961913 28048 consensus_peers.cc:597] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:04.977048 28196 consensus_peers.cc:597] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:04.981494 28122 consensus_peers.cc:597] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.984875 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:04.993270 28833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:04.993460 28834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:04.998224 28836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:05.002030 18414 server_base.cc:1061] running on GCE node
I20260709 13:22:05.005373 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:05.005764 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:05.006013 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603325005986 us; error 0 us; skew 500 ppm
I20260709 13:22:05.006675 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:05.011122 18414 webserver.cc:533] Webserver started at http://127.17.251.129:41059/ using document root <none> and password file <none>
I20260709 13:22:05.011844 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:05.012097 18414 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:22:05.019555 18414 fs_manager.cc:714] Time spent opening directory manager: real 0.006s	user 0.005s	sys 0.001s
W20260709 13:22:05.026854 28048 consensus_peers.cc:597] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:05.032651 28841 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:05.034332 18414 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:22:05.034693 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-0-root
uuid: "6b1d1aefe48e42119ca040c70045fe28"
format_stamp: "Formatted at 2026-07-09 13:21:49 on dist-test-slave-7f95"
I20260709 13:22:05.035331 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603012191013-18414-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:22:05.059785 28048 consensus_peers.cc:597] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:05.065449 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:05.067608 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:05.069952 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:05.077661 28848 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:22:05.424023 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:22:05.424407 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.349s	user 0.012s	sys 0.000s
I20260709 13:22:05.424777 18414 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:22:05.436667 28848 tablet_bootstrap.cc:492] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:05.450752 28848 tablet_bootstrap.cc:492] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.451712 28848 tablet_bootstrap.cc:492] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:05.452399 28848 ts_tablet_manager.cc:1403] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.016s	user 0.003s	sys 0.010s
I20260709 13:22:05.455318 28848 raft_consensus.cc:359] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:05.456079 28848 raft_consensus.cc:740] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.456743 28848 consensus_queue.cc:260] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:05.459403 28848 ts_tablet_manager.cc:1434] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.006s
I20260709 13:22:05.460089 28848 tablet_bootstrap.cc:492] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:05.473897 28848 tablet_bootstrap.cc:492] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.474743 28848 tablet_bootstrap.cc:492] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:05.475304 28848 ts_tablet_manager.cc:1403] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:22:05.477150 28848 raft_consensus.cc:359] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:05.477710 28848 raft_consensus.cc:740] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.478463 28848 consensus_queue.cc:260] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:05.480983 28848 ts_tablet_manager.cc:1434] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:05.482021 28848 tablet_bootstrap.cc:492] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:05.495882 28848 tablet_bootstrap.cc:492] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.496707 28848 tablet_bootstrap.cc:492] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:05.497268 28848 ts_tablet_manager.cc:1403] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.004s
I20260709 13:22:05.499764 28848 raft_consensus.cc:359] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:05.500304 28848 raft_consensus.cc:740] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.501031 28848 consensus_queue.cc:260] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:05.503014 28848 ts_tablet_manager.cc:1434] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:22:05.503696 28848 tablet_bootstrap.cc:492] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:05.517870 28848 tablet_bootstrap.cc:492] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.518887 28848 tablet_bootstrap.cc:492] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:05.520267 28848 ts_tablet_manager.cc:1403] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:22:05.525413 28848 raft_consensus.cc:359] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:05.526238 28848 raft_consensus.cc:740] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.527101 28848 consensus_queue.cc:260] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:05.530455 28848 ts_tablet_manager.cc:1434] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:22:05.531323 28848 tablet_bootstrap.cc:492] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:05.548604 28848 tablet_bootstrap.cc:492] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.549371 28848 tablet_bootstrap.cc:492] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:05.550058 28848 ts_tablet_manager.cc:1403] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:22:05.553717 28848 raft_consensus.cc:359] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:05.554412 28848 raft_consensus.cc:740] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.555086 28848 consensus_queue.cc:260] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:05.556988 28848 ts_tablet_manager.cc:1434] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:22:05.557868 28848 tablet_bootstrap.cc:492] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:05.569214 28684 raft_consensus.cc:493] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:05.569839 28684 raft_consensus.cc:515] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:05.572605 28684 leader_election.cc:290] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:05.573515 28848 tablet_bootstrap.cc:492] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.574113 28080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1785087e0e647aebaa4e56a6c11482e" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:22:05.574599 28848 tablet_bootstrap.cc:492] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:05.575309 28848 ts_tablet_manager.cc:1403] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:22:05.577908 28848 raft_consensus.cc:359] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:05.578680 28848 raft_consensus.cc:740] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.579474 28848 consensus_queue.cc:260] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
W20260709 13:22:05.580338 28122 leader_election.cc:336] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:05.580816 28122 leader_election.cc:304] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651
I20260709 13:22:05.581358 28848 ts_tablet_manager.cc:1434] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:05.582223 28848 tablet_bootstrap.cc:492] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:05.582499 28684 raft_consensus.cc:2749] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:05.598004 28848 tablet_bootstrap.cc:492] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.599131 28848 tablet_bootstrap.cc:492] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:05.599798 28848 ts_tablet_manager.cc:1403] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:22:05.602391 28848 raft_consensus.cc:359] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:05.603094 28848 raft_consensus.cc:740] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.603740 28848 consensus_queue.cc:260] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:05.605720 28848 ts_tablet_manager.cc:1434] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:05.606563 28848 tablet_bootstrap.cc:492] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:05.619372 28848 tablet_bootstrap.cc:492] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.620110 28848 tablet_bootstrap.cc:492] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:05.620736 28848 ts_tablet_manager.cc:1403] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:22:05.623291 28848 raft_consensus.cc:359] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:05.624024 28848 raft_consensus.cc:740] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.624730 28848 consensus_queue.cc:260] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:05.626473 28848 ts_tablet_manager.cc:1434] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:22:05.627197 28848 tablet_bootstrap.cc:492] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:05.647325 28848 tablet_bootstrap.cc:492] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.648277 28848 tablet_bootstrap.cc:492] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:05.648909 28848 ts_tablet_manager.cc:1403] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 13:22:05.651399 28848 raft_consensus.cc:359] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:05.652060 28848 raft_consensus.cc:740] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.652813 28848 consensus_queue.cc:260] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:05.654918 28848 ts_tablet_manager.cc:1434] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:22:05.655705 28848 tablet_bootstrap.cc:492] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:05.672169 28848 tablet_bootstrap.cc:492] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.673148 28848 tablet_bootstrap.cc:492] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:05.673801 28848 ts_tablet_manager.cc:1403] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.005s
I20260709 13:22:05.675717 28848 raft_consensus.cc:359] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:05.676257 28848 raft_consensus.cc:740] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.676795 28848 consensus_queue.cc:260] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:05.678444 28848 ts_tablet_manager.cc:1434] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:05.679104 28848 tablet_bootstrap.cc:492] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:05.693588 28848 tablet_bootstrap.cc:492] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.694600 18414 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:22:05.694676 28848 tablet_bootstrap.cc:492] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:05.695259 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.270s	user 0.250s	sys 0.007s
I20260709 13:22:05.695909 28848 ts_tablet_manager.cc:1403] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:22:05.698727 28848 raft_consensus.cc:359] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:05.699646 28848 raft_consensus.cc:740] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.700598 28848 consensus_queue.cc:260] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:05.702566 28848 ts_tablet_manager.cc:1434] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:05.703225 28848 tablet_bootstrap.cc:492] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:05.718252 28684 raft_consensus.cc:493] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:05.718809 28684 raft_consensus.cc:515] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:05.719172 28848 tablet_bootstrap.cc:492] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.720819 28848 tablet_bootstrap.cc:492] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:05.721184 28684 leader_election.cc:290] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:05.721735 28848 ts_tablet_manager.cc:1403] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:22:05.723022 28077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ed080f456b4849b44145557b5889b1" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
W20260709 13:22:05.725909 28122 leader_election.cc:336] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:05.725437 28848 raft_consensus.cc:359] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:05.726358 28122 leader_election.cc:304] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651
I20260709 13:22:05.726568 28848 raft_consensus.cc:740] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.728278 28684 raft_consensus.cc:2749] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:05.727703 28848 consensus_queue.cc:260] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:05.731261 28848 ts_tablet_manager.cc:1434] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:22:05.732352 28848 tablet_bootstrap.cc:492] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:05.745458 28684 raft_consensus.cc:493] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:05.746136 28684 raft_consensus.cc:515] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:05.748237 28684 leader_election.cc:290] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:05.749935 28226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8359246c5ff428e89f3b5c15a65aa98" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
W20260709 13:22:05.753351 28122 leader_election.cc:336] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:05.753819 28122 leader_election.cc:304] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:05.755009 28684 raft_consensus.cc:2749] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:05.781123 28611 raft_consensus.cc:493] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:05.781737 28611 raft_consensus.cc:515] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:05.783998 28848 tablet_bootstrap.cc:492] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.784766 28151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25fa78648f943939c0b04e5ae654cdf" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:22:05.785346 28848 tablet_bootstrap.cc:492] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:05.786401 28848 ts_tablet_manager.cc:1403] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.054s	user 0.027s	sys 0.024s
W20260709 13:22:05.789909 28048 leader_election.cc:336] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:05.789999 28848 raft_consensus.cc:359] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:05.791239 28848 raft_consensus.cc:740] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.791249 28048 leader_election.cc:304] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:22:05.792520 28824 raft_consensus.cc:2749] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:05.792126 28848 consensus_queue.cc:260] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:05.798213 28848 ts_tablet_manager.cc:1434] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:22:05.799378 28848 tablet_bootstrap.cc:492] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:05.791352 28611 leader_election.cc:290] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:05.821048 28848 tablet_bootstrap.cc:492] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.822072 28848 tablet_bootstrap.cc:492] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:05.822757 28848 ts_tablet_manager.cc:1403] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.024s	user 0.021s	sys 0.000s
I20260709 13:22:05.825505 28848 raft_consensus.cc:359] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:05.826587 28848 raft_consensus.cc:740] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.827627 28684 raft_consensus.cc:493] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:05.827303 28848 consensus_queue.cc:260] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:05.828191 28684 raft_consensus.cc:515] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:05.829686 28848 ts_tablet_manager.cc:1434] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:22:05.830204 28684 leader_election.cc:290] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:05.830566 28848 tablet_bootstrap.cc:492] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:05.835178 28077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c61eea3984e50916353d4844fe718" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:22:05.838446 28598 raft_consensus.cc:493] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:05.839040 28598 raft_consensus.cc:515] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:05.841277 28598 leader_election.cc:290] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:05.843438 28151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb17cd0859ea43a5b7c93c90f172a611" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
W20260709 13:22:05.847195 28196 leader_election.cc:336] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:05.855412 28849 raft_consensus.cc:493] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:05.856035 28849 raft_consensus.cc:515] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:05.857528 28198 leader_election.cc:304] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:22:05.858304 28849 leader_election.cc:290] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:05.859036 28819 raft_consensus.cc:2749] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:05.873199 28831 raft_consensus.cc:493] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:05.873811 28831 raft_consensus.cc:515] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:05.874233 28848 tablet_bootstrap.cc:492] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.875368 28848 tablet_bootstrap.cc:492] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:05.876058 28831 leader_election.cc:290] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:05.878511 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f95034322d746e4aaf06b06873de375" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:22:05.881542 28848 ts_tablet_manager.cc:1403] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.008s
I20260709 13:22:05.884306 28848 raft_consensus.cc:359] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:05.885025 28848 raft_consensus.cc:740] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.886173 28080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e12f9e1f649c19b7ba5bac1e051dd" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:22:05.886145 28848 consensus_queue.cc:260] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:05.888983 28848 ts_tablet_manager.cc:1434] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:22:05.889853 28848 tablet_bootstrap.cc:492] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:05.891505 28822 raft_consensus.cc:493] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:05.892086 28822 raft_consensus.cc:515] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:05.896829 28849 raft_consensus.cc:493] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:05.897472 28849 raft_consensus.cc:515] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
W20260709 13:22:05.900162 28122 leader_election.cc:336] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:05.900679 28122 leader_election.cc:304] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651
I20260709 13:22:05.903106 28684 raft_consensus.cc:2749] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:05.896920 28824 raft_consensus.cc:493] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:05.906255 28824 raft_consensus.cc:515] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:05.908430 28824 leader_election.cc:290] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:05.909240 28849 leader_election.cc:290] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:05.915645 28154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c61eea3984e50916353d4844fe718" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:22:05.916435 28154 raft_consensus.cc:2468] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:22:05.918327 28151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1785087e0e647aebaa4e56a6c11482e" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:22:05.919040 28151 raft_consensus.cc:2468] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
W20260709 13:22:05.920696 28048 leader_election.cc:336] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:05.921175 28048 leader_election.cc:304] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:22:05.928084 28907 raft_consensus.cc:2749] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:05.929292 28050 leader_election.cc:304] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:05.930320 28050 leader_election.cc:304] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:05.932756 28822 leader_election.cc:290] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:05.934731 28226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19150adcadcf4e14beef1b948b754f04" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:22:05.938452 28907 raft_consensus.cc:2804] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:05.942574 28907 raft_consensus.cc:493] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:05.943009 28907 raft_consensus.cc:3060] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:05.945132 28824 raft_consensus.cc:493] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:05.945957 28824 raft_consensus.cc:515] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:05.948129 28824 leader_election.cc:290] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
W20260709 13:22:05.949188 28048 leader_election.cc:336] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:05.938391 28849 raft_consensus.cc:2804] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:05.950662 28849 raft_consensus.cc:493] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:05.951040 28849 raft_consensus.cc:3060] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:05.961134 28048 leader_election.cc:336] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
W20260709 13:22:05.969084 28048 leader_election.cc:336] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:05.973131 28598 raft_consensus.cc:493] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:05.973812 28598 raft_consensus.cc:515] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:05.975832 28598 leader_election.cc:290] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:05.988155 28154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ed080f456b4849b44145557b5889b1" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:22:05.988880 28154 raft_consensus.cc:2468] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
W20260709 13:22:05.987646 28196 leader_election.cc:336] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:05.990590 28050 leader_election.cc:304] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
W20260709 13:22:05.937935 28122 leader_election.cc:336] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
W20260709 13:22:05.991621 28122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 53738.6us
I20260709 13:22:05.993855 28824 raft_consensus.cc:2804] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:05.994267 28123 leader_election.cc:304] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651
I20260709 13:22:05.994457 28824 raft_consensus.cc:493] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:05.994920 28824 raft_consensus.cc:3060] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:05.995391 28904 raft_consensus.cc:2749] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:05.997991 28904 raft_consensus.cc:493] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:05.998658 28904 raft_consensus.cc:515] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:06.001452 28904 leader_election.cc:290] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:06.002182 28226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb17cd0859ea43a5b7c93c90f172a611" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:22:06.002894 28226 raft_consensus.cc:2468] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:22:06.004556 28121 leader_election.cc:304] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:22:06.004654 28824 raft_consensus.cc:515] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.005662 28904 raft_consensus.cc:2804] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:06.005693 28154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8359246c5ff428e89f3b5c15a65aa98" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:22:06.006115 28904 raft_consensus.cc:493] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:06.006685 28904 raft_consensus.cc:3060] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.006744 28154 raft_consensus.cc:2468] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:22:06.008684 28198 leader_election.cc:304] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:06.009778 28907 raft_consensus.cc:515] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.010788 28598 raft_consensus.cc:2804] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:06.011194 28598 raft_consensus.cc:493] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:06.011529 28598 raft_consensus.cc:3060] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.013190 28849 raft_consensus.cc:515] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.015378 28849 leader_election.cc:290] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:06.019237 28151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1785087e0e647aebaa4e56a6c11482e" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:06.012089 28907 leader_election.cc:290] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:06.019882 28151 raft_consensus.cc:3060] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.020605 28824 leader_election.cc:290] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:06.022192 28848 tablet_bootstrap.cc:492] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.024133 28848 tablet_bootstrap.cc:492] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:06.025002 28848 ts_tablet_manager.cc:1403] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.135s	user 0.016s	sys 0.002s
I20260709 13:22:06.028609 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ed080f456b4849b44145557b5889b1" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:06.029569 28158 raft_consensus.cc:3060] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.031184 28154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c61eea3984e50916353d4844fe718" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:06.035993 28154 raft_consensus.cc:3060] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.036599 28819 raft_consensus.cc:493] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:06.037250 28819 raft_consensus.cc:515] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:06.040251 28819 leader_election.cc:290] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:06.042027 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19150adcadcf4e14beef1b948b754f04" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:22:06.042268 28598 raft_consensus.cc:515] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:06.042831 28157 raft_consensus.cc:2468] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:22:06.043021 28158 raft_consensus.cc:2468] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 2.
I20260709 13:22:06.044180 28198 leader_election.cc:304] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:22:06.046178 28819 raft_consensus.cc:2804] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:06.046795 28819 raft_consensus.cc:493] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:06.047379 28819 raft_consensus.cc:3060] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:06.047839 28048 leader_election.cc:336] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:06.044493 28848 raft_consensus.cc:359] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
W20260709 13:22:06.048434 28048 leader_election.cc:336] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:06.048538 28848 raft_consensus.cc:740] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.051514 28154 raft_consensus.cc:2468] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 2.
I20260709 13:22:06.054651 28598 leader_election.cc:290] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
W20260709 13:22:06.054257 28122 leader_election.cc:336] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:06.055395 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8359246c5ff428e89f3b5c15a65aa98" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:06.046823 28151 raft_consensus.cc:2468] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 2.
I20260709 13:22:06.056366 28050 leader_election.cc:304] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:06.055416 28848 consensus_queue.cc:260] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:06.057981 28824 raft_consensus.cc:2804] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:06.058507 28824 raft_consensus.cc:697] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 2 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:22:06.059432 28824 consensus_queue.cc:237] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.060166 28848 ts_tablet_manager.cc:1434] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
W20260709 13:22:06.062758 28196 leader_election.cc:336] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:06.057042 28157 raft_consensus.cc:3060] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.066219 28919 raft_consensus.cc:493] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:06.066809 28919 raft_consensus.cc:515] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:06.069797 28919 leader_election.cc:290] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:06.070834 28848 tablet_bootstrap.cc:492] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:06.072206 28050 leader_election.cc:304] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:06.071789 28819 raft_consensus.cc:515] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:06.075515 28919 raft_consensus.cc:2804] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:06.076370 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19150adcadcf4e14beef1b948b754f04" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:06.079689 28158 raft_consensus.cc:3060] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.080639 28157 raft_consensus.cc:2468] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 2.
W20260709 13:22:06.076653 28048 leader_election.cc:336] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:06.081154 28122 leader_election.cc:304] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b; no voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:06.076879 28919 raft_consensus.cc:697] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 2 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:22:06.070796 28904 raft_consensus.cc:515] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:06.084781 28904 leader_election.cc:290] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:06.085580 28226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb17cd0859ea43a5b7c93c90f172a611" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:22:06.086191 28226 raft_consensus.cc:3060] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:06.091030 28048 leader_election.cc:336] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:06.083843 28919 consensus_queue.cc:237] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.093782 28819 leader_election.cc:290] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:06.099318 28226 raft_consensus.cc:2468] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 2.
I20260709 13:22:06.099316 28158 raft_consensus.cc:2468] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 2.
W20260709 13:22:06.077179 28196 leader_election.cc:336] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:06.100430 28831 raft_consensus.cc:2749] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:06.100863 28121 leader_election.cc:304] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:22:06.101740 28822 raft_consensus.cc:2804] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:06.102257 28822 raft_consensus.cc:697] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:22:06.103149 28822 consensus_queue.cc:237] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:06.107666 28905 raft_consensus.cc:493] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:06.108189 28905 raft_consensus.cc:515] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.110052 28050 leader_election.cc:304] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:06.110641 28849 raft_consensus.cc:493] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:06.111224 28849 raft_consensus.cc:515] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.111613 28611 raft_consensus.cc:2804] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:06.112078 28611 raft_consensus.cc:697] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 2 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:22:06.112847 28611 consensus_queue.cc:237] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.113251 28849 leader_election.cc:290] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:06.118166 28905 leader_election.cc:290] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:06.119725 28080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25fa78648f943939c0b04e5ae654cdf" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:22:06.139210 28080 raft_consensus.cc:2468] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:22:06.115801 28154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e12f9e1f649c19b7ba5bac1e051dd" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b" is_pre_election: true
I20260709 13:22:06.140820 28154 raft_consensus.cc:2468] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 1.
I20260709 13:22:06.117993 28226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90c9f452bac4ef0b959ca0e78ab475f" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2f737d674147808bb32783de176848" is_pre_election: true
I20260709 13:22:06.144469 28123 leader_election.cc:304] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:06.146087 28050 leader_election.cc:304] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:06.146971 28907 raft_consensus.cc:2804] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:06.147375 28907 raft_consensus.cc:493] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:06.147747 28907 raft_consensus.cc:3060] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.150715 28047 leader_election.cc:304] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d80a443d06244116ae813b77fc539651; no voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:06.152751 28919 raft_consensus.cc:2749] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:06.157110 28907 raft_consensus.cc:515] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.158676 28904 raft_consensus.cc:2804] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:06.159251 28904 raft_consensus.cc:493] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:06.160270 28904 raft_consensus.cc:3060] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.126641 28198 leader_election.cc:304] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:22:06.162750 28598 raft_consensus.cc:2804] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:22:06.165148 28122 leader_election.cc:336] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:06.166287 28158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e12f9e1f649c19b7ba5bac1e051dd" candidate_uuid: "d80a443d06244116ae813b77fc539651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:06.166976 28158 raft_consensus.cc:3060] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.164173 28598 raft_consensus.cc:697] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:06.167991 28598 consensus_queue.cc:237] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
W20260709 13:22:06.169351 28122 leader_election.cc:336] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
W20260709 13:22:06.170225 28122 leader_election.cc:336] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:06.162931 28198 leader_election.cc:304] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:06.169206 27904 catalog_manager.cc:5697] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 1 to 2, leader changed from 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129) to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:06.173563 28828 raft_consensus.cc:2804] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:06.178292 28828 raft_consensus.cc:697] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:06.178670 28904 raft_consensus.cc:515] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.179255 28828 consensus_queue.cc:237] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:06.185895 28904 leader_election.cc:290] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
W20260709 13:22:06.188313 28122 leader_election.cc:336] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:06.189193 28158 raft_consensus.cc:2468] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d80a443d06244116ae813b77fc539651 in term 2.
I20260709 13:22:06.188587 27905 catalog_manager.cc:5697] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b reported cstate change: term changed from 1 to 2, leader changed from 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129) to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 2 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } }
W20260709 13:22:06.192706 28196 leader_election.cc:336] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:06.194491 28050 leader_election.cc:304] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:06.195376 28824 raft_consensus.cc:2804] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:06.195839 28824 raft_consensus.cc:697] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 2 LEADER]: Becoming Leader. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:22:06.160368 28907 leader_election.cc:290] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:06.196878 28824 consensus_queue.cc:237] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.191928 28080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25fa78648f943939c0b04e5ae654cdf" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:06.200251 28080 raft_consensus.cc:3060] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:06.194485 28048 leader_election.cc:336] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
W20260709 13:22:06.226194 28196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 71902us
I20260709 13:22:06.212814 28822 raft_consensus.cc:493] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:06.244446 28822 raft_consensus.cc:515] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
W20260709 13:22:06.249450 28048 leader_election.cc:336] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:06.252535 28077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f95034322d746e4aaf06b06873de375" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:22:06.251497 28822 leader_election.cc:290] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:06.253249 28077 raft_consensus.cc:2468] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:22:06.255893 28123 leader_election.cc:304] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:06.257050 28822 raft_consensus.cc:2804] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:06.253847 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.129:33695
I20260709 13:22:06.258049 28941 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.129:33695 every 8 connection(s)
I20260709 13:22:06.258270 28080 raft_consensus.cc:2468] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 2.
I20260709 13:22:06.261377 28822 raft_consensus.cc:493] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:06.262671 28822 raft_consensus.cc:3060] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.263576 28123 leader_election.cc:304] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:06.267364 28905 raft_consensus.cc:2804] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:06.267937 28905 raft_consensus.cc:697] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:22:06.269466 28905 consensus_queue.cc:237] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.277114 28819 raft_consensus.cc:493] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:06.277842 28819 raft_consensus.cc:515] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:06.277048 27904 catalog_manager.cc:5697] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 1 to 2, leader changed from 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129) to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:06.280208 28819 leader_election.cc:290] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:06.280092 27904 catalog_manager.cc:5697] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 1 to 2, leader changed from 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129) to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:06.282027 28077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90c9f452bac4ef0b959ca0e78ab475f" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651" is_pre_election: true
I20260709 13:22:06.281709 27904 catalog_manager.cc:5697] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 reported cstate change: term changed from 1 to 2, leader changed from 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129) to d80a443d06244116ae813b77fc539651 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "d80a443d06244116ae813b77fc539651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:06.282665 28077 raft_consensus.cc:2468] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 1.
I20260709 13:22:06.284142 28197 leader_election.cc:304] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:06.285605 28819 raft_consensus.cc:2804] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:06.286185 28819 raft_consensus.cc:493] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:06.286667 28819 raft_consensus.cc:3060] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.288132 27905 catalog_manager.cc:5697] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 1 to 2, leader changed from 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129) to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 2 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:06.290537 27905 catalog_manager.cc:5697] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 1 to 2, leader changed from 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129) to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 2 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:06.300160 28819 raft_consensus.cc:515] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:06.303862 28819 leader_election.cc:290] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:06.304841 28077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90c9f452bac4ef0b959ca0e78ab475f" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:06.305454 28077 raft_consensus.cc:3060] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:06.309835 28848 log.cc:927] Time spent T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28: Append to log took a long time: real 0.054s	user 0.000s	sys 0.002s
I20260709 13:22:06.311998 28848 tablet_bootstrap.cc:492] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.326912 28848 tablet_bootstrap.cc:492] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:06.328310 28848 ts_tablet_manager.cc:1403] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.258s	user 0.015s	sys 0.010s
I20260709 13:22:06.336274 28822 raft_consensus.cc:515] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.340324 28848 raft_consensus.cc:359] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:06.341580 28848 raft_consensus.cc:740] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.341073 28081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f95034322d746e4aaf06b06873de375" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:06.349220 28081 raft_consensus.cc:3060] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.358642 28848 consensus_queue.cc:260] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:06.363363 28077 raft_consensus.cc:2468] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 2.
I20260709 13:22:06.366920 28896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f95034322d746e4aaf06b06873de375" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:22:06.367805 28896 raft_consensus.cc:2468] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 1.
I20260709 13:22:06.373764 28897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f95034322d746e4aaf06b06873de375" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:22:06.374514 28897 raft_consensus.cc:3060] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.378033 28197 leader_election.cc:304] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:06.378919 28828 raft_consensus.cc:2804] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:06.379622 28828 raft_consensus.cc:697] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:06.384003 28848 ts_tablet_manager.cc:1434] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.055s	user 0.003s	sys 0.005s
I20260709 13:22:06.385322 28848 tablet_bootstrap.cc:492] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:06.376953 28081 raft_consensus.cc:2468] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 2.
I20260709 13:22:06.387212 28123 leader_election.cc:304] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:06.387909 28905 raft_consensus.cc:2804] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:06.388620 28905 raft_consensus.cc:697] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:22:06.380883 28828 consensus_queue.cc:237] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:06.389514 28905 consensus_queue.cc:237] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.395473 27904 catalog_manager.cc:5697] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b reported cstate change: term changed from 1 to 2, leader changed from 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129) to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 2 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:06.364303 28822 leader_election.cc:290] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 election: Requested vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:06.419530 28943 heartbeater.cc:344] Connected to a master server at 127.17.251.190:33451
I20260709 13:22:06.419979 28943 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:06.419296 27905 catalog_manager.cc:5697] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 1 to 2, leader changed from 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129) to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 2 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:06.420912 28943 heartbeater.cc:507] Master 127.17.251.190:33451 requested a full tablet report, sending...
I20260709 13:22:06.430817 28897 raft_consensus.cc:2468] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 2.
I20260709 13:22:06.447047 28848 tablet_bootstrap.cc:492] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.448177 28848 tablet_bootstrap.cc:492] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:06.448922 28848 ts_tablet_manager.cc:1403] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.006s
I20260709 13:22:06.453089 28896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90c9f452bac4ef0b959ca0e78ab475f" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28" is_pre_election: true
I20260709 13:22:06.451645 28848 raft_consensus.cc:359] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:06.453466 28893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90c9f452bac4ef0b959ca0e78ab475f" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
I20260709 13:22:06.454553 28848 raft_consensus.cc:740] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.455668 28848 consensus_queue.cc:260] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:06.449927 27905 ts_manager.cc:194] Re-registered known tserver with Master: 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
W20260709 13:22:06.458882 28196 leader_election.cc:343] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:06.461189 28196 leader_election.cc:343] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:06.464296 28158 raft_consensus.cc:1275] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Refusing update from remote peer d80a443d06244116ae813b77fc539651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:06.471315 28824 consensus_queue.cc:1048] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:06.490403 27904 catalog_manager.cc:5697] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b reported cstate change: term changed from 1 to 2, leader changed from 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129) to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 2 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:06.500223 28848 ts_tablet_manager.cc:1434] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.051s	user 0.018s	sys 0.016s
I20260709 13:22:06.501528 28848 tablet_bootstrap.cc:492] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
W20260709 13:22:06.509485 28048 consensus_peers.cc:597] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:06.517078 28158 raft_consensus.cc:1275] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Refusing update from remote peer d80a443d06244116ae813b77fc539651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:06.519225 28611 consensus_queue.cc:1048] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:06.531195 28048 consensus_peers.cc:597] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:06.533587 28848 tablet_bootstrap.cc:492] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.535112 28848 tablet_bootstrap.cc:492] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:06.536000 28848 ts_tablet_manager.cc:1403] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.007s
I20260709 13:22:06.539332 28848 raft_consensus.cc:359] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:06.540020 28848 raft_consensus.cc:740] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.541858 28848 consensus_queue.cc:260] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:06.544127 28848 ts_tablet_manager.cc:1434] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:06.544943 28848 tablet_bootstrap.cc:492] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:06.549759 28158 raft_consensus.cc:1275] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Refusing update from remote peer d80a443d06244116ae813b77fc539651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:06.551502 28849 consensus_queue.cc:1048] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:06.574672 28848 tablet_bootstrap.cc:492] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.575634 28848 tablet_bootstrap.cc:492] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:06.576279 28848 ts_tablet_manager.cc:1403] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.004s
I20260709 13:22:06.580435 28848 raft_consensus.cc:359] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.580881 28154 raft_consensus.cc:1275] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Refusing update from remote peer 2e2f737d674147808bb32783de176848: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:06.581174 28848 raft_consensus.cc:740] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.582130 28848 consensus_queue.cc:260] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.582934 28598 consensus_queue.cc:1048] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:06.584478 28848 ts_tablet_manager.cc:1434] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:06.585386 28848 tablet_bootstrap.cc:492] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
W20260709 13:22:06.585716 28048 consensus_peers.cc:597] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:06.590361 28157 raft_consensus.cc:1275] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Refusing update from remote peer 2e2f737d674147808bb32783de176848: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:06.590646 27905 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52376
I20260709 13:22:06.592087 28598 consensus_queue.cc:1048] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:06.597759 28943 heartbeater.cc:499] Master 127.17.251.190:33451 was elected leader, sending a full tablet report...
I20260709 13:22:06.607182 28848 tablet_bootstrap.cc:492] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.608453 28848 tablet_bootstrap.cc:492] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:06.609438 28848 ts_tablet_manager.cc:1403] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.008s
I20260709 13:22:06.625465 28848 raft_consensus.cc:359] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:06.626344 28848 raft_consensus.cc:740] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.627102 28848 consensus_queue.cc:260] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:06.629238 28848 ts_tablet_manager.cc:1434] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:22:06.630164 28848 tablet_bootstrap.cc:492] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
W20260709 13:22:06.648556 28196 consensus_peers.cc:597] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:06.650305 28196 consensus_peers.cc:597] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:06.666620 28122 consensus_peers.cc:597] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:06.672762 28848 tablet_bootstrap.cc:492] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.673976 28848 tablet_bootstrap.cc:492] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:06.674726 28848 ts_tablet_manager.cc:1403] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.009s
I20260709 13:22:06.678406 28848 raft_consensus.cc:359] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:06.679203 28848 raft_consensus.cc:740] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.679998 28848 consensus_queue.cc:260] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:06.682217 28848 ts_tablet_manager.cc:1434] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:22:06.683022 28848 tablet_bootstrap.cc:492] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
W20260709 13:22:06.688431 28122 consensus_peers.cc:597] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:06.698508 28848 tablet_bootstrap.cc:492] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.699635 28848 tablet_bootstrap.cc:492] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:06.700314 28848 ts_tablet_manager.cc:1403] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:22:06.703047 28848 raft_consensus.cc:359] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.703707 28848 raft_consensus.cc:740] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.704335 28848 consensus_queue.cc:260] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.706369 28848 ts_tablet_manager.cc:1434] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:06.707067 28848 tablet_bootstrap.cc:492] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:06.707029 28231 raft_consensus.cc:1275] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Refusing update from remote peer afb0dc4e88ca4275975541dfe077b38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:06.708950 28905 consensus_queue.cc:1048] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:06.724740 28848 tablet_bootstrap.cc:492] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.725754 28848 tablet_bootstrap.cc:492] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:06.726296 28895 raft_consensus.cc:3060] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.726426 28848 ts_tablet_manager.cc:1403] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:22:06.729315 28848 raft_consensus.cc:359] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.729966 28848 raft_consensus.cc:740] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.730604 28848 consensus_queue.cc:260] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.733256 28848 ts_tablet_manager.cc:1434] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:06.734079 28848 tablet_bootstrap.cc:492] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:06.742584 28895 raft_consensus.cc:1275] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Refusing update from remote peer d80a443d06244116ae813b77fc539651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:06.744154 28824 consensus_queue.cc:1048] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:06.758670 28848 tablet_bootstrap.cc:492] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.759665 28848 tablet_bootstrap.cc:492] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:06.760362 28848 ts_tablet_manager.cc:1403] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.007s
I20260709 13:22:06.762907 28848 raft_consensus.cc:359] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:06.763566 28848 raft_consensus.cc:740] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.764398 28848 consensus_queue.cc:260] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:06.767074 28154 raft_consensus.cc:1275] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Refusing update from remote peer d80a443d06244116ae813b77fc539651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:06.768849 28919 consensus_queue.cc:1048] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:06.769109 28848 ts_tablet_manager.cc:1434] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:06.770066 28848 tablet_bootstrap.cc:492] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:06.787904 28848 tablet_bootstrap.cc:492] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.788964 28848 tablet_bootstrap.cc:492] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:06.789700 28848 ts_tablet_manager.cc:1403] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:22:06.792361 28848 raft_consensus.cc:359] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:06.793100 28848 raft_consensus.cc:740] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.793967 28848 consensus_queue.cc:260] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:06.796118 28848 ts_tablet_manager.cc:1434] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:22:06.796693 28848 tablet_bootstrap.cc:492] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:06.802985 28081 raft_consensus.cc:1275] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Refusing update from remote peer 2e2f737d674147808bb32783de176848: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:06.805029 28598 consensus_queue.cc:1048] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:06.811825 28080 raft_consensus.cc:1275] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Refusing update from remote peer afb0dc4e88ca4275975541dfe077b38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:06.815320 28904 consensus_queue.cc:1048] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:06.819681 28848 tablet_bootstrap.cc:492] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.820732 28848 tablet_bootstrap.cc:492] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:06.821419 28848 ts_tablet_manager.cc:1403] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.003s
I20260709 13:22:06.824164 28848 raft_consensus.cc:359] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:06.824869 28848 raft_consensus.cc:740] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.825590 28848 consensus_queue.cc:260] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:06.827548 28848 ts_tablet_manager.cc:1434] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:22:06.828410 28848 tablet_bootstrap.cc:492] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:06.849781 28897 raft_consensus.cc:3060] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.863765 28081 raft_consensus.cc:1275] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Refusing update from remote peer afb0dc4e88ca4275975541dfe077b38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:06.865523 28905 consensus_queue.cc:1048] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:06.917987 28895 raft_consensus.cc:1275] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Refusing update from remote peer afb0dc4e88ca4275975541dfe077b38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:06.930589 28822 consensus_queue.cc:1048] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:06.944367 28848 tablet_bootstrap.cc:492] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.945470 28848 tablet_bootstrap.cc:492] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:06.946295 28848 ts_tablet_manager.cc:1403] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.118s	user 0.045s	sys 0.066s
I20260709 13:22:06.948698 28848 raft_consensus.cc:359] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.949429 28848 raft_consensus.cc:740] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.950299 28848 consensus_queue.cc:260] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:06.954937 28848 ts_tablet_manager.cc:1434] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:22:06.956071 28848 tablet_bootstrap.cc:492] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:06.945143 28897 raft_consensus.cc:1275] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Refusing update from remote peer 2e2f737d674147808bb32783de176848: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:06.977547 28819 consensus_queue.cc:1048] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:06.987888 28848 tablet_bootstrap.cc:492] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.988854 28848 tablet_bootstrap.cc:492] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:06.989591 28848 ts_tablet_manager.cc:1403] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.009s
I20260709 13:22:06.992614 28848 raft_consensus.cc:359] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:06.993242 28848 raft_consensus.cc:740] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.994040 28848 consensus_queue.cc:260] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:06.996240 28848 ts_tablet_manager.cc:1434] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:22:06.997161 28848 tablet_bootstrap.cc:492] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:07.026232 28848 tablet_bootstrap.cc:492] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:07.027215 28848 tablet_bootstrap.cc:492] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:07.027884 28848 ts_tablet_manager.cc:1403] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.007s
I20260709 13:22:07.030407 28848 raft_consensus.cc:359] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:07.031095 28848 raft_consensus.cc:740] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.031903 28848 consensus_queue.cc:260] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:07.034312 28848 ts_tablet_manager.cc:1434] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:22:07.035116 28848 tablet_bootstrap.cc:492] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:07.055313 28848 tablet_bootstrap.cc:492] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:07.056399 28848 tablet_bootstrap.cc:492] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:07.057266 28848 ts_tablet_manager.cc:1403] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.011s
I20260709 13:22:07.060012 28848 raft_consensus.cc:359] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:07.060808 28848 raft_consensus.cc:740] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.061637 28848 consensus_queue.cc:260] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:07.063937 28848 ts_tablet_manager.cc:1434] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:07.064846 28848 tablet_bootstrap.cc:492] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:07.135637 28893 raft_consensus.cc:3060] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:07.170588 28122 consensus_peers.cc:597] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:07.196158 28047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:36151, user_credentials={real_user=slave}} blocked reactor thread for 73759.6us
I20260709 13:22:07.208362 28895 raft_consensus.cc:3060] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:07.219732 28848 tablet_bootstrap.cc:492] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:07.220853 28848 tablet_bootstrap.cc:492] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:07.221551 28848 ts_tablet_manager.cc:1403] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.157s	user 0.057s	sys 0.044s
I20260709 13:22:07.228539 28848 raft_consensus.cc:359] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:07.229246 28848 raft_consensus.cc:740] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.230008 28848 consensus_queue.cc:260] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:07.233803 28848 ts_tablet_manager.cc:1434] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:22:07.235971 28848 tablet_bootstrap.cc:492] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
W20260709 13:22:07.262209 28122 consensus_peers.cc:597] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:07.265508 28848 tablet_bootstrap.cc:492] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:07.266628 28848 tablet_bootstrap.cc:492] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:07.267289 28848 ts_tablet_manager.cc:1403] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.007s
I20260709 13:22:07.269870 28848 raft_consensus.cc:359] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:07.270529 28848 raft_consensus.cc:740] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.271152 28848 consensus_queue.cc:260] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:07.273260 28848 ts_tablet_manager.cc:1434] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:22:07.274753 28848 tablet_bootstrap.cc:492] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:07.296571 28848 tablet_bootstrap.cc:492] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:07.297662 28848 tablet_bootstrap.cc:492] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:07.298935 28848 ts_tablet_manager.cc:1403] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.004s
I20260709 13:22:07.301537 28848 raft_consensus.cc:359] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:07.302263 28848 raft_consensus.cc:740] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.302965 28848 consensus_queue.cc:260] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:07.305282 28848 ts_tablet_manager.cc:1434] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:07.306950 28848 tablet_bootstrap.cc:492] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:07.321244 28848 tablet_bootstrap.cc:492] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:07.322268 28848 tablet_bootstrap.cc:492] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
W20260709 13:22:07.322464 28196 consensus_peers.cc:597] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:07.322965 28848 ts_tablet_manager.cc:1403] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:22:07.325531 28848 raft_consensus.cc:359] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:07.326319 28848 raft_consensus.cc:740] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.327000 28848 consensus_queue.cc:260] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:07.329346 28848 ts_tablet_manager.cc:1434] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:22:07.330168 28848 tablet_bootstrap.cc:492] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
W20260709 13:22:07.333490 28048 consensus_peers.cc:597] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:07.345863 28848 tablet_bootstrap.cc:492] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:07.346748 28848 tablet_bootstrap.cc:492] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:07.347425 28848 ts_tablet_manager.cc:1403] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 13:22:07.349776 28848 raft_consensus.cc:359] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:07.350425 28848 raft_consensus.cc:740] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.351094 28848 consensus_queue.cc:260] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:07.354665 28848 ts_tablet_manager.cc:1434] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:22:07.355535 28848 tablet_bootstrap.cc:492] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:07.372177 28848 tablet_bootstrap.cc:492] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:07.373116 28848 tablet_bootstrap.cc:492] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:07.373803 28848 ts_tablet_manager.cc:1403] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.001s
I20260709 13:22:07.376159 28848 raft_consensus.cc:359] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:07.376823 28848 raft_consensus.cc:740] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.377496 28848 consensus_queue.cc:260] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:07.379388 28848 ts_tablet_manager.cc:1434] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:07.380407 28848 tablet_bootstrap.cc:492] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
W20260709 13:22:07.393208 28196 consensus_peers.cc:597] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:07.399312 28848 tablet_bootstrap.cc:492] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:07.400334 28848 tablet_bootstrap.cc:492] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:07.401010 28848 ts_tablet_manager.cc:1403] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.000s
I20260709 13:22:07.403818 28848 raft_consensus.cc:359] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:07.404511 28848 raft_consensus.cc:740] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.405203 28848 consensus_queue.cc:260] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:07.407051 28848 ts_tablet_manager.cc:1434] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 13:22:07.408403 28848 tablet_bootstrap.cc:492] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:07.439925 28848 tablet_bootstrap.cc:492] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:07.440990 28848 tablet_bootstrap.cc:492] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:07.442124 28848 ts_tablet_manager.cc:1403] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.034s	user 0.028s	sys 0.004s
W20260709 13:22:07.444239 28048 consensus_peers.cc:597] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:07.444880 28848 raft_consensus.cc:359] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:07.445719 28848 raft_consensus.cc:740] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.446386 28848 consensus_queue.cc:260] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:07.448053 28848 ts_tablet_manager.cc:1434] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:22:07.449067 28848 tablet_bootstrap.cc:492] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:07.463188 28848 tablet_bootstrap.cc:492] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:07.463994 28848 tablet_bootstrap.cc:492] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:07.464691 28848 ts_tablet_manager.cc:1403] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:22:07.467517 28848 raft_consensus.cc:359] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:07.468086 28848 raft_consensus.cc:740] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.468667 28848 consensus_queue.cc:260] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:07.470118 28848 ts_tablet_manager.cc:1434] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:22:07.471154 28848 tablet_bootstrap.cc:492] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:07.498080 28895 raft_consensus.cc:3060] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:07.518733 28848 tablet_bootstrap.cc:492] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:07.519773 28848 tablet_bootstrap.cc:492] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:07.520517 28848 ts_tablet_manager.cc:1403] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.027s
I20260709 13:22:07.524127 28848 raft_consensus.cc:359] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:07.524842 28848 raft_consensus.cc:740] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.525585 28848 consensus_queue.cc:260] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:07.528224 28848 ts_tablet_manager.cc:1434] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:22:07.529142 28848 tablet_bootstrap.cc:492] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:07.542309 28848 tablet_bootstrap.cc:492] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:07.543190 28848 tablet_bootstrap.cc:492] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:07.543758 28848 ts_tablet_manager.cc:1403] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:22:07.545739 28848 raft_consensus.cc:359] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:07.546375 28848 raft_consensus.cc:740] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.546902 28848 consensus_queue.cc:260] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:07.548936 28848 ts_tablet_manager.cc:1434] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:07.550228 28848 tablet_bootstrap.cc:492] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:07.565838 28848 tablet_bootstrap.cc:492] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:07.566617 28848 tablet_bootstrap.cc:492] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:07.567276 28848 ts_tablet_manager.cc:1403] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:22:07.569519 28848 raft_consensus.cc:359] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:07.570142 28848 raft_consensus.cc:740] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.570664 28848 consensus_queue.cc:260] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:07.572075 28848 ts_tablet_manager.cc:1434] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:07.573093 28848 tablet_bootstrap.cc:492] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:07.585562 28848 tablet_bootstrap.cc:492] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:07.586519 28848 tablet_bootstrap.cc:492] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:07.587080 28848 ts_tablet_manager.cc:1403] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:22:07.589171 28848 raft_consensus.cc:359] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:07.589718 28848 raft_consensus.cc:740] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.590234 28848 consensus_queue.cc:260] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:07.591857 28848 ts_tablet_manager.cc:1434] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:07.592772 28848 tablet_bootstrap.cc:492] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap starting.
I20260709 13:22:07.613538 28848 tablet_bootstrap.cc:492] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:07.614637 28848 tablet_bootstrap.cc:492] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28: Bootstrap complete.
I20260709 13:22:07.615216 28848 ts_tablet_manager.cc:1403] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 13:22:07.619272 28848 raft_consensus.cc:359] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:07.619944 28848 raft_consensus.cc:740] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.620662 28848 consensus_queue.cc:260] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:07.623127 28848 ts_tablet_manager.cc:1434] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:07.623732 28895 raft_consensus.cc:3060] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:07.680609 28896 raft_consensus.cc:3060] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:07.723417 28896 raft_consensus.cc:3060] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:07.907985 28896 raft_consensus.cc:3060] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:08.887040 28047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.132:36151, user_credentials={real_user=slave}} blocked reactor thread for 137399us
W20260709 13:22:09.123687 28123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:43901, user_credentials={real_user=slave}} blocked reactor thread for 59254.2us
W20260709 13:22:09.940053 27938 debug-util.cc:398] Leaking SignalData structure 0x7b08003542e0 after lost signal to thread 18417
W20260709 13:22:09.941095 27938 debug-util.cc:398] Leaking SignalData structure 0x7b08003b6560 after lost signal to thread 27941
W20260709 13:22:09.942219 27938 debug-util.cc:398] Leaking SignalData structure 0x7b0800231f40 after lost signal to thread 28108
W20260709 13:22:09.943133 27938 debug-util.cc:398] Leaking SignalData structure 0x7b08002e10c0 after lost signal to thread 28182
W20260709 13:22:09.944048 27938 debug-util.cc:398] Leaking SignalData structure 0x7b08003506a0 after lost signal to thread 28256
W20260709 13:22:09.945087 27938 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa3a0 after lost signal to thread 28941
W20260709 13:22:11.597456 28122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 175928us
I20260709 13:22:16.321539 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:16.383628 28157 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f95034322d746e4aaf06b06873de375"
dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
mode: GRACEFUL
new_leader_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:22:16.384361 28157 raft_consensus.cc:606] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Received request to transfer leadership to TS 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:16.396365 28226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "115ec4e7eaff44c191ebb3618716383c"
dest_uuid: "2e2f737d674147808bb32783de176848"
mode: GRACEFUL
new_leader_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:47822
I20260709 13:22:16.396845 28226 raft_consensus.cc:606] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Received request to transfer leadership to TS 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:16.399250 28226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17389976f8e346dbb2fbc326a9e60396"
dest_uuid: "2e2f737d674147808bb32783de176848"
mode: GRACEFUL
new_leader_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:47822
I20260709 13:22:16.399662 28226 raft_consensus.cc:606] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Received request to transfer leadership to TS 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:16.401942 28226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f7df1c61b2348668e7022bfc34d7886"
dest_uuid: "2e2f737d674147808bb32783de176848"
mode: GRACEFUL
new_leader_uuid: "afb0dc4e88ca4275975541dfe077b38b"
 from {username='slave'} at 127.0.0.1:47822
I20260709 13:22:16.402355 28226 raft_consensus.cc:606] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Received request to transfer leadership to TS afb0dc4e88ca4275975541dfe077b38b
I20260709 13:22:16.404795 28226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "755b1458334b47b2ae9a71fb44952d95"
dest_uuid: "2e2f737d674147808bb32783de176848"
mode: GRACEFUL
new_leader_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:47822
I20260709 13:22:16.405318 28226 raft_consensus.cc:606] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Received request to transfer leadership to TS 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:16.408833 28230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a685a97179a94ca299d31636b789c516"
dest_uuid: "2e2f737d674147808bb32783de176848"
mode: GRACEFUL
new_leader_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:47822
I20260709 13:22:16.409329 28230 raft_consensus.cc:606] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Received request to transfer leadership to TS 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:16.421758 28083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed7ccef5723d4614918b18c47b9dfa3a"
dest_uuid: "d80a443d06244116ae813b77fc539651"
mode: GRACEFUL
new_leader_uuid: "2e2f737d674147808bb32783de176848"
 from {username='slave'} at 127.0.0.1:44484
I20260709 13:22:16.422353 28083 raft_consensus.cc:606] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Received request to transfer leadership to TS 2e2f737d674147808bb32783de176848
I20260709 13:22:16.423607 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:22:16.425385 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:16.453661 29053 raft_consensus.cc:993] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848: : Instructing follower afb0dc4e88ca4275975541dfe077b38b to start an election
I20260709 13:22:16.454322 29055 raft_consensus.cc:1081] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Signalling peer afb0dc4e88ca4275975541dfe077b38b to start an election
I20260709 13:22:16.455910 28157 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f7df1c61b2348668e7022bfc34d7886"
dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
 from {username='slave'} at 127.0.0.1:51310
I20260709 13:22:16.456516 28157 raft_consensus.cc:493] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:16.456908 28157 raft_consensus.cc:3060] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.464923 28157 raft_consensus.cc:515] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:16.467121 28157 leader_election.cc:290] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:22:16.468128 28230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7df1c61b2348668e7022bfc34d7886" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:22:16.468040 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7df1c61b2348668e7022bfc34d7886" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:16.468945 28230 raft_consensus.cc:3055] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:16.469004 28082 raft_consensus.cc:3060] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.469420 28230 raft_consensus.cc:740] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:16.470284 28230 consensus_queue.cc:260] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:16.471457 28230 raft_consensus.cc:3060] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.476190 28082 raft_consensus.cc:2468] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 2.
I20260709 13:22:16.478215 28123 leader_election.cc:304] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:16.479214 28831 raft_consensus.cc:2804] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:16.479261 28230 raft_consensus.cc:2468] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 2.
I20260709 13:22:16.479698 28831 raft_consensus.cc:697] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:22:16.480650 28831 consensus_queue.cc:237] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:16.493603 29055 raft_consensus.cc:993] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848: : Instructing follower 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:16.494191 29055 raft_consensus.cc:1081] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Signalling peer 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:16.496179 28897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a685a97179a94ca299d31636b789c516"
dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:53094
I20260709 13:22:16.496778 28897 raft_consensus.cc:493] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:16.497109 28897 raft_consensus.cc:3060] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.497605 27905 catalog_manager.cc:5697] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b reported cstate change: term changed from 1 to 2, leader changed from 2e2f737d674147808bb32783de176848 (127.17.251.132) to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 2 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.504923 28897 raft_consensus.cc:515] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:16.526171 28230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a685a97179a94ca299d31636b789c516" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:22:16.526990 28230 raft_consensus.cc:3055] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:16.527345 28230 raft_consensus.cc:740] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:16.530262 28897 leader_election.cc:290] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:16.528556 28230 consensus_queue.cc:260] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:16.534938 28230 raft_consensus.cc:3060] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.546500 29047 raft_consensus.cc:993] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b: : Instructing follower 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:16.547055 29047 raft_consensus.cc:1081] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Signalling peer 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:16.549072 28897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f95034322d746e4aaf06b06873de375"
dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:53078
I20260709 13:22:16.549610 28897 raft_consensus.cc:493] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:16.549960 28897 raft_consensus.cc:3060] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:16.558187 28897 raft_consensus.cc:515] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:16.561033 28897 leader_election.cc:290] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 3 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:16.570235 28230 raft_consensus.cc:2468] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:16.572202 28842 leader_election.cc:304] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28; no voters: 
I20260709 13:22:16.575278 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a685a97179a94ca299d31636b789c516" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:16.575977 28083 raft_consensus.cc:3060] T a685a97179a94ca299d31636b789c516 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.589882 29049 raft_consensus.cc:993] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651: : Instructing follower 2e2f737d674147808bb32783de176848 to start an election
I20260709 13:22:16.590503 29049 raft_consensus.cc:1081] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Signalling peer 2e2f737d674147808bb32783de176848 to start an election
I20260709 13:22:16.590638 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f95034322d746e4aaf06b06873de375" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:16.591323 28082 raft_consensus.cc:3060] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:16.592952 29072 raft_consensus.cc:2804] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:16.595635 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f95034322d746e4aaf06b06873de375" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:16.596977 28155 raft_consensus.cc:3055] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:16.599304 28155 raft_consensus.cc:740] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:22:16.600209 28155 consensus_queue.cc:260] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:16.601541 28155 raft_consensus.cc:3060] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:16.604048 29072 raft_consensus.cc:697] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:22:16.604303 28082 raft_consensus.cc:2468] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 3.
I20260709 13:22:16.605243 29072 consensus_queue.cc:237] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:16.609359 28155 raft_consensus.cc:2468] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 3.
I20260709 13:22:16.610460 28230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed7ccef5723d4614918b18c47b9dfa3a"
dest_uuid: "2e2f737d674147808bb32783de176848"
 from {username='slave'} at 127.0.0.1:42322
I20260709 13:22:16.611174 28230 raft_consensus.cc:493] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:16.611737 28230 raft_consensus.cc:3060] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.611539 28844 leader_election.cc:304] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:16.610597 28083 raft_consensus.cc:2468] T a685a97179a94ca299d31636b789c516 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:16.619130 28230 raft_consensus.cc:515] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:16.621361 29073 raft_consensus.cc:2804] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:16.622076 28230 leader_election.cc:290] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:16.627103 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7ccef5723d4614918b18c47b9dfa3a" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:16.627677 28155 raft_consensus.cc:3060] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.636953 28155 raft_consensus.cc:2468] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 2.
I20260709 13:22:16.636741 27905 catalog_manager.cc:5697] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 1 to 2, leader changed from 2e2f737d674147808bb32783de176848 (127.17.251.132) to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.639022 28198 leader_election.cc:304] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:22:16.640599 29053 raft_consensus.cc:2804] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:16.641322 29053 raft_consensus.cc:697] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:16.649772 29053 consensus_queue.cc:237] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:16.666388 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7ccef5723d4614918b18c47b9dfa3a" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:16.667372 28083 raft_consensus.cc:3055] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:16.667765 28083 raft_consensus.cc:740] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:22:16.669312 28083 consensus_queue.cc:260] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:16.672456 28083 raft_consensus.cc:3060] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.691394 29073 raft_consensus.cc:697] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 3 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:22:16.693154 29073 consensus_queue.cc:237] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:16.699177 28083 raft_consensus.cc:2468] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 2.
I20260709 13:22:16.700898 29076 raft_consensus.cc:993] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848: : Instructing follower 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:16.701411 29076 raft_consensus.cc:1081] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Signalling peer 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:16.704406 29078 raft_consensus.cc:993] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848: : Instructing follower 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:16.705044 29076 raft_consensus.cc:1081] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Signalling peer 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:16.708482 28896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "115ec4e7eaff44c191ebb3618716383c"
dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:53094
I20260709 13:22:16.708469 28897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17389976f8e346dbb2fbc326a9e60396"
dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:53094
I20260709 13:22:16.709208 28896 raft_consensus.cc:493] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:16.709434 28897 raft_consensus.cc:493] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:16.709949 28897 raft_consensus.cc:3060] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:16.709668 28896 raft_consensus.cc:3060] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.721961 28896 raft_consensus.cc:515] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:16.724865 28226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115ec4e7eaff44c191ebb3618716383c" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:22:16.725458 28226 raft_consensus.cc:3055] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:16.725771 28226 raft_consensus.cc:740] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:16.726495 28226 consensus_queue.cc:260] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:16.727679 28226 raft_consensus.cc:3060] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.729995 28897 raft_consensus.cc:515] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:16.732190 27905 catalog_manager.cc:5697] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 1 to 2, leader changed from d80a443d06244116ae813b77fc539651 (127.17.251.130) to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 2 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:16.734191 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17389976f8e346dbb2fbc326a9e60396" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:16.734688 28897 leader_election.cc:290] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 3 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:22:16.734880 28155 raft_consensus.cc:3060] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:16.736605 28230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17389976f8e346dbb2fbc326a9e60396" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:22:16.737181 28230 raft_consensus.cc:3055] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:16.737504 28230 raft_consensus.cc:740] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:16.741488 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115ec4e7eaff44c191ebb3618716383c" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:16.742240 28082 raft_consensus.cc:3060] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.739246 28896 leader_election.cc:290] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:16.742908 28155 raft_consensus.cc:2468] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 3.
I20260709 13:22:16.742946 27904 catalog_manager.cc:5697] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 2 to 3, leader changed from afb0dc4e88ca4275975541dfe077b38b (127.17.251.131) to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 3 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.744222 28845 leader_election.cc:304] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:22:16.745118 29073 raft_consensus.cc:2804] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:16.745667 29073 raft_consensus.cc:697] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 3 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:22:16.746582 29073 consensus_queue.cc:237] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:16.745123 29080 raft_consensus.cc:993] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848: : Instructing follower 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:16.750648 29080 raft_consensus.cc:1081] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Signalling peer 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:16.750438 28230 consensus_queue.cc:260] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:16.752826 28896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "755b1458334b47b2ae9a71fb44952d95"
dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:53094
I20260709 13:22:16.753463 28896 raft_consensus.cc:493] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:16.753963 28896 raft_consensus.cc:3060] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.766563 28230 raft_consensus.cc:3060] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:16.775117 28082 raft_consensus.cc:2468] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:16.776670 28844 leader_election.cc:304] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:16.776701 28226 raft_consensus.cc:2468] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:16.778466 29073 raft_consensus.cc:2804] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:16.779044 29073 raft_consensus.cc:697] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:22:16.779358 28896 raft_consensus.cc:515] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:16.780157 28230 raft_consensus.cc:2468] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 3.
I20260709 13:22:16.780046 29073 consensus_queue.cc:237] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:16.782068 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755b1458334b47b2ae9a71fb44952d95" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:16.782713 28155 raft_consensus.cc:3060] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.789050 27905 catalog_manager.cc:5697] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 2 to 3, leader changed from 2e2f737d674147808bb32783de176848 (127.17.251.132) to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 3 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:16.795295 28155 raft_consensus.cc:2468] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:16.797545 28230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755b1458334b47b2ae9a71fb44952d95" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:22:16.796818 28896 leader_election.cc:290] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:22:16.798197 28230 raft_consensus.cc:3055] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:16.798520 28230 raft_consensus.cc:740] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:16.799450 28151 raft_consensus.cc:1240] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Rejecting Update request from peer 2e2f737d674147808bb32783de176848 for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:16.799391 28230 consensus_queue.cc:260] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:16.800545 28230 raft_consensus.cc:3060] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.800455 28845 leader_election.cc:304] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:22:16.808889 28230 raft_consensus.cc:2468] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:16.809487 29073 raft_consensus.cc:2804] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:16.811446 29073 raft_consensus.cc:697] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:22:16.812469 29073 consensus_queue.cc:237] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:16.812134 27905 catalog_manager.cc:5697] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 1 to 2, leader changed from 2e2f737d674147808bb32783de176848 (127.17.251.132) to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.838353 27905 catalog_manager.cc:5697] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 1 to 2, leader changed from 2e2f737d674147808bb32783de176848 (127.17.251.132) to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:16.928836 28082 raft_consensus.cc:1275] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Refusing update from remote peer afb0dc4e88ca4275975541dfe077b38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:16.930305 29063 consensus_queue.cc:1048] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:16.960184 28230 raft_consensus.cc:1275] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Refusing update from remote peer afb0dc4e88ca4275975541dfe077b38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:16.965665 29063 consensus_queue.cc:1048] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.026310 28083 raft_consensus.cc:1275] T a685a97179a94ca299d31636b789c516 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.027501 29073 consensus_queue.cc:1048] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.047219 28230 raft_consensus.cc:1275] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.048967 29072 consensus_queue.cc:1048] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:17.239813 28083 raft_consensus.cc:1275] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Refusing update from remote peer 2e2f737d674147808bb32783de176848: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.241205 29076 consensus_queue.cc:1048] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.250428 28155 raft_consensus.cc:1275] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Refusing update from remote peer 2e2f737d674147808bb32783de176848: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.251899 29078 consensus_queue.cc:1048] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.275323 28230 raft_consensus.cc:1275] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.276952 29072 consensus_queue.cc:1048] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.278235 28083 raft_consensus.cc:1275] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 3 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:17.279513 29072 consensus_queue.cc:1048] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:17.282928 28155 raft_consensus.cc:1275] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:17.284431 29072 consensus_queue.cc:1048] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:17.301015 28151 raft_consensus.cc:1275] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.303507 29072 consensus_queue.cc:1048] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.314965 28151 raft_consensus.cc:1275] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:17.317915 28226 raft_consensus.cc:1275] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:17.319854 29073 consensus_queue.cc:1048] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:17.327090 29073 consensus_queue.cc:1048] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:17.372155 28226 raft_consensus.cc:1275] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.374104 29099 consensus_queue.cc:1048] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.416270 28083 raft_consensus.cc:1275] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.423830 29073 consensus_queue.cc:1048] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.429705 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:17.507468 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:17.551192 28083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "027980aba9e546578394bd75f01ffba4"
dest_uuid: "d80a443d06244116ae813b77fc539651"
mode: GRACEFUL
new_leader_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:44484
I20260709 13:22:17.551815 28083 raft_consensus.cc:606] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Received request to transfer leadership to TS 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:17.554311 28226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44f20c0135d64866abcf710b9b331281"
dest_uuid: "2e2f737d674147808bb32783de176848"
mode: GRACEFUL
new_leader_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:47822
I20260709 13:22:17.554972 28226 raft_consensus.cc:606] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Received request to transfer leadership to TS 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:17.557683 28157 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f7df1c61b2348668e7022bfc34d7886"
dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
mode: GRACEFUL
new_leader_uuid: "2e2f737d674147808bb32783de176848"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:22:17.558266 28157 raft_consensus.cc:606] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Received request to transfer leadership to TS 2e2f737d674147808bb32783de176848
I20260709 13:22:17.560783 28226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8359246c5ff428e89f3b5c15a65aa98"
dest_uuid: "2e2f737d674147808bb32783de176848"
mode: GRACEFUL
new_leader_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:47822
I20260709 13:22:17.561364 28226 raft_consensus.cc:606] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Received request to transfer leadership to TS 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:17.564146 28155 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4edfd4e5ea7461eaa8917755dff8c60"
dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
mode: GRACEFUL
new_leader_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:22:17.564657 28155 raft_consensus.cc:606] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Received request to transfer leadership to TS 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:17.567117 28155 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d84d9e7845264be9b66bcd292aab7e1d"
dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
mode: GRACEFUL
new_leader_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:22:17.567575 28155 raft_consensus.cc:606] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Received request to transfer leadership to TS 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:17.568607 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:22:17.570415 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:17.645823 29078 raft_consensus.cc:993] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848: : Instructing follower 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:17.646421 29078 raft_consensus.cc:1081] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Signalling peer 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:17.647944 28896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44f20c0135d64866abcf710b9b331281"
dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:53094
I20260709 13:22:17.648391 28896 raft_consensus.cc:493] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:17.648690 28896 raft_consensus.cc:3060] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.654740 28896 raft_consensus.cc:515] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:17.656531 28896 leader_election.cc:290] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:17.657212 28228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f20c0135d64866abcf710b9b331281" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:22:17.657775 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f20c0135d64866abcf710b9b331281" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:17.658010 28228 raft_consensus.cc:3055] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:17.658388 28228 raft_consensus.cc:740] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:17.659206 28228 consensus_queue.cc:260] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:17.660553 28228 raft_consensus.cc:3060] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.662783 28083 raft_consensus.cc:3060] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.669152 28228 raft_consensus.cc:2468] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:17.670680 28842 leader_election.cc:304] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28; no voters: 
I20260709 13:22:17.671562 29072 raft_consensus.cc:2804] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:17.672070 29072 raft_consensus.cc:697] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:22:17.673010 29072 consensus_queue.cc:237] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:17.680598 28083 raft_consensus.cc:2468] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:17.688627 27905 catalog_manager.cc:5697] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 1 to 2, leader changed from 2e2f737d674147808bb32783de176848 (127.17.251.132) to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:17.696604 29078 raft_consensus.cc:993] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848: : Instructing follower 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:17.697129 29053 raft_consensus.cc:1081] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Signalling peer 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:17.698760 28896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8359246c5ff428e89f3b5c15a65aa98"
dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:53094
I20260709 13:22:17.699330 28896 raft_consensus.cc:493] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:17.699679 28896 raft_consensus.cc:3060] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:17.705791 28896 raft_consensus.cc:515] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:17.707590 28896 leader_election.cc:290] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 3 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:22:17.708642 28226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8359246c5ff428e89f3b5c15a65aa98" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:22:17.709115 28226 raft_consensus.cc:3055] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:17.709290 28226 raft_consensus.cc:740] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:17.709812 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8359246c5ff428e89f3b5c15a65aa98" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:17.710144 28226 consensus_queue.cc:260] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:17.710489 28155 raft_consensus.cc:3060] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:17.711201 28226 raft_consensus.cc:3060] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:17.717344 28155 raft_consensus.cc:2468] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 3.
I20260709 13:22:17.717993 28226 raft_consensus.cc:2468] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 3.
I20260709 13:22:17.719074 28842 leader_election.cc:304] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28; no voters: 
I20260709 13:22:17.719702 29072 raft_consensus.cc:2804] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:17.720146 29072 raft_consensus.cc:697] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 3 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:22:17.721024 29072 consensus_queue.cc:237] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:17.736769 27905 catalog_manager.cc:5697] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 2 to 3, leader changed from 2e2f737d674147808bb32783de176848 (127.17.251.132) to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 3 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:17.813952 29069 raft_consensus.cc:993] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651: : Instructing follower 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:17.814467 29069 raft_consensus.cc:1081] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Signalling peer 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:17.816138 28888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "027980aba9e546578394bd75f01ffba4"
dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:53088
I20260709 13:22:17.816715 28888 raft_consensus.cc:493] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:17.817138 28888 raft_consensus.cc:3060] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.824666 28888 raft_consensus.cc:515] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:17.826356 28888 leader_election.cc:290] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:17.827097 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "027980aba9e546578394bd75f01ffba4" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:17.827268 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "027980aba9e546578394bd75f01ffba4" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:17.827732 28083 raft_consensus.cc:3055] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:17.827831 28155 raft_consensus.cc:3060] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.827971 28083 raft_consensus.cc:740] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:22:17.828828 28083 consensus_queue.cc:260] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:17.830116 28083 raft_consensus.cc:3060] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.834007 28155 raft_consensus.cc:2468] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:17.835130 28845 leader_election.cc:304] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:22:17.835867 29072 raft_consensus.cc:2804] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:17.835968 28083 raft_consensus.cc:2468] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:17.836339 29072 raft_consensus.cc:697] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:22:17.837267 29072 consensus_queue.cc:237] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:17.847429 27905 catalog_manager.cc:5697] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 1 to 2, leader changed from d80a443d06244116ae813b77fc539651 (127.17.251.130) to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:17.853816 29063 raft_consensus.cc:993] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b: : Instructing follower 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:17.854350 29063 raft_consensus.cc:1081] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Signalling peer 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:17.855924 28888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4edfd4e5ea7461eaa8917755dff8c60"
dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:53078
I20260709 13:22:17.856508 28888 raft_consensus.cc:493] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:17.856858 28888 raft_consensus.cc:3060] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.863300 28888 raft_consensus.cc:515] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:17.865545 28888 leader_election.cc:290] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:22:17.865743 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4edfd4e5ea7461eaa8917755dff8c60" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:17.866274 28226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4edfd4e5ea7461eaa8917755dff8c60" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:22:17.866466 28155 raft_consensus.cc:3055] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:17.866873 28155 raft_consensus.cc:740] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:22:17.866869 28226 raft_consensus.cc:3060] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.867630 28155 consensus_queue.cc:260] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:17.868583 28155 raft_consensus.cc:3060] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.873765 28226 raft_consensus.cc:2468] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:17.876163 28842 leader_election.cc:304] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, 6b1d1aefe48e42119ca040c70045fe28; no voters: 
I20260709 13:22:17.877123 29072 raft_consensus.cc:2804] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:17.877648 28155 raft_consensus.cc:2468] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:17.877666 29072 raft_consensus.cc:697] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:22:17.878866 29072 consensus_queue.cc:237] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:17.892328 27905 catalog_manager.cc:5697] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 1 to 2, leader changed from afb0dc4e88ca4275975541dfe077b38b (127.17.251.131) to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:18.003410 29063 raft_consensus.cc:993] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b: : Instructing follower 2e2f737d674147808bb32783de176848 to start an election
I20260709 13:22:18.003892 29047 raft_consensus.cc:1081] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Signalling peer 2e2f737d674147808bb32783de176848 to start an election
I20260709 13:22:18.005556 28226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f7df1c61b2348668e7022bfc34d7886"
dest_uuid: "2e2f737d674147808bb32783de176848"
 from {username='slave'} at 127.0.0.1:42318
I20260709 13:22:18.006114 28226 raft_consensus.cc:493] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:18.006441 28226 raft_consensus.cc:3060] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:18.013797 28226 raft_consensus.cc:515] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:18.015728 28226 leader_election.cc:290] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:18.016803 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7df1c61b2348668e7022bfc34d7886" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:18.017457 28157 raft_consensus.cc:3055] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:18.017227 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7df1c61b2348668e7022bfc34d7886" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:18.017858 28157 raft_consensus.cc:740] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:22:18.018198 28082 raft_consensus.cc:3060] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:18.018620 28157 consensus_queue.cc:260] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:18.019892 28157 raft_consensus.cc:3060] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:18.025902 28082 raft_consensus.cc:2468] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 3.
I20260709 13:22:18.027283 28197 leader_election.cc:304] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:18.027997 29078 raft_consensus.cc:2804] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:18.028493 29078 raft_consensus.cc:697] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 3 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:18.027513 28157 raft_consensus.cc:2468] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 3.
I20260709 13:22:18.029189 29078 consensus_queue.cc:237] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:18.043848 27905 catalog_manager.cc:5697] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 2 to 3, leader changed from afb0dc4e88ca4275975541dfe077b38b (127.17.251.131) to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 3 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:18.045567 29047 raft_consensus.cc:993] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b: : Instructing follower 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:18.046147 29047 raft_consensus.cc:1081] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Signalling peer 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:18.047794 28897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d84d9e7845264be9b66bcd292aab7e1d"
dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:53078
I20260709 13:22:18.048332 28897 raft_consensus.cc:493] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:18.048693 28897 raft_consensus.cc:3060] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.055075 28897 raft_consensus.cc:515] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:18.057014 28897 leader_election.cc:290] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Requested vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:22:18.057159 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84d9e7845264be9b66bcd292aab7e1d" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:18.057969 28155 raft_consensus.cc:3055] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:18.058377 28155 raft_consensus.cc:740] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:22:18.059299 28155 consensus_queue.cc:260] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:18.057504 28228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84d9e7845264be9b66bcd292aab7e1d" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:22:18.060638 28155 raft_consensus.cc:3060] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.060918 28228 raft_consensus.cc:3060] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.068398 28155 raft_consensus.cc:2468] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:18.068398 28228 raft_consensus.cc:2468] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:18.069813 28845 leader_election.cc:304] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:22:18.070562 29073 raft_consensus.cc:2804] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:18.070966 29073 raft_consensus.cc:697] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:22:18.071656 29073 consensus_queue.cc:237] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:18.080951 27905 catalog_manager.cc:5697] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 1 to 2, leader changed from afb0dc4e88ca4275975541dfe077b38b (127.17.251.131) to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:18.103758 28228 raft_consensus.cc:1275] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.104919 29073 consensus_queue.cc:1048] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.118382 28226 raft_consensus.cc:1275] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:18.120950 29075 consensus_queue.cc:1048] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:18.125208 28082 raft_consensus.cc:1275] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.126644 29072 consensus_queue.cc:1048] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.133821 28155 raft_consensus.cc:1275] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:18.135216 29072 consensus_queue.cc:1048] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:22:18.225015 28122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:33695, user_credentials={real_user=slave}} blocked reactor thread for 55626.3us
I20260709 13:22:18.258702 28157 raft_consensus.cc:1275] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.260027 29099 consensus_queue.cc:1048] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.278345 28226 raft_consensus.cc:1275] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.279731 29072 consensus_queue.cc:1048] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.309134 28151 raft_consensus.cc:1275] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.310449 29072 consensus_queue.cc:1048] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.321789 28082 raft_consensus.cc:1275] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.323338 29073 consensus_queue.cc:1048] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.474292 28151 raft_consensus.cc:1275] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Refusing update from remote peer 2e2f737d674147808bb32783de176848: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:18.475670 29078 consensus_queue.cc:1048] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:18.488058 28082 raft_consensus.cc:1275] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [term 3 FOLLOWER]: Refusing update from remote peer 2e2f737d674147808bb32783de176848: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:18.489879 29121 consensus_queue.cc:1048] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:18.571552 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:18.610184 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:18.623775 28151 raft_consensus.cc:1275] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.625702 29073 consensus_queue.cc:1048] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:18.637302 28228 raft_consensus.cc:1275] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.639926 29075 consensus_queue.cc:1048] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.673933 28226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35b5e77de8ab4ce39569a347a84ed651"
dest_uuid: "2e2f737d674147808bb32783de176848"
mode: GRACEFUL
new_leader_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:47822
I20260709 13:22:18.674538 28226 raft_consensus.cc:606] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Received request to transfer leadership to TS 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:18.678331 28083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3758e0f5638b496dbea84f0014c5e6a5"
dest_uuid: "d80a443d06244116ae813b77fc539651"
mode: GRACEFUL
new_leader_uuid: "2e2f737d674147808bb32783de176848"
 from {username='slave'} at 127.0.0.1:44484
I20260709 13:22:18.679037 28083 raft_consensus.cc:606] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Received request to transfer leadership to TS 2e2f737d674147808bb32783de176848
I20260709 13:22:18.682888 28082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "896e12f9e1f649c19b7ba5bac1e051dd"
dest_uuid: "d80a443d06244116ae813b77fc539651"
mode: GRACEFUL
new_leader_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:44484
I20260709 13:22:18.683701 28082 raft_consensus.cc:606] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 2 LEADER]: Received request to transfer leadership to TS 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:18.688633 28083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "922beb15151e447cbbc0eaee6dc5266d"
dest_uuid: "d80a443d06244116ae813b77fc539651"
mode: GRACEFUL
new_leader_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:44484
I20260709 13:22:18.689320 28083 raft_consensus.cc:606] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Received request to transfer leadership to TS 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:18.690593 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:22:18.692694 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:18.703284 29058 raft_consensus.cc:993] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651: : Instructing follower 2e2f737d674147808bb32783de176848 to start an election
I20260709 13:22:18.703857 29058 raft_consensus.cc:1081] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Signalling peer 2e2f737d674147808bb32783de176848 to start an election
I20260709 13:22:18.705744 28228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3758e0f5638b496dbea84f0014c5e6a5"
dest_uuid: "2e2f737d674147808bb32783de176848"
 from {username='slave'} at 127.0.0.1:42322
I20260709 13:22:18.706364 28228 raft_consensus.cc:493] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:18.706804 28228 raft_consensus.cc:3060] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.714366 28228 raft_consensus.cc:515] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:18.716069 28228 leader_election.cc:290] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:18.716917 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3758e0f5638b496dbea84f0014c5e6a5" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:18.717238 28151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3758e0f5638b496dbea84f0014c5e6a5" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:18.717515 28083 raft_consensus.cc:3055] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:18.717875 28151 raft_consensus.cc:3060] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.717919 28083 raft_consensus.cc:740] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:22:18.718783 28083 consensus_queue.cc:260] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:18.719794 28083 raft_consensus.cc:3060] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.724839 28151 raft_consensus.cc:2468] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 2.
I20260709 13:22:18.726513 28083 raft_consensus.cc:2468] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 2.
I20260709 13:22:18.727522 28198 leader_election.cc:304] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, afb0dc4e88ca4275975541dfe077b38b; no voters: 
I20260709 13:22:18.729008 29053 raft_consensus.cc:2804] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:18.729483 29053 raft_consensus.cc:697] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:18.730350 29053 consensus_queue.cc:237] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:18.744099 27905 catalog_manager.cc:5697] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 1 to 2, leader changed from d80a443d06244116ae813b77fc539651 (127.17.251.130) to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 2 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:18.963773 29069 raft_consensus.cc:993] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651: : Instructing follower 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:18.964258 29058 raft_consensus.cc:1081] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 2 LEADER]: Signalling peer 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:18.965723 28888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "896e12f9e1f649c19b7ba5bac1e051dd"
dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:53088
I20260709 13:22:18.966177 28888 raft_consensus.cc:493] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:18.966428 28888 raft_consensus.cc:3060] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:18.971690 28888 raft_consensus.cc:515] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:18.973883 28888 leader_election.cc:290] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 3 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:18.974427 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e12f9e1f649c19b7ba5bac1e051dd" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:18.975131 28083 raft_consensus.cc:3055] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:18.975255 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e12f9e1f649c19b7ba5bac1e051dd" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:18.975528 28083 raft_consensus.cc:740] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:22:18.976493 28083 consensus_queue.cc:260] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:18.977814 28083 raft_consensus.cc:3060] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:18.975878 28157 raft_consensus.cc:3060] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:18.984289 28083 raft_consensus.cc:2468] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 3.
I20260709 13:22:18.985460 28844 leader_election.cc:304] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:18.986474 29073 raft_consensus.cc:2804] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:18.986889 29073 raft_consensus.cc:697] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 3 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:22:18.987689 29073 consensus_queue.cc:237] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:18.989012 28157 raft_consensus.cc:2468] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 3.
I20260709 13:22:18.999485 27905 catalog_manager.cc:5697] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 2 to 3, leader changed from d80a443d06244116ae813b77fc539651 (127.17.251.130) to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 3 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:19.102732 29121 raft_consensus.cc:993] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848: : Instructing follower 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:19.103310 29080 raft_consensus.cc:1081] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Signalling peer 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:19.105185 28888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35b5e77de8ab4ce39569a347a84ed651"
dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:53094
I20260709 13:22:19.105803 28888 raft_consensus.cc:493] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:19.106231 28888 raft_consensus.cc:3060] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:19.112164 28157 raft_consensus.cc:1275] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Refusing update from remote peer 2e2f737d674147808bb32783de176848: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:19.112757 28888 raft_consensus.cc:515] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:19.113551 29053 consensus_queue.cc:1048] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:19.115890 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b5e77de8ab4ce39569a347a84ed651" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:19.116182 28888 leader_election.cc:290] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:22:19.116446 28082 raft_consensus.cc:3060] T 35b5e77de8ab4ce39569a347a84ed651 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:19.116355 28226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b5e77de8ab4ce39569a347a84ed651" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:22:19.126009 28226 raft_consensus.cc:3055] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:19.128607 28226 raft_consensus.cc:740] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:19.131160 28226 consensus_queue.cc:260] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:19.126305 28083 raft_consensus.cc:1275] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Refusing update from remote peer 2e2f737d674147808bb32783de176848: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:19.132786 28226 raft_consensus.cc:3060] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:19.133778 28082 raft_consensus.cc:2468] T 35b5e77de8ab4ce39569a347a84ed651 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:19.139535 29121 consensus_queue.cc:1048] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:19.140051 28844 leader_election.cc:304] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:19.141116 29073 raft_consensus.cc:2804] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:19.141698 29073 raft_consensus.cc:697] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:22:19.142345 28226 raft_consensus.cc:2468] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:19.143280 29073 consensus_queue.cc:237] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:19.155525 27906 catalog_manager.cc:5697] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 1 to 2, leader changed from 2e2f737d674147808bb32783de176848 (127.17.251.132) to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:19.157958 29058 raft_consensus.cc:993] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651: : Instructing follower 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:19.158490 29058 raft_consensus.cc:1081] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Signalling peer 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:19.164535 28888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "922beb15151e447cbbc0eaee6dc5266d"
dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:53088
I20260709 13:22:19.165122 28888 raft_consensus.cc:493] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:19.165462 28888 raft_consensus.cc:3060] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:19.171752 28888 raft_consensus.cc:515] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:19.174535 28888 leader_election.cc:290] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:19.174863 28157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922beb15151e447cbbc0eaee6dc5266d" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:19.174203 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922beb15151e447cbbc0eaee6dc5266d" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:19.175549 28157 raft_consensus.cc:3060] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:19.175872 28082 raft_consensus.cc:3055] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:19.176219 28082 raft_consensus.cc:740] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d80a443d06244116ae813b77fc539651, State: Running, Role: LEADER
I20260709 13:22:19.177173 28082 consensus_queue.cc:260] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:19.179070 28082 raft_consensus.cc:3060] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:19.186982 28157 raft_consensus.cc:2468] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:19.186982 28082 raft_consensus.cc:2468] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:19.190326 28844 leader_election.cc:304] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:19.192332 29073 raft_consensus.cc:2804] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:19.192822 29073 raft_consensus.cc:697] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:22:19.193821 29073 consensus_queue.cc:237] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } }
I20260709 13:22:19.203850 27905 catalog_manager.cc:5697] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 1 to 2, leader changed from d80a443d06244116ae813b77fc539651 (127.17.251.130) to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:19.391680 28157 raft_consensus.cc:1275] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:19.392915 29073 consensus_queue.cc:1048] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:19.402762 28083 raft_consensus.cc:1275] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 3 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:19.404644 29073 consensus_queue.cc:1048] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:19.670408 28226 raft_consensus.cc:1275] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:19.670509 28083 raft_consensus.cc:1275] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:19.671922 29073 consensus_queue.cc:1048] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:19.671998 29099 consensus_queue.cc:1048] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:19.678135 28082 raft_consensus.cc:1275] T 35b5e77de8ab4ce39569a347a84ed651 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:19.680258 29073 consensus_queue.cc:1048] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:19.694108 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:19.701849 28157 raft_consensus.cc:1275] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:19.704196 29073 consensus_queue.cc:1048] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:19.772840 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:19.818831 28226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75fae586ea8f4cc8a5e968c2e41f2e8d"
dest_uuid: "2e2f737d674147808bb32783de176848"
mode: GRACEFUL
new_leader_uuid: "afb0dc4e88ca4275975541dfe077b38b"
 from {username='slave'} at 127.0.0.1:47822
I20260709 13:22:19.819315 28226 raft_consensus.cc:606] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Received request to transfer leadership to TS afb0dc4e88ca4275975541dfe077b38b
I20260709 13:22:19.820509 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:22:19.821908 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:19.857113 29121 raft_consensus.cc:993] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848: : Instructing follower afb0dc4e88ca4275975541dfe077b38b to start an election
I20260709 13:22:19.857728 29121 raft_consensus.cc:1081] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Signalling peer afb0dc4e88ca4275975541dfe077b38b to start an election
I20260709 13:22:19.859529 28157 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75fae586ea8f4cc8a5e968c2e41f2e8d"
dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
 from {username='slave'} at 127.0.0.1:51310
I20260709 13:22:19.860116 28157 raft_consensus.cc:493] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:19.860450 28157 raft_consensus.cc:3060] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:19.866755 28157 raft_consensus.cc:515] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:19.868690 28157 leader_election.cc:290] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), 2e2f737d674147808bb32783de176848 (127.17.251.132:36151)
I20260709 13:22:19.869503 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fae586ea8f4cc8a5e968c2e41f2e8d" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:19.869951 28226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fae586ea8f4cc8a5e968c2e41f2e8d" candidate_uuid: "afb0dc4e88ca4275975541dfe077b38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:22:19.870668 28226 raft_consensus.cc:3055] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:19.870354 28083 raft_consensus.cc:3060] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:19.871095 28226 raft_consensus.cc:740] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:19.872100 28226 consensus_queue.cc:260] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:19.873471 28226 raft_consensus.cc:3060] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:19.880187 28083 raft_consensus.cc:2468] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 2.
I20260709 13:22:19.880630 28226 raft_consensus.cc:2468] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb0dc4e88ca4275975541dfe077b38b in term 2.
I20260709 13:22:19.881901 28123 leader_election.cc:304] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afb0dc4e88ca4275975541dfe077b38b, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:19.882824 29112 raft_consensus.cc:2804] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:19.883314 29112 raft_consensus.cc:697] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Becoming Leader. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:22:19.884768 29112 consensus_queue.cc:237] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:19.897316 27906 catalog_manager.cc:5697] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b reported cstate change: term changed from 1 to 2, leader changed from 2e2f737d674147808bb32783de176848 (127.17.251.132) to afb0dc4e88ca4275975541dfe077b38b (127.17.251.131). New cstate: current_term: 2 leader_uuid: "afb0dc4e88ca4275975541dfe077b38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:20.316144 28082 raft_consensus.cc:1275] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Refusing update from remote peer afb0dc4e88ca4275975541dfe077b38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:20.317555 29146 consensus_queue.cc:1048] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:20.341845 28228 raft_consensus.cc:1275] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Refusing update from remote peer afb0dc4e88ca4275975541dfe077b38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:20.343436 29146 consensus_queue.cc:1048] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:20.822758 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:20.869427 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:20.906322 28157 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75fae586ea8f4cc8a5e968c2e41f2e8d"
dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
mode: GRACEFUL
new_leader_uuid: "2e2f737d674147808bb32783de176848"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:22:20.906899 28157 raft_consensus.cc:606] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Received request to transfer leadership to TS 2e2f737d674147808bb32783de176848
I20260709 13:22:20.908075 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:22:20.909606 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:21.389235 29164 raft_consensus.cc:993] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b: : Instructing follower 2e2f737d674147808bb32783de176848 to start an election
I20260709 13:22:21.389793 29146 raft_consensus.cc:1081] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Signalling peer 2e2f737d674147808bb32783de176848 to start an election
I20260709 13:22:21.391247 28228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75fae586ea8f4cc8a5e968c2e41f2e8d"
dest_uuid: "2e2f737d674147808bb32783de176848"
 from {username='slave'} at 127.0.0.1:42318
I20260709 13:22:21.391654 28228 raft_consensus.cc:493] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:21.391871 28228 raft_consensus.cc:3060] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:21.397300 28228 raft_consensus.cc:515] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:21.399535 28228 leader_election.cc:290] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 election: Requested vote from peers d80a443d06244116ae813b77fc539651 (127.17.251.130:43901), afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409)
I20260709 13:22:21.400094 28082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fae586ea8f4cc8a5e968c2e41f2e8d" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:21.400429 28155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fae586ea8f4cc8a5e968c2e41f2e8d" candidate_uuid: "2e2f737d674147808bb32783de176848" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "afb0dc4e88ca4275975541dfe077b38b"
I20260709 13:22:21.401018 28155 raft_consensus.cc:3055] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:21.401316 28155 raft_consensus.cc:740] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: afb0dc4e88ca4275975541dfe077b38b, State: Running, Role: LEADER
I20260709 13:22:21.400810 28082 raft_consensus.cc:3060] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:21.402073 28155 consensus_queue.cc:260] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:21.403262 28155 raft_consensus.cc:3060] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:21.407352 28082 raft_consensus.cc:2468] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 3.
I20260709 13:22:21.408499 28197 leader_election.cc:304] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2f737d674147808bb32783de176848, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:21.409193 29157 raft_consensus.cc:2804] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:21.409236 28155 raft_consensus.cc:2468] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2f737d674147808bb32783de176848 in term 3.
I20260709 13:22:21.409608 29157 raft_consensus.cc:697] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 3 LEADER]: Becoming Leader. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:21.410472 29157 consensus_queue.cc:237] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } }
I20260709 13:22:21.419497 27906 catalog_manager.cc:5697] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 reported cstate change: term changed from 2 to 3, leader changed from afb0dc4e88ca4275975541dfe077b38b (127.17.251.131) to 2e2f737d674147808bb32783de176848 (127.17.251.132). New cstate: current_term: 3 leader_uuid: "2e2f737d674147808bb32783de176848" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:21.910504 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:21.932538 28157 raft_consensus.cc:1275] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Refusing update from remote peer 2e2f737d674147808bb32783de176848: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:21.934373 29157 consensus_queue.cc:1048] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:21.985055 28082 raft_consensus.cc:1275] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651 [term 3 FOLLOWER]: Refusing update from remote peer 2e2f737d674147808bb32783de176848: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:21.986771 29156 consensus_queue.cc:1048] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:21.988615 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:22.070025 28228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01b35f8e5efb4b2194c44623574d41e4"
dest_uuid: "2e2f737d674147808bb32783de176848"
mode: GRACEFUL
new_leader_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:47822
I20260709 13:22:22.070680 28228 raft_consensus.cc:606] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Received request to transfer leadership to TS 6b1d1aefe48e42119ca040c70045fe28
I20260709 13:22:22.072623 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:22:22.074704 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:22.157063 29156 raft_consensus.cc:993] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848: : Instructing follower 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:22.157670 29157 raft_consensus.cc:1081] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Signalling peer 6b1d1aefe48e42119ca040c70045fe28 to start an election
I20260709 13:22:22.159317 28897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01b35f8e5efb4b2194c44623574d41e4"
dest_uuid: "6b1d1aefe48e42119ca040c70045fe28"
 from {username='slave'} at 127.0.0.1:53094
I20260709 13:22:22.159885 28897 raft_consensus.cc:493] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:22.160187 28897 raft_consensus.cc:3060] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:22.167737 28897 raft_consensus.cc:515] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:22.169934 28897 leader_election.cc:290] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Requested vote from peers 2e2f737d674147808bb32783de176848 (127.17.251.132:36151), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:22.171108 28083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b35f8e5efb4b2194c44623574d41e4" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d80a443d06244116ae813b77fc539651"
I20260709 13:22:22.171823 28083 raft_consensus.cc:3060] T 01b35f8e5efb4b2194c44623574d41e4 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:22.172770 28228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b35f8e5efb4b2194c44623574d41e4" candidate_uuid: "6b1d1aefe48e42119ca040c70045fe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2f737d674147808bb32783de176848"
I20260709 13:22:22.173395 28228 raft_consensus.cc:3055] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:22.173743 28228 raft_consensus.cc:740] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e2f737d674147808bb32783de176848, State: Running, Role: LEADER
I20260709 13:22:22.174503 28228 consensus_queue.cc:260] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:22.175777 28228 raft_consensus.cc:3060] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:22.179407 28083 raft_consensus.cc:2468] T 01b35f8e5efb4b2194c44623574d41e4 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:22.181522 28844 leader_election.cc:304] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651; no voters: 
I20260709 13:22:22.182358 29099 raft_consensus.cc:2804] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:22.182871 29099 raft_consensus.cc:697] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Becoming Leader. State: Replica: 6b1d1aefe48e42119ca040c70045fe28, State: Running, Role: LEADER
I20260709 13:22:22.184731 28228 raft_consensus.cc:2468] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1d1aefe48e42119ca040c70045fe28 in term 2.
I20260709 13:22:22.184149 29099 consensus_queue.cc:237] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:22.196853 27906 catalog_manager.cc:5697] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 reported cstate change: term changed from 1 to 2, leader changed from 2e2f737d674147808bb32783de176848 (127.17.251.132) to 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "6b1d1aefe48e42119ca040c70045fe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.756681 28226 raft_consensus.cc:1275] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:22.757903 29179 consensus_queue.cc:1048] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:22.768481 28083 raft_consensus.cc:1275] T 01b35f8e5efb4b2194c44623574d41e4 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Refusing update from remote peer 6b1d1aefe48e42119ca040c70045fe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:22.771149 29179 consensus_queue.cc:1048] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.075726 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:23.114472 18414 tablet_server.cc:179] TabletServer@127.17.251.129:33695 shutting down...
W20260709 13:22:23.120944 28196 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 147 similar messages]
W20260709 13:22:23.126237 28196 consensus_peers.cc:597] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.128934 28196 consensus_peers.cc:597] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.153924 28122 consensus_peers.cc:597] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.158653 28122 consensus_peers.cc:597] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.160354 28048 consensus_peers.cc:597] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.161657 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:23.165884 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.167071 18414 raft_consensus.cc:2243] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.168118 18414 raft_consensus.cc:2272] T a8359246c5ff428e89f3b5c15a65aa98 P 6b1d1aefe48e42119ca040c70045fe28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.171626 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.172328 18414 raft_consensus.cc:2243] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.172775 18414 raft_consensus.cc:2272] T f3a25078ad8448a485e557a6edaf0118 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.175782 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.176703 18414 raft_consensus.cc:2243] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.177697 18414 raft_consensus.cc:2272] T 115ec4e7eaff44c191ebb3618716383c P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.178762 28196 consensus_peers.cc:597] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.180635 18414 tablet_replica.cc:333] stopping tablet replica
W20260709 13:22:23.180816 28122 consensus_peers.cc:597] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.181514 28196 consensus_peers.cc:597] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.181684 18414 raft_consensus.cc:2243] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.182454 18414 raft_consensus.cc:2272] T 19150adcadcf4e14beef1b948b754f04 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.183331 28048 consensus_peers.cc:597] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.184171 28048 consensus_peers.cc:597] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.185185 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.185986 18414 raft_consensus.cc:2243] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.186590 18414 raft_consensus.cc:2272] T b1785087e0e647aebaa4e56a6c11482e P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.187655 28048 consensus_peers.cc:597] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.189531 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.190281 18414 raft_consensus.cc:2243] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.190783 18414 raft_consensus.cc:2272] T 1e3da7f8304442df89580b5f02ed1bcf P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.193348 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.193969 18414 raft_consensus.cc:2243] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:22:23.194554 28843 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:22:23.194722 18414 raft_consensus.cc:2272] T 17389976f8e346dbb2fbc326a9e60396 P 6b1d1aefe48e42119ca040c70045fe28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.197053 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.197799 18414 raft_consensus.cc:2243] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.198181 18414 raft_consensus.cc:2272] T 798271eb9117496ab0d95ece523d5268 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.200305 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.200924 18414 raft_consensus.cc:2243] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.201716 18414 raft_consensus.cc:2272] T 922beb15151e447cbbc0eaee6dc5266d P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.203763 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.204353 18414 raft_consensus.cc:2243] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.205088 18414 raft_consensus.cc:2272] T b4edfd4e5ea7461eaa8917755dff8c60 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.207310 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.207939 18414 raft_consensus.cc:2243] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.208361 18414 raft_consensus.cc:2272] T 7e87d83bcd69480ca50f5ea54a73cead P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.211375 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.212350 18414 raft_consensus.cc:2243] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.212999 18414 raft_consensus.cc:2272] T d90c9f452bac4ef0b959ca0e78ab475f P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.214488 28048 consensus_peers.cc:597] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.216081 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.216917 18414 raft_consensus.cc:2243] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.217386 18414 raft_consensus.cc:2272] T b0ed080f456b4849b44145557b5889b1 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.219699 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.220418 18414 raft_consensus.cc:2243] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.220880 18414 raft_consensus.cc:2272] T bb17cd0859ea43a5b7c93c90f172a611 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.223065 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.223701 18414 raft_consensus.cc:2243] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.224146 18414 raft_consensus.cc:2272] T e19c61eea3984e50916353d4844fe718 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.226166 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.226692 18414 raft_consensus.cc:2243] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.227156 18414 raft_consensus.cc:2272] T ec29c7c5037f4fe79d9681c5b1c7b53b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.229880 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.230458 18414 raft_consensus.cc:2243] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.230940 18414 raft_consensus.cc:2272] T 1c653748b39e457aab513022ae1306f5 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.233011 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.233700 18414 raft_consensus.cc:2243] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.234182 18414 raft_consensus.cc:2272] T 2964725f81fe44ec98f509298316722b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.236770 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.237409 18414 raft_consensus.cc:2243] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.237901 18414 raft_consensus.cc:2272] T 9815241ff06642b59c8d28aaeb390d8e P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.240890 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.241726 18414 raft_consensus.cc:2243] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.242246 18414 raft_consensus.cc:2272] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.245115 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.245944 18414 raft_consensus.cc:2243] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.246448 18414 raft_consensus.cc:2272] T 34330356e21a4098a1c12380085e120f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.249269 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.250099 18414 raft_consensus.cc:2243] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.251097 18414 raft_consensus.cc:2272] T d84d9e7845264be9b66bcd292aab7e1d P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.253168 28122 consensus_peers.cc:597] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.253965 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.254724 18414 raft_consensus.cc:2243] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.255481 18414 raft_consensus.cc:2272] T 44f20c0135d64866abcf710b9b331281 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.257810 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.258615 18414 raft_consensus.cc:2243] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.258997 18414 raft_consensus.cc:2272] T d72f52140be74d50aeccec9aebfd2f5b P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.261672 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.262272 18414 raft_consensus.cc:2243] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.262742 18414 raft_consensus.cc:2272] T fff4d26a60a64a959845d8a267925536 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.263499 28048 consensus_peers.cc:597] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.265352 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.266288 18414 raft_consensus.cc:2243] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.267354 18414 raft_consensus.cc:2272] T a685a97179a94ca299d31636b789c516 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.270056 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.270617 18414 raft_consensus.cc:2243] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.271495 18414 raft_consensus.cc:2272] T 027980aba9e546578394bd75f01ffba4 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.274226 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.274781 18414 raft_consensus.cc:2243] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.275204 18414 raft_consensus.cc:2272] T b2f566c9bd364fbcbc859d1c30f0f793 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.277211 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.277926 18414 raft_consensus.cc:2243] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.278457 18414 raft_consensus.cc:2272] T e63f258079e143c89ee02598a5df4701 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.281168 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.281912 18414 raft_consensus.cc:2243] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.282408 18414 raft_consensus.cc:2272] T 55a66e81e89d46308972b6fbc0328b74 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.284390 28196 consensus_peers.cc:597] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.285221 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.286134 18414 raft_consensus.cc:2243] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.286666 18414 raft_consensus.cc:2272] T 251228d678dc4ab7887704367c7bd62a P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.289745 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.290521 18414 raft_consensus.cc:2243] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.291026 18414 raft_consensus.cc:2272] T 09ce0cdf347247538a4b952da2421761 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.293892 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.294716 18414 raft_consensus.cc:2243] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.295257 18414 raft_consensus.cc:2272] T 77ff8ad68e8c484084ae9ff0160e712f P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.295737 28122 consensus_peers.cc:597] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.297709 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.298384 18414 raft_consensus.cc:2243] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.299322 18414 raft_consensus.cc:2272] T 35b5e77de8ab4ce39569a347a84ed651 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.302096 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.302644 18414 raft_consensus.cc:2243] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.303000 18414 raft_consensus.cc:2272] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.304910 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.305428 18414 raft_consensus.cc:2243] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.305864 18414 raft_consensus.cc:2272] T cbe7aa856d09405fbb13f70607e0d3e9 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.307832 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.308569 18414 raft_consensus.cc:2243] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.308970 18414 raft_consensus.cc:2272] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.311107 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.311673 18414 raft_consensus.cc:2243] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.312407 18414 raft_consensus.cc:2272] T 896e12f9e1f649c19b7ba5bac1e051dd P 6b1d1aefe48e42119ca040c70045fe28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.314646 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.315464 18414 raft_consensus.cc:2243] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.315974 18414 raft_consensus.cc:2272] T 8733000b90a544ba82435f9b7f6e5403 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.318477 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.319033 18414 raft_consensus.cc:2243] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.319928 18414 raft_consensus.cc:2272] T 0f95034322d746e4aaf06b06873de375 P 6b1d1aefe48e42119ca040c70045fe28 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.322597 28048 consensus_peers.cc:597] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.322820 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.323693 18414 raft_consensus.cc:2243] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.324234 18414 raft_consensus.cc:2272] T c25fa78648f943939c0b04e5ae654cdf P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.327090 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.327857 18414 raft_consensus.cc:2243] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.328336 18414 raft_consensus.cc:2272] T 82f55c4d42a545aabd60f9579818ff2b P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.330873 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.331616 18414 raft_consensus.cc:2243] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.332142 18414 raft_consensus.cc:2272] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 6b1d1aefe48e42119ca040c70045fe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.335002 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.335664 18414 raft_consensus.cc:2243] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:22:23.336064 28122 consensus_peers.cc:597] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.336612 18414 raft_consensus.cc:2272] T 755b1458334b47b2ae9a71fb44952d95 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.339059 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:23.339540 18414 raft_consensus.cc:2243] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.340258 18414 raft_consensus.cc:2272] T 01b35f8e5efb4b2194c44623574d41e4 P 6b1d1aefe48e42119ca040c70045fe28 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.361038 28048 consensus_peers.cc:597] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.372326 28048 consensus_peers.cc:597] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.410889 18414 tablet_server.cc:196] TabletServer@127.17.251.129:33695 shutdown complete.
W20260709 13:22:23.423693 28196 consensus_peers.cc:597] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.452035 28048 consensus_peers.cc:597] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.456111 28122 consensus_peers.cc:597] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.465394 28122 consensus_peers.cc:597] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.472692 28122 consensus_peers.cc:597] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.506390 18414 tablet_server.cc:179] TabletServer@127.17.251.130:0 shutting down...
W20260709 13:22:23.522296 28196 consensus_peers.cc:597] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.545372 28197 consensus_peers.cc:597] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.550469 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:23.551527 18414 tablet_replica.cc:333] T a1c8db979236426c88754a4d4d46e147 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.552619 18414 raft_consensus.cc:2243] T a1c8db979236426c88754a4d4d46e147 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.553224 18414 raft_consensus.cc:2272] T a1c8db979236426c88754a4d4d46e147 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.550849 28122 consensus_peers.cc:597] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.554297 28197 consensus_peers.cc:597] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.555323 28048 consensus_peers.cc:597] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.556035 18414 tablet_replica.cc:333] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.556715 18414 raft_consensus.cc:2243] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.557178 18414 raft_consensus.cc:2272] T 922beb15151e447cbbc0eaee6dc5266d P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.559708 18414 tablet_replica.cc:333] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.560463 18414 raft_consensus.cc:2243] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.561437 18414 raft_consensus.cc:2272] T dc8f779373b044c2b2e3d0e781f4d04f P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.563963 28122 consensus_peers.cc:597] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.564234 18414 tablet_replica.cc:333] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.565053 18414 raft_consensus.cc:2243] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.565502 18414 raft_consensus.cc:2272] T d72f52140be74d50aeccec9aebfd2f5b P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.567849 18414 tablet_replica.cc:333] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.568449 18414 raft_consensus.cc:2243] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.569502 18414 raft_consensus.cc:2272] T e7175e0071a54910af34661c079bcca4 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.571925 18414 tablet_replica.cc:333] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.572495 18414 raft_consensus.cc:2243] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.572904 18414 raft_consensus.cc:2272] T 44f20c0135d64866abcf710b9b331281 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.574837 18414 tablet_replica.cc:333] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.575387 18414 raft_consensus.cc:2243] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.576156 18414 raft_consensus.cc:2272] T b1785087e0e647aebaa4e56a6c11482e P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.578114 18414 tablet_replica.cc:333] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.579022 18414 raft_consensus.cc:2243] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.580118 18414 raft_consensus.cc:2272] T 7e87d83bcd69480ca50f5ea54a73cead P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.582705 28123 consensus_peers.cc:597] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.583204 18414 tablet_replica.cc:333] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.583959 18414 raft_consensus.cc:2243] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.584462 18414 raft_consensus.cc:2272] T ec29c7c5037f4fe79d9681c5b1c7b53b P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.587291 18414 tablet_replica.cc:333] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.588250 18414 raft_consensus.cc:2243] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.589444 18414 raft_consensus.cc:2272] T 55a66e81e89d46308972b6fbc0328b74 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.592182 18414 tablet_replica.cc:333] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.592870 18414 raft_consensus.cc:2243] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.593415 18414 raft_consensus.cc:2272] T 4f7df1c61b2348668e7022bfc34d7886 P d80a443d06244116ae813b77fc539651 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.595927 18414 tablet_replica.cc:333] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.596625 18414 raft_consensus.cc:2243] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.597121 18414 raft_consensus.cc:2272] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.599557 18414 tablet_replica.cc:333] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.600183 18414 raft_consensus.cc:2243] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.600643 18414 raft_consensus.cc:2272] T 96c01bb7a8b84db7b8b44098cd5602a2 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.602824 18414 tablet_replica.cc:333] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.603437 18414 raft_consensus.cc:2243] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.604534 18414 raft_consensus.cc:2272] T a1ccc7022ab04f9a8ddc87ac37f31c7c P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.607471 18414 tablet_replica.cc:333] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.608337 18414 raft_consensus.cc:2243] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.608879 18414 raft_consensus.cc:2272] T ed7ccef5723d4614918b18c47b9dfa3a P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.611641 18414 tablet_replica.cc:333] T 35b5e77de8ab4ce39569a347a84ed651 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.612380 18414 raft_consensus.cc:2243] T 35b5e77de8ab4ce39569a347a84ed651 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.612987 18414 raft_consensus.cc:2272] T 35b5e77de8ab4ce39569a347a84ed651 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.615984 18414 tablet_replica.cc:333] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.616961 18414 raft_consensus.cc:2243] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.617655 18414 raft_consensus.cc:2272] T 09ce0cdf347247538a4b952da2421761 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.620594 18414 tablet_replica.cc:333] T fff4d26a60a64a959845d8a267925536 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.621351 18414 raft_consensus.cc:2243] T fff4d26a60a64a959845d8a267925536 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.621927 18414 raft_consensus.cc:2272] T fff4d26a60a64a959845d8a267925536 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.624853 18414 tablet_replica.cc:333] T a685a97179a94ca299d31636b789c516 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.625703 18414 raft_consensus.cc:2243] T a685a97179a94ca299d31636b789c516 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.626221 18414 raft_consensus.cc:2272] T a685a97179a94ca299d31636b789c516 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.628886 28122 consensus_peers.cc:597] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.628928 18414 tablet_replica.cc:333] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.630002 18414 raft_consensus.cc:2243] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:22:23.630713 28197 consensus_peers.cc:597] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.631110 18414 raft_consensus.cc:2272] T f3a25078ad8448a485e557a6edaf0118 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.633932 18414 tablet_replica.cc:333] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.634541 18414 raft_consensus.cc:2243] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.635349 18414 raft_consensus.cc:2272] T 6dd28360227f4dca8286a91d1be17d04 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.638010 18414 tablet_replica.cc:333] T 6a85c97f3d564240a87737e17e8b536e P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.638741 18414 raft_consensus.cc:2243] T 6a85c97f3d564240a87737e17e8b536e P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.639195 18414 raft_consensus.cc:2272] T 6a85c97f3d564240a87737e17e8b536e P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.641218 18414 tablet_replica.cc:333] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.641875 18414 raft_consensus.cc:2243] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.642433 18414 raft_consensus.cc:2272] T a8feb7220d3845768a841d7df788966e P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.645018 18414 tablet_replica.cc:333] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.645752 18414 raft_consensus.cc:2243] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.646839 18414 raft_consensus.cc:2272] T 6b91d5539ce0478a92a005af25d828a6 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.649904 18414 tablet_replica.cc:333] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.650833 18414 raft_consensus.cc:2243] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.651386 18414 raft_consensus.cc:2272] T 027980aba9e546578394bd75f01ffba4 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.651628 28122 consensus_peers.cc:597] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b -> Peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Couldn't send request to peer 6b1d1aefe48e42119ca040c70045fe28. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.651872 28123 consensus_peers.cc:597] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.653827 18414 tablet_replica.cc:333] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.654512 18414 raft_consensus.cc:2243] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.654901 18414 raft_consensus.cc:2272] T 75fae586ea8f4cc8a5e968c2e41f2e8d P d80a443d06244116ae813b77fc539651 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.657076 18414 tablet_replica.cc:333] T 01b35f8e5efb4b2194c44623574d41e4 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.657965 18414 raft_consensus.cc:2243] T 01b35f8e5efb4b2194c44623574d41e4 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.658491 18414 raft_consensus.cc:2272] T 01b35f8e5efb4b2194c44623574d41e4 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.660287 28197 consensus_peers.cc:597] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.661587 18414 tablet_replica.cc:333] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.662382 18414 raft_consensus.cc:2243] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.662850 18414 raft_consensus.cc:2272] T 0f95034322d746e4aaf06b06873de375 P d80a443d06244116ae813b77fc539651 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.664935 18414 tablet_replica.cc:333] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.665740 18414 raft_consensus.cc:2243] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.666754 18414 raft_consensus.cc:2272] T 8733000b90a544ba82435f9b7f6e5403 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.669327 18414 tablet_replica.cc:333] T 88b8050a4f374a91b8993cd0d6ed3dbd P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.670159 18414 raft_consensus.cc:2243] T 88b8050a4f374a91b8993cd0d6ed3dbd P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.670706 18414 raft_consensus.cc:2272] T 88b8050a4f374a91b8993cd0d6ed3dbd P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.673938 18414 tablet_replica.cc:333] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.674710 18414 raft_consensus.cc:2243] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.675738 18414 raft_consensus.cc:2272] T b0ed080f456b4849b44145557b5889b1 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.678355 18414 tablet_replica.cc:333] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.678936 18414 raft_consensus.cc:2243] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.679840 18414 raft_consensus.cc:2272] T e19c61eea3984e50916353d4844fe718 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.684821 18414 tablet_replica.cc:333] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.685611 18414 raft_consensus.cc:2243] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.686172 18414 raft_consensus.cc:2272] T 3758e0f5638b496dbea84f0014c5e6a5 P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.688091 18414 tablet_replica.cc:333] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.688638 18414 raft_consensus.cc:2243] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.689431 18414 raft_consensus.cc:2272] T 251228d678dc4ab7887704367c7bd62a P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.691982 18414 tablet_replica.cc:333] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.692561 18414 raft_consensus.cc:2243] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.693022 18414 raft_consensus.cc:2272] T e63f258079e143c89ee02598a5df4701 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.695372 18414 tablet_replica.cc:333] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.695998 18414 raft_consensus.cc:2243] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.696548 18414 raft_consensus.cc:2272] T b2f566c9bd364fbcbc859d1c30f0f793 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.699221 18414 tablet_replica.cc:333] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.699967 18414 raft_consensus.cc:2243] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.700502 18414 raft_consensus.cc:2272] T cbe7aa856d09405fbb13f70607e0d3e9 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.703225 18414 tablet_replica.cc:333] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.704135 18414 raft_consensus.cc:2243] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.705206 18414 raft_consensus.cc:2272] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.707976 18414 tablet_replica.cc:333] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.708757 18414 raft_consensus.cc:2243] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.709270 18414 raft_consensus.cc:2272] T 896e12f9e1f649c19b7ba5bac1e051dd P d80a443d06244116ae813b77fc539651 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.712127 18414 tablet_replica.cc:333] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.712911 18414 raft_consensus.cc:2243] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.713518 18414 raft_consensus.cc:2272] T 115ec4e7eaff44c191ebb3618716383c P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.713557 28197 consensus_peers.cc:597] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.716605 18414 tablet_replica.cc:333] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.717382 18414 raft_consensus.cc:2243] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.717969 18414 raft_consensus.cc:2272] T dc2ec8b6b6234ee6b530a1c4b7e18618 P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.718681 28123 consensus_peers.cc:597] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.719828 28197 consensus_peers.cc:597] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.720827 18414 tablet_replica.cc:333] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.721587 18414 raft_consensus.cc:2243] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.722637 18414 raft_consensus.cc:2272] T 82f55c4d42a545aabd60f9579818ff2b P d80a443d06244116ae813b77fc539651 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.724103 28197 consensus_peers.cc:597] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.725458 18414 tablet_replica.cc:333] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.726274 18414 raft_consensus.cc:2243] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.726857 18414 raft_consensus.cc:2272] T c25fa78648f943939c0b04e5ae654cdf P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.729163 18414 tablet_replica.cc:333] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651: stopping tablet replica
I20260709 13:22:23.729835 18414 raft_consensus.cc:2243] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.730392 18414 raft_consensus.cc:2272] T d90c9f452bac4ef0b959ca0e78ab475f P d80a443d06244116ae813b77fc539651 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.737058 28197 consensus_peers.cc:597] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.738761 28123 consensus_peers.cc:597] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.785157 28123 consensus_peers.cc:597] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.806623 28197 consensus_peers.cc:597] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.807736 18414 tablet_server.cc:196] TabletServer@127.17.251.130:0 shutdown complete.
W20260709 13:22:23.815891 28197 consensus_peers.cc:597] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.836597 28197 consensus_peers.cc:597] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.889482 28123 consensus_peers.cc:597] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.899313 18414 tablet_server.cc:179] TabletServer@127.17.251.131:0 shutting down...
W20260709 13:22:23.912215 28198 consensus_peers.cc:597] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 -> Peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Couldn't send request to peer afb0dc4e88ca4275975541dfe077b38b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.941706 28198 consensus_peers.cc:597] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 -> Peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Couldn't send request to peer afb0dc4e88ca4275975541dfe077b38b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:23.942504 28123 consensus_peers.cc:597] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.950014 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:23.950969 18414 tablet_replica.cc:333] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:23.951637 18414 raft_consensus.cc:2243] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.952175 18414 raft_consensus.cc:2272] T 19150adcadcf4e14beef1b948b754f04 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.954631 18414 tablet_replica.cc:333] T dc8f779373b044c2b2e3d0e781f4d04f P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:23.955595 18414 raft_consensus.cc:2243] T dc8f779373b044c2b2e3d0e781f4d04f P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.956171 18414 raft_consensus.cc:2272] T dc8f779373b044c2b2e3d0e781f4d04f P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.958956 18414 tablet_replica.cc:333] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:23.959843 18414 raft_consensus.cc:2243] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.960424 18414 raft_consensus.cc:2272] T 922beb15151e447cbbc0eaee6dc5266d P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.961553 28197 consensus_peers.cc:597] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:23.963203 18414 tablet_replica.cc:333] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:23.963972 18414 raft_consensus.cc:2243] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.964874 18414 raft_consensus.cc:2272] T 798271eb9117496ab0d95ece523d5268 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.967032 18414 tablet_replica.cc:333] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:23.967643 18414 raft_consensus.cc:2243] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.968446 18414 raft_consensus.cc:2272] T 1c653748b39e457aab513022ae1306f5 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.970445 18414 tablet_replica.cc:333] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:23.971048 18414 raft_consensus.cc:2243] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.971503 18414 raft_consensus.cc:2272] T 17389976f8e346dbb2fbc326a9e60396 P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.973419 18414 tablet_replica.cc:333] T 7e87d83bcd69480ca50f5ea54a73cead P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:23.974040 18414 raft_consensus.cc:2243] T 7e87d83bcd69480ca50f5ea54a73cead P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.974494 18414 raft_consensus.cc:2272] T 7e87d83bcd69480ca50f5ea54a73cead P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.976513 18414 tablet_replica.cc:333] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:23.977087 18414 raft_consensus.cc:2243] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.977553 18414 raft_consensus.cc:2272] T b1785087e0e647aebaa4e56a6c11482e P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.979530 18414 tablet_replica.cc:333] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:23.980130 18414 raft_consensus.cc:2243] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.980958 18414 raft_consensus.cc:2272] T 1e3da7f8304442df89580b5f02ed1bcf P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.982973 18414 tablet_replica.cc:333] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:23.983525 18414 raft_consensus.cc:2243] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.983945 18414 raft_consensus.cc:2272] T 4f7df1c61b2348668e7022bfc34d7886 P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.986141 18414 tablet_replica.cc:333] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:23.986764 18414 raft_consensus.cc:2243] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.987560 18414 raft_consensus.cc:2272] T ec29c7c5037f4fe79d9681c5b1c7b53b P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.989516 18414 tablet_replica.cc:333] T 96c01bb7a8b84db7b8b44098cd5602a2 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:23.990139 18414 raft_consensus.cc:2243] T 96c01bb7a8b84db7b8b44098cd5602a2 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.990602 18414 raft_consensus.cc:2272] T 96c01bb7a8b84db7b8b44098cd5602a2 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.992547 18414 tablet_replica.cc:333] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:23.993335 18414 raft_consensus.cc:2243] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.993902 18414 raft_consensus.cc:2272] T ed7ccef5723d4614918b18c47b9dfa3a P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.995967 18414 tablet_replica.cc:333] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:23.996649 18414 raft_consensus.cc:2243] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.997097 18414 raft_consensus.cc:2272] T 3758e0f5638b496dbea84f0014c5e6a5 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.999086 18414 tablet_replica.cc:333] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:23.999675 18414 raft_consensus.cc:2243] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.000098 18414 raft_consensus.cc:2272] T a8359246c5ff428e89f3b5c15a65aa98 P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.002290 18414 tablet_replica.cc:333] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.002918 18414 raft_consensus.cc:2243] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.003695 18414 raft_consensus.cc:2272] T 77ff8ad68e8c484084ae9ff0160e712f P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.006054 18414 tablet_replica.cc:333] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
W20260709 13:22:24.006531 28123 consensus_peers.cc:597] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b -> Peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Couldn't send request to peer d80a443d06244116ae813b77fc539651. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:24.006844 18414 raft_consensus.cc:2243] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.008011 18414 raft_consensus.cc:2272] T 9815241ff06642b59c8d28aaeb390d8e P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.010470 18414 tablet_replica.cc:333] T 2964725f81fe44ec98f509298316722b P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.011386 18414 raft_consensus.cc:2243] T 2964725f81fe44ec98f509298316722b P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.011998 18414 raft_consensus.cc:2272] T 2964725f81fe44ec98f509298316722b P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.014766 18414 tablet_replica.cc:333] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.015494 18414 raft_consensus.cc:2243] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.016222 18414 raft_consensus.cc:2272] T 2e1dc5fdce0d4a289fc84c10ecbcd2c7 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.018244 18414 tablet_replica.cc:333] T a1c8db979236426c88754a4d4d46e147 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.018769 18414 raft_consensus.cc:2243] T a1c8db979236426c88754a4d4d46e147 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.019165 18414 raft_consensus.cc:2272] T a1c8db979236426c88754a4d4d46e147 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.021217 18414 tablet_replica.cc:333] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.021941 18414 raft_consensus.cc:2243] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.022374 18414 raft_consensus.cc:2272] T b4edfd4e5ea7461eaa8917755dff8c60 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.024488 18414 tablet_replica.cc:333] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.025054 18414 raft_consensus.cc:2243] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.025486 18414 raft_consensus.cc:2272] T 027980aba9e546578394bd75f01ffba4 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.027563 18414 tablet_replica.cc:333] T f3a25078ad8448a485e557a6edaf0118 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.028086 18414 raft_consensus.cc:2243] T f3a25078ad8448a485e557a6edaf0118 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.028607 18414 raft_consensus.cc:2272] T f3a25078ad8448a485e557a6edaf0118 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.031095 18414 tablet_replica.cc:333] T 6dd28360227f4dca8286a91d1be17d04 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
W20260709 13:22:24.031566 28198 consensus_peers.cc:597] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 -> Peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Couldn't send request to peer afb0dc4e88ca4275975541dfe077b38b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:24.031775 18414 raft_consensus.cc:2243] T 6dd28360227f4dca8286a91d1be17d04 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.032371 18414 raft_consensus.cc:2272] T 6dd28360227f4dca8286a91d1be17d04 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.034492 18414 tablet_replica.cc:333] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.035048 18414 raft_consensus.cc:2243] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.035843 18414 raft_consensus.cc:2272] T 6a85c97f3d564240a87737e17e8b536e P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.037919 18414 tablet_replica.cc:333] T a8feb7220d3845768a841d7df788966e P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.038511 18414 raft_consensus.cc:2243] T a8feb7220d3845768a841d7df788966e P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.038937 18414 raft_consensus.cc:2272] T a8feb7220d3845768a841d7df788966e P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.040798 18414 tablet_replica.cc:333] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.041340 18414 raft_consensus.cc:2243] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.041893 18414 raft_consensus.cc:2272] T 6b91d5539ce0478a92a005af25d828a6 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.044253 18414 tablet_replica.cc:333] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
W20260709 13:22:24.044193 28198 consensus_peers.cc:597] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 -> Peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Couldn't send request to peer afb0dc4e88ca4275975541dfe077b38b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:24.045101 18414 raft_consensus.cc:2243] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.045557 18414 raft_consensus.cc:2272] T e19c61eea3984e50916353d4844fe718 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.047963 18414 tablet_replica.cc:333] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.048771 18414 raft_consensus.cc:2243] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.049708 18414 raft_consensus.cc:2272] T bb17cd0859ea43a5b7c93c90f172a611 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.051657 18414 tablet_replica.cc:333] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.052230 18414 raft_consensus.cc:2243] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.053135 18414 raft_consensus.cc:2272] T 88b8050a4f374a91b8993cd0d6ed3dbd P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.055394 18414 tablet_replica.cc:333] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.055975 18414 raft_consensus.cc:2243] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.056435 18414 raft_consensus.cc:2272] T b0ed080f456b4849b44145557b5889b1 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:24.058099 28198 consensus_peers.cc:597] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 -> Peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Couldn't send request to peer afb0dc4e88ca4275975541dfe077b38b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:24.058847 18414 tablet_replica.cc:333] T e7175e0071a54910af34661c079bcca4 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.059549 18414 raft_consensus.cc:2243] T e7175e0071a54910af34661c079bcca4 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.060129 18414 raft_consensus.cc:2272] T e7175e0071a54910af34661c079bcca4 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.062534 18414 tablet_replica.cc:333] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.063134 18414 raft_consensus.cc:2243] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.063567 18414 raft_consensus.cc:2272] T d84d9e7845264be9b66bcd292aab7e1d P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.065369 18414 tablet_replica.cc:333] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.065973 18414 raft_consensus.cc:2243] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.066387 18414 raft_consensus.cc:2272] T 75fae586ea8f4cc8a5e968c2e41f2e8d P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.068229 18414 tablet_replica.cc:333] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.068763 18414 raft_consensus.cc:2243] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.069555 18414 raft_consensus.cc:2272] T e63f258079e143c89ee02598a5df4701 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.071653 18414 tablet_replica.cc:333] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.072289 18414 raft_consensus.cc:2243] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.073140 18414 raft_consensus.cc:2272] T b2f566c9bd364fbcbc859d1c30f0f793 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.075471 18414 tablet_replica.cc:333] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.076009 18414 raft_consensus.cc:2243] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.076932 18414 raft_consensus.cc:2272] T cbe7aa856d09405fbb13f70607e0d3e9 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.078897 18414 tablet_replica.cc:333] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.079429 18414 raft_consensus.cc:2243] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.079952 18414 raft_consensus.cc:2272] T 896e12f9e1f649c19b7ba5bac1e051dd P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.082545 18414 tablet_replica.cc:333] T dc2ec8b6b6234ee6b530a1c4b7e18618 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.083235 18414 raft_consensus.cc:2243] T dc2ec8b6b6234ee6b530a1c4b7e18618 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.083767 18414 raft_consensus.cc:2272] T dc2ec8b6b6234ee6b530a1c4b7e18618 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.086550 18414 tablet_replica.cc:333] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.087227 18414 raft_consensus.cc:2243] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.087723 18414 raft_consensus.cc:2272] T 0f95034322d746e4aaf06b06873de375 P afb0dc4e88ca4275975541dfe077b38b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.090317 18414 tablet_replica.cc:333] T 81f6ad6d00d44eb5b9914641b6da9ae5 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.090816 18414 raft_consensus.cc:2243] T 81f6ad6d00d44eb5b9914641b6da9ae5 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.091195 18414 raft_consensus.cc:2272] T 81f6ad6d00d44eb5b9914641b6da9ae5 P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.093552 18414 tablet_replica.cc:333] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.094219 18414 raft_consensus.cc:2243] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.095217 18414 raft_consensus.cc:2272] T c25fa78648f943939c0b04e5ae654cdf P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:24.095795 28198 consensus_peers.cc:597] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 -> Peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Couldn't send request to peer afb0dc4e88ca4275975541dfe077b38b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:24.097295 18414 tablet_replica.cc:333] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.097944 18414 raft_consensus.cc:2243] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.098414 18414 raft_consensus.cc:2272] T 755b1458334b47b2ae9a71fb44952d95 P afb0dc4e88ca4275975541dfe077b38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.100359 18414 tablet_replica.cc:333] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b: stopping tablet replica
I20260709 13:22:24.100842 18414 raft_consensus.cc:2243] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.101599 18414 raft_consensus.cc:2272] T 34330356e21a4098a1c12380085e120f P afb0dc4e88ca4275975541dfe077b38b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:24.132853 28198 consensus_peers.cc:597] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 -> Peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Couldn't send request to peer afb0dc4e88ca4275975541dfe077b38b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:24.179834 18414 tablet_server.cc:196] TabletServer@127.17.251.131:0 shutdown complete.
W20260709 13:22:24.224047 28198 consensus_peers.cc:597] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 -> Peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Couldn't send request to peer afb0dc4e88ca4275975541dfe077b38b. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.131:44409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:24.247020 28198 consensus_peers.cc:597] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 -> Peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Couldn't send request to peer afb0dc4e88ca4275975541dfe077b38b. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.131:44409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:24.300796 18414 tablet_server.cc:179] TabletServer@127.17.251.132:0 shutting down...
W20260709 13:22:24.302949 28198 consensus_peers.cc:597] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 -> Peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Couldn't send request to peer afb0dc4e88ca4275975541dfe077b38b. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.131:44409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:24.360478 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:24.363044 18414 tablet_replica.cc:333] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.366611 18414 raft_consensus.cc:2243] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.370286 29156 raft_consensus.cc:493] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:24.370628 18414 raft_consensus.cc:2272] T 19150adcadcf4e14beef1b948b754f04 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.371614 29156 raft_consensus.cc:515] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:24.376464 18414 tablet_replica.cc:333] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.379477 18414 raft_consensus.cc:2243] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.379946 29156 leader_election.cc:290] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:24.380784 18414 raft_consensus.cc:2272] T 798271eb9117496ab0d95ece523d5268 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:24.382751 28196 leader_election.cc:336] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
W20260709 13:22:24.383657 28198 leader_election.cc:336] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Network error: Client connection negotiation failed: client connection to 127.17.251.131:44409: connect: Connection refused (error 111)
I20260709 13:22:24.384176 28198 leader_election.cc:304] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:22:24.385157 29156 raft_consensus.cc:2749] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:22:24.385748 18414 tablet_replica.cc:333] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.387533 18414 raft_consensus.cc:2243] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.388420 18414 raft_consensus.cc:2272] T dc8f779373b044c2b2e3d0e781f4d04f P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.392050 18414 tablet_replica.cc:333] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.392735 18414 raft_consensus.cc:2243] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.393378 18414 raft_consensus.cc:2272] T 1c653748b39e457aab513022ae1306f5 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.396128 18414 tablet_replica.cc:333] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.396857 18414 raft_consensus.cc:2243] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.397464 18414 raft_consensus.cc:2272] T 17389976f8e346dbb2fbc326a9e60396 P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.400228 18414 tablet_replica.cc:333] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.401252 18414 raft_consensus.cc:2243] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.402761 18414 raft_consensus.cc:2272] T 4f7df1c61b2348668e7022bfc34d7886 P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.405516 18414 tablet_replica.cc:333] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.406395 18414 raft_consensus.cc:2243] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.406999 18414 raft_consensus.cc:2272] T 1e3da7f8304442df89580b5f02ed1bcf P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.409514 18414 tablet_replica.cc:333] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.410328 18414 raft_consensus.cc:2243] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.410939 18414 raft_consensus.cc:2272] T 55a66e81e89d46308972b6fbc0328b74 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.413074 29205 raft_consensus.cc:493] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:24.413784 29205 raft_consensus.cc:515] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:24.414188 18414 tablet_replica.cc:333] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.415218 18414 raft_consensus.cc:2243] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.416059 29205 leader_election.cc:290] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
I20260709 13:22:24.416165 18414 raft_consensus.cc:2272] T 82f55c4d42a545aabd60f9579818ff2b P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.421051 18414 tablet_replica.cc:333] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848: stopping tablet replica
W20260709 13:22:24.421072 28197 leader_election.cc:336] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Network error: Client connection negotiation failed: client connection to 127.17.251.130:43901: connect: Connection refused (error 111)
W20260709 13:22:24.421806 28196 leader_election.cc:336] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:24.422322 18414 raft_consensus.cc:2243] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.422271 28196 leader_election.cc:304] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651
I20260709 13:22:24.423210 29205 raft_consensus.cc:2749] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:22:24.424508 18414 raft_consensus.cc:2272] T 81f6ad6d00d44eb5b9914641b6da9ae5 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.427570 18414 tablet_replica.cc:333] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.428472 18414 raft_consensus.cc:2243] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.429206 18414 raft_consensus.cc:2272] T 77ff8ad68e8c484084ae9ff0160e712f P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.432094 18414 tablet_replica.cc:333] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.432891 18414 raft_consensus.cc:2243] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.433562 18414 raft_consensus.cc:2272] T 35b5e77de8ab4ce39569a347a84ed651 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.436458 18414 tablet_replica.cc:333] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.437448 18414 raft_consensus.cc:2243] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.439390 18414 raft_consensus.cc:2272] T 09ce0cdf347247538a4b952da2421761 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.442709 29205 raft_consensus.cc:493] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:24.443312 18414 tablet_replica.cc:333] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.443660 29205 raft_consensus.cc:515] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:24.446055 18414 raft_consensus.cc:2243] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.448429 18414 raft_consensus.cc:2272] T a1c8db979236426c88754a4d4d46e147 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.449990 29205 leader_election.cc:290] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:24.453052 18414 tablet_replica.cc:333] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848: stopping tablet replica
W20260709 13:22:24.453311 28198 leader_election.cc:336] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Network error: Client connection negotiation failed: client connection to 127.17.251.131:44409: connect: Connection refused (error 111)
W20260709 13:22:24.453931 28196 leader_election.cc:336] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:24.454442 28196 leader_election.cc:304] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:22:24.454860 18414 raft_consensus.cc:2243] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.455387 29205 raft_consensus.cc:2749] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:22:24.456039 18414 raft_consensus.cc:2272] T b4edfd4e5ea7461eaa8917755dff8c60 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.460103 18414 tablet_replica.cc:333] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.461037 18414 raft_consensus.cc:2243] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.462610 18414 raft_consensus.cc:2272] T 96c01bb7a8b84db7b8b44098cd5602a2 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:24.465497 28198 consensus_peers.cc:597] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 -> Peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Couldn't send request to peer afb0dc4e88ca4275975541dfe077b38b. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.131:44409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:24.466346 18414 tablet_replica.cc:333] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.467283 18414 raft_consensus.cc:2243] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.468953 18414 raft_consensus.cc:2272] T ed7ccef5723d4614918b18c47b9dfa3a P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.472461 18414 tablet_replica.cc:333] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.473380 18414 raft_consensus.cc:2243] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.473752 29205 raft_consensus.cc:493] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:24.474309 18414 raft_consensus.cc:2272] T a1ccc7022ab04f9a8ddc87ac37f31c7c P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.474642 29205 raft_consensus.cc:515] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:24.477699 18414 tablet_replica.cc:333] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.479089 18414 raft_consensus.cc:2243] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.479872 18414 raft_consensus.cc:2272] T a8359246c5ff428e89f3b5c15a65aa98 P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.482366 29205 leader_election.cc:290] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:24.484256 18414 tablet_replica.cc:333] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848: stopping tablet replica
W20260709 13:22:24.485235 28196 leader_election.cc:336] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:24.485507 18414 raft_consensus.cc:2243] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:22:24.487368 28198 leader_election.cc:336] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Network error: Client connection negotiation failed: client connection to 127.17.251.131:44409: connect: Connection refused (error 111)
I20260709 13:22:24.487599 18414 raft_consensus.cc:2272] T fff4d26a60a64a959845d8a267925536 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.487877 28198 leader_election.cc:304] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:22:24.488916 29205 raft_consensus.cc:2749] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:22:24.491452 18414 tablet_replica.cc:333] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.492311 18414 raft_consensus.cc:2243] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.493027 18414 raft_consensus.cc:2272] T a685a97179a94ca299d31636b789c516 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.496214 18414 tablet_replica.cc:333] T 8733000b90a544ba82435f9b7f6e5403 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.497051 18414 raft_consensus.cc:2243] T 8733000b90a544ba82435f9b7f6e5403 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.497975 18414 raft_consensus.cc:2272] T 8733000b90a544ba82435f9b7f6e5403 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.500995 18414 tablet_replica.cc:333] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.501756 18414 raft_consensus.cc:2243] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.502355 18414 raft_consensus.cc:2272] T 88b8050a4f374a91b8993cd0d6ed3dbd P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.505004 18414 tablet_replica.cc:333] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.505754 18414 raft_consensus.cc:2243] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.506282 18414 raft_consensus.cc:2272] T bb17cd0859ea43a5b7c93c90f172a611 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.508685 18414 tablet_replica.cc:333] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.509349 18414 raft_consensus.cc:2243] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.510044 18414 raft_consensus.cc:2272] T 6a85c97f3d564240a87737e17e8b536e P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.511662 29205 raft_consensus.cc:493] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:24.512377 29205 raft_consensus.cc:515] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb0dc4e88ca4275975541dfe077b38b" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 44409 } } peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } }
I20260709 13:22:24.513233 18414 tablet_replica.cc:333] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.514426 18414 raft_consensus.cc:2243] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.515259 18414 raft_consensus.cc:2272] T 6dd28360227f4dca8286a91d1be17d04 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.515059 29205 leader_election.cc:290] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409), 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695)
I20260709 13:22:24.518875 18414 tablet_replica.cc:333] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.519934 18414 raft_consensus.cc:2243] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:22:24.520741 28198 leader_election.cc:336] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer afb0dc4e88ca4275975541dfe077b38b (127.17.251.131:44409): Network error: Client connection negotiation failed: client connection to 127.17.251.131:44409: connect: Connection refused (error 111)
W20260709 13:22:24.521405 28196 leader_election.cc:336] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:24.521929 28196 leader_election.cc:304] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, afb0dc4e88ca4275975541dfe077b38b
I20260709 13:22:24.522182 18414 raft_consensus.cc:2272] T d72f52140be74d50aeccec9aebfd2f5b P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.522748 29205 raft_consensus.cc:2749] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:22:24.525475 18414 tablet_replica.cc:333] T e7175e0071a54910af34661c079bcca4 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.526302 18414 raft_consensus.cc:2243] T e7175e0071a54910af34661c079bcca4 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.526912 18414 raft_consensus.cc:2272] T e7175e0071a54910af34661c079bcca4 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.529558 18414 tablet_replica.cc:333] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.530282 18414 raft_consensus.cc:2243] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.530825 18414 raft_consensus.cc:2272] T 44f20c0135d64866abcf710b9b331281 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.533044 18414 tablet_replica.cc:333] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.533603 18414 raft_consensus.cc:2243] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.534118 18414 raft_consensus.cc:2272] T d84d9e7845264be9b66bcd292aab7e1d P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.535276 29205 raft_consensus.cc:493] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b1d1aefe48e42119ca040c70045fe28)
I20260709 13:22:24.535943 29205 raft_consensus.cc:515] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2f737d674147808bb32783de176848" member_type: VOTER last_known_addr { host: "127.17.251.132" port: 36151 } } peers { permanent_uuid: "6b1d1aefe48e42119ca040c70045fe28" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 33695 } } peers { permanent_uuid: "d80a443d06244116ae813b77fc539651" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 43901 } }
I20260709 13:22:24.537050 18414 tablet_replica.cc:333] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.538096 18414 raft_consensus.cc:2243] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:22:24.538875 28196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:22:24.539332 18414 raft_consensus.cc:2272] T 75fae586ea8f4cc8a5e968c2e41f2e8d P 2e2f737d674147808bb32783de176848 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.540129 29205 leader_election.cc:290] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695), d80a443d06244116ae813b77fc539651 (127.17.251.130:43901)
W20260709 13:22:24.542970 28196 leader_election.cc:336] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6b1d1aefe48e42119ca040c70045fe28 (127.17.251.129:33695): Network error: Client connection negotiation failed: client connection to 127.17.251.129:33695: connect: Connection refused (error 111)
I20260709 13:22:24.543529 18414 tablet_replica.cc:333] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848: stopping tablet replica
W20260709 13:22:24.543532 28197 leader_election.cc:336] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d80a443d06244116ae813b77fc539651 (127.17.251.130:43901): Network error: Client connection negotiation failed: client connection to 127.17.251.130:43901: connect: Connection refused (error 111)
I20260709 13:22:24.544126 28197 leader_election.cc:304] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2f737d674147808bb32783de176848; no voters: 6b1d1aefe48e42119ca040c70045fe28, d80a443d06244116ae813b77fc539651
I20260709 13:22:24.544370 18414 raft_consensus.cc:2243] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.544778 29205 raft_consensus.cc:2749] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:22:24.545192 18414 raft_consensus.cc:2272] T 755b1458334b47b2ae9a71fb44952d95 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.548305 18414 tablet_replica.cc:333] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.548908 18414 raft_consensus.cc:2243] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.550143 18414 raft_consensus.cc:2272] T d90c9f452bac4ef0b959ca0e78ab475f P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.552371 18414 tablet_replica.cc:333] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.553031 18414 raft_consensus.cc:2243] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.553586 18414 raft_consensus.cc:2272] T 01b35f8e5efb4b2194c44623574d41e4 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.556017 18414 tablet_replica.cc:333] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.556648 18414 raft_consensus.cc:2243] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.557175 18414 raft_consensus.cc:2272] T 34330356e21a4098a1c12380085e120f P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.559482 18414 tablet_replica.cc:333] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.560002 18414 raft_consensus.cc:2243] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.561290 18414 raft_consensus.cc:2272] T 3758e0f5638b496dbea84f0014c5e6a5 P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.563532 18414 tablet_replica.cc:333] T 251228d678dc4ab7887704367c7bd62a P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.564180 18414 raft_consensus.cc:2243] T 251228d678dc4ab7887704367c7bd62a P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.564675 18414 raft_consensus.cc:2272] T 251228d678dc4ab7887704367c7bd62a P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.567157 18414 tablet_replica.cc:333] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.567706 18414 raft_consensus.cc:2243] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.568718 18414 raft_consensus.cc:2272] T a8feb7220d3845768a841d7df788966e P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.570843 18414 tablet_replica.cc:333] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.571411 18414 raft_consensus.cc:2243] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.571938 18414 raft_consensus.cc:2272] T 6b91d5539ce0478a92a005af25d828a6 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.574328 18414 tablet_replica.cc:333] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.574909 18414 raft_consensus.cc:2243] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.575433 18414 raft_consensus.cc:2272] T 86e62ca8c25e497bb3f7ad553ee4f3c2 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.577687 18414 tablet_replica.cc:333] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.578214 18414 raft_consensus.cc:2243] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.578756 18414 raft_consensus.cc:2272] T 115ec4e7eaff44c191ebb3618716383c P 2e2f737d674147808bb32783de176848 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.634071 18414 tablet_replica.cc:333] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.634970 18414 raft_consensus.cc:2243] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.636580 18414 raft_consensus.cc:2272] T dc2ec8b6b6234ee6b530a1c4b7e18618 P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.640303 18414 tablet_replica.cc:333] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.641134 18414 raft_consensus.cc:2243] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:24.641932 18414 raft_consensus.cc:2272] T 9815241ff06642b59c8d28aaeb390d8e P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:24.645675 18414 tablet_replica.cc:333] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848: stopping tablet replica
I20260709 13:22:24.646386 18414 raft_consensus.cc:2243] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:24.648583 18414 raft_consensus.cc:2272] T 2964725f81fe44ec98f509298316722b P 2e2f737d674147808bb32783de176848 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:25.656153 28253 debug-util.cc:398] Leaking SignalData structure 0x7b0800360520 after lost signal to thread 18417
W20260709 13:22:25.657342 28253 debug-util.cc:398] Leaking SignalData structure 0x7b0800090a80 after lost signal to thread 27941
W20260709 13:22:25.739584 18414 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 28253)
W20260709 13:22:26.740238 18414 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 28253)
W20260709 13:22:27.740777 18414 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 28253)
I20260709 13:22:28.399891 18414 tablet_server.cc:196] TabletServer@127.17.251.132:0 shutdown complete.
I20260709 13:22:28.482206 18414 master.cc:562] Master@127.17.251.190:33451 shutting down...
I20260709 13:22:28.513134 18414 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:28.513924 18414 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:28.514271 18414 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9932ddcf115449d3b4be7818b4d708db: stopping tablet replica
I20260709 13:22:28.561125 18414 master.cc:584] Master@127.17.251.190:33451 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (39338 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:22:28.664698 18414 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.251.190:39935
I20260709 13:22:28.666337 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:28.672789 29206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:28.672844 29207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:28.673384 29209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:28.674093 18414 server_base.cc:1061] running on GCE node
I20260709 13:22:28.675240 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:28.675470 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:28.675638 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603348675618 us; error 0 us; skew 500 ppm
I20260709 13:22:28.676386 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:28.679008 18414 webserver.cc:533] Webserver started at http://127.17.251.190:37893/ using document root <none> and password file <none>
I20260709 13:22:28.679520 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:28.679735 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:28.680028 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:28.681340 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/master-0-root/instance:
uuid: "0e4e6a0c59f7444088e57abf08e39c53"
format_stamp: "Formatted at 2026-07-09 13:22:28 on dist-test-slave-7f95"
I20260709 13:22:28.686101 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:28.689741 29214 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:28.690506 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:22:28.690814 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/master-0-root
uuid: "0e4e6a0c59f7444088e57abf08e39c53"
format_stamp: "Formatted at 2026-07-09 13:22:28 on dist-test-slave-7f95"
I20260709 13:22:28.691112 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:28.708259 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:28.709525 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:28.751101 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.190:39935
I20260709 13:22:28.751195 29265 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.190:39935 every 8 connection(s)
I20260709 13:22:28.755532 29266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:28.767432 29266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53: Bootstrap starting.
I20260709 13:22:28.772430 29266 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:28.776981 29266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53: No bootstrap required, opened a new log
I20260709 13:22:28.779384 29266 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e4e6a0c59f7444088e57abf08e39c53" member_type: VOTER }
I20260709 13:22:28.779807 29266 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:28.780054 29266 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e4e6a0c59f7444088e57abf08e39c53, State: Initialized, Role: FOLLOWER
I20260709 13:22:28.780712 29266 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e4e6a0c59f7444088e57abf08e39c53" member_type: VOTER }
I20260709 13:22:28.781194 29266 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:28.781438 29266 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:28.781744 29266 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:28.786975 29266 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e4e6a0c59f7444088e57abf08e39c53" member_type: VOTER }
I20260709 13:22:28.787547 29266 leader_election.cc:304] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e4e6a0c59f7444088e57abf08e39c53; no voters: 
I20260709 13:22:28.788825 29266 leader_election.cc:290] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:28.789182 29269 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:28.790714 29269 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [term 1 LEADER]: Becoming Leader. State: Replica: 0e4e6a0c59f7444088e57abf08e39c53, State: Running, Role: LEADER
I20260709 13:22:28.791519 29269 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e4e6a0c59f7444088e57abf08e39c53" member_type: VOTER }
I20260709 13:22:28.791986 29266 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:28.796620 29270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e4e6a0c59f7444088e57abf08e39c53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e4e6a0c59f7444088e57abf08e39c53" member_type: VOTER } }
I20260709 13:22:28.797086 29271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e4e6a0c59f7444088e57abf08e39c53. Latest consensus state: current_term: 1 leader_uuid: "0e4e6a0c59f7444088e57abf08e39c53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e4e6a0c59f7444088e57abf08e39c53" member_type: VOTER } }
I20260709 13:22:28.797452 29270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:28.797679 29271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:28.800305 29275 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:28.808863 29275 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:28.810367 18414 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:28.819625 29275 catalog_manager.cc:1383] Generated new cluster ID: 04c8dd2cc6af422e8591df9c5c21fd47
I20260709 13:22:28.819998 29275 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:28.838137 29275 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:28.839510 29275 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:28.854395 29275 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53: Generated new TSK 0
I20260709 13:22:28.855104 29275 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:28.877234 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:28.883850 29287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:28.884848 29288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:28.886379 29290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:28.887068 18414 server_base.cc:1061] running on GCE node
I20260709 13:22:28.887996 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:28.888180 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:28.888298 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603348888288 us; error 0 us; skew 500 ppm
I20260709 13:22:28.888799 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:28.891129 18414 webserver.cc:533] Webserver started at http://127.17.251.129:45883/ using document root <none> and password file <none>
I20260709 13:22:28.891603 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:28.891764 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:28.891990 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:28.893337 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-0-root/instance:
uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
format_stamp: "Formatted at 2026-07-09 13:22:28 on dist-test-slave-7f95"
I20260709 13:22:28.897863 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:22:28.900985 29295 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:28.901808 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:22:28.902098 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-0-root
uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
format_stamp: "Formatted at 2026-07-09 13:22:28 on dist-test-slave-7f95"
I20260709 13:22:28.902410 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:28.930935 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:28.932258 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:28.933943 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:28.936389 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:28.936621 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:28.936883 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:28.937074 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:28.979369 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.129:40115
I20260709 13:22:28.979467 29357 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.129:40115 every 8 connection(s)
I20260709 13:22:28.984663 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:28.991883 29362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:28.992237 29363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:28.995666 29365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:28.996698 18414 server_base.cc:1061] running on GCE node
I20260709 13:22:28.997995 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:28.998231 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:28.998406 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603348998385 us; error 0 us; skew 500 ppm
I20260709 13:22:28.998974 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:29.001816 18414 webserver.cc:533] Webserver started at http://127.17.251.130:41267/ using document root <none> and password file <none>
I20260709 13:22:29.002378 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:29.002626 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:29.002951 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:29.003300 29358 heartbeater.cc:344] Connected to a master server at 127.17.251.190:39935
I20260709 13:22:29.003757 29358 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:29.004518 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-1-root/instance:
uuid: "c1f91ebc21464cca9f3ff200dd243882"
format_stamp: "Formatted at 2026-07-09 13:22:29 on dist-test-slave-7f95"
I20260709 13:22:29.004649 29358 heartbeater.cc:507] Master 127.17.251.190:39935 requested a full tablet report, sending...
I20260709 13:22:29.006990 29231 ts_manager.cc:194] Registered new tserver with Master: 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115)
I20260709 13:22:29.009662 29231 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59768
I20260709 13:22:29.010576 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.007s
I20260709 13:22:29.014240 29370 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:29.014981 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:22:29.015233 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-1-root
uuid: "c1f91ebc21464cca9f3ff200dd243882"
format_stamp: "Formatted at 2026-07-09 13:22:29 on dist-test-slave-7f95"
I20260709 13:22:29.015473 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:29.037412 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:29.038717 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:29.040184 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:29.042515 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:29.042712 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:29.043015 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:29.043180 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:29.083887 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.130:34511
I20260709 13:22:29.084019 29432 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.130:34511 every 8 connection(s)
I20260709 13:22:29.088848 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:29.096052 29436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:29.098376 29437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:29.101562 29439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:29.102602 29433 heartbeater.cc:344] Connected to a master server at 127.17.251.190:39935
I20260709 13:22:29.103050 29433 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:29.103770 18414 server_base.cc:1061] running on GCE node
I20260709 13:22:29.104036 29433 heartbeater.cc:507] Master 127.17.251.190:39935 requested a full tablet report, sending...
I20260709 13:22:29.104899 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:29.105211 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:29.105404 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603349105386 us; error 0 us; skew 500 ppm
I20260709 13:22:29.106025 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:29.106400 29231 ts_manager.cc:194] Registered new tserver with Master: c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:29.108119 29231 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59784
I20260709 13:22:29.108701 18414 webserver.cc:533] Webserver started at http://127.17.251.131:42599/ using document root <none> and password file <none>
I20260709 13:22:29.109298 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:29.109515 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:29.109870 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:29.111266 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-2-root/instance:
uuid: "bc16d3a078044ee081d6dc1f2fe92657"
format_stamp: "Formatted at 2026-07-09 13:22:29 on dist-test-slave-7f95"
I20260709 13:22:29.115705 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:22:29.118891 29444 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:29.119660 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:22:29.119956 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-2-root
uuid: "bc16d3a078044ee081d6dc1f2fe92657"
format_stamp: "Formatted at 2026-07-09 13:22:29 on dist-test-slave-7f95"
I20260709 13:22:29.120258 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:29.138099 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:29.139297 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:29.140805 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:29.143028 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:29.143262 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:29.143497 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:29.143678 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:29.185582 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.131:36961
I20260709 13:22:29.185766 29506 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.131:36961 every 8 connection(s)
I20260709 13:22:29.200268 29507 heartbeater.cc:344] Connected to a master server at 127.17.251.190:39935
I20260709 13:22:29.200757 29507 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:29.201545 29507 heartbeater.cc:507] Master 127.17.251.190:39935 requested a full tablet report, sending...
I20260709 13:22:29.203756 29231 ts_manager.cc:194] Registered new tserver with Master: bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:29.203904 18414 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014902168s
I20260709 13:22:29.205715 29231 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59800
I20260709 13:22:29.231211 29231 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59814:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:29.234206 29231 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:29.312548 29323 tablet_service.cc:1511] Processing CreateTablet for tablet 49b853389a34460e871a95cae81aef1b (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:22:29.314110 29323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b853389a34460e871a95cae81aef1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.314062 29320 tablet_service.cc:1511] Processing CreateTablet for tablet b73acada0ca644e4a0edabb1028ae717 (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:22:29.315603 29320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b73acada0ca644e4a0edabb1028ae717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.318244 29321 tablet_service.cc:1511] Processing CreateTablet for tablet e6be5c437aff4fc1ac20b95bbdbb73cd (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:22:29.319346 29319 tablet_service.cc:1511] Processing CreateTablet for tablet f04ccf1a4c134687af79a56cc6ddc0e2 (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:22:29.321197 29322 tablet_service.cc:1511] Processing CreateTablet for tablet cb327970a55b483289199513e743156e (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:22:29.319753 29321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6be5c437aff4fc1ac20b95bbdbb73cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.322865 29322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb327970a55b483289199513e743156e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.323519 29319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04ccf1a4c134687af79a56cc6ddc0e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.325748 29398 tablet_service.cc:1511] Processing CreateTablet for tablet 49b853389a34460e871a95cae81aef1b (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:22:29.325760 29318 tablet_service.cc:1511] Processing CreateTablet for tablet bedfb7ffc3ce484bb2b2b312c5a37f4b (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:22:29.327483 29398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b853389a34460e871a95cae81aef1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.327551 29318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bedfb7ffc3ce484bb2b2b312c5a37f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.334892 29397 tablet_service.cc:1511] Processing CreateTablet for tablet cb327970a55b483289199513e743156e (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:22:29.336441 29397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb327970a55b483289199513e743156e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.346890 29396 tablet_service.cc:1511] Processing CreateTablet for tablet e6be5c437aff4fc1ac20b95bbdbb73cd (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:22:29.348495 29396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6be5c437aff4fc1ac20b95bbdbb73cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.353746 29395 tablet_service.cc:1511] Processing CreateTablet for tablet b73acada0ca644e4a0edabb1028ae717 (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:22:29.355304 29395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b73acada0ca644e4a0edabb1028ae717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.363018 29317 tablet_service.cc:1511] Processing CreateTablet for tablet a4bdea60f82e48de85a6a242875c05fd (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:22:29.365053 29317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4bdea60f82e48de85a6a242875c05fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.374625 29394 tablet_service.cc:1511] Processing CreateTablet for tablet f04ccf1a4c134687af79a56cc6ddc0e2 (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:22:29.376180 29394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04ccf1a4c134687af79a56cc6ddc0e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.379434 29393 tablet_service.cc:1511] Processing CreateTablet for tablet bedfb7ffc3ce484bb2b2b312c5a37f4b (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:22:29.380950 29393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bedfb7ffc3ce484bb2b2b312c5a37f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.381544 29391 tablet_service.cc:1511] Processing CreateTablet for tablet e7814d4c68564172a5d484898d9f5a19 (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:22:29.383044 29391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7814d4c68564172a5d484898d9f5a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.382870 29392 tablet_service.cc:1511] Processing CreateTablet for tablet a4bdea60f82e48de85a6a242875c05fd (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:22:29.375775 29316 tablet_service.cc:1511] Processing CreateTablet for tablet e7814d4c68564172a5d484898d9f5a19 (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:22:29.384867 29316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7814d4c68564172a5d484898d9f5a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.386037 29392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4bdea60f82e48de85a6a242875c05fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.410981 29472 tablet_service.cc:1511] Processing CreateTablet for tablet 49b853389a34460e871a95cae81aef1b (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:22:29.412556 29472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b853389a34460e871a95cae81aef1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.414942 29470 tablet_service.cc:1511] Processing CreateTablet for tablet e6be5c437aff4fc1ac20b95bbdbb73cd (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:22:29.416486 29470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6be5c437aff4fc1ac20b95bbdbb73cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.419836 29466 tablet_service.cc:1511] Processing CreateTablet for tablet a4bdea60f82e48de85a6a242875c05fd (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:22:29.421010 29471 tablet_service.cc:1511] Processing CreateTablet for tablet cb327970a55b483289199513e743156e (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:22:29.419836 29468 tablet_service.cc:1511] Processing CreateTablet for tablet f04ccf1a4c134687af79a56cc6ddc0e2 (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:22:29.421293 29467 tablet_service.cc:1511] Processing CreateTablet for tablet bedfb7ffc3ce484bb2b2b312c5a37f4b (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:22:29.423059 29469 tablet_service.cc:1511] Processing CreateTablet for tablet b73acada0ca644e4a0edabb1028ae717 (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:22:29.430702 29390 tablet_service.cc:1511] Processing CreateTablet for tablet 2933283aca654c2580c5899cba38f514 (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:22:29.432232 29390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2933283aca654c2580c5899cba38f514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.433903 29322 tablet_service.cc:1511] Processing CreateTablet for tablet eb4b578b0a274a6e9d6a05cf5d6aad7f (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:22:29.435323 29322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4b578b0a274a6e9d6a05cf5d6aad7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.434947 29465 tablet_service.cc:1511] Processing CreateTablet for tablet e7814d4c68564172a5d484898d9f5a19 (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:22:29.437989 29471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb327970a55b483289199513e743156e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.438091 29464 tablet_service.cc:1511] Processing CreateTablet for tablet 2933283aca654c2580c5899cba38f514 (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:22:29.439476 29465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7814d4c68564172a5d484898d9f5a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.442096 29468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04ccf1a4c134687af79a56cc6ddc0e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.443317 29466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4bdea60f82e48de85a6a242875c05fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.444208 29464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2933283aca654c2580c5899cba38f514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.445381 29469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b73acada0ca644e4a0edabb1028ae717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.447144 29523 tablet_bootstrap.cc:492] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882: Bootstrap starting.
I20260709 13:22:29.450611 29389 tablet_service.cc:1511] Processing CreateTablet for tablet eb4b578b0a274a6e9d6a05cf5d6aad7f (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:22:29.452179 29389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4b578b0a274a6e9d6a05cf5d6aad7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.455487 29463 tablet_service.cc:1511] Processing CreateTablet for tablet eb4b578b0a274a6e9d6a05cf5d6aad7f (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:22:29.456928 29463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4b578b0a274a6e9d6a05cf5d6aad7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.466202 29467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bedfb7ffc3ce484bb2b2b312c5a37f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.472229 29522 tablet_bootstrap.cc:492] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
I20260709 13:22:29.472453 29319 tablet_service.cc:1511] Processing CreateTablet for tablet 2933283aca654c2580c5899cba38f514 (DEFAULT_TABLE table=test-workload [id=8347448d103d43eba3298da03df8455a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:22:29.473865 29319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2933283aca654c2580c5899cba38f514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:29.489861 29523 tablet_bootstrap.cc:654] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.522230 29522 tablet_bootstrap.cc:654] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.537940 29524 tablet_bootstrap.cc:492] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657: Bootstrap starting.
I20260709 13:22:29.539052 29523 tablet_bootstrap.cc:492] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882: No bootstrap required, opened a new log
I20260709 13:22:29.539629 29523 ts_tablet_manager.cc:1403] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882: Time spent bootstrapping tablet: real 0.093s	user 0.006s	sys 0.008s
I20260709 13:22:29.548696 29524 tablet_bootstrap.cc:654] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.559839 29523 raft_consensus.cc:359] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.561079 29523 raft_consensus.cc:385] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.561425 29523 raft_consensus.cc:740] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.562184 29522 tablet_bootstrap.cc:492] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9: No bootstrap required, opened a new log
I20260709 13:22:29.562273 29523 consensus_queue.cc:260] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.562855 29522 ts_tablet_manager.cc:1403] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.091s	user 0.009s	sys 0.007s
I20260709 13:22:29.563020 29524 tablet_bootstrap.cc:492] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657: No bootstrap required, opened a new log
I20260709 13:22:29.563519 29524 ts_tablet_manager.cc:1403] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 13:22:29.564735 29433 heartbeater.cc:499] Master 127.17.251.190:39935 was elected leader, sending a full tablet report...
I20260709 13:22:29.565306 29523 ts_tablet_manager.cc:1434] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:22:29.566322 29523 tablet_bootstrap.cc:492] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882: Bootstrap starting.
I20260709 13:22:29.566039 29522 raft_consensus.cc:359] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.566823 29522 raft_consensus.cc:385] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.566526 29524 raft_consensus.cc:359] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.567138 29522 raft_consensus.cc:740] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.567252 29524 raft_consensus.cc:385] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.567575 29524 raft_consensus.cc:740] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.568111 29522 consensus_queue.cc:260] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.568441 29524 consensus_queue.cc:260] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.573073 29523 tablet_bootstrap.cc:654] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.575683 29524 ts_tablet_manager.cc:1434] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.004s
I20260709 13:22:29.576776 29507 heartbeater.cc:499] Master 127.17.251.190:39935 was elected leader, sending a full tablet report...
I20260709 13:22:29.584192 29524 tablet_bootstrap.cc:492] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657: Bootstrap starting.
W20260709 13:22:29.588128 29434 tablet.cc:2406] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:22:29.592941 29358 heartbeater.cc:499] Master 127.17.251.190:39935 was elected leader, sending a full tablet report...
I20260709 13:22:29.588122 29528 raft_consensus.cc:493] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:29.594172 29528 raft_consensus.cc:515] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.596212 29524 tablet_bootstrap.cc:654] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.597095 29522 ts_tablet_manager.cc:1434] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.034s	user 0.021s	sys 0.005s
I20260709 13:22:29.598753 29522 tablet_bootstrap.cc:492] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
I20260709 13:22:29.592881 29529 raft_consensus.cc:493] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:29.600148 29523 tablet_bootstrap.cc:492] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882: No bootstrap required, opened a new log
I20260709 13:22:29.599989 29529 raft_consensus.cc:515] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.600813 29523 ts_tablet_manager.cc:1403] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.003s
I20260709 13:22:29.605253 29523 raft_consensus.cc:359] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.606033 29523 raft_consensus.cc:385] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.606315 29523 raft_consensus.cc:740] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.607100 29523 consensus_queue.cc:260] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.609426 29523 ts_tablet_manager.cc:1434] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:22:29.610540 29523 tablet_bootstrap.cc:492] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882: Bootstrap starting.
I20260709 13:22:29.611428 29333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b853389a34460e871a95cae81aef1b" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" is_pre_election: true
W20260709 13:22:29.613413 29371 leader_election.cc:343] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:29.627460 29523 tablet_bootstrap.cc:654] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.633479 29528 leader_election.cc:290] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:29.640529 29529 leader_election.cc:290] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:29.645669 29522 tablet_bootstrap.cc:654] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.649845 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b853389a34460e871a95cae81aef1b" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657" is_pre_election: true
W20260709 13:22:29.652534 29371 leader_election.cc:343] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:29.653277 29371 leader_election.cc:304] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1f91ebc21464cca9f3ff200dd243882; no voters: 53b52b7f69b34e93b324b8eebec3bcc9, bc16d3a078044ee081d6dc1f2fe92657
I20260709 13:22:29.654522 29528 raft_consensus.cc:2749] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:29.664920 29524 tablet_bootstrap.cc:492] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657: No bootstrap required, opened a new log
I20260709 13:22:29.671175 29524 ts_tablet_manager.cc:1403] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.010s
I20260709 13:22:29.677896 29522 tablet_bootstrap.cc:492] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9: No bootstrap required, opened a new log
I20260709 13:22:29.678537 29522 ts_tablet_manager.cc:1403] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.080s	user 0.021s	sys 0.019s
I20260709 13:22:29.681777 29522 raft_consensus.cc:359] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.682533 29522 raft_consensus.cc:385] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.682832 29522 raft_consensus.cc:740] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.683552 29522 consensus_queue.cc:260] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.684526 29524 raft_consensus.cc:359] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.685336 29524 raft_consensus.cc:385] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.685663 29524 raft_consensus.cc:740] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.685860 29522 ts_tablet_manager.cc:1434] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:29.687045 29522 tablet_bootstrap.cc:492] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
I20260709 13:22:29.694293 29522 tablet_bootstrap.cc:654] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.696914 29523 tablet_bootstrap.cc:492] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882: No bootstrap required, opened a new log
I20260709 13:22:29.696694 29524 consensus_queue.cc:260] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.706226 29522 tablet_bootstrap.cc:492] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9: No bootstrap required, opened a new log
I20260709 13:22:29.706904 29522 ts_tablet_manager.cc:1403] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.005s
I20260709 13:22:29.708247 29524 ts_tablet_manager.cc:1434] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:22:29.709702 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04ccf1a4c134687af79a56cc6ddc0e2" candidate_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657" is_pre_election: true
I20260709 13:22:29.710183 29522 raft_consensus.cc:359] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.706305 29523 ts_tablet_manager.cc:1403] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882: Time spent bootstrapping tablet: real 0.096s	user 0.009s	sys 0.009s
I20260709 13:22:29.710961 29522 raft_consensus.cc:385] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.711855 29522 raft_consensus.cc:740] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
W20260709 13:22:29.712870 29296 leader_election.cc:343] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:29.712718 29522 consensus_queue.cc:260] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.715286 29522 ts_tablet_manager.cc:1434] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:22:29.709757 29524 tablet_bootstrap.cc:492] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657: Bootstrap starting.
I20260709 13:22:29.722550 29522 tablet_bootstrap.cc:492] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
I20260709 13:22:29.727626 29523 raft_consensus.cc:359] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.728443 29523 raft_consensus.cc:385] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.728765 29523 raft_consensus.cc:740] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.731292 29523 consensus_queue.cc:260] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.733456 29523 ts_tablet_manager.cc:1434] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.003s
I20260709 13:22:29.734091 29522 tablet_bootstrap.cc:654] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.735898 29523 tablet_bootstrap.cc:492] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882: Bootstrap starting.
I20260709 13:22:29.745220 29523 tablet_bootstrap.cc:654] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.747480 29524 tablet_bootstrap.cc:654] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.750447 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04ccf1a4c134687af79a56cc6ddc0e2" candidate_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882" is_pre_election: true
W20260709 13:22:29.752177 29298 leader_election.cc:343] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:29.752681 29298 leader_election.cc:304] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9; no voters: bc16d3a078044ee081d6dc1f2fe92657, c1f91ebc21464cca9f3ff200dd243882
I20260709 13:22:29.753959 29533 raft_consensus.cc:2749] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:29.754696 29522 tablet_bootstrap.cc:492] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9: No bootstrap required, opened a new log
I20260709 13:22:29.755272 29522 ts_tablet_manager.cc:1403] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.009s
I20260709 13:22:29.755434 29524 tablet_bootstrap.cc:492] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657: No bootstrap required, opened a new log
I20260709 13:22:29.755980 29524 ts_tablet_manager.cc:1403] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657: Time spent bootstrapping tablet: real 0.046s	user 0.006s	sys 0.007s
I20260709 13:22:29.758486 29522 raft_consensus.cc:359] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.758882 29524 raft_consensus.cc:359] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.759280 29522 raft_consensus.cc:385] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.759668 29524 raft_consensus.cc:385] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.759750 29522 raft_consensus.cc:740] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.760092 29524 raft_consensus.cc:740] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.760854 29524 consensus_queue.cc:260] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.760778 29522 consensus_queue.cc:260] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.761584 29523 tablet_bootstrap.cc:492] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882: No bootstrap required, opened a new log
I20260709 13:22:29.762180 29523 ts_tablet_manager.cc:1403] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.007s
I20260709 13:22:29.763175 29524 ts_tablet_manager.cc:1434] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:22:29.764262 29524 tablet_bootstrap.cc:492] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657: Bootstrap starting.
I20260709 13:22:29.765765 29522 ts_tablet_manager.cc:1434] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.006s
I20260709 13:22:29.766798 29522 tablet_bootstrap.cc:492] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
I20260709 13:22:29.771652 29524 tablet_bootstrap.cc:654] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.775223 29522 tablet_bootstrap.cc:654] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.772163 29523 raft_consensus.cc:359] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.777324 29523 raft_consensus.cc:385] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.777690 29523 raft_consensus.cc:740] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.778517 29523 consensus_queue.cc:260] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.780733 29523 ts_tablet_manager.cc:1434] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.001s
I20260709 13:22:29.782434 29523 tablet_bootstrap.cc:492] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882: Bootstrap starting.
I20260709 13:22:29.784308 29522 tablet_bootstrap.cc:492] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9: No bootstrap required, opened a new log
I20260709 13:22:29.784924 29522 ts_tablet_manager.cc:1403] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.001s
I20260709 13:22:29.786945 29524 tablet_bootstrap.cc:492] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657: No bootstrap required, opened a new log
I20260709 13:22:29.787580 29524 ts_tablet_manager.cc:1403] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.011s
I20260709 13:22:29.788105 29522 raft_consensus.cc:359] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.789177 29522 raft_consensus.cc:385] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.789474 29522 raft_consensus.cc:740] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.790400 29522 consensus_queue.cc:260] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.791059 29524 raft_consensus.cc:359] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.791858 29523 tablet_bootstrap.cc:654] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.792276 29524 raft_consensus.cc:385] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.792786 29524 raft_consensus.cc:740] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.793474 29522 ts_tablet_manager.cc:1434] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:29.793912 29524 consensus_queue.cc:260] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.794648 29522 tablet_bootstrap.cc:492] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
I20260709 13:22:29.798923 29524 ts_tablet_manager.cc:1434] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:22:29.800060 29524 tablet_bootstrap.cc:492] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657: Bootstrap starting.
I20260709 13:22:29.803923 29522 tablet_bootstrap.cc:654] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:29.805086 29279 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:29.807320 29524 tablet_bootstrap.cc:654] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.808380 29523 tablet_bootstrap.cc:492] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882: No bootstrap required, opened a new log
I20260709 13:22:29.810052 29523 ts_tablet_manager.cc:1403] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.007s
I20260709 13:22:29.815101 29530 raft_consensus.cc:493] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:29.816037 29530 raft_consensus.cc:515] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.818881 29523 raft_consensus.cc:359] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.820107 29523 raft_consensus.cc:385] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.820513 29523 raft_consensus.cc:740] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.821842 29523 consensus_queue.cc:260] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.825502 29523 ts_tablet_manager.cc:1434] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:22:29.827051 29523 tablet_bootstrap.cc:492] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882: Bootstrap starting.
I20260709 13:22:29.832958 29522 tablet_bootstrap.cc:492] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9: No bootstrap required, opened a new log
I20260709 13:22:29.833676 29522 ts_tablet_manager.cc:1403] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.025s
I20260709 13:22:29.834081 29524 tablet_bootstrap.cc:492] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657: No bootstrap required, opened a new log
I20260709 13:22:29.834707 29524 ts_tablet_manager.cc:1403] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.016s
I20260709 13:22:29.837308 29523 tablet_bootstrap.cc:654] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.836992 29522 raft_consensus.cc:359] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.837888 29522 raft_consensus.cc:385] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.838239 29522 raft_consensus.cc:740] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.838258 29524 raft_consensus.cc:359] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.839362 29524 raft_consensus.cc:385] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.839438 29522 consensus_queue.cc:260] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.839738 29524 raft_consensus.cc:740] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.846753 29522 ts_tablet_manager.cc:1434] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:22:29.841827 29530 leader_election.cc:290] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:29.848111 29522 tablet_bootstrap.cc:492] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
I20260709 13:22:29.847661 29524 consensus_queue.cc:260] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.849751 29523 tablet_bootstrap.cc:492] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882: No bootstrap required, opened a new log
I20260709 13:22:29.850344 29523 ts_tablet_manager.cc:1403] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.002s
I20260709 13:22:29.853102 29524 ts_tablet_manager.cc:1434] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:22:29.853823 29523 raft_consensus.cc:359] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.854511 29524 tablet_bootstrap.cc:492] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657: Bootstrap starting.
I20260709 13:22:29.854684 29523 raft_consensus.cc:385] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.855386 29523 raft_consensus.cc:740] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.855762 29522 tablet_bootstrap.cc:654] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.856367 29523 consensus_queue.cc:260] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.861550 29533 raft_consensus.cc:493] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:29.862368 29523 ts_tablet_manager.cc:1434] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.006s
I20260709 13:22:29.862211 29533 raft_consensus.cc:515] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.863493 29524 tablet_bootstrap.cc:654] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.864890 29533 leader_election.cc:290] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:29.863547 29523 tablet_bootstrap.cc:492] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882: Bootstrap starting.
I20260709 13:22:29.867364 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedfb7ffc3ce484bb2b2b312c5a37f4b" candidate_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882" is_pre_election: true
I20260709 13:22:29.868094 29408 raft_consensus.cc:2468] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53b52b7f69b34e93b324b8eebec3bcc9 in term 0.
I20260709 13:22:29.869508 29298 leader_election.cc:304] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:29.870321 29522 tablet_bootstrap.cc:492] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9: No bootstrap required, opened a new log
I20260709 13:22:29.870428 29529 raft_consensus.cc:493] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:29.871080 29522 ts_tablet_manager.cc:1403] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 13:22:29.871176 29529 raft_consensus.cc:515] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.874442 29522 raft_consensus.cc:359] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.874958 29523 tablet_bootstrap.cc:654] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.875293 29522 raft_consensus.cc:385] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.875993 29522 raft_consensus.cc:740] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.876791 29522 consensus_queue.cc:260] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.879074 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedfb7ffc3ce484bb2b2b312c5a37f4b" candidate_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657" is_pre_election: true
I20260709 13:22:29.874989 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b578b0a274a6e9d6a05cf5d6aad7f" candidate_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882" is_pre_election: true
W20260709 13:22:29.882414 29298 leader_election.cc:343] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:29.876017 29529 leader_election.cc:290] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:29.884109 29529 raft_consensus.cc:2804] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:29.884584 29529 raft_consensus.cc:493] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:29.885013 29529 raft_consensus.cc:3060] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:29.887713 29530 raft_consensus.cc:493] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:29.887964 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b578b0a274a6e9d6a05cf5d6aad7f" candidate_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657" is_pre_election: true
I20260709 13:22:29.888375 29530 raft_consensus.cc:515] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
W20260709 13:22:29.890347 29296 leader_election.cc:343] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:29.890829 29530 leader_election.cc:290] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
W20260709 13:22:29.891755 29296 leader_election.cc:343] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:29.897776 29296 leader_election.cc:304] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9; no voters: bc16d3a078044ee081d6dc1f2fe92657, c1f91ebc21464cca9f3ff200dd243882
I20260709 13:22:29.902412 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882" is_pre_election: true
I20260709 13:22:29.905252 29533 raft_consensus.cc:2749] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:29.906072 29531 raft_consensus.cc:493] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:29.905587 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04ccf1a4c134687af79a56cc6ddc0e2" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882" is_pre_election: true
I20260709 13:22:29.906610 29531 raft_consensus.cc:515] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.911906 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7814d4c68564172a5d484898d9f5a19" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657" is_pre_election: true
I20260709 13:22:29.913055 29333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7814d4c68564172a5d484898d9f5a19" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" is_pre_election: true
W20260709 13:22:29.914354 29371 leader_election.cc:343] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:29.915565 29371 leader_election.cc:343] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:29.916249 29371 leader_election.cc:304] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1f91ebc21464cca9f3ff200dd243882; no voters: 53b52b7f69b34e93b324b8eebec3bcc9, bc16d3a078044ee081d6dc1f2fe92657
I20260709 13:22:29.917512 29528 raft_consensus.cc:2749] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:29.909408 29531 leader_election.cc:290] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:29.919996 29408 raft_consensus.cc:2468] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 0.
W20260709 13:22:29.921682 29447 leader_election.cc:343] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:29.922573 29447 leader_election.cc:304] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc16d3a078044ee081d6dc1f2fe92657, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:29.923439 29530 raft_consensus.cc:2804] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:29.924026 29530 raft_consensus.cc:493] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:29.924521 29530 raft_consensus.cc:3060] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:29.933975 29524 tablet_bootstrap.cc:492] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657: No bootstrap required, opened a new log
I20260709 13:22:29.934648 29524 ts_tablet_manager.cc:1403] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657: Time spent bootstrapping tablet: real 0.080s	user 0.026s	sys 0.015s
I20260709 13:22:29.934073 29529 raft_consensus.cc:515] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.936105 29522 ts_tablet_manager.cc:1434] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.065s	user 0.031s	sys 0.031s
I20260709 13:22:29.937744 29524 raft_consensus.cc:359] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.938124 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedfb7ffc3ce484bb2b2b312c5a37f4b" candidate_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
I20260709 13:22:29.938612 29524 raft_consensus.cc:385] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.938943 29524 raft_consensus.cc:740] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.938977 29408 raft_consensus.cc:3060] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:29.939831 29524 consensus_queue.cc:260] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.940181 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedfb7ffc3ce484bb2b2b312c5a37f4b" candidate_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
I20260709 13:22:29.940534 29522 tablet_bootstrap.cc:492] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
W20260709 13:22:29.941609 29296 leader_election.cc:343] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:29.939035 29529 leader_election.cc:290] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 election: Requested vote from peers c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:29.947870 29522 tablet_bootstrap.cc:654] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:29.949695 29523 tablet_bootstrap.cc:492] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882: No bootstrap required, opened a new log
I20260709 13:22:29.952721 29530 raft_consensus.cc:515] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.955435 29531 raft_consensus.cc:493] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:29.958417 29531 raft_consensus.cc:515] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.956399 29333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" is_pre_election: true
I20260709 13:22:29.950475 29523 ts_tablet_manager.cc:1403] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.007s
I20260709 13:22:29.961048 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04ccf1a4c134687af79a56cc6ddc0e2" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
I20260709 13:22:29.960107 29530 leader_election.cc:290] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:29.961606 29332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04ccf1a4c134687af79a56cc6ddc0e2" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" is_pre_election: true
I20260709 13:22:29.961848 29407 raft_consensus.cc:3060] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:29.962430 29332 raft_consensus.cc:2468] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 0.
I20260709 13:22:29.965438 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73acada0ca644e4a0edabb1028ae717" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" is_pre_election: true
I20260709 13:22:29.969261 29331 raft_consensus.cc:2468] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 0.
I20260709 13:22:29.970381 29407 raft_consensus.cc:2468] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 1.
I20260709 13:22:29.957269 29408 raft_consensus.cc:2468] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53b52b7f69b34e93b324b8eebec3bcc9 in term 1.
I20260709 13:22:29.971123 29371 leader_election.cc:304] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:29.973834 29528 raft_consensus.cc:2804] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:29.973577 29531 leader_election.cc:290] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:29.974004 29523 raft_consensus.cc:359] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.974965 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73acada0ca644e4a0edabb1028ae717" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657" is_pre_election: true
I20260709 13:22:29.975435 29528 raft_consensus.cc:493] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:22:29.974736 29445 leader_election.cc:343] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:29.975672 29523 raft_consensus.cc:385] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.975849 29528 raft_consensus.cc:3060] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:29.976357 29523 raft_consensus.cc:740] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Initialized, Role: FOLLOWER
W20260709 13:22:29.976804 29371 leader_election.cc:343] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:29.976158 29445 leader_election.cc:304] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc16d3a078044ee081d6dc1f2fe92657; no voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882
I20260709 13:22:29.977386 29523 consensus_queue.cc:260] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.977990 29530 raft_consensus.cc:2749] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:29.976696 29447 leader_election.cc:304] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc16d3a078044ee081d6dc1f2fe92657, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:29.980171 29523 ts_tablet_manager.cc:1434] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 13:22:29.981310 29523 tablet_bootstrap.cc:492] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882: Bootstrap starting.
I20260709 13:22:29.981803 29530 raft_consensus.cc:2804] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:29.982348 29530 raft_consensus.cc:697] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 LEADER]: Becoming Leader. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:29.983227 29530 consensus_queue.cc:237] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.974001 29524 ts_tablet_manager.cc:1434] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.015s
I20260709 13:22:29.974331 29332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04ccf1a4c134687af79a56cc6ddc0e2" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:29.984938 29332 raft_consensus.cc:3060] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:29.981204 29522 tablet_bootstrap.cc:492] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9: No bootstrap required, opened a new log
I20260709 13:22:29.987231 29522 ts_tablet_manager.cc:1403] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.008s
I20260709 13:22:29.988086 29524 tablet_bootstrap.cc:492] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657: Bootstrap starting.
I20260709 13:22:29.990923 29522 raft_consensus.cc:359] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.993041 29298 leader_election.cc:304] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882; no voters: bc16d3a078044ee081d6dc1f2fe92657
I20260709 13:22:29.994266 29522 raft_consensus.cc:385] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:29.994845 29522 raft_consensus.cc:740] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:29.995321 29554 raft_consensus.cc:493] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:29.995859 29554 raft_consensus.cc:515] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.995950 29522 consensus_queue.cc:260] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:29.997547 29533 raft_consensus.cc:2804] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:29.998267 29332 raft_consensus.cc:2468] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 1.
I20260709 13:22:29.999318 29522 ts_tablet_manager.cc:1434] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:22:30.004235 29522 tablet_bootstrap.cc:492] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
I20260709 13:22:30.004860 29523 tablet_bootstrap.cc:654] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:30.007205 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b853389a34460e871a95cae81aef1b" candidate_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882" is_pre_election: true
I20260709 13:22:30.008003 29408 raft_consensus.cc:2468] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53b52b7f69b34e93b324b8eebec3bcc9 in term 0.
I20260709 13:22:30.009557 29298 leader_election.cc:304] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:30.010667 29559 raft_consensus.cc:2804] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:30.011093 29559 raft_consensus.cc:493] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:30.011442 29559 raft_consensus.cc:3060] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.012696 29524 tablet_bootstrap.cc:654] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:30.014055 29522 tablet_bootstrap.cc:654] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:30.015316 29533 raft_consensus.cc:697] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 LEADER]: Becoming Leader. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Running, Role: LEADER
I20260709 13:22:30.016453 29533 consensus_queue.cc:237] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.019337 29523 tablet_bootstrap.cc:492] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882: No bootstrap required, opened a new log
I20260709 13:22:30.019944 29523 ts_tablet_manager.cc:1403] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.006s
I20260709 13:22:30.020030 29559 raft_consensus.cc:515] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.021404 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b853389a34460e871a95cae81aef1b" candidate_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657" is_pre_election: true
I20260709 13:22:30.022338 29482 raft_consensus.cc:2468] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53b52b7f69b34e93b324b8eebec3bcc9 in term 0.
I20260709 13:22:30.023082 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b853389a34460e871a95cae81aef1b" candidate_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
I20260709 13:22:30.023082 29523 raft_consensus.cc:359] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.023849 29408 raft_consensus.cc:3060] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.024050 29523 raft_consensus.cc:385] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:30.024488 29523 raft_consensus.cc:740] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Initialized, Role: FOLLOWER
I20260709 13:22:30.024471 29530 raft_consensus.cc:493] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:30.025393 29530 raft_consensus.cc:515] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.026739 29554 leader_election.cc:290] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:30.027598 29530 leader_election.cc:290] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:30.028806 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2933283aca654c2580c5899cba38f514" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882" is_pre_election: true
I20260709 13:22:30.028709 29523 consensus_queue.cc:260] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.029232 29332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2933283aca654c2580c5899cba38f514" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" is_pre_election: true
I20260709 13:22:30.030335 29407 raft_consensus.cc:2468] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 0.
I20260709 13:22:30.030375 29332 raft_consensus.cc:2468] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 0.
I20260709 13:22:30.032315 29523 ts_tablet_manager.cc:1434] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:22:30.032193 29447 leader_election.cc:304] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc16d3a078044ee081d6dc1f2fe92657, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:30.036211 29523 tablet_bootstrap.cc:492] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882: Bootstrap starting.
I20260709 13:22:30.039561 29530 raft_consensus.cc:2804] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:30.040323 29530 raft_consensus.cc:493] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:30.039569 29228 catalog_manager.cc:5697] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:30.040762 29530 raft_consensus.cc:3060] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.045540 29524 tablet_bootstrap.cc:492] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657: No bootstrap required, opened a new log
I20260709 13:22:30.046167 29524 ts_tablet_manager.cc:1403] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.017s
I20260709 13:22:30.048020 29554 raft_consensus.cc:493] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:30.048555 29554 raft_consensus.cc:515] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.051838 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb327970a55b483289199513e743156e" candidate_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657" is_pre_election: true
I20260709 13:22:30.051931 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb327970a55b483289199513e743156e" candidate_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882" is_pre_election: true
I20260709 13:22:30.053766 29559 leader_election.cc:290] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 election: Requested vote from peers c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:30.054206 29407 raft_consensus.cc:2468] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53b52b7f69b34e93b324b8eebec3bcc9 in term 0.
W20260709 13:22:30.055289 29296 leader_election.cc:343] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:30.053040 29554 leader_election.cc:290] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:30.056480 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b853389a34460e871a95cae81aef1b" candidate_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
I20260709 13:22:30.057111 29482 raft_consensus.cc:3060] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.056890 29530 raft_consensus.cc:515] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.055438 29408 raft_consensus.cc:2468] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53b52b7f69b34e93b324b8eebec3bcc9 in term 1.
I20260709 13:22:30.057811 29524 raft_consensus.cc:359] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.058333 29298 leader_election.cc:304] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882; no voters: bc16d3a078044ee081d6dc1f2fe92657
I20260709 13:22:30.058696 29524 raft_consensus.cc:385] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:30.059140 29524 raft_consensus.cc:740] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Initialized, Role: FOLLOWER
I20260709 13:22:30.063958 29524 consensus_queue.cc:260] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.066727 29524 ts_tablet_manager.cc:1434] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:22:30.067324 29522 tablet_bootstrap.cc:492] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9: No bootstrap required, opened a new log
I20260709 13:22:29.984656 29528 raft_consensus.cc:515] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.067914 29522 ts_tablet_manager.cc:1403] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.010s
I20260709 13:22:30.067759 29524 tablet_bootstrap.cc:492] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657: Bootstrap starting.
I20260709 13:22:30.067816 29556 raft_consensus.cc:493] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:30.062598 29554 raft_consensus.cc:2804] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:30.074998 29523 tablet_bootstrap.cc:654] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:30.071978 29298 leader_election.cc:304] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:30.070019 29332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2933283aca654c2580c5899cba38f514" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:30.077867 29559 raft_consensus.cc:2804] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:30.078137 29332 raft_consensus.cc:3060] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.078428 29559 raft_consensus.cc:697] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 LEADER]: Becoming Leader. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Running, Role: LEADER
I20260709 13:22:30.079702 29559 consensus_queue.cc:237] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.084934 29556 raft_consensus.cc:515] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.089160 29556 leader_election.cc:290] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:30.074239 29554 raft_consensus.cc:493] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:30.090009 29554 raft_consensus.cc:3060] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.090260 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6be5c437aff4fc1ac20b95bbdbb73cd" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" is_pre_election: true
I20260709 13:22:30.091372 29331 raft_consensus.cc:2468] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 0.
I20260709 13:22:30.093396 29445 leader_election.cc:304] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, bc16d3a078044ee081d6dc1f2fe92657; no voters: 
I20260709 13:22:30.090420 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6be5c437aff4fc1ac20b95bbdbb73cd" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882" is_pre_election: true
W20260709 13:22:30.095780 29447 leader_election.cc:343] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:30.111305 29524 tablet_bootstrap.cc:654] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:30.118706 29332 raft_consensus.cc:2468] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 1.
I20260709 13:22:30.123865 29530 leader_election.cc:290] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:30.121403 29556 raft_consensus.cc:2804] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:30.130602 29445 leader_election.cc:304] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, bc16d3a078044ee081d6dc1f2fe92657; no voters: 
I20260709 13:22:30.131871 29528 leader_election.cc:290] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:30.135046 29481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73acada0ca644e4a0edabb1028ae717" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
I20260709 13:22:30.136158 29482 raft_consensus.cc:2468] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53b52b7f69b34e93b324b8eebec3bcc9 in term 1.
W20260709 13:22:30.137840 29371 leader_election.cc:343] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:30.131016 29556 raft_consensus.cc:493] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:30.139278 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2933283aca654c2580c5899cba38f514" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
I20260709 13:22:30.139921 29556 raft_consensus.cc:3060] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.140352 29408 raft_consensus.cc:3060] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.140399 29332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73acada0ca644e4a0edabb1028ae717" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:30.141438 29332 raft_consensus.cc:3060] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.143217 29530 raft_consensus.cc:2804] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:30.153560 29522 raft_consensus.cc:359] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.154721 29522 raft_consensus.cc:385] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:30.155085 29522 raft_consensus.cc:740] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:30.156426 29522 consensus_queue.cc:260] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.122680 29554 raft_consensus.cc:515] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.164063 29524 tablet_bootstrap.cc:492] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657: No bootstrap required, opened a new log
I20260709 13:22:30.164850 29524 ts_tablet_manager.cc:1403] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657: Time spent bootstrapping tablet: real 0.097s	user 0.024s	sys 0.012s
I20260709 13:22:30.166620 29522 ts_tablet_manager.cc:1434] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.097s	user 0.009s	sys 0.000s
I20260709 13:22:30.167497 29556 raft_consensus.cc:515] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.167996 29522 tablet_bootstrap.cc:492] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
I20260709 13:22:30.168247 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb327970a55b483289199513e743156e" candidate_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
I20260709 13:22:30.168851 29407 raft_consensus.cc:3060] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.169776 29556 leader_election.cc:290] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:30.170135 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb327970a55b483289199513e743156e" candidate_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
W20260709 13:22:30.171640 29296 leader_election.cc:343] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:30.175994 29523 tablet_bootstrap.cc:492] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882: No bootstrap required, opened a new log
I20260709 13:22:30.176403 29523 ts_tablet_manager.cc:1403] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882: Time spent bootstrapping tablet: real 0.140s	user 0.043s	sys 0.039s
I20260709 13:22:30.168845 29554 leader_election.cc:290] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 election: Requested vote from peers c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:30.180096 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6be5c437aff4fc1ac20b95bbdbb73cd" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
I20260709 13:22:30.182262 29528 raft_consensus.cc:493] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:30.182762 29522 tablet_bootstrap.cc:654] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:30.178963 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6be5c437aff4fc1ac20b95bbdbb73cd" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
W20260709 13:22:30.183256 29447 leader_election.cc:343] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:30.182781 29528 raft_consensus.cc:515] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.183182 29231 catalog_manager.cc:5697] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:30.186045 29528 leader_election.cc:290] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:30.188287 29524 raft_consensus.cc:359] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.189040 29524 raft_consensus.cc:385] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:30.189306 29524 raft_consensus.cc:740] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Initialized, Role: FOLLOWER
I20260709 13:22:30.183337 29331 raft_consensus.cc:3060] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.189224 29407 raft_consensus.cc:2468] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53b52b7f69b34e93b324b8eebec3bcc9 in term 1.
I20260709 13:22:30.189469 29333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" is_pre_election: true
I20260709 13:22:30.191160 29332 raft_consensus.cc:2468] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 1.
I20260709 13:22:30.178781 29530 raft_consensus.cc:697] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 LEADER]: Becoming Leader. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:30.192829 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657" is_pre_election: true
I20260709 13:22:30.193233 29530 consensus_queue.cc:237] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
W20260709 13:22:30.193635 29371 leader_election.cc:343] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:30.193830 29482 raft_consensus.cc:2468] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 0.
I20260709 13:22:30.195205 29298 leader_election.cc:304] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882; no voters: bc16d3a078044ee081d6dc1f2fe92657
I20260709 13:22:30.196038 29554 raft_consensus.cc:2804] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:30.196688 29554 raft_consensus.cc:697] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 LEADER]: Becoming Leader. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Running, Role: LEADER
I20260709 13:22:30.197566 29554 consensus_queue.cc:237] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.199735 29371 leader_election.cc:304] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882; no voters: bc16d3a078044ee081d6dc1f2fe92657
I20260709 13:22:30.201220 29371 leader_election.cc:304] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc16d3a078044ee081d6dc1f2fe92657, c1f91ebc21464cca9f3ff200dd243882; no voters: 53b52b7f69b34e93b324b8eebec3bcc9
I20260709 13:22:30.202648 29531 raft_consensus.cc:2804] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:30.204093 29524 consensus_queue.cc:260] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.206753 29523 raft_consensus.cc:359] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.211244 29523 raft_consensus.cc:385] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:30.212492 29523 raft_consensus.cc:740] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Initialized, Role: FOLLOWER
I20260709 13:22:30.213372 29524 ts_tablet_manager.cc:1434] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.003s
I20260709 13:22:30.205946 29528 raft_consensus.cc:2804] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:30.215332 29531 raft_consensus.cc:697] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 1 LEADER]: Becoming Leader. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:30.218225 29408 raft_consensus.cc:2468] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 1.
I20260709 13:22:30.219168 29531 consensus_queue.cc:237] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.221131 29523 consensus_queue.cc:260] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.217844 29528 raft_consensus.cc:493] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:30.229167 29528 raft_consensus.cc:3060] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.228685 29570 raft_consensus.cc:493] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:30.230365 29570 raft_consensus.cc:515] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.230862 29522 tablet_bootstrap.cc:492] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9: No bootstrap required, opened a new log
I20260709 13:22:30.231541 29522 ts_tablet_manager.cc:1403] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.064s	user 0.025s	sys 0.012s
I20260709 13:22:30.234866 29570 leader_election.cc:290] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:30.240592 29332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedfb7ffc3ce484bb2b2b312c5a37f4b" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" is_pre_election: true
I20260709 13:22:30.242084 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedfb7ffc3ce484bb2b2b312c5a37f4b" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882" is_pre_election: true
I20260709 13:22:30.243180 29407 raft_consensus.cc:2393] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc16d3a078044ee081d6dc1f2fe92657 in current term 1: Already voted for candidate 53b52b7f69b34e93b324b8eebec3bcc9 in this term.
I20260709 13:22:30.235028 29331 raft_consensus.cc:2468] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 1.
I20260709 13:22:30.246636 29445 leader_election.cc:304] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, bc16d3a078044ee081d6dc1f2fe92657; no voters: c1f91ebc21464cca9f3ff200dd243882
I20260709 13:22:30.254288 29447 leader_election.cc:304] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc16d3a078044ee081d6dc1f2fe92657; no voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882
I20260709 13:22:30.250010 29570 raft_consensus.cc:2804] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:30.256110 29556 raft_consensus.cc:3060] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.258245 29524 tablet_bootstrap.cc:492] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657: Bootstrap starting.
I20260709 13:22:30.272073 29573 raft_consensus.cc:493] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:30.272940 29573 raft_consensus.cc:515] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.264736 29528 raft_consensus.cc:515] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.281296 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b578b0a274a6e9d6a05cf5d6aad7f" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657" is_pre_election: true
I20260709 13:22:30.277697 29522 raft_consensus.cc:359] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.282256 29522 raft_consensus.cc:385] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:30.282723 29522 raft_consensus.cc:740] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:30.279767 29573 leader_election.cc:290] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:30.283329 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b578b0a274a6e9d6a05cf5d6aad7f" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" is_pre_election: true
I20260709 13:22:30.282253 29482 raft_consensus.cc:2468] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 0.
I20260709 13:22:30.285082 29524 tablet_bootstrap.cc:654] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:30.284284 29331 raft_consensus.cc:2468] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 0.
I20260709 13:22:30.287037 29528 leader_election.cc:290] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:30.288714 29371 leader_election.cc:304] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:30.290926 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:30.292888 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
I20260709 13:22:30.294189 29482 raft_consensus.cc:3060] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.284284 29522 consensus_queue.cc:260] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.305680 29331 raft_consensus.cc:3060] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.305861 29528 raft_consensus.cc:2804] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:30.306301 29528 raft_consensus.cc:493] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:30.306670 29528 raft_consensus.cc:3060] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.307879 29522 ts_tablet_manager.cc:1434] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.076s	user 0.011s	sys 0.000s
I20260709 13:22:30.310479 29523 ts_tablet_manager.cc:1434] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882: Time spent starting tablet: real 0.134s	user 0.023s	sys 0.022s
I20260709 13:22:30.311930 29523 tablet_bootstrap.cc:492] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882: Bootstrap starting.
I20260709 13:22:30.313858 29570 raft_consensus.cc:697] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [term 1 LEADER]: Becoming Leader. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:30.314438 29578 raft_consensus.cc:493] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:30.314807 29482 raft_consensus.cc:2468] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 1.
I20260709 13:22:30.314926 29570 consensus_queue.cc:237] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.314986 29578 raft_consensus.cc:515] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.316401 29371 leader_election.cc:304] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc16d3a078044ee081d6dc1f2fe92657, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:30.317641 29575 raft_consensus.cc:2804] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:30.318198 29575 raft_consensus.cc:697] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 1 LEADER]: Becoming Leader. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:30.318522 29578 leader_election.cc:290] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:30.319082 29578 raft_consensus.cc:493] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:30.319073 29575 consensus_queue.cc:237] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.319799 29578 raft_consensus.cc:515] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.320596 29332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b578b0a274a6e9d6a05cf5d6aad7f" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" is_pre_election: true
I20260709 13:22:30.321137 29523 tablet_bootstrap.cc:654] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:30.321281 29332 raft_consensus.cc:2468] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 0.
I20260709 13:22:30.327219 29445 leader_election.cc:304] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, bc16d3a078044ee081d6dc1f2fe92657; no voters: 
I20260709 13:22:30.328147 29530 raft_consensus.cc:2804] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:30.328037 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b578b0a274a6e9d6a05cf5d6aad7f" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882" is_pre_election: true
I20260709 13:22:30.328626 29530 raft_consensus.cc:493] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:30.329026 29530 raft_consensus.cc:3060] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.330137 29333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7814d4c68564172a5d484898d9f5a19" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" is_pre_election: true
I20260709 13:22:30.279001 29556 raft_consensus.cc:2749] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:30.331087 29333 raft_consensus.cc:2468] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 0.
I20260709 13:22:30.335390 29578 leader_election.cc:290] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:30.337374 29445 leader_election.cc:304] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, bc16d3a078044ee081d6dc1f2fe92657; no voters: 
I20260709 13:22:30.338284 29578 raft_consensus.cc:2804] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:30.338682 29578 raft_consensus.cc:493] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:30.339015 29578 raft_consensus.cc:3060] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.340312 29331 raft_consensus.cc:2468] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 1.
I20260709 13:22:30.343302 29528 raft_consensus.cc:515] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.343849 29231 catalog_manager.cc:5697] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "c1f91ebc21464cca9f3ff200dd243882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:30.338120 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7814d4c68564172a5d484898d9f5a19" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882" is_pre_election: true
I20260709 13:22:30.345954 29407 raft_consensus.cc:2468] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 0.
I20260709 13:22:30.345999 29528 leader_election.cc:290] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:30.346360 29408 raft_consensus.cc:2393] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc16d3a078044ee081d6dc1f2fe92657 in current term 1: Already voted for candidate c1f91ebc21464cca9f3ff200dd243882 in this term.
I20260709 13:22:30.352500 29524 tablet_bootstrap.cc:492] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657: No bootstrap required, opened a new log
I20260709 13:22:30.353093 29524 ts_tablet_manager.cc:1403] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.010s
I20260709 13:22:30.356756 29578 raft_consensus.cc:515] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.359002 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b578b0a274a6e9d6a05cf5d6aad7f" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
I20260709 13:22:30.359278 29578 leader_election.cc:290] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:30.361726 29524 raft_consensus.cc:359] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.362993 29524 raft_consensus.cc:385] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:30.363266 29524 raft_consensus.cc:740] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Initialized, Role: FOLLOWER
I20260709 13:22:30.365957 29333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b578b0a274a6e9d6a05cf5d6aad7f" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:30.366878 29333 raft_consensus.cc:3060] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.346051 29228 catalog_manager.cc:5697] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:30.371968 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7814d4c68564172a5d484898d9f5a19" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
I20260709 13:22:30.372675 29408 raft_consensus.cc:3060] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.372361 29229 catalog_manager.cc:5697] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:30.374172 29333 raft_consensus.cc:2468] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 1.
I20260709 13:22:30.376096 29524 consensus_queue.cc:260] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.380722 29530 raft_consensus.cc:515] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.382006 29482 raft_consensus.cc:2393] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c1f91ebc21464cca9f3ff200dd243882 in current term 1: Already voted for candidate bc16d3a078044ee081d6dc1f2fe92657 in this term.
I20260709 13:22:30.382716 29228 catalog_manager.cc:5697] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:30.384253 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7814d4c68564172a5d484898d9f5a19" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:30.386786 29331 raft_consensus.cc:3060] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.389842 29408 raft_consensus.cc:2468] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 1.
I20260709 13:22:30.375551 29371 leader_election.cc:304] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:30.386886 29333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b578b0a274a6e9d6a05cf5d6aad7f" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:30.392596 29575 raft_consensus.cc:2804] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:30.393225 29333 raft_consensus.cc:2393] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bc16d3a078044ee081d6dc1f2fe92657 in current term 1: Already voted for candidate c1f91ebc21464cca9f3ff200dd243882 in this term.
I20260709 13:22:30.388525 29524 ts_tablet_manager.cc:1434] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 13:22:30.393162 29575 raft_consensus.cc:697] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [term 1 LEADER]: Becoming Leader. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:30.395677 29575 consensus_queue.cc:237] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.383809 29523 tablet_bootstrap.cc:492] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882: No bootstrap required, opened a new log
I20260709 13:22:30.393812 29447 leader_election.cc:304] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc16d3a078044ee081d6dc1f2fe92657, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:30.397500 29523 ts_tablet_manager.cc:1403] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.004s
I20260709 13:22:30.398039 29578 raft_consensus.cc:2804] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:30.398330 29524 tablet_bootstrap.cc:492] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657: Bootstrap starting.
I20260709 13:22:30.398577 29578 raft_consensus.cc:697] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 LEADER]: Becoming Leader. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:30.399490 29578 consensus_queue.cc:237] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.401834 29229 catalog_manager.cc:5697] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:30.385764 29530 leader_election.cc:290] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:30.394018 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b578b0a274a6e9d6a05cf5d6aad7f" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
I20260709 13:22:30.413563 29447 leader_election.cc:304] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc16d3a078044ee081d6dc1f2fe92657; no voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882
I20260709 13:22:30.413450 29523 raft_consensus.cc:359] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.414419 29523 raft_consensus.cc:385] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:30.414755 29524 tablet_bootstrap.cc:654] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:30.414997 29530 raft_consensus.cc:2749] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:30.396996 29331 raft_consensus.cc:2468] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 1.
I20260709 13:22:30.414717 29523 raft_consensus.cc:740] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Initialized, Role: FOLLOWER
I20260709 13:22:30.418048 29523 consensus_queue.cc:260] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.421031 29523 ts_tablet_manager.cc:1434] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.001s
I20260709 13:22:30.424861 29524 tablet_bootstrap.cc:492] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657: No bootstrap required, opened a new log
I20260709 13:22:30.425442 29524 ts_tablet_manager.cc:1403] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.004s
I20260709 13:22:30.425441 29228 catalog_manager.cc:5697] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:30.427716 29524 raft_consensus.cc:359] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.428272 29524 raft_consensus.cc:385] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:30.428501 29524 raft_consensus.cc:740] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Initialized, Role: FOLLOWER
I20260709 13:22:30.428414 29229 catalog_manager.cc:5697] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "c1f91ebc21464cca9f3ff200dd243882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:30.429383 29524 consensus_queue.cc:260] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.431141 29524 ts_tablet_manager.cc:1434] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:30.430510 29229 catalog_manager.cc:5697] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "c1f91ebc21464cca9f3ff200dd243882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:30.486644 29554 consensus_queue.cc:1048] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:30.502491 29533 consensus_queue.cc:1048] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:30.536568 18414 ts_manager.cc:295] Set tserver state for 53b52b7f69b34e93b324b8eebec3bcc9 to MAINTENANCE_MODE
I20260709 13:22:30.537381 18414 tablet_server.cc:179] TabletServer@127.17.251.129:0 shutting down...
I20260709 13:22:30.557399 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:30.558324 18414 tablet_replica.cc:333] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9: stopping tablet replica
I20260709 13:22:30.559284 18414 raft_consensus.cc:2243] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.559703 18414 raft_consensus.cc:2272] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.562083 18414 tablet_replica.cc:333] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9: stopping tablet replica
I20260709 13:22:30.562669 18414 raft_consensus.cc:2243] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.563265 18414 pending_rounds.cc:70] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9: Trying to abort 1 pending ops.
I20260709 13:22:30.563446 18414 pending_rounds.cc:77] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305639321749463040 op_type: NO_OP noop_request { }
I20260709 13:22:30.563771 18414 raft_consensus.cc:2889] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:22:30.564015 18414 raft_consensus.cc:2272] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.566370 18414 tablet_replica.cc:333] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9: stopping tablet replica
I20260709 13:22:30.566929 18414 raft_consensus.cc:2243] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.567770 18414 raft_consensus.cc:2272] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.570072 18414 tablet_replica.cc:333] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9: stopping tablet replica
I20260709 13:22:30.570633 18414 raft_consensus.cc:2243] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.570973 18414 raft_consensus.cc:2272] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.572693 18414 tablet_replica.cc:333] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9: stopping tablet replica
I20260709 13:22:30.573185 18414 raft_consensus.cc:2243] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:30.573873 18414 pending_rounds.cc:70] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9: Trying to abort 1 pending ops.
I20260709 13:22:30.574044 18414 pending_rounds.cc:77] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305639322539122688 op_type: NO_OP noop_request { }
I20260709 13:22:30.574283 18414 raft_consensus.cc:2889] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:22:30.574527 18414 raft_consensus.cc:2272] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.576936 18414 tablet_replica.cc:333] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9: stopping tablet replica
I20260709 13:22:30.577486 18414 raft_consensus.cc:2243] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.577947 18414 raft_consensus.cc:2272] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.579746 18414 tablet_replica.cc:333] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9: stopping tablet replica
I20260709 13:22:30.580278 18414 raft_consensus.cc:2243] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.580639 18414 raft_consensus.cc:2272] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.582621 18414 tablet_replica.cc:333] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9: stopping tablet replica
I20260709 13:22:30.583109 18414 raft_consensus.cc:2243] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.583459 18414 raft_consensus.cc:2272] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.585215 18414 tablet_replica.cc:333] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9: stopping tablet replica
I20260709 13:22:30.585800 18414 raft_consensus.cc:2243] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.586145 18414 raft_consensus.cc:2272] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:30.587920 18414 tablet_replica.cc:333] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9: stopping tablet replica
I20260709 13:22:30.588570 18414 raft_consensus.cc:2243] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:30.589048 18414 raft_consensus.cc:2272] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:30.589702 29445 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 119 similar messages]
W20260709 13:22:30.592981 29445 consensus_peers.cc:597] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.595487 29578 consensus_queue.cc:1048] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:30.626430 18414 tablet_server.cc:196] TabletServer@127.17.251.129:0 shutdown complete.
W20260709 13:22:30.627749 29371 consensus_peers.cc:597] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.708622 29556 raft_consensus.cc:493] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:30.709209 29556 raft_consensus.cc:515] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.710952 29556 leader_election.cc:290] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:30.712276 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb327970a55b483289199513e743156e" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882" is_pre_election: true
I20260709 13:22:30.713181 29408 raft_consensus.cc:2393] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc16d3a078044ee081d6dc1f2fe92657 in current term 1: Already voted for candidate 53b52b7f69b34e93b324b8eebec3bcc9 in this term.
W20260709 13:22:30.715552 29445 leader_election.cc:336] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111)
I20260709 13:22:30.715997 29445 leader_election.cc:304] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc16d3a078044ee081d6dc1f2fe92657; no voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882
I20260709 13:22:30.716743 29556 raft_consensus.cc:3060] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.722667 29556 raft_consensus.cc:2749] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:30.723816 29445 consensus_peers.cc:597] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.754359 29556 raft_consensus.cc:493] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:30.754971 29556 raft_consensus.cc:515] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.756726 29556 leader_election.cc:290] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:30.758322 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73acada0ca644e4a0edabb1028ae717" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882" is_pre_election: true
W20260709 13:22:30.760622 29445 leader_election.cc:336] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111)
I20260709 13:22:30.760965 29445 leader_election.cc:304] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc16d3a078044ee081d6dc1f2fe92657; no voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882
I20260709 13:22:30.761572 29556 raft_consensus.cc:2749] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:30.768498 29482 raft_consensus.cc:3060] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:30.773594 29556 consensus_queue.cc:1048] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:30.776630 29575 consensus_queue.cc:1048] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:30.795885 29408 raft_consensus.cc:3060] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:30.797947 29371 consensus_peers.cc:597] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:30.804356 29445 consensus_peers.cc:597] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:30.806313 29279 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:30.806115 29556 consensus_queue.cc:1048] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:30.806327 29573 raft_consensus.cc:493] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:30.807359 29573 raft_consensus.cc:515] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:30.809666 29573 leader_election.cc:290] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:30.811766 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6be5c437aff4fc1ac20b95bbdbb73cd" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657" is_pre_election: true
W20260709 13:22:30.816511 29371 leader_election.cc:336] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111)
I20260709 13:22:30.817167 29371 leader_election.cc:304] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1f91ebc21464cca9f3ff200dd243882; no voters: 53b52b7f69b34e93b324b8eebec3bcc9, bc16d3a078044ee081d6dc1f2fe92657
I20260709 13:22:30.818090 29573 raft_consensus.cc:2749] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:30.835137 29573 consensus_queue.cc:1048] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:22:30.848981 29371 consensus_peers.cc:597] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.872011 29570 consensus_queue.cc:1048] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:22:30.886417 29445 consensus_peers.cc:597] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:30.920945 29531 consensus_queue.cc:1048] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:22:31.807452 29279 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:31.996400 29531 raft_consensus.cc:493] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 53b52b7f69b34e93b324b8eebec3bcc9)
I20260709 13:22:31.997018 29531 raft_consensus.cc:515] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:31.998752 29531 leader_election.cc:290] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:32.000577 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b853389a34460e871a95cae81aef1b" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657" is_pre_election: true
W20260709 13:22:32.002795 29371 leader_election.cc:336] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111)
I20260709 13:22:32.003598 29371 leader_election.cc:304] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1f91ebc21464cca9f3ff200dd243882; no voters: 53b52b7f69b34e93b324b8eebec3bcc9, bc16d3a078044ee081d6dc1f2fe92657
I20260709 13:22:32.004380 29531 raft_consensus.cc:2749] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:32.006224 29530 raft_consensus.cc:493] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 53b52b7f69b34e93b324b8eebec3bcc9)
I20260709 13:22:32.006795 29530 raft_consensus.cc:515] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:32.008709 29530 leader_election.cc:290] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:32.009931 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b853389a34460e871a95cae81aef1b" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882" is_pre_election: true
I20260709 13:22:32.010551 29408 raft_consensus.cc:2468] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 1.
I20260709 13:22:32.011754 29447 leader_election.cc:304] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc16d3a078044ee081d6dc1f2fe92657, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:32.012442 29530 raft_consensus.cc:2804] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:22:32.012589 29445 leader_election.cc:336] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111)
I20260709 13:22:32.012894 29530 raft_consensus.cc:493] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 53b52b7f69b34e93b324b8eebec3bcc9)
I20260709 13:22:32.013281 29530 raft_consensus.cc:3060] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.018864 29530 raft_consensus.cc:515] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:32.020591 29530 leader_election.cc:290] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 2 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:32.021867 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b853389a34460e871a95cae81aef1b" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
I20260709 13:22:32.022594 29408 raft_consensus.cc:3060] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:32.024632 29445 leader_election.cc:336] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111)
I20260709 13:22:32.028606 29408 raft_consensus.cc:2468] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 2.
I20260709 13:22:32.029778 29447 leader_election.cc:304] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc16d3a078044ee081d6dc1f2fe92657, c1f91ebc21464cca9f3ff200dd243882; no voters: 53b52b7f69b34e93b324b8eebec3bcc9
I20260709 13:22:32.030496 29530 raft_consensus.cc:2804] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.031368 29530 raft_consensus.cc:697] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 2 LEADER]: Becoming Leader. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:32.032279 29530 consensus_queue.cc:237] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:32.039774 29229 catalog_manager.cc:5697] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 reported cstate change: term changed from 1 to 2, leader changed from 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129) to bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131). New cstate: current_term: 2 leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:32.050371 29530 raft_consensus.cc:493] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:32.051090 29530 raft_consensus.cc:515] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:32.054188 29530 leader_election.cc:290] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:32.054844 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedfb7ffc3ce484bb2b2b312c5a37f4b" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882" is_pre_election: true
I20260709 13:22:32.055629 29408 raft_consensus.cc:2468] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 1.
I20260709 13:22:32.056842 29447 leader_election.cc:304] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc16d3a078044ee081d6dc1f2fe92657, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:32.057551 29530 raft_consensus.cc:2804] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:22:32.057808 29445 leader_election.cc:336] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111)
I20260709 13:22:32.057981 29530 raft_consensus.cc:493] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:32.058459 29530 raft_consensus.cc:3060] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.063958 29530 raft_consensus.cc:515] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:32.065812 29530 leader_election.cc:290] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 2 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:32.066933 29408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedfb7ffc3ce484bb2b2b312c5a37f4b" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
I20260709 13:22:32.067524 29408 raft_consensus.cc:3060] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:32.069417 29445 leader_election.cc:336] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111)
I20260709 13:22:32.073032 29408 raft_consensus.cc:2468] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 2.
I20260709 13:22:32.074330 29447 leader_election.cc:304] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc16d3a078044ee081d6dc1f2fe92657, c1f91ebc21464cca9f3ff200dd243882; no voters: 53b52b7f69b34e93b324b8eebec3bcc9
I20260709 13:22:32.075029 29530 raft_consensus.cc:2804] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.075510 29530 raft_consensus.cc:697] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 2 LEADER]: Becoming Leader. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:32.076323 29530 consensus_queue.cc:237] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:32.083475 29229 catalog_manager.cc:5697] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 reported cstate change: term changed from 1 to 2, leader changed from 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129) to bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131). New cstate: current_term: 2 leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:32.189154 29531 raft_consensus.cc:493] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:32.189774 29531 raft_consensus.cc:515] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:32.191610 29531 leader_election.cc:290] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:32.193470 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb327970a55b483289199513e743156e" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657" is_pre_election: true
I20260709 13:22:32.194257 29482 raft_consensus.cc:2468] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 1.
I20260709 13:22:32.195293 29371 leader_election.cc:304] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc16d3a078044ee081d6dc1f2fe92657, c1f91ebc21464cca9f3ff200dd243882; no voters: 
W20260709 13:22:32.196135 29371 leader_election.cc:336] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111)
I20260709 13:22:32.196168 29531 raft_consensus.cc:2804] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:32.196713 29531 raft_consensus.cc:493] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:32.197013 29531 raft_consensus.cc:3060] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.203269 29531 raft_consensus.cc:515] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:32.205488 29531 leader_election.cc:290] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 2 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:32.207441 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb327970a55b483289199513e743156e" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
I20260709 13:22:32.208201 29482 raft_consensus.cc:3060] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:32.209803 29371 leader_election.cc:336] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111)
I20260709 13:22:32.214057 29482 raft_consensus.cc:2468] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 2.
I20260709 13:22:32.215457 29371 leader_election.cc:304] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc16d3a078044ee081d6dc1f2fe92657, c1f91ebc21464cca9f3ff200dd243882; no voters: 53b52b7f69b34e93b324b8eebec3bcc9
I20260709 13:22:32.216220 29531 raft_consensus.cc:2804] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.217717 29531 raft_consensus.cc:697] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [term 2 LEADER]: Becoming Leader. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:32.218462 29531 consensus_queue.cc:237] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:32.227813 29229 catalog_manager.cc:5697] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 reported cstate change: term changed from 1 to 2, leader changed from 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129) to c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "c1f91ebc21464cca9f3ff200dd243882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: UNKNOWN } } }
W20260709 13:22:32.458169 29445 consensus_peers.cc:597] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:32.506503 29445 consensus_peers.cc:597] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:32.510131 29408 raft_consensus.cc:1275] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Refusing update from remote peer bc16d3a078044ee081d6dc1f2fe92657: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:32.511415 29530 consensus_queue.cc:1048] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:32.621380 29408 raft_consensus.cc:1275] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Refusing update from remote peer bc16d3a078044ee081d6dc1f2fe92657: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:22:32.622888 29530 consensus_queue.cc:1048] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:32.727591 29482 raft_consensus.cc:1275] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Refusing update from remote peer c1f91ebc21464cca9f3ff200dd243882: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:22:32.728875 29531 consensus_queue.cc:1048] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:22:32.739542 29371 consensus_peers.cc:597] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:32.808404 29279 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:32.916783 29445 consensus_peers.cc:597] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.088181 29445 consensus_peers.cc:597] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.110103 29371 consensus_peers.cc:597] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.226573 29445 consensus_peers.cc:597] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.275842 29371 consensus_peers.cc:597] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.340397 29371 consensus_peers.cc:597] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.404026 29445 consensus_peers.cc:597] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:33.809420 29279 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:34.810743 29279 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:35.041716 29445 consensus_peers.cc:597] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:35.127910 29445 consensus_peers.cc:597] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:35.444801 29371 consensus_peers.cc:597] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:35.508607 29445 consensus_peers.cc:597] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:35.519129 29371 consensus_peers.cc:597] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:35.569810 29371 consensus_peers.cc:597] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:35.607877 29445 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111) [suppressed 101 similar messages]
W20260709 13:22:35.610441 29445 consensus_peers.cc:597] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:35.646560 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:35.654104 29622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:35.654697 29623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:35.656939 29625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:35.659349 18414 server_base.cc:1061] running on GCE node
I20260709 13:22:35.661991 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:35.662258 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:35.662458 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603355662433 us; error 0 us; skew 500 ppm
I20260709 13:22:35.663058 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:35.666115 18414 webserver.cc:533] Webserver started at http://127.17.251.129:45883/ using document root <none> and password file <none>
I20260709 13:22:35.666728 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:35.666939 18414 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:22:35.671105 18414 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:22:35.675482 29630 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:35.676457 18414 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:22:35.676855 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-0-root
uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
format_stamp: "Formatted at 2026-07-09 13:22:28 on dist-test-slave-7f95"
I20260709 13:22:35.677297 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603012191013-18414-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:35.697870 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:35.699258 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:35.701305 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:35.705570 29637 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:22:35.755605 29371 consensus_peers.cc:597] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:35.762722 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:22:35.763180 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.059s	user 0.003s	sys 0.000s
I20260709 13:22:35.763469 18414 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:22:35.770110 29637 tablet_bootstrap.cc:492] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
W20260709 13:22:35.785897 29445 consensus_peers.cc:597] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:35.787746 29637 tablet_bootstrap.cc:492] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.788548 29637 tablet_bootstrap.cc:492] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap complete.
I20260709 13:22:35.789140 29637 ts_tablet_manager.cc:1403] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:22:35.791776 29637 raft_consensus.cc:359] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.793036 29637 raft_consensus.cc:740] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.793956 29637 consensus_queue.cc:260] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.796468 29637 ts_tablet_manager.cc:1434] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:35.797161 29637 tablet_bootstrap.cc:492] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
I20260709 13:22:35.809943 29637 tablet_bootstrap.cc:492] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.810799 29637 tablet_bootstrap.cc:492] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap complete.
I20260709 13:22:35.811601 29637 ts_tablet_manager.cc:1403] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
W20260709 13:22:35.811885 29279 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:35.813918 29637 raft_consensus.cc:359] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.814738 29637 raft_consensus.cc:740] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.815307 18414 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:22:35.815637 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.052s	user 0.050s	sys 0.000s
I20260709 13:22:35.815424 29637 consensus_queue.cc:260] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.817216 29637 ts_tablet_manager.cc:1434] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:22:35.818078 29637 tablet_bootstrap.cc:492] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
I20260709 13:22:35.833987 29637 tablet_bootstrap.cc:492] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.834874 29637 tablet_bootstrap.cc:492] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap complete.
I20260709 13:22:35.835495 29637 ts_tablet_manager.cc:1403] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:22:35.837806 29637 raft_consensus.cc:359] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.838430 29637 raft_consensus.cc:740] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.839143 29637 consensus_queue.cc:260] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.840875 29637 ts_tablet_manager.cc:1434] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:35.841713 29637 tablet_bootstrap.cc:492] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
I20260709 13:22:35.854280 29637 tablet_bootstrap.cc:492] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.855242 29637 tablet_bootstrap.cc:492] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap complete.
I20260709 13:22:35.855820 29637 ts_tablet_manager.cc:1403] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:22:35.857896 29637 raft_consensus.cc:359] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.858412 29637 raft_consensus.cc:740] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.859068 29637 consensus_queue.cc:260] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.860550 29637 ts_tablet_manager.cc:1434] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:35.861174 29637 tablet_bootstrap.cc:492] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
I20260709 13:22:35.872992 29637 tablet_bootstrap.cc:492] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.873816 29637 tablet_bootstrap.cc:492] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap complete.
I20260709 13:22:35.874451 29637 ts_tablet_manager.cc:1403] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:22:35.876332 29637 raft_consensus.cc:359] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.876854 29637 raft_consensus.cc:740] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.877532 29637 consensus_queue.cc:260] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.879344 29637 ts_tablet_manager.cc:1434] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:35.880033 29637 tablet_bootstrap.cc:492] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
I20260709 13:22:35.886535 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.129:40115
I20260709 13:22:35.886674 29699 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.129:40115 every 8 connection(s)
I20260709 13:22:35.891569 29637 tablet_bootstrap.cc:492] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.892628 29637 tablet_bootstrap.cc:492] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap complete.
I20260709 13:22:35.893466 29637 ts_tablet_manager.cc:1403] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:22:35.893787 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:35.896377 29637 raft_consensus.cc:359] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.897238 29637 raft_consensus.cc:740] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.898151 29637 consensus_queue.cc:260] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.900368 29637 ts_tablet_manager.cc:1434] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:22:35.901108 29637 tablet_bootstrap.cc:492] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
I20260709 13:22:35.916697 29701 heartbeater.cc:344] Connected to a master server at 127.17.251.190:39935
I20260709 13:22:35.917295 29701 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:35.918334 29701 heartbeater.cc:507] Master 127.17.251.190:39935 requested a full tablet report, sending...
I20260709 13:22:35.918789 29637 tablet_bootstrap.cc:492] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.919728 29637 tablet_bootstrap.cc:492] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap complete.
I20260709 13:22:35.920420 29637 ts_tablet_manager.cc:1403] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:22:35.922600 29482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2933283aca654c2580c5899cba38f514"
dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
mode: GRACEFUL
new_leader_uuid: "c1f91ebc21464cca9f3ff200dd243882"
 from {username='slave'} at 127.0.0.1:51464
I20260709 13:22:35.923367 29482 raft_consensus.cc:606] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 LEADER]: Received request to transfer leadership to TS c1f91ebc21464cca9f3ff200dd243882
I20260709 13:22:35.923350 29637 raft_consensus.cc:359] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.924253 29637 raft_consensus.cc:740] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.925733 29637 consensus_queue.cc:260] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.926491 29482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49b853389a34460e871a95cae81aef1b"
dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
mode: GRACEFUL
new_leader_uuid: "c1f91ebc21464cca9f3ff200dd243882"
 from {username='slave'} at 127.0.0.1:51464
I20260709 13:22:35.927129 29482 raft_consensus.cc:606] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 2 LEADER]: Received request to transfer leadership to TS c1f91ebc21464cca9f3ff200dd243882
I20260709 13:22:35.927719 29228 ts_manager.cc:194] Re-registered known tserver with Master: 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115)
I20260709 13:22:35.927882 29637 ts_tablet_manager.cc:1434] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:35.928929 29637 tablet_bootstrap.cc:492] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
I20260709 13:22:35.940510 29228 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45606
I20260709 13:22:35.942035 29407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd"
dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
mode: GRACEFUL
new_leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:22:35.942778 29407 raft_consensus.cc:606] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 1 LEADER]: Received request to transfer leadership to TS bc16d3a078044ee081d6dc1f2fe92657
I20260709 13:22:35.944347 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:22:35.944799 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:35.945052 29701 heartbeater.cc:499] Master 127.17.251.190:39935 was elected leader, sending a full tablet report...
I20260709 13:22:35.945371 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:35.949273 29637 tablet_bootstrap.cc:492] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:22:35.950230 29637 tablet_bootstrap.cc:492] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap complete.
I20260709 13:22:35.950775 29637 ts_tablet_manager.cc:1403] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:22:35.952723 29637 raft_consensus.cc:359] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.953440 29637 raft_consensus.cc:740] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.954077 29637 consensus_queue.cc:260] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.956189 29637 ts_tablet_manager.cc:1434] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:35.957147 29637 tablet_bootstrap.cc:492] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
I20260709 13:22:35.969772 29637 tablet_bootstrap.cc:492] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.970458 29637 tablet_bootstrap.cc:492] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap complete.
I20260709 13:22:35.970999 29637 ts_tablet_manager.cc:1403] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:22:35.972815 29637 raft_consensus.cc:359] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.973325 29637 raft_consensus.cc:740] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.973937 29637 consensus_queue.cc:260] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.975664 29637 ts_tablet_manager.cc:1434] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:35.976450 29637 tablet_bootstrap.cc:492] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap starting.
I20260709 13:22:35.988349 29637 tablet_bootstrap.cc:492] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:22:35.989045 29637 tablet_bootstrap.cc:492] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9: Bootstrap complete.
I20260709 13:22:35.989675 29637 ts_tablet_manager.cc:1403] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 13:22:35.991957 29637 raft_consensus.cc:359] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.992789 29637 raft_consensus.cc:740] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b52b7f69b34e93b324b8eebec3bcc9, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.993515 29637 consensus_queue.cc:260] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:35.995451 29637 ts_tablet_manager.cc:1434] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:35.996372 29616 raft_consensus.cc:993] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657: : Instructing follower c1f91ebc21464cca9f3ff200dd243882 to start an election
I20260709 13:22:35.997066 29712 raft_consensus.cc:1081] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 2 LEADER]: Signalling peer c1f91ebc21464cca9f3ff200dd243882 to start an election
I20260709 13:22:35.998819 29407 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49b853389a34460e871a95cae81aef1b"
dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
 from {username='slave'} at 127.0.0.1:33318
I20260709 13:22:35.999332 29407 raft_consensus.cc:493] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:35.999660 29407 raft_consensus.cc:3060] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:36.006913 29407 raft_consensus.cc:515] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:36.008658 29407 leader_election.cc:290] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 3 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:36.010713 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b853389a34460e871a95cae81aef1b" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
I20260709 13:22:36.011452 29482 raft_consensus.cc:3055] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:36.011782 29482 raft_consensus.cc:740] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:36.012771 29482 consensus_queue.cc:260] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:36.014295 29482 raft_consensus.cc:3060] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:36.020712 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b853389a34460e871a95cae81aef1b" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:36.021493 29674 raft_consensus.cc:3060] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:22:36.022410 29482 raft_consensus.cc:2468] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 3.
I20260709 13:22:36.023940 29371 leader_election.cc:304] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc16d3a078044ee081d6dc1f2fe92657, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:36.024899 29618 raft_consensus.cc:2804] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:36.026475 29618 raft_consensus.cc:697] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 3 LEADER]: Becoming Leader. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:36.027567 29618 consensus_queue.cc:237] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:36.029163 29674 raft_consensus.cc:2468] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 3.
I20260709 13:22:36.036203 29228 catalog_manager.cc:5697] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 reported cstate change: term changed from 2 to 3, leader changed from bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131) to c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130). New cstate: current_term: 3 leader_uuid: "c1f91ebc21464cca9f3ff200dd243882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:36.062553 29674 raft_consensus.cc:3060] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:36.072016 29674 pending_rounds.cc:85] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9: Aborting all ops after (but not including) 0
I20260709 13:22:36.072229 29674 pending_rounds.cc:107] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:22:36.072554 29674 raft_consensus.cc:2889] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:22:36.151603 29673 raft_consensus.cc:3060] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:36.157963 29673 pending_rounds.cc:85] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9: Aborting all ops after (but not including) 0
I20260709 13:22:36.158186 29673 pending_rounds.cc:107] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:22:36.158356 29673 raft_consensus.cc:2889] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:22:36.332818 29714 raft_consensus.cc:993] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882: : Instructing follower bc16d3a078044ee081d6dc1f2fe92657 to start an election
I20260709 13:22:36.333250 29618 raft_consensus.cc:1081] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 1 LEADER]: Signalling peer bc16d3a078044ee081d6dc1f2fe92657 to start an election
I20260709 13:22:36.334805 29482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd"
dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
 from {username='slave'} at 127.0.0.1:51452
I20260709 13:22:36.335302 29482 raft_consensus.cc:493] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:36.335620 29482 raft_consensus.cc:3060] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:36.340735 29482 raft_consensus.cc:515] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:36.342669 29482 leader_election.cc:290] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 2 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:36.343509 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:36.343806 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
I20260709 13:22:36.344244 29673 raft_consensus.cc:3060] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:36.344404 29407 raft_consensus.cc:3055] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:36.344813 29407 raft_consensus.cc:740] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:36.345670 29407 consensus_queue.cc:260] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:36.346728 29407 raft_consensus.cc:3060] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:36.350124 29673 raft_consensus.cc:2468] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 2.
I20260709 13:22:36.351253 29445 leader_election.cc:304] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, bc16d3a078044ee081d6dc1f2fe92657; no voters: 
I20260709 13:22:36.352208 29712 raft_consensus.cc:2804] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:36.352732 29712 raft_consensus.cc:697] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 2 LEADER]: Becoming Leader. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:36.353786 29712 consensus_queue.cc:237] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:36.354275 29407 raft_consensus.cc:2468] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 2.
I20260709 13:22:36.361599 29228 catalog_manager.cc:5697] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 reported cstate change: term changed from 1 to 2, leader changed from c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130) to bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131). New cstate: current_term: 2 leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:36.431842 29616 raft_consensus.cc:993] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657: : Instructing follower c1f91ebc21464cca9f3ff200dd243882 to start an election
I20260709 13:22:36.432328 29712 raft_consensus.cc:1081] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 LEADER]: Signalling peer c1f91ebc21464cca9f3ff200dd243882 to start an election
I20260709 13:22:36.433876 29407 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2933283aca654c2580c5899cba38f514"
dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
 from {username='slave'} at 127.0.0.1:33318
I20260709 13:22:36.434486 29407 raft_consensus.cc:493] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:36.434803 29407 raft_consensus.cc:3060] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:36.440471 29407 raft_consensus.cc:515] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:36.442735 29407 leader_election.cc:290] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 2 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:36.443327 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2933283aca654c2580c5899cba38f514" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:36.443805 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2933283aca654c2580c5899cba38f514" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
I20260709 13:22:36.444077 29673 raft_consensus.cc:3060] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:36.444649 29482 raft_consensus.cc:3055] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:36.444962 29482 raft_consensus.cc:740] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:36.445827 29482 consensus_queue.cc:260] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:36.447052 29482 raft_consensus.cc:3060] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:36.450762 29673 raft_consensus.cc:2468] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 2.
I20260709 13:22:36.451922 29371 leader_election.cc:304] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:36.452312 29482 raft_consensus.cc:2468] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 2.
I20260709 13:22:36.452807 29618 raft_consensus.cc:2804] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:36.453368 29618 raft_consensus.cc:697] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 2 LEADER]: Becoming Leader. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:36.454336 29618 consensus_queue.cc:237] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:36.461337 29228 catalog_manager.cc:5697] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 reported cstate change: term changed from 1 to 2, leader changed from bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131) to c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "c1f91ebc21464cca9f3ff200dd243882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:36.524467 29482 raft_consensus.cc:1275] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 3 FOLLOWER]: Refusing update from remote peer c1f91ebc21464cca9f3ff200dd243882: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:36.525761 29732 consensus_queue.cc:1048] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:36.535377 29673 raft_consensus.cc:1275] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 3 FOLLOWER]: Refusing update from remote peer c1f91ebc21464cca9f3ff200dd243882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:36.539883 29618 consensus_queue.cc:1048] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:36.767149 29407 raft_consensus.cc:1275] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Refusing update from remote peer bc16d3a078044ee081d6dc1f2fe92657: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:36.768574 29737 consensus_queue.cc:1048] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:36.778890 29673 raft_consensus.cc:1275] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Refusing update from remote peer bc16d3a078044ee081d6dc1f2fe92657: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:36.781206 29616 consensus_queue.cc:1048] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:36.813056 29279 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:36.865526 29482 raft_consensus.cc:1275] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Refusing update from remote peer c1f91ebc21464cca9f3ff200dd243882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:36.866976 29618 consensus_queue.cc:1048] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:36.869513 29673 raft_consensus.cc:1275] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Refusing update from remote peer c1f91ebc21464cca9f3ff200dd243882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:36.871023 29714 consensus_queue.cc:1048] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:36.953819 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:36.961118 29407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2933283aca654c2580c5899cba38f514"
dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
mode: GRACEFUL
new_leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:22:36.961731 29407 raft_consensus.cc:606] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 2 LEADER]: Received request to transfer leadership to TS bc16d3a078044ee081d6dc1f2fe92657
I20260709 13:22:36.964181 29407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49b853389a34460e871a95cae81aef1b"
dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
mode: GRACEFUL
new_leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:22:36.964675 29407 raft_consensus.cc:606] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 3 LEADER]: Received request to transfer leadership to TS bc16d3a078044ee081d6dc1f2fe92657
I20260709 13:22:36.967202 29482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7814d4c68564172a5d484898d9f5a19"
dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
mode: GRACEFUL
new_leader_uuid: "c1f91ebc21464cca9f3ff200dd243882"
 from {username='slave'} at 127.0.0.1:51464
I20260709 13:22:36.967743 29482 raft_consensus.cc:606] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 LEADER]: Received request to transfer leadership to TS c1f91ebc21464cca9f3ff200dd243882
I20260709 13:22:36.969015 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:22:36.969494 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:36.970148 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:36.996459 29714 raft_consensus.cc:993] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882: : Instructing follower bc16d3a078044ee081d6dc1f2fe92657 to start an election
I20260709 13:22:36.997136 29741 raft_consensus.cc:1081] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 3 LEADER]: Signalling peer bc16d3a078044ee081d6dc1f2fe92657 to start an election
I20260709 13:22:36.998679 29482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49b853389a34460e871a95cae81aef1b"
dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
 from {username='slave'} at 127.0.0.1:51452
I20260709 13:22:36.999187 29482 raft_consensus.cc:493] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:36.999505 29482 raft_consensus.cc:3060] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:37.006033 29482 raft_consensus.cc:515] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:37.008041 29482 leader_election.cc:290] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 4 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:37.008435 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b853389a34460e871a95cae81aef1b" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:37.009145 29673 raft_consensus.cc:3060] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:37.014461 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b853389a34460e871a95cae81aef1b" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
I20260709 13:22:37.015240 29407 raft_consensus.cc:3055] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:22:37.015321 29673 raft_consensus.cc:2468] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 4.
I20260709 13:22:37.015707 29407 raft_consensus.cc:740] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:37.016825 29445 leader_election.cc:304] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, bc16d3a078044ee081d6dc1f2fe92657; no voters: 
I20260709 13:22:37.016728 29407 consensus_queue.cc:260] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:37.017833 29739 raft_consensus.cc:2804] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:22:37.017999 29407 raft_consensus.cc:3060] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:37.018313 29739 raft_consensus.cc:697] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 4 LEADER]: Becoming Leader. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:37.019264 29739 consensus_queue.cc:237] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:37.025501 29407 raft_consensus.cc:2468] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 4.
I20260709 13:22:37.026609 29228 catalog_manager.cc:5697] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 reported cstate change: term changed from 3 to 4, leader changed from c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130) to bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131). New cstate: current_term: 4 leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:37.332212 29714 raft_consensus.cc:993] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882: : Instructing follower bc16d3a078044ee081d6dc1f2fe92657 to start an election
I20260709 13:22:37.332741 29741 raft_consensus.cc:1081] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 2 LEADER]: Signalling peer bc16d3a078044ee081d6dc1f2fe92657 to start an election
I20260709 13:22:37.334255 29482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2933283aca654c2580c5899cba38f514"
dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
 from {username='slave'} at 127.0.0.1:51452
I20260709 13:22:37.334759 29482 raft_consensus.cc:493] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:37.335062 29482 raft_consensus.cc:3060] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:37.339735 29482 raft_consensus.cc:515] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:37.341230 29482 leader_election.cc:290] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 3 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:37.342279 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2933283aca654c2580c5899cba38f514" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:37.342332 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2933283aca654c2580c5899cba38f514" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
I20260709 13:22:37.343245 29673 raft_consensus.cc:3060] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:37.343317 29407 raft_consensus.cc:3055] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:37.343801 29407 raft_consensus.cc:740] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:37.344535 29407 consensus_queue.cc:260] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:37.345556 29407 raft_consensus.cc:3060] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:37.348778 29673 raft_consensus.cc:2468] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 3.
I20260709 13:22:37.350109 29445 leader_election.cc:304] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, bc16d3a078044ee081d6dc1f2fe92657; no voters: 
I20260709 13:22:37.350895 29745 raft_consensus.cc:2804] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:37.351137 29407 raft_consensus.cc:2468] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 3.
I20260709 13:22:37.351351 29745 raft_consensus.cc:697] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 3 LEADER]: Becoming Leader. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:37.352332 29745 consensus_queue.cc:237] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:37.358654 29228 catalog_manager.cc:5697] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 reported cstate change: term changed from 2 to 3, leader changed from c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130) to bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131). New cstate: current_term: 3 leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:37.500345 29673 raft_consensus.cc:1275] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 4 FOLLOWER]: Refusing update from remote peer bc16d3a078044ee081d6dc1f2fe92657: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:22:37.500487 29407 raft_consensus.cc:1275] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 4 FOLLOWER]: Refusing update from remote peer bc16d3a078044ee081d6dc1f2fe92657: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:22:37.501966 29616 consensus_queue.cc:1048] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:37.502637 29745 consensus_queue.cc:1048] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:37.518733 29739 raft_consensus.cc:993] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657: : Instructing follower c1f91ebc21464cca9f3ff200dd243882 to start an election
I20260709 13:22:37.519347 29739 raft_consensus.cc:1081] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 LEADER]: Signalling peer c1f91ebc21464cca9f3ff200dd243882 to start an election
I20260709 13:22:37.521211 29407 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7814d4c68564172a5d484898d9f5a19"
dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
 from {username='slave'} at 127.0.0.1:33318
I20260709 13:22:37.524081 29407 raft_consensus.cc:493] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:37.524595 29407 raft_consensus.cc:3060] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:37.532567 29407 raft_consensus.cc:515] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:37.534583 29407 leader_election.cc:290] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 2 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:37.535138 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7814d4c68564172a5d484898d9f5a19" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:37.535625 29481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7814d4c68564172a5d484898d9f5a19" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
I20260709 13:22:37.535775 29673 raft_consensus.cc:3060] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:37.536202 29481 raft_consensus.cc:3055] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:37.536499 29481 raft_consensus.cc:740] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:37.537205 29481 consensus_queue.cc:260] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:37.538230 29481 raft_consensus.cc:3060] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:37.542147 29673 raft_consensus.cc:2468] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 2.
I20260709 13:22:37.543269 29371 leader_election.cc:304] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:37.544009 29741 raft_consensus.cc:2804] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:37.544507 29741 raft_consensus.cc:697] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 2 LEADER]: Becoming Leader. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:37.544939 29481 raft_consensus.cc:2468] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 2.
I20260709 13:22:37.545536 29741 consensus_queue.cc:237] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:37.554224 29231 catalog_manager.cc:5697] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 reported cstate change: term changed from 1 to 2, leader changed from bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131) to c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "c1f91ebc21464cca9f3ff200dd243882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: UNKNOWN } } }
W20260709 13:22:37.814138 29279 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:37.814821 29407 raft_consensus.cc:1275] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 3 FOLLOWER]: Refusing update from remote peer bc16d3a078044ee081d6dc1f2fe92657: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:37.816215 29745 consensus_queue.cc:1048] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:37.817276 29673 raft_consensus.cc:1275] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 3 FOLLOWER]: Refusing update from remote peer bc16d3a078044ee081d6dc1f2fe92657: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:37.819478 29616 consensus_queue.cc:1048] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:37.976447 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:37.981729 29673 raft_consensus.cc:1275] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Refusing update from remote peer c1f91ebc21464cca9f3ff200dd243882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:37.983105 29741 consensus_queue.cc:1048] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:37.984350 29481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49b853389a34460e871a95cae81aef1b"
dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
mode: GRACEFUL
new_leader_uuid: "c1f91ebc21464cca9f3ff200dd243882"
 from {username='slave'} at 127.0.0.1:51464
I20260709 13:22:37.985018 29481 raft_consensus.cc:606] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 4 LEADER]: Received request to transfer leadership to TS c1f91ebc21464cca9f3ff200dd243882
I20260709 13:22:37.986661 29739 raft_consensus.cc:993] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657: : Instructing follower c1f91ebc21464cca9f3ff200dd243882 to start an election
I20260709 13:22:37.987120 29616 raft_consensus.cc:1081] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 4 LEADER]: Signalling peer c1f91ebc21464cca9f3ff200dd243882 to start an election
I20260709 13:22:37.988000 29481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd"
dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
mode: GRACEFUL
new_leader_uuid: "c1f91ebc21464cca9f3ff200dd243882"
 from {username='slave'} at 127.0.0.1:51464
I20260709 13:22:37.988791 29481 raft_consensus.cc:606] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 2 LEADER]: Received request to transfer leadership to TS c1f91ebc21464cca9f3ff200dd243882
I20260709 13:22:37.988816 29407 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49b853389a34460e871a95cae81aef1b"
dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
 from {username='slave'} at 127.0.0.1:33318
I20260709 13:22:37.989580 29407 raft_consensus.cc:493] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:37.990027 29407 raft_consensus.cc:3060] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:22:37.995297 29408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b73acada0ca644e4a0edabb1028ae717"
dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
mode: GRACEFUL
new_leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:22:37.995956 29408 raft_consensus.cc:606] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 1 LEADER]: Received request to transfer leadership to TS bc16d3a078044ee081d6dc1f2fe92657
I20260709 13:22:37.997505 29407 raft_consensus.cc:515] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:37.999439 29407 leader_election.cc:290] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 5 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:38.001238 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b853389a34460e871a95cae81aef1b" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:38.001922 29674 raft_consensus.cc:3060] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:22:38.004153 29482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b853389a34460e871a95cae81aef1b" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
I20260709 13:22:38.006685 29482 raft_consensus.cc:3055] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:22:38.006789 29481 raft_consensus.cc:1275] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Refusing update from remote peer c1f91ebc21464cca9f3ff200dd243882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:38.007011 29482 raft_consensus.cc:740] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:38.007824 29482 consensus_queue.cc:260] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:38.003643 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:22:38.009002 29482 raft_consensus.cc:3060] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:22:38.008800 29714 consensus_queue.cc:1048] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:38.009359 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:38.010218 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:38.013089 29674 raft_consensus.cc:2468] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 5.
I20260709 13:22:38.015937 29482 raft_consensus.cc:2468] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 5.
I20260709 13:22:38.016139 29371 leader_election.cc:304] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:38.017316 29714 raft_consensus.cc:2804] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:22:38.017874 29714 raft_consensus.cc:697] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 5 LEADER]: Becoming Leader. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:38.018719 29714 consensus_queue.cc:237] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:38.026497 29228 catalog_manager.cc:5697] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 reported cstate change: term changed from 4 to 5, leader changed from bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131) to c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130). New cstate: current_term: 5 leader_uuid: "c1f91ebc21464cca9f3ff200dd243882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:38.043572 29752 raft_consensus.cc:993] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882: : Instructing follower bc16d3a078044ee081d6dc1f2fe92657 to start an election
I20260709 13:22:38.044016 29714 raft_consensus.cc:1081] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 1 LEADER]: Signalling peer bc16d3a078044ee081d6dc1f2fe92657 to start an election
I20260709 13:22:38.045647 29481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b73acada0ca644e4a0edabb1028ae717"
dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
 from {username='slave'} at 127.0.0.1:51452
I20260709 13:22:38.046135 29481 raft_consensus.cc:493] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:38.046428 29481 raft_consensus.cc:3060] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:38.051437 29481 raft_consensus.cc:515] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:38.053023 29481 leader_election.cc:290] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 2 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:38.053992 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73acada0ca644e4a0edabb1028ae717" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:38.054127 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73acada0ca644e4a0edabb1028ae717" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
I20260709 13:22:38.054719 29674 raft_consensus.cc:3060] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:38.054733 29407 raft_consensus.cc:3055] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:38.055291 29407 raft_consensus.cc:740] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:38.056130 29407 consensus_queue.cc:260] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:38.057307 29407 raft_consensus.cc:3060] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:38.062150 29674 raft_consensus.cc:2468] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 2.
I20260709 13:22:38.063334 29445 leader_election.cc:304] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, bc16d3a078044ee081d6dc1f2fe92657; no voters: 
I20260709 13:22:38.064200 29616 raft_consensus.cc:2804] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:38.064278 29407 raft_consensus.cc:2468] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 2.
I20260709 13:22:38.065037 29616 raft_consensus.cc:697] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [term 2 LEADER]: Becoming Leader. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:38.066893 29616 consensus_queue.cc:237] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:38.080899 29228 catalog_manager.cc:5697] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 reported cstate change: term changed from 1 to 2, leader changed from c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130) to bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131). New cstate: current_term: 2 leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:38.192373 29616 raft_consensus.cc:993] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657: : Instructing follower c1f91ebc21464cca9f3ff200dd243882 to start an election
I20260709 13:22:38.192919 29745 raft_consensus.cc:1081] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 2 LEADER]: Signalling peer c1f91ebc21464cca9f3ff200dd243882 to start an election
I20260709 13:22:38.194590 29407 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd"
dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
 from {username='slave'} at 127.0.0.1:33318
I20260709 13:22:38.195088 29407 raft_consensus.cc:493] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:38.195379 29407 raft_consensus.cc:3060] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:38.199903 29407 raft_consensus.cc:515] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:38.201411 29407 leader_election.cc:290] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 3 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:38.202404 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:38.202674 29481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
I20260709 13:22:38.203099 29673 raft_consensus.cc:3060] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:38.203243 29481 raft_consensus.cc:3055] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:38.203656 29481 raft_consensus.cc:740] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:38.204493 29481 consensus_queue.cc:260] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:38.205771 29481 raft_consensus.cc:3060] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:38.210929 29673 raft_consensus.cc:2468] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 3.
I20260709 13:22:38.212313 29371 leader_election.cc:304] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:38.213126 29714 raft_consensus.cc:2804] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:38.213333 29481 raft_consensus.cc:2468] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 3.
I20260709 13:22:38.213601 29714 raft_consensus.cc:697] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 3 LEADER]: Becoming Leader. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:38.214593 29714 consensus_queue.cc:237] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:38.222335 29228 catalog_manager.cc:5697] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 reported cstate change: term changed from 2 to 3, leader changed from bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131) to c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130). New cstate: current_term: 3 leader_uuid: "c1f91ebc21464cca9f3ff200dd243882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:38.483246 29407 raft_consensus.cc:1275] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Refusing update from remote peer bc16d3a078044ee081d6dc1f2fe92657: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:38.484689 29745 consensus_queue.cc:1048] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:38.495429 29673 raft_consensus.cc:1275] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Refusing update from remote peer bc16d3a078044ee081d6dc1f2fe92657: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:38.498090 29745 consensus_queue.cc:1048] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:38.511557 29673 raft_consensus.cc:1275] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 5 FOLLOWER]: Refusing update from remote peer c1f91ebc21464cca9f3ff200dd243882: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:22:38.513024 29714 consensus_queue.cc:1048] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:22:38.521664 29481 raft_consensus.cc:1275] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 5 FOLLOWER]: Refusing update from remote peer c1f91ebc21464cca9f3ff200dd243882: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:22:38.524813 29714 consensus_queue.cc:1048] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:22:38.752383 29481 raft_consensus.cc:1275] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 3 FOLLOWER]: Refusing update from remote peer c1f91ebc21464cca9f3ff200dd243882: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:38.753873 29714 consensus_queue.cc:1048] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:38.763032 29673 raft_consensus.cc:1275] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 3 FOLLOWER]: Refusing update from remote peer c1f91ebc21464cca9f3ff200dd243882: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:38.765039 29752 consensus_queue.cc:1048] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:22:38.815100 29279 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:39.021243 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:39.028801 29407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd"
dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
mode: GRACEFUL
new_leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:22:39.029352 29407 raft_consensus.cc:606] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 3 LEADER]: Received request to transfer leadership to TS bc16d3a078044ee081d6dc1f2fe92657
I20260709 13:22:39.032105 29481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bedfb7ffc3ce484bb2b2b312c5a37f4b"
dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
mode: GRACEFUL
new_leader_uuid: "c1f91ebc21464cca9f3ff200dd243882"
 from {username='slave'} at 127.0.0.1:51464
I20260709 13:22:39.032687 29481 raft_consensus.cc:606] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 2 LEADER]: Received request to transfer leadership to TS c1f91ebc21464cca9f3ff200dd243882
I20260709 13:22:39.035364 29407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7814d4c68564172a5d484898d9f5a19"
dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
mode: GRACEFUL
new_leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:22:39.035871 29407 raft_consensus.cc:606] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 2 LEADER]: Received request to transfer leadership to TS bc16d3a078044ee081d6dc1f2fe92657
I20260709 13:22:39.036902 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:22:39.037536 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:39.038211 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:39.086046 29739 raft_consensus.cc:993] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657: : Instructing follower c1f91ebc21464cca9f3ff200dd243882 to start an election
I20260709 13:22:39.086597 29745 raft_consensus.cc:1081] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 2 LEADER]: Signalling peer c1f91ebc21464cca9f3ff200dd243882 to start an election
I20260709 13:22:39.088129 29407 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bedfb7ffc3ce484bb2b2b312c5a37f4b"
dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
 from {username='slave'} at 127.0.0.1:33318
I20260709 13:22:39.088550 29407 raft_consensus.cc:493] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:39.088778 29407 raft_consensus.cc:3060] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:39.094309 29407 raft_consensus.cc:515] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:39.095914 29407 leader_election.cc:290] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 3 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:39.096670 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedfb7ffc3ce484bb2b2b312c5a37f4b" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:39.096904 29481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedfb7ffc3ce484bb2b2b312c5a37f4b" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
I20260709 13:22:39.097334 29673 raft_consensus.cc:3060] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:39.097563 29481 raft_consensus.cc:3055] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:39.097962 29481 raft_consensus.cc:740] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:39.098709 29481 consensus_queue.cc:260] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:39.099766 29481 raft_consensus.cc:3060] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:39.102711 29673 raft_consensus.cc:2468] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 3.
I20260709 13:22:39.104017 29371 leader_election.cc:304] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:39.104815 29752 raft_consensus.cc:2804] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:39.105244 29752 raft_consensus.cc:697] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [term 3 LEADER]: Becoming Leader. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:39.105974 29481 raft_consensus.cc:2468] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 3.
I20260709 13:22:39.106159 29752 consensus_queue.cc:237] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:39.114001 29229 catalog_manager.cc:5697] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 reported cstate change: term changed from 2 to 3, leader changed from bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131) to c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130). New cstate: current_term: 3 leader_uuid: "c1f91ebc21464cca9f3ff200dd243882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:39.141116 29714 raft_consensus.cc:993] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882: : Instructing follower bc16d3a078044ee081d6dc1f2fe92657 to start an election
I20260709 13:22:39.141706 29752 raft_consensus.cc:1081] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 2 LEADER]: Signalling peer bc16d3a078044ee081d6dc1f2fe92657 to start an election
I20260709 13:22:39.143244 29481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7814d4c68564172a5d484898d9f5a19"
dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
 from {username='slave'} at 127.0.0.1:51452
I20260709 13:22:39.143865 29481 raft_consensus.cc:493] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:39.144236 29481 raft_consensus.cc:3060] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:39.151899 29481 raft_consensus.cc:515] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:39.153841 29481 leader_election.cc:290] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 3 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:39.154561 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7814d4c68564172a5d484898d9f5a19" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:39.154774 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7814d4c68564172a5d484898d9f5a19" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
I20260709 13:22:39.155185 29673 raft_consensus.cc:3060] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:39.155406 29407 raft_consensus.cc:3055] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:39.155642 29407 raft_consensus.cc:740] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:39.156289 29407 consensus_queue.cc:260] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:39.157163 29407 raft_consensus.cc:3060] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:39.159863 29673 raft_consensus.cc:2468] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 3.
I20260709 13:22:39.160912 29445 leader_election.cc:304] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, bc16d3a078044ee081d6dc1f2fe92657; no voters: 
I20260709 13:22:39.161664 29745 raft_consensus.cc:2804] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:39.162091 29745 raft_consensus.cc:697] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 3 LEADER]: Becoming Leader. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:39.162366 29407 raft_consensus.cc:2468] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 3.
I20260709 13:22:39.162859 29745 consensus_queue.cc:237] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:39.170331 29229 catalog_manager.cc:5697] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 reported cstate change: term changed from 2 to 3, leader changed from c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130) to bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131). New cstate: current_term: 3 leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:39.189440 29714 raft_consensus.cc:993] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882: : Instructing follower bc16d3a078044ee081d6dc1f2fe92657 to start an election
I20260709 13:22:39.189975 29752 raft_consensus.cc:1081] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 3 LEADER]: Signalling peer bc16d3a078044ee081d6dc1f2fe92657 to start an election
I20260709 13:22:39.191543 29481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd"
dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
 from {username='slave'} at 127.0.0.1:51452
I20260709 13:22:39.192106 29481 raft_consensus.cc:493] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:39.192433 29481 raft_consensus.cc:3060] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:39.198191 29481 raft_consensus.cc:515] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:39.200001 29481 leader_election.cc:290] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 4 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:39.200701 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:39.201084 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
I20260709 13:22:39.201406 29673 raft_consensus.cc:3060] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:39.201712 29407 raft_consensus.cc:3055] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:22:39.202060 29407 raft_consensus.cc:740] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:39.202713 29407 consensus_queue.cc:260] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:39.203646 29407 raft_consensus.cc:3060] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:39.206712 29673 raft_consensus.cc:2468] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 4.
I20260709 13:22:39.207872 29445 leader_election.cc:304] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, bc16d3a078044ee081d6dc1f2fe92657; no voters: 
I20260709 13:22:39.208686 29745 raft_consensus.cc:2804] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:22:39.208755 29407 raft_consensus.cc:2468] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 4.
I20260709 13:22:39.209199 29745 raft_consensus.cc:697] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 4 LEADER]: Becoming Leader. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:39.210112 29745 consensus_queue.cc:237] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:39.216114 29229 catalog_manager.cc:5697] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 reported cstate change: term changed from 3 to 4, leader changed from c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130) to bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131). New cstate: current_term: 4 leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:39.499518 29673 raft_consensus.cc:1275] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 3 FOLLOWER]: Refusing update from remote peer c1f91ebc21464cca9f3ff200dd243882: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:22:39.500862 29714 consensus_queue.cc:1048] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:39.511209 29481 raft_consensus.cc:1275] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 3 FOLLOWER]: Refusing update from remote peer c1f91ebc21464cca9f3ff200dd243882: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:22:39.515193 29752 consensus_queue.cc:1048] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:39.583458 29407 raft_consensus.cc:1275] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 3 FOLLOWER]: Refusing update from remote peer bc16d3a078044ee081d6dc1f2fe92657: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:39.584724 29745 consensus_queue.cc:1048] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:39.593897 29673 raft_consensus.cc:1275] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 3 FOLLOWER]: Refusing update from remote peer bc16d3a078044ee081d6dc1f2fe92657: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:39.595695 29739 consensus_queue.cc:1048] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:39.656890 29673 raft_consensus.cc:1275] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 4 FOLLOWER]: Refusing update from remote peer bc16d3a078044ee081d6dc1f2fe92657: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:22:39.658388 29739 consensus_queue.cc:1048] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:39.667968 29407 raft_consensus.cc:1275] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 4 FOLLOWER]: Refusing update from remote peer bc16d3a078044ee081d6dc1f2fe92657: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:22:39.669452 29777 consensus_queue.cc:1048] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:22:39.816109 29279 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:40.044628 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:40.053048 29407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49b853389a34460e871a95cae81aef1b"
dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
mode: GRACEFUL
new_leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:22:40.053706 29407 raft_consensus.cc:606] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 5 LEADER]: Received request to transfer leadership to TS bc16d3a078044ee081d6dc1f2fe92657
I20260709 13:22:40.056579 29481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd"
dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
mode: GRACEFUL
new_leader_uuid: "c1f91ebc21464cca9f3ff200dd243882"
 from {username='slave'} at 127.0.0.1:51464
I20260709 13:22:40.057210 29481 raft_consensus.cc:606] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 4 LEADER]: Received request to transfer leadership to TS c1f91ebc21464cca9f3ff200dd243882
I20260709 13:22:40.060746 29481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f04ccf1a4c134687af79a56cc6ddc0e2"
dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
mode: GRACEFUL
new_leader_uuid: "c1f91ebc21464cca9f3ff200dd243882"
 from {username='slave'} at 127.0.0.1:51464
I20260709 13:22:40.061412 29481 raft_consensus.cc:606] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 LEADER]: Received request to transfer leadership to TS c1f91ebc21464cca9f3ff200dd243882
I20260709 13:22:40.062763 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:22:40.063367 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:40.064043 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:40.114951 29777 raft_consensus.cc:993] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657: : Instructing follower c1f91ebc21464cca9f3ff200dd243882 to start an election
I20260709 13:22:40.115793 29745 raft_consensus.cc:1081] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 4 LEADER]: Signalling peer c1f91ebc21464cca9f3ff200dd243882 to start an election
I20260709 13:22:40.117604 29407 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd"
dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
 from {username='slave'} at 127.0.0.1:33318
I20260709 13:22:40.118649 29407 raft_consensus.cc:493] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:40.119104 29407 raft_consensus.cc:3060] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:22:40.126303 29407 raft_consensus.cc:515] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:40.127962 29407 leader_election.cc:290] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 5 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:40.128765 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:40.128968 29481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bdea60f82e48de85a6a242875c05fd" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
I20260709 13:22:40.129380 29673 raft_consensus.cc:3060] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:22:40.129755 29481 raft_consensus.cc:3055] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:22:40.130069 29481 raft_consensus.cc:740] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:40.130769 29481 consensus_queue.cc:260] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:40.131711 29481 raft_consensus.cc:3060] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:22:40.134666 29673 raft_consensus.cc:2468] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 5.
I20260709 13:22:40.136454 29371 leader_election.cc:304] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:40.137274 29714 raft_consensus.cc:2804] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:22:40.137476 29481 raft_consensus.cc:2468] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 5.
I20260709 13:22:40.137919 29714 raft_consensus.cc:697] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 5 LEADER]: Becoming Leader. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:40.138927 29714 consensus_queue.cc:237] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:40.145835 29229 catalog_manager.cc:5697] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 reported cstate change: term changed from 4 to 5, leader changed from bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131) to c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130). New cstate: current_term: 5 leader_uuid: "c1f91ebc21464cca9f3ff200dd243882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:40.207608 29739 raft_consensus.cc:993] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657: : Instructing follower c1f91ebc21464cca9f3ff200dd243882 to start an election
I20260709 13:22:40.208077 29745 raft_consensus.cc:1081] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 LEADER]: Signalling peer c1f91ebc21464cca9f3ff200dd243882 to start an election
I20260709 13:22:40.209582 29407 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f04ccf1a4c134687af79a56cc6ddc0e2"
dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
 from {username='slave'} at 127.0.0.1:33318
I20260709 13:22:40.210067 29407 raft_consensus.cc:493] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:40.210345 29407 raft_consensus.cc:3060] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:40.215265 29407 raft_consensus.cc:515] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:40.216712 29407 leader_election.cc:290] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 2 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131:36961)
I20260709 13:22:40.217705 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04ccf1a4c134687af79a56cc6ddc0e2" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:40.217968 29481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04ccf1a4c134687af79a56cc6ddc0e2" candidate_uuid: "c1f91ebc21464cca9f3ff200dd243882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
I20260709 13:22:40.218279 29673 raft_consensus.cc:3060] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:40.218591 29481 raft_consensus.cc:3055] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:40.218894 29481 raft_consensus.cc:740] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:40.219651 29481 consensus_queue.cc:260] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:40.220697 29481 raft_consensus.cc:3060] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:40.223697 29673 raft_consensus.cc:2468] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 2.
I20260709 13:22:40.224835 29371 leader_election.cc:304] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, c1f91ebc21464cca9f3ff200dd243882; no voters: 
I20260709 13:22:40.225672 29714 raft_consensus.cc:2804] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:40.226174 29714 raft_consensus.cc:697] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [term 2 LEADER]: Becoming Leader. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:40.226903 29481 raft_consensus.cc:2468] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f91ebc21464cca9f3ff200dd243882 in term 2.
I20260709 13:22:40.227105 29714 consensus_queue.cc:237] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:40.229557 29752 raft_consensus.cc:993] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882: : Instructing follower bc16d3a078044ee081d6dc1f2fe92657 to start an election
I20260709 13:22:40.230098 29779 raft_consensus.cc:1081] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 5 LEADER]: Signalling peer bc16d3a078044ee081d6dc1f2fe92657 to start an election
I20260709 13:22:40.231866 29482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49b853389a34460e871a95cae81aef1b"
dest_uuid: "bc16d3a078044ee081d6dc1f2fe92657"
 from {username='slave'} at 127.0.0.1:51452
I20260709 13:22:40.232342 29482 raft_consensus.cc:493] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:40.232648 29482 raft_consensus.cc:3060] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:22:40.235426 29229 catalog_manager.cc:5697] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 reported cstate change: term changed from 1 to 2, leader changed from bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131) to c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "c1f91ebc21464cca9f3ff200dd243882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:40.239094 29482 raft_consensus.cc:515] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:40.240757 29482 leader_election.cc:290] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 6 election: Requested vote from peers 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115), c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511)
I20260709 13:22:40.244796 29407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b853389a34460e871a95cae81aef1b" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "c1f91ebc21464cca9f3ff200dd243882"
I20260709 13:22:40.245343 29407 raft_consensus.cc:3055] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:22:40.245231 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b853389a34460e871a95cae81aef1b" candidate_uuid: "bc16d3a078044ee081d6dc1f2fe92657" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "53b52b7f69b34e93b324b8eebec3bcc9"
I20260709 13:22:40.245608 29407 raft_consensus.cc:740] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c1f91ebc21464cca9f3ff200dd243882, State: Running, Role: LEADER
I20260709 13:22:40.245847 29673 raft_consensus.cc:3060] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:22:40.246445 29407 consensus_queue.cc:260] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:40.247372 29407 raft_consensus.cc:3060] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:22:40.251061 29673 raft_consensus.cc:2468] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 6.
I20260709 13:22:40.252307 29445 leader_election.cc:304] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b52b7f69b34e93b324b8eebec3bcc9, bc16d3a078044ee081d6dc1f2fe92657; no voters: 
I20260709 13:22:40.252770 29407 raft_consensus.cc:2468] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc16d3a078044ee081d6dc1f2fe92657 in term 6.
I20260709 13:22:40.253135 29745 raft_consensus.cc:2804] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:22:40.253890 29745 raft_consensus.cc:697] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 6 LEADER]: Becoming Leader. State: Replica: bc16d3a078044ee081d6dc1f2fe92657, State: Running, Role: LEADER
I20260709 13:22:40.254649 29745 consensus_queue.cc:237] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } }
I20260709 13:22:40.261371 29229 catalog_manager.cc:5697] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 reported cstate change: term changed from 5 to 6, leader changed from c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130) to bc16d3a078044ee081d6dc1f2fe92657 (127.17.251.131). New cstate: current_term: 6 leader_uuid: "bc16d3a078044ee081d6dc1f2fe92657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:40.643882 29482 raft_consensus.cc:1275] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 5 FOLLOWER]: Refusing update from remote peer c1f91ebc21464cca9f3ff200dd243882: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:22:40.645392 29779 consensus_queue.cc:1048] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:22:40.654393 29674 raft_consensus.cc:1275] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 5 FOLLOWER]: Refusing update from remote peer c1f91ebc21464cca9f3ff200dd243882: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:22:40.656949 29714 consensus_queue.cc:1048] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:22:40.766419 29674 raft_consensus.cc:1275] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 6 FOLLOWER]: Refusing update from remote peer bc16d3a078044ee081d6dc1f2fe92657: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:22:40.767868 29745 consensus_queue.cc:1048] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:22:40.779093 29407 raft_consensus.cc:1275] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 6 FOLLOWER]: Refusing update from remote peer bc16d3a078044ee081d6dc1f2fe92657: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:22:40.780580 29745 consensus_queue.cc:1048] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f91ebc21464cca9f3ff200dd243882" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:22:40.783277 29482 raft_consensus.cc:1275] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Refusing update from remote peer c1f91ebc21464cca9f3ff200dd243882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:40.785372 29714 consensus_queue.cc:1048] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc16d3a078044ee081d6dc1f2fe92657" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:40.801819 29674 raft_consensus.cc:1275] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Refusing update from remote peer c1f91ebc21464cca9f3ff200dd243882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:40.803328 29752 consensus_queue.cc:1048] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53b52b7f69b34e93b324b8eebec3bcc9" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:40.817368 29279 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:41.071214 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:41.099853 18414 tablet_server.cc:179] TabletServer@127.17.251.129:40115 shutting down...
I20260709 13:22:41.119942 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:41.120601 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:41.121178 18414 raft_consensus.cc:2243] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.121776 18414 raft_consensus.cc:2272] T bedfb7ffc3ce484bb2b2b312c5a37f4b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.123862 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:41.124400 18414 raft_consensus.cc:2243] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.124782 18414 raft_consensus.cc:2272] T cb327970a55b483289199513e743156e P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.126701 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:41.127216 18414 raft_consensus.cc:2243] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.127615 18414 raft_consensus.cc:2272] T a4bdea60f82e48de85a6a242875c05fd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.130038 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:41.130581 18414 raft_consensus.cc:2243] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.130959 18414 raft_consensus.cc:2272] T e6be5c437aff4fc1ac20b95bbdbb73cd P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.132779 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:41.133299 18414 raft_consensus.cc:2243] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.133750 18414 raft_consensus.cc:2272] T b73acada0ca644e4a0edabb1028ae717 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.135485 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:41.135957 18414 raft_consensus.cc:2243] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.136350 18414 raft_consensus.cc:2272] T e7814d4c68564172a5d484898d9f5a19 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.138159 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:41.138616 18414 raft_consensus.cc:2243] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.138959 18414 raft_consensus.cc:2272] T eb4b578b0a274a6e9d6a05cf5d6aad7f P 53b52b7f69b34e93b324b8eebec3bcc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.140779 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:41.141237 18414 raft_consensus.cc:2243] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.141597 18414 raft_consensus.cc:2272] T 49b853389a34460e871a95cae81aef1b P 53b52b7f69b34e93b324b8eebec3bcc9 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.143764 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:41.144246 18414 raft_consensus.cc:2243] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.144603 18414 raft_consensus.cc:2272] T 2933283aca654c2580c5899cba38f514 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.146389 18414 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:41.146797 18414 raft_consensus.cc:2243] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.147151 18414 raft_consensus.cc:2272] T f04ccf1a4c134687af79a56cc6ddc0e2 P 53b52b7f69b34e93b324b8eebec3bcc9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.176607 18414 tablet_server.cc:196] TabletServer@127.17.251.129:40115 shutdown complete.
W20260709 13:22:41.177857 29445 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260709 13:22:41.182130 29445 consensus_peers.cc:597] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:41.196768 18414 tablet_server.cc:179] TabletServer@127.17.251.130:0 shutting down...
W20260709 13:22:41.208238 29447 consensus_peers.cc:597] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 -> Peer c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511): Couldn't send request to peer c1f91ebc21464cca9f3ff200dd243882. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:41.222421 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:41.223384 18414 tablet_replica.cc:333] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882: stopping tablet replica
I20260709 13:22:41.224192 18414 raft_consensus.cc:2243] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:22:41.225175 18414 raft_consensus.cc:2272] T a4bdea60f82e48de85a6a242875c05fd P c1f91ebc21464cca9f3ff200dd243882 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:41.226591 29445 consensus_peers.cc:597] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:41.229046 18414 tablet_replica.cc:333] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882: stopping tablet replica
I20260709 13:22:41.229929 18414 raft_consensus.cc:2243] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:41.230751 18414 raft_consensus.cc:2272] T bedfb7ffc3ce484bb2b2b312c5a37f4b P c1f91ebc21464cca9f3ff200dd243882 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.233207 18414 tablet_replica.cc:333] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882: stopping tablet replica
W20260709 13:22:41.233470 29371 consensus_peers.cc:597] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:41.233978 18414 raft_consensus.cc:2243] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.234498 18414 raft_consensus.cc:2272] T 2933283aca654c2580c5899cba38f514 P c1f91ebc21464cca9f3ff200dd243882 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.236773 18414 tablet_replica.cc:333] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882: stopping tablet replica
I20260709 13:22:41.237383 18414 raft_consensus.cc:2243] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:41.238229 18414 raft_consensus.cc:2272] T f04ccf1a4c134687af79a56cc6ddc0e2 P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.241328 18414 tablet_replica.cc:333] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882: stopping tablet replica
I20260709 13:22:41.242128 18414 raft_consensus.cc:2243] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.242648 18414 raft_consensus.cc:2272] T e6be5c437aff4fc1ac20b95bbdbb73cd P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.244725 18414 tablet_replica.cc:333] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882: stopping tablet replica
I20260709 13:22:41.245277 18414 raft_consensus.cc:2243] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.245745 18414 raft_consensus.cc:2272] T e7814d4c68564172a5d484898d9f5a19 P c1f91ebc21464cca9f3ff200dd243882 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.247830 18414 tablet_replica.cc:333] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882: stopping tablet replica
I20260709 13:22:41.248346 18414 raft_consensus.cc:2243] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.248781 18414 raft_consensus.cc:2272] T b73acada0ca644e4a0edabb1028ae717 P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.250883 18414 tablet_replica.cc:333] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882: stopping tablet replica
I20260709 13:22:41.251417 18414 raft_consensus.cc:2243] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:41.252671 18414 raft_consensus.cc:2272] T cb327970a55b483289199513e743156e P c1f91ebc21464cca9f3ff200dd243882 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.255157 18414 tablet_replica.cc:333] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882: stopping tablet replica
I20260709 13:22:41.255987 18414 raft_consensus.cc:2243] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:41.256929 18414 raft_consensus.cc:2272] T eb4b578b0a274a6e9d6a05cf5d6aad7f P c1f91ebc21464cca9f3ff200dd243882 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.260190 18414 tablet_replica.cc:333] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882: stopping tablet replica
W20260709 13:22:41.260221 29447 consensus_peers.cc:597] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 -> Peer c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511): Couldn't send request to peer c1f91ebc21464cca9f3ff200dd243882. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:41.260779 18414 raft_consensus.cc:2243] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.261322 18414 raft_consensus.cc:2272] T 49b853389a34460e871a95cae81aef1b P c1f91ebc21464cca9f3ff200dd243882 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.295029 18414 tablet_server.cc:196] TabletServer@127.17.251.130:0 shutdown complete.
W20260709 13:22:41.296351 29447 consensus_peers.cc:597] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 -> Peer c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511): Couldn't send request to peer c1f91ebc21464cca9f3ff200dd243882. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:34511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:41.321590 18414 tablet_server.cc:179] TabletServer@127.17.251.131:0 shutting down...
W20260709 13:22:41.352028 29447 consensus_peers.cc:597] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 -> Peer c1f91ebc21464cca9f3ff200dd243882 (127.17.251.130:34511): Couldn't send request to peer c1f91ebc21464cca9f3ff200dd243882. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:34511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:41.354894 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:41.355571 18414 tablet_replica.cc:333] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657: stopping tablet replica
I20260709 13:22:41.356185 18414 raft_consensus.cc:2243] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.356591 18414 raft_consensus.cc:2272] T cb327970a55b483289199513e743156e P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.358807 18414 tablet_replica.cc:333] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657: stopping tablet replica
I20260709 13:22:41.359324 18414 raft_consensus.cc:2243] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.359681 18414 raft_consensus.cc:2272] T bedfb7ffc3ce484bb2b2b312c5a37f4b P bc16d3a078044ee081d6dc1f2fe92657 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.361490 18414 tablet_replica.cc:333] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657: stopping tablet replica
I20260709 13:22:41.362089 18414 raft_consensus.cc:2243] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.362470 18414 raft_consensus.cc:2272] T eb4b578b0a274a6e9d6a05cf5d6aad7f P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.364367 18414 tablet_replica.cc:333] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657: stopping tablet replica
I20260709 13:22:41.364853 18414 raft_consensus.cc:2243] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:22:41.365607 18414 raft_consensus.cc:2272] T 49b853389a34460e871a95cae81aef1b P bc16d3a078044ee081d6dc1f2fe92657 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.368817 18414 tablet_replica.cc:333] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657: stopping tablet replica
I20260709 13:22:41.369491 18414 raft_consensus.cc:2243] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.370081 18414 raft_consensus.cc:2272] T f04ccf1a4c134687af79a56cc6ddc0e2 P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.373083 18414 tablet_replica.cc:333] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657: stopping tablet replica
I20260709 13:22:41.373819 18414 raft_consensus.cc:2243] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:22:41.374439 29445 consensus_peers.cc:597] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 -> Peer 53b52b7f69b34e93b324b8eebec3bcc9 (127.17.251.129:40115): Couldn't send request to peer 53b52b7f69b34e93b324b8eebec3bcc9. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:40115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:41.374781 18414 raft_consensus.cc:2272] T 2933283aca654c2580c5899cba38f514 P bc16d3a078044ee081d6dc1f2fe92657 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.377805 18414 tablet_replica.cc:333] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657: stopping tablet replica
I20260709 13:22:41.378590 18414 raft_consensus.cc:2243] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:41.379092 18414 raft_consensus.cc:2272] T a4bdea60f82e48de85a6a242875c05fd P bc16d3a078044ee081d6dc1f2fe92657 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.381608 18414 tablet_replica.cc:333] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657: stopping tablet replica
I20260709 13:22:41.382230 18414 raft_consensus.cc:2243] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:41.383014 18414 raft_consensus.cc:2272] T b73acada0ca644e4a0edabb1028ae717 P bc16d3a078044ee081d6dc1f2fe92657 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.385092 18414 tablet_replica.cc:333] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657: stopping tablet replica
I20260709 13:22:41.385691 18414 raft_consensus.cc:2243] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:41.386552 18414 raft_consensus.cc:2272] T e7814d4c68564172a5d484898d9f5a19 P bc16d3a078044ee081d6dc1f2fe92657 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.389413 18414 tablet_replica.cc:333] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657: stopping tablet replica
I20260709 13:22:41.390100 18414 raft_consensus.cc:2243] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:41.391139 18414 raft_consensus.cc:2272] T e6be5c437aff4fc1ac20b95bbdbb73cd P bc16d3a078044ee081d6dc1f2fe92657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.415935 18414 tablet_server.cc:196] TabletServer@127.17.251.131:0 shutdown complete.
I20260709 13:22:41.440807 18414 master.cc:562] Master@127.17.251.190:39935 shutting down...
I20260709 13:22:41.467207 18414 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:41.467793 18414 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:41.468135 18414 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0e4e6a0c59f7444088e57abf08e39c53: stopping tablet replica
I20260709 13:22:41.489555 18414 master.cc:584] Master@127.17.251.190:39935 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12868 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:22:41.533694 18414 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.251.190:36937
I20260709 13:22:41.535233 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:41.541471 29805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:41.541496 29804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:41.542106 29808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:41.543861 18414 server_base.cc:1061] running on GCE node
I20260709 13:22:41.544809 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:41.544998 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:41.545113 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603361545102 us; error 0 us; skew 500 ppm
I20260709 13:22:41.545696 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:41.547984 18414 webserver.cc:533] Webserver started at http://127.17.251.190:42923/ using document root <none> and password file <none>
I20260709 13:22:41.548439 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:41.548589 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:41.548817 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:41.550025 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/master-0-root/instance:
uuid: "bdc1bf4e30db4e20a07c1b19d5734c90"
format_stamp: "Formatted at 2026-07-09 13:22:41 on dist-test-slave-7f95"
I20260709 13:22:41.554499 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:41.557803 29813 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:41.558573 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:22:41.558830 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/master-0-root
uuid: "bdc1bf4e30db4e20a07c1b19d5734c90"
format_stamp: "Formatted at 2026-07-09 13:22:41 on dist-test-slave-7f95"
I20260709 13:22:41.559103 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:41.589141 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:41.590338 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:41.629232 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.190:36937
I20260709 13:22:41.629391 29864 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.190:36937 every 8 connection(s)
I20260709 13:22:41.633394 29865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:41.646337 29865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90: Bootstrap starting.
I20260709 13:22:41.651727 29865 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:41.656597 29865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90: No bootstrap required, opened a new log
I20260709 13:22:41.658910 29865 raft_consensus.cc:359] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc1bf4e30db4e20a07c1b19d5734c90" member_type: VOTER }
I20260709 13:22:41.659346 29865 raft_consensus.cc:385] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:41.659579 29865 raft_consensus.cc:740] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdc1bf4e30db4e20a07c1b19d5734c90, State: Initialized, Role: FOLLOWER
I20260709 13:22:41.660218 29865 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc1bf4e30db4e20a07c1b19d5734c90" member_type: VOTER }
I20260709 13:22:41.660764 29865 raft_consensus.cc:399] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:41.661053 29865 raft_consensus.cc:493] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:41.661352 29865 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:41.666345 29865 raft_consensus.cc:515] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc1bf4e30db4e20a07c1b19d5734c90" member_type: VOTER }
I20260709 13:22:41.666908 29865 leader_election.cc:304] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdc1bf4e30db4e20a07c1b19d5734c90; no voters: 
I20260709 13:22:41.668073 29865 leader_election.cc:290] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:41.668424 29868 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:41.669853 29868 raft_consensus.cc:697] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [term 1 LEADER]: Becoming Leader. State: Replica: bdc1bf4e30db4e20a07c1b19d5734c90, State: Running, Role: LEADER
I20260709 13:22:41.670450 29868 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc1bf4e30db4e20a07c1b19d5734c90" member_type: VOTER }
I20260709 13:22:41.671025 29865 sys_catalog.cc:565] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:41.675172 29870 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdc1bf4e30db4e20a07c1b19d5734c90. Latest consensus state: current_term: 1 leader_uuid: "bdc1bf4e30db4e20a07c1b19d5734c90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc1bf4e30db4e20a07c1b19d5734c90" member_type: VOTER } }
I20260709 13:22:41.676236 29869 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdc1bf4e30db4e20a07c1b19d5734c90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc1bf4e30db4e20a07c1b19d5734c90" member_type: VOTER } }
I20260709 13:22:41.677035 29870 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:41.677165 29869 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:41.679126 29877 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:41.684139 29877 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:41.686307 18414 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:41.692777 29877 catalog_manager.cc:1383] Generated new cluster ID: 3762b25e090e4510a3566ccce900519f
I20260709 13:22:41.693099 29877 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:41.712886 29877 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:41.714282 29877 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:41.726799 29877 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90: Generated new TSK 0
I20260709 13:22:41.727439 29877 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:41.752789 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:41.759177 29886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:41.760421 29887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:41.762578 29889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:41.762658 18414 server_base.cc:1061] running on GCE node
I20260709 13:22:41.763932 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:41.764166 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:41.764357 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603361764341 us; error 0 us; skew 500 ppm
I20260709 13:22:41.764987 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:41.767441 18414 webserver.cc:533] Webserver started at http://127.17.251.129:42345/ using document root <none> and password file <none>
I20260709 13:22:41.767982 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:41.768180 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:41.768476 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:41.769589 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/ts-0-root/instance:
uuid: "38c6d4739d5646269292c03fe746b36d"
format_stamp: "Formatted at 2026-07-09 13:22:41 on dist-test-slave-7f95"
I20260709 13:22:41.774184 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:22:41.777561 29894 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:41.778573 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:22:41.778836 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/ts-0-root
uuid: "38c6d4739d5646269292c03fe746b36d"
format_stamp: "Formatted at 2026-07-09 13:22:41 on dist-test-slave-7f95"
I20260709 13:22:41.779101 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:41.791194 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:41.792374 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:41.793891 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:41.796262 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:41.796446 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:41.796772 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:41.796937 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:41.838924 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.129:44847
I20260709 13:22:41.839049 29956 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.129:44847 every 8 connection(s)
I20260709 13:22:41.844215 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:41.851645 29961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:41.852814 29962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:41.857048 18414 server_base.cc:1061] running on GCE node
W20260709 13:22:41.858132 29964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:41.859115 29957 heartbeater.cc:344] Connected to a master server at 127.17.251.190:36937
I20260709 13:22:41.859247 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:22:41.859550 29957 heartbeater.cc:461] Registering TS with master...
W20260709 13:22:41.859587 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:41.859903 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603361859888 us; error 0 us; skew 500 ppm
I20260709 13:22:41.860397 29957 heartbeater.cc:507] Master 127.17.251.190:36937 requested a full tablet report, sending...
I20260709 13:22:41.860580 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:41.863036 29830 ts_manager.cc:194] Registered new tserver with Master: 38c6d4739d5646269292c03fe746b36d (127.17.251.129:44847)
I20260709 13:22:41.863495 18414 webserver.cc:533] Webserver started at http://127.17.251.130:42619/ using document root <none> and password file <none>
I20260709 13:22:41.864180 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:41.864425 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:41.864746 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:41.865538 29830 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40552
I20260709 13:22:41.866227 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/ts-1-root/instance:
uuid: "a790f0aa256d42409d6fc265a47c162f"
format_stamp: "Formatted at 2026-07-09 13:22:41 on dist-test-slave-7f95"
I20260709 13:22:41.871269 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:41.874528 29969 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:41.875277 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:22:41.875582 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/ts-1-root
uuid: "a790f0aa256d42409d6fc265a47c162f"
format_stamp: "Formatted at 2026-07-09 13:22:41 on dist-test-slave-7f95"
I20260709 13:22:41.875872 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:41.889987 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:41.891222 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:41.892762 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:41.895227 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:41.895479 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:41.895745 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:41.895922 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:41.942943 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.130:34349
I20260709 13:22:41.943114 30031 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.130:34349 every 8 connection(s)
I20260709 13:22:41.948537 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:41.960270 30035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:41.961236 30036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:41.967656 30032 heartbeater.cc:344] Connected to a master server at 127.17.251.190:36937
I20260709 13:22:41.968070 18414 server_base.cc:1061] running on GCE node
I20260709 13:22:41.968279 30032 heartbeater.cc:461] Registering TS with master...
W20260709 13:22:41.968984 30039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:41.969230 30032 heartbeater.cc:507] Master 127.17.251.190:36937 requested a full tablet report, sending...
I20260709 13:22:41.970253 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:41.970624 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:41.970820 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603361970802 us; error 0 us; skew 500 ppm
I20260709 13:22:41.971606 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:41.972098 29830 ts_manager.cc:194] Registered new tserver with Master: a790f0aa256d42409d6fc265a47c162f (127.17.251.130:34349)
I20260709 13:22:41.974280 29830 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40556
I20260709 13:22:41.974870 18414 webserver.cc:533] Webserver started at http://127.17.251.131:39635/ using document root <none> and password file <none>
I20260709 13:22:41.975587 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:41.975831 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:41.976114 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:41.977332 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/ts-2-root/instance:
uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6"
format_stamp: "Formatted at 2026-07-09 13:22:41 on dist-test-slave-7f95"
I20260709 13:22:41.982520 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:41.986102 30043 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:41.986950 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:22:41.987286 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/ts-2-root
uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6"
format_stamp: "Formatted at 2026-07-09 13:22:41 on dist-test-slave-7f95"
I20260709 13:22:41.987648 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603012191013-18414-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:42.014127 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:42.015558 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:42.017364 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:42.019732 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:42.019989 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:42.020239 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:42.020427 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:42.062006 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.131:33599
I20260709 13:22:42.062152 30105 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.131:33599 every 8 connection(s)
I20260709 13:22:42.076433 30106 heartbeater.cc:344] Connected to a master server at 127.17.251.190:36937
I20260709 13:22:42.076922 30106 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:42.077840 30106 heartbeater.cc:507] Master 127.17.251.190:36937 requested a full tablet report, sending...
I20260709 13:22:42.079933 29830 ts_manager.cc:194] Registered new tserver with Master: 58161bd9ec2f444bbe0ec73a24bcc0c6 (127.17.251.131:33599)
I20260709 13:22:42.080143 18414 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014930413s
I20260709 13:22:42.081984 29830 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40570
I20260709 13:22:42.108634 29830 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40580:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:42.110998 29830 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:42.158978 29922 tablet_service.cc:1511] Processing CreateTablet for tablet a9cba3d442204c7e8b8745e8b95acb9c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=15c86b614f0b49d59545fcf0f0d08334]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:42.160118 29921 tablet_service.cc:1511] Processing CreateTablet for tablet 96b2a6f71a004c7eae5fe30c58c40aa0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=15c86b614f0b49d59545fcf0f0d08334]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:42.160571 29922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9cba3d442204c7e8b8745e8b95acb9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:42.161571 29921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96b2a6f71a004c7eae5fe30c58c40aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:42.170783 30071 tablet_service.cc:1511] Processing CreateTablet for tablet a9cba3d442204c7e8b8745e8b95acb9c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=15c86b614f0b49d59545fcf0f0d08334]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:42.172236 30071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9cba3d442204c7e8b8745e8b95acb9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:42.173308 30070 tablet_service.cc:1511] Processing CreateTablet for tablet 96b2a6f71a004c7eae5fe30c58c40aa0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=15c86b614f0b49d59545fcf0f0d08334]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:42.174844 30070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96b2a6f71a004c7eae5fe30c58c40aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:42.178483 29997 tablet_service.cc:1511] Processing CreateTablet for tablet a9cba3d442204c7e8b8745e8b95acb9c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=15c86b614f0b49d59545fcf0f0d08334]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:42.180285 29997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9cba3d442204c7e8b8745e8b95acb9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:42.180766 29996 tablet_service.cc:1511] Processing CreateTablet for tablet 96b2a6f71a004c7eae5fe30c58c40aa0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=15c86b614f0b49d59545fcf0f0d08334]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:42.182161 29996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96b2a6f71a004c7eae5fe30c58c40aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:42.206017 30121 tablet_bootstrap.cc:492] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d: Bootstrap starting.
I20260709 13:22:42.209218 30122 tablet_bootstrap.cc:492] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6: Bootstrap starting.
I20260709 13:22:42.213227 30121 tablet_bootstrap.cc:654] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:42.216926 30122 tablet_bootstrap.cc:654] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:42.225224 30123 tablet_bootstrap.cc:492] T 96b2a6f71a004c7eae5fe30c58c40aa0 P a790f0aa256d42409d6fc265a47c162f: Bootstrap starting.
I20260709 13:22:42.228422 30121 tablet_bootstrap.cc:492] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d: No bootstrap required, opened a new log
I20260709 13:22:42.229091 30121 ts_tablet_manager.cc:1403] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.008s
I20260709 13:22:42.229113 30122 tablet_bootstrap.cc:492] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6: No bootstrap required, opened a new log
I20260709 13:22:42.229979 30122 ts_tablet_manager.cc:1403] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6: Time spent bootstrapping tablet: real 0.021s	user 0.003s	sys 0.018s
I20260709 13:22:42.232983 30123 tablet_bootstrap.cc:654] T 96b2a6f71a004c7eae5fe30c58c40aa0 P a790f0aa256d42409d6fc265a47c162f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:42.233186 30122 raft_consensus.cc:359] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.234200 30122 raft_consensus.cc:385] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:42.234486 30122 raft_consensus.cc:740] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58161bd9ec2f444bbe0ec73a24bcc0c6, State: Initialized, Role: FOLLOWER
I20260709 13:22:42.234361 30121 raft_consensus.cc:359] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.235404 30121 raft_consensus.cc:385] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:42.235409 30122 consensus_queue.cc:260] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.235926 30121 raft_consensus.cc:740] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c6d4739d5646269292c03fe746b36d, State: Initialized, Role: FOLLOWER
I20260709 13:22:42.236992 30121 consensus_queue.cc:260] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.240209 29957 heartbeater.cc:499] Master 127.17.251.190:36937 was elected leader, sending a full tablet report...
I20260709 13:22:42.241058 30121 ts_tablet_manager.cc:1434] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:22:42.242583 30121 tablet_bootstrap.cc:492] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 38c6d4739d5646269292c03fe746b36d: Bootstrap starting.
I20260709 13:22:42.242830 30106 heartbeater.cc:499] Master 127.17.251.190:36937 was elected leader, sending a full tablet report...
I20260709 13:22:42.245065 30123 tablet_bootstrap.cc:492] T 96b2a6f71a004c7eae5fe30c58c40aa0 P a790f0aa256d42409d6fc265a47c162f: No bootstrap required, opened a new log
I20260709 13:22:42.245679 30123 ts_tablet_manager.cc:1403] T 96b2a6f71a004c7eae5fe30c58c40aa0 P a790f0aa256d42409d6fc265a47c162f: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:22:42.248740 30122 ts_tablet_manager.cc:1434] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.002s
I20260709 13:22:42.249065 30123 raft_consensus.cc:359] T 96b2a6f71a004c7eae5fe30c58c40aa0 P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.249786 30122 tablet_bootstrap.cc:492] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6: Bootstrap starting.
I20260709 13:22:42.250090 30123 raft_consensus.cc:385] T 96b2a6f71a004c7eae5fe30c58c40aa0 P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:42.250512 30123 raft_consensus.cc:740] T 96b2a6f71a004c7eae5fe30c58c40aa0 P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a790f0aa256d42409d6fc265a47c162f, State: Initialized, Role: FOLLOWER
I20260709 13:22:42.251556 30123 consensus_queue.cc:260] T 96b2a6f71a004c7eae5fe30c58c40aa0 P a790f0aa256d42409d6fc265a47c162f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.255851 30121 tablet_bootstrap.cc:654] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 38c6d4739d5646269292c03fe746b36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:42.266939 30032 heartbeater.cc:499] Master 127.17.251.190:36937 was elected leader, sending a full tablet report...
I20260709 13:22:42.267532 30123 ts_tablet_manager.cc:1434] T 96b2a6f71a004c7eae5fe30c58c40aa0 P a790f0aa256d42409d6fc265a47c162f: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.011s
I20260709 13:22:42.268822 30122 tablet_bootstrap.cc:654] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:42.268976 30123 tablet_bootstrap.cc:492] T a9cba3d442204c7e8b8745e8b95acb9c P a790f0aa256d42409d6fc265a47c162f: Bootstrap starting.
I20260709 13:22:42.269940 30121 tablet_bootstrap.cc:492] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 38c6d4739d5646269292c03fe746b36d: No bootstrap required, opened a new log
I20260709 13:22:42.274313 30121 ts_tablet_manager.cc:1403] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 38c6d4739d5646269292c03fe746b36d: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.011s
I20260709 13:22:42.277702 30123 tablet_bootstrap.cc:654] T a9cba3d442204c7e8b8745e8b95acb9c P a790f0aa256d42409d6fc265a47c162f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:42.277792 30121 raft_consensus.cc:359] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.278680 30121 raft_consensus.cc:385] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:42.279095 30121 raft_consensus.cc:740] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c6d4739d5646269292c03fe746b36d, State: Initialized, Role: FOLLOWER
I20260709 13:22:42.280012 30121 consensus_queue.cc:260] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 38c6d4739d5646269292c03fe746b36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.282824 30121 ts_tablet_manager.cc:1434] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 38c6d4739d5646269292c03fe746b36d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:22:42.287163 30122 tablet_bootstrap.cc:492] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6: No bootstrap required, opened a new log
I20260709 13:22:42.287505 30123 tablet_bootstrap.cc:492] T a9cba3d442204c7e8b8745e8b95acb9c P a790f0aa256d42409d6fc265a47c162f: No bootstrap required, opened a new log
I20260709 13:22:42.287856 30122 ts_tablet_manager.cc:1403] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.004s
I20260709 13:22:42.288138 30123 ts_tablet_manager.cc:1403] T a9cba3d442204c7e8b8745e8b95acb9c P a790f0aa256d42409d6fc265a47c162f: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:22:42.290830 30122 raft_consensus.cc:359] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.291477 30122 raft_consensus.cc:385] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:42.291678 30122 raft_consensus.cc:740] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58161bd9ec2f444bbe0ec73a24bcc0c6, State: Initialized, Role: FOLLOWER
I20260709 13:22:42.291677 30123 raft_consensus.cc:359] T a9cba3d442204c7e8b8745e8b95acb9c P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.292716 30123 raft_consensus.cc:385] T a9cba3d442204c7e8b8745e8b95acb9c P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:42.293100 30123 raft_consensus.cc:740] T a9cba3d442204c7e8b8745e8b95acb9c P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a790f0aa256d42409d6fc265a47c162f, State: Initialized, Role: FOLLOWER
I20260709 13:22:42.292979 30122 consensus_queue.cc:260] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.294163 30123 consensus_queue.cc:260] T a9cba3d442204c7e8b8745e8b95acb9c P a790f0aa256d42409d6fc265a47c162f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.295655 30122 ts_tablet_manager.cc:1434] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:22:42.297003 30123 ts_tablet_manager.cc:1434] T a9cba3d442204c7e8b8745e8b95acb9c P a790f0aa256d42409d6fc265a47c162f: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.008s
I20260709 13:22:42.317739 30127 raft_consensus.cc:493] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:42.318197 30127 raft_consensus.cc:515] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.320603 30127 leader_election.cc:290] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38c6d4739d5646269292c03fe746b36d (127.17.251.129:44847), a790f0aa256d42409d6fc265a47c162f (127.17.251.130:34349)
I20260709 13:22:42.330425 29932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9cba3d442204c7e8b8745e8b95acb9c" candidate_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38c6d4739d5646269292c03fe746b36d" is_pre_election: true
I20260709 13:22:42.331379 29932 raft_consensus.cc:2468] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58161bd9ec2f444bbe0ec73a24bcc0c6 in term 0.
I20260709 13:22:42.332803 30007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9cba3d442204c7e8b8745e8b95acb9c" candidate_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a790f0aa256d42409d6fc265a47c162f" is_pre_election: true
I20260709 13:22:42.332854 30044 leader_election.cc:304] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c6d4739d5646269292c03fe746b36d, 58161bd9ec2f444bbe0ec73a24bcc0c6; no voters: 
I20260709 13:22:42.333609 30007 raft_consensus.cc:2468] T a9cba3d442204c7e8b8745e8b95acb9c P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58161bd9ec2f444bbe0ec73a24bcc0c6 in term 0.
I20260709 13:22:42.334028 30127 raft_consensus.cc:2804] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:42.334472 30127 raft_consensus.cc:493] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:42.334851 30127 raft_consensus.cc:3060] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:42.340610 30127 raft_consensus.cc:515] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.342378 30127 leader_election.cc:290] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [CANDIDATE]: Term 1 election: Requested vote from peers 38c6d4739d5646269292c03fe746b36d (127.17.251.129:44847), a790f0aa256d42409d6fc265a47c162f (127.17.251.130:34349)
I20260709 13:22:42.343370 29932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9cba3d442204c7e8b8745e8b95acb9c" candidate_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38c6d4739d5646269292c03fe746b36d"
I20260709 13:22:42.343580 30007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9cba3d442204c7e8b8745e8b95acb9c" candidate_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a790f0aa256d42409d6fc265a47c162f"
I20260709 13:22:42.344018 29932 raft_consensus.cc:3060] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:42.344245 30007 raft_consensus.cc:3060] T a9cba3d442204c7e8b8745e8b95acb9c P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:42.350265 29932 raft_consensus.cc:2468] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58161bd9ec2f444bbe0ec73a24bcc0c6 in term 1.
I20260709 13:22:42.351181 30007 raft_consensus.cc:2468] T a9cba3d442204c7e8b8745e8b95acb9c P a790f0aa256d42409d6fc265a47c162f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58161bd9ec2f444bbe0ec73a24bcc0c6 in term 1.
I20260709 13:22:42.351572 30044 leader_election.cc:304] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c6d4739d5646269292c03fe746b36d, 58161bd9ec2f444bbe0ec73a24bcc0c6; no voters: 
I20260709 13:22:42.352474 30127 raft_consensus.cc:2804] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:42.353753 30127 raft_consensus.cc:697] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 LEADER]: Becoming Leader. State: Replica: 58161bd9ec2f444bbe0ec73a24bcc0c6, State: Running, Role: LEADER
I20260709 13:22:42.354676 30127 consensus_queue.cc:237] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.363814 29829 catalog_manager.cc:5697] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58161bd9ec2f444bbe0ec73a24bcc0c6 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:42.484714 30127 raft_consensus.cc:493] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:42.485500 30127 raft_consensus.cc:515] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.487457 30127 leader_election.cc:290] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38c6d4739d5646269292c03fe746b36d (127.17.251.129:44847), a790f0aa256d42409d6fc265a47c162f (127.17.251.130:34349)
I20260709 13:22:42.488488 29932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96b2a6f71a004c7eae5fe30c58c40aa0" candidate_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38c6d4739d5646269292c03fe746b36d" is_pre_election: true
I20260709 13:22:42.488729 30007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96b2a6f71a004c7eae5fe30c58c40aa0" candidate_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a790f0aa256d42409d6fc265a47c162f" is_pre_election: true
I20260709 13:22:42.489224 29932 raft_consensus.cc:2468] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58161bd9ec2f444bbe0ec73a24bcc0c6 in term 0.
I20260709 13:22:42.489511 30007 raft_consensus.cc:2468] T 96b2a6f71a004c7eae5fe30c58c40aa0 P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58161bd9ec2f444bbe0ec73a24bcc0c6 in term 0.
I20260709 13:22:42.490412 30044 leader_election.cc:304] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c6d4739d5646269292c03fe746b36d, 58161bd9ec2f444bbe0ec73a24bcc0c6; no voters: 
I20260709 13:22:42.491058 30127 raft_consensus.cc:2804] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:42.491379 30127 raft_consensus.cc:493] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:42.491698 30127 raft_consensus.cc:3060] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:42.498034 30127 raft_consensus.cc:515] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.499830 30127 leader_election.cc:290] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [CANDIDATE]: Term 1 election: Requested vote from peers 38c6d4739d5646269292c03fe746b36d (127.17.251.129:44847), a790f0aa256d42409d6fc265a47c162f (127.17.251.130:34349)
I20260709 13:22:42.500728 29932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96b2a6f71a004c7eae5fe30c58c40aa0" candidate_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38c6d4739d5646269292c03fe746b36d"
I20260709 13:22:42.500984 30007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96b2a6f71a004c7eae5fe30c58c40aa0" candidate_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a790f0aa256d42409d6fc265a47c162f"
I20260709 13:22:42.501334 29932 raft_consensus.cc:3060] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:42.501675 30007 raft_consensus.cc:3060] T 96b2a6f71a004c7eae5fe30c58c40aa0 P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:42.506914 29932 raft_consensus.cc:2468] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 38c6d4739d5646269292c03fe746b36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58161bd9ec2f444bbe0ec73a24bcc0c6 in term 1.
I20260709 13:22:42.506914 30007 raft_consensus.cc:2468] T 96b2a6f71a004c7eae5fe30c58c40aa0 P a790f0aa256d42409d6fc265a47c162f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58161bd9ec2f444bbe0ec73a24bcc0c6 in term 1.
I20260709 13:22:42.508270 30044 leader_election.cc:304] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58161bd9ec2f444bbe0ec73a24bcc0c6, a790f0aa256d42409d6fc265a47c162f; no voters: 
I20260709 13:22:42.508960 30127 raft_consensus.cc:2804] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:42.509373 30127 raft_consensus.cc:697] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 LEADER]: Becoming Leader. State: Replica: 58161bd9ec2f444bbe0ec73a24bcc0c6, State: Running, Role: LEADER
I20260709 13:22:42.510183 30127 consensus_queue.cc:237] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.516500 29829 catalog_manager.cc:5697] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58161bd9ec2f444bbe0ec73a24bcc0c6 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:42.575484 29829 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40592:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:42.577811 29829 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:42.603377 29922 tablet_service.cc:1511] Processing CreateTablet for tablet 76e2a68eea4040a2ac8ab9b03c90c2ce (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d23258d1af6b4f0f9d669ebf50d21216]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:42.604715 29922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76e2a68eea4040a2ac8ab9b03c90c2ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:42.604717 29996 tablet_service.cc:1511] Processing CreateTablet for tablet 76e2a68eea4040a2ac8ab9b03c90c2ce (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d23258d1af6b4f0f9d669ebf50d21216]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:42.606287 29996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76e2a68eea4040a2ac8ab9b03c90c2ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:42.606722 30071 tablet_service.cc:1511] Processing CreateTablet for tablet 76e2a68eea4040a2ac8ab9b03c90c2ce (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d23258d1af6b4f0f9d669ebf50d21216]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:42.608086 30071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76e2a68eea4040a2ac8ab9b03c90c2ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:42.608220 29921 tablet_service.cc:1511] Processing CreateTablet for tablet 0e44d1d725704082b3c4248993d0710c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d23258d1af6b4f0f9d669ebf50d21216]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:42.609512 29921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e44d1d725704082b3c4248993d0710c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:42.621747 30121 tablet_bootstrap.cc:492] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d: Bootstrap starting.
I20260709 13:22:42.622310 30123 tablet_bootstrap.cc:492] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f: Bootstrap starting.
I20260709 13:22:42.625213 30122 tablet_bootstrap.cc:492] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6: Bootstrap starting.
I20260709 13:22:42.628392 30121 tablet_bootstrap.cc:654] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:42.629295 30123 tablet_bootstrap.cc:654] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:42.629812 29997 tablet_service.cc:1511] Processing CreateTablet for tablet 0e44d1d725704082b3c4248993d0710c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d23258d1af6b4f0f9d669ebf50d21216]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:42.631385 29997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e44d1d725704082b3c4248993d0710c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:42.634600 30122 tablet_bootstrap.cc:654] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:42.637902 30121 tablet_bootstrap.cc:492] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d: No bootstrap required, opened a new log
I20260709 13:22:42.638666 30121 ts_tablet_manager.cc:1403] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.009s
I20260709 13:22:42.643893 30121 raft_consensus.cc:359] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.644753 30121 raft_consensus.cc:385] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:42.645107 30121 raft_consensus.cc:740] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c6d4739d5646269292c03fe746b36d, State: Initialized, Role: FOLLOWER
I20260709 13:22:42.645823 30123 tablet_bootstrap.cc:492] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f: No bootstrap required, opened a new log
I20260709 13:22:42.646453 30123 ts_tablet_manager.cc:1403] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.012s
I20260709 13:22:42.646140 30121 consensus_queue.cc:260] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.649048 30071 tablet_service.cc:1511] Processing CreateTablet for tablet 0e44d1d725704082b3c4248993d0710c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d23258d1af6b4f0f9d669ebf50d21216]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:42.649653 30123 raft_consensus.cc:359] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.650466 30123 raft_consensus.cc:385] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:42.650848 30123 raft_consensus.cc:740] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a790f0aa256d42409d6fc265a47c162f, State: Initialized, Role: FOLLOWER
I20260709 13:22:42.651731 30123 consensus_queue.cc:260] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.650429 30071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e44d1d725704082b3c4248993d0710c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:42.654139 30123 ts_tablet_manager.cc:1434] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:22:42.655234 30123 tablet_bootstrap.cc:492] T 0e44d1d725704082b3c4248993d0710c P a790f0aa256d42409d6fc265a47c162f: Bootstrap starting.
I20260709 13:22:42.656328 30122 tablet_bootstrap.cc:492] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6: No bootstrap required, opened a new log
I20260709 13:22:42.656917 30122 ts_tablet_manager.cc:1403] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.005s
I20260709 13:22:42.660157 30122 raft_consensus.cc:359] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.660985 30122 raft_consensus.cc:385] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:42.661367 30122 raft_consensus.cc:740] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58161bd9ec2f444bbe0ec73a24bcc0c6, State: Initialized, Role: FOLLOWER
I20260709 13:22:42.662492 30123 tablet_bootstrap.cc:654] T 0e44d1d725704082b3c4248993d0710c P a790f0aa256d42409d6fc265a47c162f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:42.662305 30122 consensus_queue.cc:260] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.664292 30121 ts_tablet_manager.cc:1434] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:22:42.664758 30122 ts_tablet_manager.cc:1434] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:42.675801 30121 tablet_bootstrap.cc:492] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d: Bootstrap starting.
I20260709 13:22:42.680203 30122 tablet_bootstrap.cc:492] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6: Bootstrap starting.
I20260709 13:22:42.680953 30123 tablet_bootstrap.cc:492] T 0e44d1d725704082b3c4248993d0710c P a790f0aa256d42409d6fc265a47c162f: No bootstrap required, opened a new log
W20260709 13:22:42.680953 29878 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:42.681756 30123 ts_tablet_manager.cc:1403] T 0e44d1d725704082b3c4248993d0710c P a790f0aa256d42409d6fc265a47c162f: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.016s
I20260709 13:22:42.684213 30123 raft_consensus.cc:359] T 0e44d1d725704082b3c4248993d0710c P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.684827 30123 raft_consensus.cc:385] T 0e44d1d725704082b3c4248993d0710c P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:42.685091 30123 raft_consensus.cc:740] T 0e44d1d725704082b3c4248993d0710c P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a790f0aa256d42409d6fc265a47c162f, State: Initialized, Role: FOLLOWER
I20260709 13:22:42.685817 30123 consensus_queue.cc:260] T 0e44d1d725704082b3c4248993d0710c P a790f0aa256d42409d6fc265a47c162f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.686932 30121 tablet_bootstrap.cc:654] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:42.687713 30122 tablet_bootstrap.cc:654] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:42.687911 30123 ts_tablet_manager.cc:1434] T 0e44d1d725704082b3c4248993d0710c P a790f0aa256d42409d6fc265a47c162f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:22:42.689102 30129 raft_consensus.cc:493] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:42.689690 30129 raft_consensus.cc:515] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.696444 30129 leader_election.cc:290] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38c6d4739d5646269292c03fe746b36d (127.17.251.129:44847), 58161bd9ec2f444bbe0ec73a24bcc0c6 (127.17.251.131:33599)
I20260709 13:22:42.731664 29932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e2a68eea4040a2ac8ab9b03c90c2ce" candidate_uuid: "a790f0aa256d42409d6fc265a47c162f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38c6d4739d5646269292c03fe746b36d" is_pre_election: true
I20260709 13:22:42.732856 29932 raft_consensus.cc:2468] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a790f0aa256d42409d6fc265a47c162f in term 0.
I20260709 13:22:42.735051 29970 leader_election.cc:304] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c6d4739d5646269292c03fe746b36d, a790f0aa256d42409d6fc265a47c162f; no voters: 
I20260709 13:22:42.736438 30129 raft_consensus.cc:2804] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:42.736948 30129 raft_consensus.cc:493] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:42.737370 30129 raft_consensus.cc:3060] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:42.750144 30129 raft_consensus.cc:515] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.754009 30081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e2a68eea4040a2ac8ab9b03c90c2ce" candidate_uuid: "a790f0aa256d42409d6fc265a47c162f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" is_pre_election: true
I20260709 13:22:42.754510 30122 tablet_bootstrap.cc:492] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6: No bootstrap required, opened a new log
I20260709 13:22:42.754951 30081 raft_consensus.cc:2468] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a790f0aa256d42409d6fc265a47c162f in term 0.
I20260709 13:22:42.755122 30122 ts_tablet_manager.cc:1403] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6: Time spent bootstrapping tablet: real 0.075s	user 0.044s	sys 0.027s
I20260709 13:22:42.754076 30121 tablet_bootstrap.cc:492] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d: No bootstrap required, opened a new log
I20260709 13:22:42.756362 30121 ts_tablet_manager.cc:1403] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d: Time spent bootstrapping tablet: real 0.081s	user 0.031s	sys 0.035s
I20260709 13:22:42.756671 30129 leader_election.cc:290] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [CANDIDATE]: Term 1 election: Requested vote from peers 38c6d4739d5646269292c03fe746b36d (127.17.251.129:44847), 58161bd9ec2f444bbe0ec73a24bcc0c6 (127.17.251.131:33599)
I20260709 13:22:42.757067 29932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e2a68eea4040a2ac8ab9b03c90c2ce" candidate_uuid: "a790f0aa256d42409d6fc265a47c162f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38c6d4739d5646269292c03fe746b36d"
I20260709 13:22:42.757771 29932 raft_consensus.cc:3060] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:42.758788 30122 raft_consensus.cc:359] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.759177 30081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e2a68eea4040a2ac8ab9b03c90c2ce" candidate_uuid: "a790f0aa256d42409d6fc265a47c162f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6"
I20260709 13:22:42.759606 30122 raft_consensus.cc:385] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:42.759819 30081 raft_consensus.cc:3060] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:42.759992 30122 raft_consensus.cc:740] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58161bd9ec2f444bbe0ec73a24bcc0c6, State: Initialized, Role: FOLLOWER
I20260709 13:22:42.759804 30121 raft_consensus.cc:359] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.761252 30121 raft_consensus.cc:385] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:42.761188 30122 consensus_queue.cc:260] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.761806 30121 raft_consensus.cc:740] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c6d4739d5646269292c03fe746b36d, State: Initialized, Role: FOLLOWER
I20260709 13:22:42.762852 30121 consensus_queue.cc:260] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.765251 30121 ts_tablet_manager.cc:1434] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:42.765980 30122 ts_tablet_manager.cc:1434] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:22:42.769439 30081 raft_consensus.cc:2468] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a790f0aa256d42409d6fc265a47c162f in term 1.
I20260709 13:22:42.770848 29973 leader_election.cc:304] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58161bd9ec2f444bbe0ec73a24bcc0c6, a790f0aa256d42409d6fc265a47c162f; no voters: 
I20260709 13:22:42.771631 30129 raft_consensus.cc:2804] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:42.773852 29932 raft_consensus.cc:2468] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a790f0aa256d42409d6fc265a47c162f in term 1.
I20260709 13:22:42.775992 30129 raft_consensus.cc:697] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 1 LEADER]: Becoming Leader. State: Replica: a790f0aa256d42409d6fc265a47c162f, State: Running, Role: LEADER
I20260709 13:22:42.777122 30129 consensus_queue.cc:237] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:42.785739 29827 catalog_manager.cc:5697] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f reported cstate change: term changed from 0 to 1, leader changed from <none> to a790f0aa256d42409d6fc265a47c162f (127.17.251.130). New cstate: current_term: 1 leader_uuid: "a790f0aa256d42409d6fc265a47c162f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:42.844089 30127 consensus_queue.cc:1048] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:42.855870 30155 consensus_queue.cc:1048] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:42.991696 30155 consensus_queue.cc:1048] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:43.002671 30127 consensus_queue.cc:1048] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:43.015851 30127 raft_consensus.cc:493] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:43.016359 30127 raft_consensus.cc:515] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:43.018155 30127 leader_election.cc:290] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38c6d4739d5646269292c03fe746b36d (127.17.251.129:44847), a790f0aa256d42409d6fc265a47c162f (127.17.251.130:34349)
I20260709 13:22:43.019069 29932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e44d1d725704082b3c4248993d0710c" candidate_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38c6d4739d5646269292c03fe746b36d" is_pre_election: true
I20260709 13:22:43.019450 30007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e44d1d725704082b3c4248993d0710c" candidate_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a790f0aa256d42409d6fc265a47c162f" is_pre_election: true
I20260709 13:22:43.019853 29932 raft_consensus.cc:2468] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58161bd9ec2f444bbe0ec73a24bcc0c6 in term 0.
I20260709 13:22:43.020123 30007 raft_consensus.cc:2468] T 0e44d1d725704082b3c4248993d0710c P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58161bd9ec2f444bbe0ec73a24bcc0c6 in term 0.
I20260709 13:22:43.020990 30044 leader_election.cc:304] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c6d4739d5646269292c03fe746b36d, 58161bd9ec2f444bbe0ec73a24bcc0c6; no voters: 
I20260709 13:22:43.021747 30127 raft_consensus.cc:2804] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:43.022074 30127 raft_consensus.cc:493] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:43.022347 30127 raft_consensus.cc:3060] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:43.027468 30127 raft_consensus.cc:515] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:43.029124 30127 leader_election.cc:290] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [CANDIDATE]: Term 1 election: Requested vote from peers 38c6d4739d5646269292c03fe746b36d (127.17.251.129:44847), a790f0aa256d42409d6fc265a47c162f (127.17.251.130:34349)
I20260709 13:22:43.030069 29932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e44d1d725704082b3c4248993d0710c" candidate_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38c6d4739d5646269292c03fe746b36d"
I20260709 13:22:43.030308 30007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e44d1d725704082b3c4248993d0710c" candidate_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a790f0aa256d42409d6fc265a47c162f"
I20260709 13:22:43.030761 29932 raft_consensus.cc:3060] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:43.030851 30007 raft_consensus.cc:3060] T 0e44d1d725704082b3c4248993d0710c P a790f0aa256d42409d6fc265a47c162f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:43.038319 30007 raft_consensus.cc:2468] T 0e44d1d725704082b3c4248993d0710c P a790f0aa256d42409d6fc265a47c162f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58161bd9ec2f444bbe0ec73a24bcc0c6 in term 1.
I20260709 13:22:43.038319 29932 raft_consensus.cc:2468] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58161bd9ec2f444bbe0ec73a24bcc0c6 in term 1.
I20260709 13:22:43.039750 30044 leader_election.cc:304] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58161bd9ec2f444bbe0ec73a24bcc0c6, a790f0aa256d42409d6fc265a47c162f; no voters: 
I20260709 13:22:43.040618 30127 raft_consensus.cc:2804] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:43.041128 30127 raft_consensus.cc:697] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 LEADER]: Becoming Leader. State: Replica: 58161bd9ec2f444bbe0ec73a24bcc0c6, State: Running, Role: LEADER
I20260709 13:22:43.041987 30127 consensus_queue.cc:237] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:43.049245 29828 catalog_manager.cc:5697] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58161bd9ec2f444bbe0ec73a24bcc0c6 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:43.145140 30081 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9cba3d442204c7e8b8745e8b95acb9c"
dest_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6"
mode: GRACEFUL
new_leader_uuid: "38c6d4739d5646269292c03fe746b36d"
 from {username='slave'} at 127.0.0.1:44150
I20260709 13:22:43.145802 30081 raft_consensus.cc:606] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 LEADER]: Received request to transfer leadership to TS 38c6d4739d5646269292c03fe746b36d
I20260709 13:22:43.162560 30007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76e2a68eea4040a2ac8ab9b03c90c2ce"
dest_uuid: "a790f0aa256d42409d6fc265a47c162f"
mode: GRACEFUL
new_leader_uuid: "38c6d4739d5646269292c03fe746b36d"
 from {username='slave'} at 127.0.0.1:58484
I20260709 13:22:43.163141 30007 raft_consensus.cc:606] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 1 LEADER]: Received request to transfer leadership to TS 38c6d4739d5646269292c03fe746b36d
I20260709 13:22:43.168504 30081 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e44d1d725704082b3c4248993d0710c"
dest_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6"
mode: GRACEFUL
new_leader_uuid: "38c6d4739d5646269292c03fe746b36d"
 from {username='slave'} at 127.0.0.1:44150
I20260709 13:22:43.169154 30081 raft_consensus.cc:606] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 LEADER]: Received request to transfer leadership to TS 38c6d4739d5646269292c03fe746b36d
I20260709 13:22:43.230896 30134 raft_consensus.cc:993] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6: : Instructing follower 38c6d4739d5646269292c03fe746b36d to start an election
I20260709 13:22:43.231382 30127 raft_consensus.cc:1081] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 LEADER]: Signalling peer 38c6d4739d5646269292c03fe746b36d to start an election
I20260709 13:22:43.233107 29932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9cba3d442204c7e8b8745e8b95acb9c"
dest_uuid: "38c6d4739d5646269292c03fe746b36d"
 from {username='slave'} at 127.0.0.1:42532
I20260709 13:22:43.233700 29932 raft_consensus.cc:493] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:43.234033 29932 raft_consensus.cc:3060] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:43.239923 29932 raft_consensus.cc:515] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:43.246248 29932 leader_election.cc:290] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [CANDIDATE]: Term 2 election: Requested vote from peers a790f0aa256d42409d6fc265a47c162f (127.17.251.130:34349), 58161bd9ec2f444bbe0ec73a24bcc0c6 (127.17.251.131:33599)
I20260709 13:22:43.250414 30129 consensus_queue.cc:1048] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:43.257417 30007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9cba3d442204c7e8b8745e8b95acb9c" candidate_uuid: "38c6d4739d5646269292c03fe746b36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a790f0aa256d42409d6fc265a47c162f"
I20260709 13:22:43.258141 30007 raft_consensus.cc:3060] T a9cba3d442204c7e8b8745e8b95acb9c P a790f0aa256d42409d6fc265a47c162f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:43.259750 30081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9cba3d442204c7e8b8745e8b95acb9c" candidate_uuid: "38c6d4739d5646269292c03fe746b36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6"
I20260709 13:22:43.260404 30081 raft_consensus.cc:3055] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:43.260759 30081 raft_consensus.cc:740] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58161bd9ec2f444bbe0ec73a24bcc0c6, State: Running, Role: LEADER
I20260709 13:22:43.261926 30129 raft_consensus.cc:993] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f: : Instructing follower 38c6d4739d5646269292c03fe746b36d to start an election
I20260709 13:22:43.261608 30081 consensus_queue.cc:260] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:43.262423 30129 raft_consensus.cc:1081] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 1 LEADER]: Signalling peer 38c6d4739d5646269292c03fe746b36d to start an election
I20260709 13:22:43.262921 30081 raft_consensus.cc:3060] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:43.266131 30007 raft_consensus.cc:2468] T a9cba3d442204c7e8b8745e8b95acb9c P a790f0aa256d42409d6fc265a47c162f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c6d4739d5646269292c03fe746b36d in term 2.
I20260709 13:22:43.275378 30151 consensus_queue.cc:1048] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:43.277403 29931 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76e2a68eea4040a2ac8ab9b03c90c2ce"
dest_uuid: "38c6d4739d5646269292c03fe746b36d"
 from {username='slave'} at 127.0.0.1:42544
I20260709 13:22:43.278123 29931 raft_consensus.cc:493] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:43.278512 29931 raft_consensus.cc:3060] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:43.278626 30081 raft_consensus.cc:2468] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c6d4739d5646269292c03fe746b36d in term 2.
I20260709 13:22:43.285887 29895 leader_election.cc:304] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c6d4739d5646269292c03fe746b36d, a790f0aa256d42409d6fc265a47c162f; no voters: 
I20260709 13:22:43.286994 30128 raft_consensus.cc:2804] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:43.289242 29931 raft_consensus.cc:515] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:43.295046 30007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e2a68eea4040a2ac8ab9b03c90c2ce" candidate_uuid: "38c6d4739d5646269292c03fe746b36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a790f0aa256d42409d6fc265a47c162f"
I20260709 13:22:43.297034 30007 raft_consensus.cc:3055] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:43.297468 30007 raft_consensus.cc:740] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a790f0aa256d42409d6fc265a47c162f, State: Running, Role: LEADER
I20260709 13:22:43.297536 30080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e2a68eea4040a2ac8ab9b03c90c2ce" candidate_uuid: "38c6d4739d5646269292c03fe746b36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6"
I20260709 13:22:43.296114 29931 leader_election.cc:290] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [CANDIDATE]: Term 2 election: Requested vote from peers a790f0aa256d42409d6fc265a47c162f (127.17.251.130:34349), 58161bd9ec2f444bbe0ec73a24bcc0c6 (127.17.251.131:33599)
I20260709 13:22:43.298242 30080 raft_consensus.cc:3060] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:43.299047 30007 consensus_queue.cc:260] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:43.300314 30007 raft_consensus.cc:3060] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:43.301045 30128 raft_consensus.cc:697] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [term 2 LEADER]: Becoming Leader. State: Replica: 38c6d4739d5646269292c03fe746b36d, State: Running, Role: LEADER
I20260709 13:22:43.302889 30128 consensus_queue.cc:237] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:43.306313 30080 raft_consensus.cc:2468] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c6d4739d5646269292c03fe746b36d in term 2.
I20260709 13:22:43.307929 29898 leader_election.cc:304] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c6d4739d5646269292c03fe746b36d, 58161bd9ec2f444bbe0ec73a24bcc0c6; no voters: 
I20260709 13:22:43.309067 30169 raft_consensus.cc:2804] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:43.309841 30007 raft_consensus.cc:2468] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c6d4739d5646269292c03fe746b36d in term 2.
I20260709 13:22:43.310523 30169 raft_consensus.cc:697] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 2 LEADER]: Becoming Leader. State: Replica: 38c6d4739d5646269292c03fe746b36d, State: Running, Role: LEADER
I20260709 13:22:43.311657 30169 consensus_queue.cc:237] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:43.313848 29828 catalog_manager.cc:5697] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d reported cstate change: term changed from 1 to 2, leader changed from 58161bd9ec2f444bbe0ec73a24bcc0c6 (127.17.251.131) to 38c6d4739d5646269292c03fe746b36d (127.17.251.129). New cstate: current_term: 2 leader_uuid: "38c6d4739d5646269292c03fe746b36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:43.327427 29828 catalog_manager.cc:5697] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d reported cstate change: term changed from 1 to 2, leader changed from a790f0aa256d42409d6fc265a47c162f (127.17.251.130) to 38c6d4739d5646269292c03fe746b36d (127.17.251.129). New cstate: current_term: 2 leader_uuid: "38c6d4739d5646269292c03fe746b36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:43.585039 30171 consensus_queue.cc:1048] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:43.597890 30173 consensus_queue.cc:1048] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:43.606362 30127 raft_consensus.cc:993] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6: : Instructing follower 38c6d4739d5646269292c03fe746b36d to start an election
I20260709 13:22:43.606856 30173 raft_consensus.cc:1081] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 LEADER]: Signalling peer 38c6d4739d5646269292c03fe746b36d to start an election
I20260709 13:22:43.608608 29931 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e44d1d725704082b3c4248993d0710c"
dest_uuid: "38c6d4739d5646269292c03fe746b36d"
 from {username='slave'} at 127.0.0.1:42532
I20260709 13:22:43.609149 29931 raft_consensus.cc:493] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:43.609495 29931 raft_consensus.cc:3060] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:43.615444 29931 raft_consensus.cc:515] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:43.617995 29931 leader_election.cc:290] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [CANDIDATE]: Term 2 election: Requested vote from peers a790f0aa256d42409d6fc265a47c162f (127.17.251.130:34349), 58161bd9ec2f444bbe0ec73a24bcc0c6 (127.17.251.131:33599)
I20260709 13:22:43.618201 30007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e44d1d725704082b3c4248993d0710c" candidate_uuid: "38c6d4739d5646269292c03fe746b36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a790f0aa256d42409d6fc265a47c162f"
I20260709 13:22:43.618403 30080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e44d1d725704082b3c4248993d0710c" candidate_uuid: "38c6d4739d5646269292c03fe746b36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6"
I20260709 13:22:43.618847 30007 raft_consensus.cc:3060] T 0e44d1d725704082b3c4248993d0710c P a790f0aa256d42409d6fc265a47c162f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:43.619272 30080 raft_consensus.cc:3055] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:43.619670 30080 raft_consensus.cc:740] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58161bd9ec2f444bbe0ec73a24bcc0c6, State: Running, Role: LEADER
I20260709 13:22:43.620509 30080 consensus_queue.cc:260] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:43.621990 30080 raft_consensus.cc:3060] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:43.627861 30080 raft_consensus.cc:2468] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c6d4739d5646269292c03fe746b36d in term 2.
I20260709 13:22:43.628248 30007 raft_consensus.cc:2468] T 0e44d1d725704082b3c4248993d0710c P a790f0aa256d42409d6fc265a47c162f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c6d4739d5646269292c03fe746b36d in term 2.
I20260709 13:22:43.629436 29898 leader_election.cc:304] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c6d4739d5646269292c03fe746b36d, 58161bd9ec2f444bbe0ec73a24bcc0c6; no voters: 
I20260709 13:22:43.630451 30169 raft_consensus.cc:2804] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:43.631207 30169 raft_consensus.cc:697] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [term 2 LEADER]: Becoming Leader. State: Replica: 38c6d4739d5646269292c03fe746b36d, State: Running, Role: LEADER
I20260709 13:22:43.632143 30169 consensus_queue.cc:237] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:43.639250 29827 catalog_manager.cc:5697] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d reported cstate change: term changed from 1 to 2, leader changed from 58161bd9ec2f444bbe0ec73a24bcc0c6 (127.17.251.131) to 38c6d4739d5646269292c03fe746b36d (127.17.251.129). New cstate: current_term: 2 leader_uuid: "38c6d4739d5646269292c03fe746b36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:43.748224 30080 raft_consensus.cc:1275] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 2 FOLLOWER]: Refusing update from remote peer 38c6d4739d5646269292c03fe746b36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:43.749701 30169 consensus_queue.cc:1048] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:43.759956 30081 raft_consensus.cc:1275] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 2 FOLLOWER]: Refusing update from remote peer 38c6d4739d5646269292c03fe746b36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:43.762137 30170 consensus_queue.cc:1048] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:43.763778 30007 raft_consensus.cc:1275] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 2 FOLLOWER]: Refusing update from remote peer 38c6d4739d5646269292c03fe746b36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:43.765616 30170 consensus_queue.cc:1048] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:43.772287 30006 raft_consensus.cc:1275] T a9cba3d442204c7e8b8745e8b95acb9c P a790f0aa256d42409d6fc265a47c162f [term 2 FOLLOWER]: Refusing update from remote peer 38c6d4739d5646269292c03fe746b36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:43.775418 30175 consensus_queue.cc:1048] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:43.922363 18414 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:22:43.924031 18414 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:22:43.924443 18414 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:22:43.936800 29931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76e2a68eea4040a2ac8ab9b03c90c2ce"
dest_uuid: "38c6d4739d5646269292c03fe746b36d"
mode: GRACEFUL
new_leader_uuid: "a790f0aa256d42409d6fc265a47c162f"
 from {username='slave'} at 127.0.0.1:42548
I20260709 13:22:43.937317 29931 raft_consensus.cc:606] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 2 LEADER]: Received request to transfer leadership to TS a790f0aa256d42409d6fc265a47c162f
I20260709 13:22:43.938513 18414 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:22:44.175056 30080 raft_consensus.cc:1275] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 2 FOLLOWER]: Refusing update from remote peer 38c6d4739d5646269292c03fe746b36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:44.176816 30175 consensus_queue.cc:1048] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:44.185930 30006 raft_consensus.cc:1275] T 0e44d1d725704082b3c4248993d0710c P a790f0aa256d42409d6fc265a47c162f [term 2 FOLLOWER]: Refusing update from remote peer 38c6d4739d5646269292c03fe746b36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:44.187664 30128 consensus_queue.cc:1048] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:44.265100 30175 raft_consensus.cc:993] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d: : Instructing follower a790f0aa256d42409d6fc265a47c162f to start an election
I20260709 13:22:44.265714 30128 raft_consensus.cc:1081] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 2 LEADER]: Signalling peer a790f0aa256d42409d6fc265a47c162f to start an election
I20260709 13:22:44.267669 30006 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76e2a68eea4040a2ac8ab9b03c90c2ce"
dest_uuid: "a790f0aa256d42409d6fc265a47c162f"
 from {username='slave'} at 127.0.0.1:58486
I20260709 13:22:44.268276 30006 raft_consensus.cc:493] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:44.268638 30006 raft_consensus.cc:3060] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:44.275324 30006 raft_consensus.cc:515] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:44.277226 30006 leader_election.cc:290] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [CANDIDATE]: Term 3 election: Requested vote from peers 38c6d4739d5646269292c03fe746b36d (127.17.251.129:44847), 58161bd9ec2f444bbe0ec73a24bcc0c6 (127.17.251.131:33599)
I20260709 13:22:44.278589 30080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e2a68eea4040a2ac8ab9b03c90c2ce" candidate_uuid: "a790f0aa256d42409d6fc265a47c162f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6"
I20260709 13:22:44.278640 29931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e2a68eea4040a2ac8ab9b03c90c2ce" candidate_uuid: "a790f0aa256d42409d6fc265a47c162f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "38c6d4739d5646269292c03fe746b36d"
I20260709 13:22:44.279294 30080 raft_consensus.cc:3060] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:44.279431 29931 raft_consensus.cc:3055] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:44.279891 29931 raft_consensus.cc:740] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 38c6d4739d5646269292c03fe746b36d, State: Running, Role: LEADER
I20260709 13:22:44.280864 29931 consensus_queue.cc:260] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:44.282222 29931 raft_consensus.cc:3060] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:44.287664 30080 raft_consensus.cc:2468] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a790f0aa256d42409d6fc265a47c162f in term 3.
I20260709 13:22:44.289753 29973 leader_election.cc:304] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58161bd9ec2f444bbe0ec73a24bcc0c6, a790f0aa256d42409d6fc265a47c162f; no voters: 
I20260709 13:22:44.290633 29931 raft_consensus.cc:2468] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a790f0aa256d42409d6fc265a47c162f in term 3.
I20260709 13:22:44.290731 30178 raft_consensus.cc:2804] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:44.291612 30178 raft_consensus.cc:697] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 3 LEADER]: Becoming Leader. State: Replica: a790f0aa256d42409d6fc265a47c162f, State: Running, Role: LEADER
I20260709 13:22:44.292546 30178 consensus_queue.cc:237] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } }
I20260709 13:22:44.301265 29829 catalog_manager.cc:5697] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f reported cstate change: term changed from 2 to 3, leader changed from 38c6d4739d5646269292c03fe746b36d (127.17.251.129) to a790f0aa256d42409d6fc265a47c162f (127.17.251.130). New cstate: current_term: 3 leader_uuid: "a790f0aa256d42409d6fc265a47c162f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c6d4739d5646269292c03fe746b36d" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a790f0aa256d42409d6fc265a47c162f" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 34349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58161bd9ec2f444bbe0ec73a24bcc0c6" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:44.570330 18414 tablet_server.cc:179] TabletServer@127.17.251.129:0 shutting down...
I20260709 13:22:44.603823 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:44.605970 18414 tablet_replica.cc:333] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 38c6d4739d5646269292c03fe746b36d: stopping tablet replica
I20260709 13:22:44.607793 18414 raft_consensus.cc:2243] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 38c6d4739d5646269292c03fe746b36d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:44.608891 18414 raft_consensus.cc:2272] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 38c6d4739d5646269292c03fe746b36d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:44.612967 18414 tablet_replica.cc:333] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d: stopping tablet replica
I20260709 13:22:44.614243 18414 raft_consensus.cc:2243] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:44.616456 18414 raft_consensus.cc:2272] T 0e44d1d725704082b3c4248993d0710c P 38c6d4739d5646269292c03fe746b36d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:44.620627 18414 tablet_replica.cc:333] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d: stopping tablet replica
I20260709 13:22:44.621235 18414 raft_consensus.cc:2243] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:44.621897 18414 raft_consensus.cc:2272] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 38c6d4739d5646269292c03fe746b36d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:44.626133 18414 tablet_replica.cc:333] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d: stopping tablet replica
I20260709 13:22:44.626714 18414 raft_consensus.cc:2243] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:44.628278 18414 raft_consensus.cc:2272] T a9cba3d442204c7e8b8745e8b95acb9c P 38c6d4739d5646269292c03fe746b36d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:44.657565 18414 tablet_server.cc:196] TabletServer@127.17.251.129:0 shutdown complete.
I20260709 13:22:44.679222 18414 tablet_server.cc:179] TabletServer@127.17.251.130:0 shutting down...
I20260709 13:22:44.708050 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:44.708832 18414 tablet_replica.cc:333] T 0e44d1d725704082b3c4248993d0710c P a790f0aa256d42409d6fc265a47c162f: stopping tablet replica
I20260709 13:22:44.709553 18414 raft_consensus.cc:2243] T 0e44d1d725704082b3c4248993d0710c P a790f0aa256d42409d6fc265a47c162f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:44.710245 18414 raft_consensus.cc:2272] T 0e44d1d725704082b3c4248993d0710c P a790f0aa256d42409d6fc265a47c162f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:44.713692 18414 tablet_replica.cc:333] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f: stopping tablet replica
I20260709 13:22:44.714329 18414 raft_consensus.cc:2243] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:44.715380 18414 pending_rounds.cc:70] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f: Trying to abort 1 pending ops.
I20260709 13:22:44.715628 18414 pending_rounds.cc:77] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305639380153151488 op_type: NO_OP noop_request { }
I20260709 13:22:44.716094 18414 raft_consensus.cc:2889] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:22:44.716450 18414 raft_consensus.cc:2272] T 76e2a68eea4040a2ac8ab9b03c90c2ce P a790f0aa256d42409d6fc265a47c162f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:44.719727 18414 tablet_replica.cc:333] T a9cba3d442204c7e8b8745e8b95acb9c P a790f0aa256d42409d6fc265a47c162f: stopping tablet replica
I20260709 13:22:44.720351 18414 raft_consensus.cc:2243] T a9cba3d442204c7e8b8745e8b95acb9c P a790f0aa256d42409d6fc265a47c162f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:44.720969 18414 raft_consensus.cc:2272] T a9cba3d442204c7e8b8745e8b95acb9c P a790f0aa256d42409d6fc265a47c162f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:44.724253 18414 tablet_replica.cc:333] T 96b2a6f71a004c7eae5fe30c58c40aa0 P a790f0aa256d42409d6fc265a47c162f: stopping tablet replica
I20260709 13:22:44.724807 18414 raft_consensus.cc:2243] T 96b2a6f71a004c7eae5fe30c58c40aa0 P a790f0aa256d42409d6fc265a47c162f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:44.725330 18414 raft_consensus.cc:2272] T 96b2a6f71a004c7eae5fe30c58c40aa0 P a790f0aa256d42409d6fc265a47c162f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:44.751376 18414 tablet_server.cc:196] TabletServer@127.17.251.130:0 shutdown complete.
I20260709 13:22:44.772182 18414 tablet_server.cc:179] TabletServer@127.17.251.131:0 shutting down...
I20260709 13:22:44.796691 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:44.797488 18414 tablet_replica.cc:333] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6: stopping tablet replica
I20260709 13:22:44.798240 18414 raft_consensus.cc:2243] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:44.798943 18414 raft_consensus.cc:2272] T 0e44d1d725704082b3c4248993d0710c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:44.802098 18414 tablet_replica.cc:333] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6: stopping tablet replica
I20260709 13:22:44.802719 18414 raft_consensus.cc:2243] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:44.803352 18414 raft_consensus.cc:2272] T 76e2a68eea4040a2ac8ab9b03c90c2ce P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:44.805949 18414 tablet_replica.cc:333] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6: stopping tablet replica
I20260709 13:22:44.806493 18414 raft_consensus.cc:2243] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:44.807265 18414 raft_consensus.cc:2272] T a9cba3d442204c7e8b8745e8b95acb9c P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:44.809763 18414 tablet_replica.cc:333] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6: stopping tablet replica
I20260709 13:22:44.810356 18414 raft_consensus.cc:2243] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:44.811360 18414 raft_consensus.cc:2272] T 96b2a6f71a004c7eae5fe30c58c40aa0 P 58161bd9ec2f444bbe0ec73a24bcc0c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:44.837174 18414 tablet_server.cc:196] TabletServer@127.17.251.131:0 shutdown complete.
I20260709 13:22:44.857302 18414 master.cc:562] Master@127.17.251.190:36937 shutting down...
I20260709 13:22:44.877830 18414 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:44.878580 18414 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:44.878927 18414 tablet_replica.cc:333] T 00000000000000000000000000000000 P bdc1bf4e30db4e20a07c1b19d5734c90: stopping tablet replica
I20260709 13:22:44.900889 18414 master.cc:584] Master@127.17.251.190:36937 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3412 ms)
[----------] 6 tests from LeaderRebalancerTest (352588 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:22:44.946697 18414 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.251.190:41769
I20260709 13:22:44.947916 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:44.954222 30183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:44.954427 30184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:44.955794 30186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:44.957021 18414 server_base.cc:1061] running on GCE node
I20260709 13:22:44.957933 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:44.958133 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:44.958271 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603364958257 us; error 0 us; skew 500 ppm
I20260709 13:22:44.958843 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:44.961256 18414 webserver.cc:533] Webserver started at http://127.17.251.190:33509/ using document root <none> and password file <none>
I20260709 13:22:44.961862 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:44.962064 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:44.962342 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:44.963547 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/master-0-root/instance:
uuid: "634d0ef2b002426d86b6312ac66feaa8"
format_stamp: "Formatted at 2026-07-09 13:22:44 on dist-test-slave-7f95"
I20260709 13:22:44.968430 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:22:44.972976 30191 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:44.973917 18414 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:22:44.974238 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/master-0-root
uuid: "634d0ef2b002426d86b6312ac66feaa8"
format_stamp: "Formatted at 2026-07-09 13:22:44 on dist-test-slave-7f95"
I20260709 13:22:44.974574 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:44.994346 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:44.995726 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:45.038378 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.190:41769
I20260709 13:22:45.038482 30242 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.190:41769 every 8 connection(s)
I20260709 13:22:45.042929 30243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.057991 30243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8: Bootstrap starting.
I20260709 13:22:45.063650 30243 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:45.068472 30243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8: No bootstrap required, opened a new log
I20260709 13:22:45.070983 30243 raft_consensus.cc:359] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "634d0ef2b002426d86b6312ac66feaa8" member_type: VOTER }
I20260709 13:22:45.071444 30243 raft_consensus.cc:385] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:45.071699 30243 raft_consensus.cc:740] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 634d0ef2b002426d86b6312ac66feaa8, State: Initialized, Role: FOLLOWER
I20260709 13:22:45.072373 30243 consensus_queue.cc:260] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "634d0ef2b002426d86b6312ac66feaa8" member_type: VOTER }
I20260709 13:22:45.072850 30243 raft_consensus.cc:399] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:45.073081 30243 raft_consensus.cc:493] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:45.073391 30243 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:45.079054 30243 raft_consensus.cc:515] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "634d0ef2b002426d86b6312ac66feaa8" member_type: VOTER }
I20260709 13:22:45.079643 30243 leader_election.cc:304] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 634d0ef2b002426d86b6312ac66feaa8; no voters: 
I20260709 13:22:45.080996 30243 leader_election.cc:290] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:45.081501 30246 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:45.083101 30246 raft_consensus.cc:697] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [term 1 LEADER]: Becoming Leader. State: Replica: 634d0ef2b002426d86b6312ac66feaa8, State: Running, Role: LEADER
I20260709 13:22:45.083912 30246 consensus_queue.cc:237] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "634d0ef2b002426d86b6312ac66feaa8" member_type: VOTER }
I20260709 13:22:45.084057 30243 sys_catalog.cc:565] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:45.087371 30247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "634d0ef2b002426d86b6312ac66feaa8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "634d0ef2b002426d86b6312ac66feaa8" member_type: VOTER } }
I20260709 13:22:45.087371 30248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 634d0ef2b002426d86b6312ac66feaa8. Latest consensus state: current_term: 1 leader_uuid: "634d0ef2b002426d86b6312ac66feaa8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "634d0ef2b002426d86b6312ac66feaa8" member_type: VOTER } }
I20260709 13:22:45.088133 30247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:45.088150 30248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:45.095430 30251 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:45.103559 30251 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:45.105309 18414 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:45.115373 30251 catalog_manager.cc:1383] Generated new cluster ID: 68d40dd87ab444d5a1502f999e022c6d
I20260709 13:22:45.115711 30251 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:45.142108 30251 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:45.143532 30251 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:45.157394 30251 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8: Generated new TSK 0
I20260709 13:22:45.158037 30251 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:45.172598 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:45.179279 30264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:45.180186 30265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:45.182173 30267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:45.182461 18414 server_base.cc:1061] running on GCE node
I20260709 13:22:45.183604 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:45.183846 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:45.184052 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603365184023 us; error 0 us; skew 500 ppm
I20260709 13:22:45.184669 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:45.187388 18414 webserver.cc:533] Webserver started at http://127.17.251.129:43345/ using document root <none> and password file <none>
I20260709 13:22:45.187966 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:45.188194 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:45.188514 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:45.190102 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/ts-0-root/instance:
uuid: "e72c3640883d4c0d88571a0839c5f947"
format_stamp: "Formatted at 2026-07-09 13:22:45 on dist-test-slave-7f95"
I20260709 13:22:45.195384 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:22:45.199007 30272 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:45.199829 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:22:45.200235 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/ts-0-root
uuid: "e72c3640883d4c0d88571a0839c5f947"
format_stamp: "Formatted at 2026-07-09 13:22:45 on dist-test-slave-7f95"
I20260709 13:22:45.200541 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:45.217304 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:45.218708 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:45.220368 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:45.222944 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:45.223193 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:45.223465 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:45.223675 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:45.267822 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.129:34845
I20260709 13:22:45.267915 30334 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.129:34845 every 8 connection(s)
I20260709 13:22:45.273392 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:45.282325 30339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:45.283949 30340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:45.285820 30342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:45.286188 18414 server_base.cc:1061] running on GCE node
I20260709 13:22:45.287992 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:45.288234 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:45.288399 30335 heartbeater.cc:344] Connected to a master server at 127.17.251.190:41769
I20260709 13:22:45.288451 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603365288430 us; error 0 us; skew 500 ppm
I20260709 13:22:45.288901 30335 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:45.289322 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:45.289881 30335 heartbeater.cc:507] Master 127.17.251.190:41769 requested a full tablet report, sending...
I20260709 13:22:45.292232 18414 webserver.cc:533] Webserver started at http://127.17.251.130:35391/ using document root <none> and password file <none>
I20260709 13:22:45.292682 30208 ts_manager.cc:194] Registered new tserver with Master: e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845)
I20260709 13:22:45.293035 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:45.293435 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:45.293809 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:45.295537 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/ts-1-root/instance:
uuid: "a2c1f703ee334f54aaf22e4c25886102"
format_stamp: "Formatted at 2026-07-09 13:22:45 on dist-test-slave-7f95"
I20260709 13:22:45.295573 30208 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48604
I20260709 13:22:45.300947 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:22:45.305034 30347 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:45.305984 18414 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:22:45.306358 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/ts-1-root
uuid: "a2c1f703ee334f54aaf22e4c25886102"
format_stamp: "Formatted at 2026-07-09 13:22:45 on dist-test-slave-7f95"
I20260709 13:22:45.306699 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:45.319283 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:45.320627 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:45.322206 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:45.324476 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:45.324704 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:45.324973 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:45.325171 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:45.367236 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.130:33447
I20260709 13:22:45.367347 30409 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.130:33447 every 8 connection(s)
I20260709 13:22:45.372464 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:45.381945 30413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:45.382288 30414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:45.386324 30410 heartbeater.cc:344] Connected to a master server at 127.17.251.190:41769
I20260709 13:22:45.386925 30410 heartbeater.cc:461] Registering TS with master...
W20260709 13:22:45.387156 30416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:45.387951 30410 heartbeater.cc:507] Master 127.17.251.190:41769 requested a full tablet report, sending...
I20260709 13:22:45.388118 18414 server_base.cc:1061] running on GCE node
I20260709 13:22:45.389250 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:45.389431 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:45.389604 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603365389585 us; error 0 us; skew 500 ppm
I20260709 13:22:45.390268 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:45.390641 30208 ts_manager.cc:194] Registered new tserver with Master: a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:45.392264 30208 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48606
I20260709 13:22:45.393428 18414 webserver.cc:533] Webserver started at http://127.17.251.131:43959/ using document root <none> and password file <none>
I20260709 13:22:45.394194 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:45.394434 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:45.394768 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:45.396143 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/ts-2-root/instance:
uuid: "2f149ae7a84c46288c47962524d5240c"
format_stamp: "Formatted at 2026-07-09 13:22:45 on dist-test-slave-7f95"
I20260709 13:22:45.400745 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:22:45.404362 30421 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:45.405259 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:45.405603 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/ts-2-root
uuid: "2f149ae7a84c46288c47962524d5240c"
format_stamp: "Formatted at 2026-07-09 13:22:45 on dist-test-slave-7f95"
I20260709 13:22:45.406011 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603012191013-18414-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:45.434669 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:45.435961 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:45.437479 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:45.439894 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:45.440157 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:45.440415 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:45.440590 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:45.485951 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.131:33861
I20260709 13:22:45.486064 30483 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.131:33861 every 8 connection(s)
I20260709 13:22:45.501605 30484 heartbeater.cc:344] Connected to a master server at 127.17.251.190:41769
I20260709 13:22:45.502179 30484 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:45.503048 30484 heartbeater.cc:507] Master 127.17.251.190:41769 requested a full tablet report, sending...
I20260709 13:22:45.505110 30208 ts_manager.cc:194] Registered new tserver with Master: 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:45.505249 18414 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015440632s
I20260709 13:22:45.506654 30208 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48610
I20260709 13:22:45.534016 30208 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48622:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:45.536949 30208 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:45.618360 30375 tablet_service.cc:1511] Processing CreateTablet for tablet de5915d8c7314cd48dd19e7d16167e66 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:45.620312 30374 tablet_service.cc:1511] Processing CreateTablet for tablet c353b5fb791243328ce69dee051716c8 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:45.625344 30373 tablet_service.cc:1511] Processing CreateTablet for tablet 7a990d537d854b3793ccf4c5bc144715 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:45.629751 30375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5915d8c7314cd48dd19e7d16167e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.629240 30372 tablet_service.cc:1511] Processing CreateTablet for tablet e5f9e4f158f64b23bb4c0ca79a584d63 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:45.631332 30372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f9e4f158f64b23bb4c0ca79a584d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.632550 30449 tablet_service.cc:1511] Processing CreateTablet for tablet de5915d8c7314cd48dd19e7d16167e66 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:45.634013 30373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a990d537d854b3793ccf4c5bc144715. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.635360 30448 tablet_service.cc:1511] Processing CreateTablet for tablet c353b5fb791243328ce69dee051716c8 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:45.637959 30447 tablet_service.cc:1511] Processing CreateTablet for tablet 7a990d537d854b3793ccf4c5bc144715 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:45.638041 30371 tablet_service.cc:1511] Processing CreateTablet for tablet f0e430433b8145deab5c06f7847d3e24 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:45.640148 30371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e430433b8145deab5c06f7847d3e24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.640681 30446 tablet_service.cc:1511] Processing CreateTablet for tablet e5f9e4f158f64b23bb4c0ca79a584d63 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:45.642060 30374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c353b5fb791243328ce69dee051716c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.643992 30370 tablet_service.cc:1511] Processing CreateTablet for tablet 6650c8247d604ebbb4f9c9105acb6edf (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:45.645561 30370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6650c8247d604ebbb4f9c9105acb6edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.645457 30443 tablet_service.cc:1511] Processing CreateTablet for tablet 3a00e306130342489b1cea7120ab1b62 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:45.647589 30444 tablet_service.cc:1511] Processing CreateTablet for tablet 6650c8247d604ebbb4f9c9105acb6edf (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:45.649641 30445 tablet_service.cc:1511] Processing CreateTablet for tablet f0e430433b8145deab5c06f7847d3e24 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:45.650646 30369 tablet_service.cc:1511] Processing CreateTablet for tablet 3a00e306130342489b1cea7120ab1b62 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:45.634073 30449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5915d8c7314cd48dd19e7d16167e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.652052 30443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a00e306130342489b1cea7120ab1b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.653337 30445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e430433b8145deab5c06f7847d3e24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.654970 30448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c353b5fb791243328ce69dee051716c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.657145 30447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a990d537d854b3793ccf4c5bc144715. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.658998 30367 tablet_service.cc:1511] Processing CreateTablet for tablet f2f6c2ce665341a2add61bcbcf5c3422 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:45.661700 30368 tablet_service.cc:1511] Processing CreateTablet for tablet 588be62bafd94913b204edb157d4ba7e (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:45.664100 30444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6650c8247d604ebbb4f9c9105acb6edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.666807 30441 tablet_service.cc:1511] Processing CreateTablet for tablet f2f6c2ce665341a2add61bcbcf5c3422 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:45.668291 30441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f6c2ce665341a2add61bcbcf5c3422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.669492 30499 tablet_bootstrap.cc:492] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102: Bootstrap starting.
I20260709 13:22:45.670791 30442 tablet_service.cc:1511] Processing CreateTablet for tablet 588be62bafd94913b204edb157d4ba7e (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:45.672438 30446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f9e4f158f64b23bb4c0ca79a584d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.652078 30369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a00e306130342489b1cea7120ab1b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.681327 30367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f6c2ce665341a2add61bcbcf5c3422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.685997 30368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 588be62bafd94913b204edb157d4ba7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.692883 30499 tablet_bootstrap.cc:654] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:45.693997 30442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 588be62bafd94913b204edb157d4ba7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.750869 30300 tablet_service.cc:1511] Processing CreateTablet for tablet de5915d8c7314cd48dd19e7d16167e66 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:45.752336 30300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5915d8c7314cd48dd19e7d16167e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.754943 30299 tablet_service.cc:1511] Processing CreateTablet for tablet c353b5fb791243328ce69dee051716c8 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:45.756433 30299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c353b5fb791243328ce69dee051716c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.759433 30298 tablet_service.cc:1511] Processing CreateTablet for tablet 7a990d537d854b3793ccf4c5bc144715 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:45.760991 30298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a990d537d854b3793ccf4c5bc144715. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.763832 30296 tablet_service.cc:1511] Processing CreateTablet for tablet f0e430433b8145deab5c06f7847d3e24 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:45.765339 30296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e430433b8145deab5c06f7847d3e24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.766922 30293 tablet_service.cc:1511] Processing CreateTablet for tablet 588be62bafd94913b204edb157d4ba7e (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:45.769322 30295 tablet_service.cc:1511] Processing CreateTablet for tablet 6650c8247d604ebbb4f9c9105acb6edf (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:45.771754 30297 tablet_service.cc:1511] Processing CreateTablet for tablet e5f9e4f158f64b23bb4c0ca79a584d63 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:45.774348 30294 tablet_service.cc:1511] Processing CreateTablet for tablet 3a00e306130342489b1cea7120ab1b62 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:45.775728 30294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a00e306130342489b1cea7120ab1b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.779503 30292 tablet_service.cc:1511] Processing CreateTablet for tablet f2f6c2ce665341a2add61bcbcf5c3422 (DEFAULT_TABLE table=test-workload [id=ae629127f304415384e74469e57cc200]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:45.780953 30295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6650c8247d604ebbb4f9c9105acb6edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.781860 30293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 588be62bafd94913b204edb157d4ba7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.787070 30292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f6c2ce665341a2add61bcbcf5c3422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.789057 30297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f9e4f158f64b23bb4c0ca79a584d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:45.803316 30499 tablet_bootstrap.cc:492] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102: No bootstrap required, opened a new log
I20260709 13:22:45.803946 30499 ts_tablet_manager.cc:1403] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102: Time spent bootstrapping tablet: real 0.135s	user 0.022s	sys 0.038s
I20260709 13:22:45.808044 30499 raft_consensus.cc:359] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.808969 30499 raft_consensus.cc:385] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:45.809317 30499 raft_consensus.cc:740] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Initialized, Role: FOLLOWER
I20260709 13:22:45.810407 30499 consensus_queue.cc:260] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.835690 30499 ts_tablet_manager.cc:1434] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.005s
I20260709 13:22:45.836560 30410 heartbeater.cc:499] Master 127.17.251.190:41769 was elected leader, sending a full tablet report...
I20260709 13:22:45.836854 30499 tablet_bootstrap.cc:492] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102: Bootstrap starting.
I20260709 13:22:45.842614 30501 tablet_bootstrap.cc:492] T f0e430433b8145deab5c06f7847d3e24 P 2f149ae7a84c46288c47962524d5240c: Bootstrap starting.
I20260709 13:22:45.852972 30503 tablet_bootstrap.cc:492] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947: Bootstrap starting.
I20260709 13:22:45.858634 30499 tablet_bootstrap.cc:654] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:45.859392 30501 tablet_bootstrap.cc:654] T f0e430433b8145deab5c06f7847d3e24 P 2f149ae7a84c46288c47962524d5240c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:45.859652 30503 tablet_bootstrap.cc:654] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:45.874377 30499 tablet_bootstrap.cc:492] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102: No bootstrap required, opened a new log
I20260709 13:22:45.874871 30499 ts_tablet_manager.cc:1403] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.008s
I20260709 13:22:45.877483 30499 raft_consensus.cc:359] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.878276 30499 raft_consensus.cc:385] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:45.878547 30499 raft_consensus.cc:740] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Initialized, Role: FOLLOWER
I20260709 13:22:45.879570 30499 consensus_queue.cc:260] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.880728 30503 tablet_bootstrap.cc:492] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947: No bootstrap required, opened a new log
I20260709 13:22:45.881246 30503 ts_tablet_manager.cc:1403] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.000s
I20260709 13:22:45.881644 30499 ts_tablet_manager.cc:1434] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:22:45.882797 30499 tablet_bootstrap.cc:492] T e5f9e4f158f64b23bb4c0ca79a584d63 P a2c1f703ee334f54aaf22e4c25886102: Bootstrap starting.
I20260709 13:22:45.884114 30503 raft_consensus.cc:359] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.884739 30503 raft_consensus.cc:385] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:45.884982 30503 raft_consensus.cc:740] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Initialized, Role: FOLLOWER
I20260709 13:22:45.885739 30503 consensus_queue.cc:260] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.888785 30335 heartbeater.cc:499] Master 127.17.251.190:41769 was elected leader, sending a full tablet report...
I20260709 13:22:45.889350 30501 tablet_bootstrap.cc:492] T f0e430433b8145deab5c06f7847d3e24 P 2f149ae7a84c46288c47962524d5240c: No bootstrap required, opened a new log
I20260709 13:22:45.889942 30501 ts_tablet_manager.cc:1403] T f0e430433b8145deab5c06f7847d3e24 P 2f149ae7a84c46288c47962524d5240c: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.000s
I20260709 13:22:45.890232 30499 tablet_bootstrap.cc:654] T e5f9e4f158f64b23bb4c0ca79a584d63 P a2c1f703ee334f54aaf22e4c25886102: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:45.893298 30501 raft_consensus.cc:359] T f0e430433b8145deab5c06f7847d3e24 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.894165 30501 raft_consensus.cc:385] T f0e430433b8145deab5c06f7847d3e24 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:45.894541 30501 raft_consensus.cc:740] T f0e430433b8145deab5c06f7847d3e24 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Initialized, Role: FOLLOWER
I20260709 13:22:45.895427 30501 consensus_queue.cc:260] T f0e430433b8145deab5c06f7847d3e24 P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.896993 30503 ts_tablet_manager.cc:1434] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:22:45.898080 30499 tablet_bootstrap.cc:492] T e5f9e4f158f64b23bb4c0ca79a584d63 P a2c1f703ee334f54aaf22e4c25886102: No bootstrap required, opened a new log
I20260709 13:22:45.898149 30503 tablet_bootstrap.cc:492] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947: Bootstrap starting.
I20260709 13:22:45.898674 30499 ts_tablet_manager.cc:1403] T e5f9e4f158f64b23bb4c0ca79a584d63 P a2c1f703ee334f54aaf22e4c25886102: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:22:45.902091 30499 raft_consensus.cc:359] T e5f9e4f158f64b23bb4c0ca79a584d63 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.903112 30499 raft_consensus.cc:385] T e5f9e4f158f64b23bb4c0ca79a584d63 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:45.903424 30499 raft_consensus.cc:740] T e5f9e4f158f64b23bb4c0ca79a584d63 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Initialized, Role: FOLLOWER
I20260709 13:22:45.904487 30499 consensus_queue.cc:260] T e5f9e4f158f64b23bb4c0ca79a584d63 P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.906466 30503 tablet_bootstrap.cc:654] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:45.912021 30499 ts_tablet_manager.cc:1434] T e5f9e4f158f64b23bb4c0ca79a584d63 P a2c1f703ee334f54aaf22e4c25886102: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:22:45.912575 30484 heartbeater.cc:499] Master 127.17.251.190:41769 was elected leader, sending a full tablet report...
I20260709 13:22:45.912838 30501 ts_tablet_manager.cc:1434] T f0e430433b8145deab5c06f7847d3e24 P 2f149ae7a84c46288c47962524d5240c: Time spent starting tablet: real 0.023s	user 0.012s	sys 0.009s
I20260709 13:22:45.913751 30499 tablet_bootstrap.cc:492] T 7a990d537d854b3793ccf4c5bc144715 P a2c1f703ee334f54aaf22e4c25886102: Bootstrap starting.
I20260709 13:22:45.914356 30501 tablet_bootstrap.cc:492] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c: Bootstrap starting.
I20260709 13:22:45.921833 30499 tablet_bootstrap.cc:654] T 7a990d537d854b3793ccf4c5bc144715 P a2c1f703ee334f54aaf22e4c25886102: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:45.925110 30501 tablet_bootstrap.cc:654] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:45.927747 30503 tablet_bootstrap.cc:492] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947: No bootstrap required, opened a new log
I20260709 13:22:45.929101 30503 ts_tablet_manager.cc:1403] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.017s
I20260709 13:22:45.933084 30503 raft_consensus.cc:359] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.934099 30503 raft_consensus.cc:385] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:45.934482 30503 raft_consensus.cc:740] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Initialized, Role: FOLLOWER
I20260709 13:22:45.935423 30503 consensus_queue.cc:260] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.936033 30501 tablet_bootstrap.cc:492] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c: No bootstrap required, opened a new log
I20260709 13:22:45.936614 30501 ts_tablet_manager.cc:1403] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 13:22:45.937795 30503 ts_tablet_manager.cc:1434] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:45.938928 30503 tablet_bootstrap.cc:492] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947: Bootstrap starting.
I20260709 13:22:45.939612 30499 tablet_bootstrap.cc:492] T 7a990d537d854b3793ccf4c5bc144715 P a2c1f703ee334f54aaf22e4c25886102: No bootstrap required, opened a new log
I20260709 13:22:45.939723 30501 raft_consensus.cc:359] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.940655 30501 raft_consensus.cc:385] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:45.940986 30501 raft_consensus.cc:740] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Initialized, Role: FOLLOWER
I20260709 13:22:45.941845 30501 consensus_queue.cc:260] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.944221 30501 ts_tablet_manager.cc:1434] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:22:45.945231 30501 tablet_bootstrap.cc:492] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c: Bootstrap starting.
I20260709 13:22:45.940335 30499 ts_tablet_manager.cc:1403] T 7a990d537d854b3793ccf4c5bc144715 P a2c1f703ee334f54aaf22e4c25886102: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.010s
I20260709 13:22:45.946834 30503 tablet_bootstrap.cc:654] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:45.948804 30499 raft_consensus.cc:359] T 7a990d537d854b3793ccf4c5bc144715 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.949690 30499 raft_consensus.cc:385] T 7a990d537d854b3793ccf4c5bc144715 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:45.950098 30499 raft_consensus.cc:740] T 7a990d537d854b3793ccf4c5bc144715 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Initialized, Role: FOLLOWER
I20260709 13:22:45.951195 30499 consensus_queue.cc:260] T 7a990d537d854b3793ccf4c5bc144715 P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.953640 30499 ts_tablet_manager.cc:1434] T 7a990d537d854b3793ccf4c5bc144715 P a2c1f703ee334f54aaf22e4c25886102: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:22:45.954648 30499 tablet_bootstrap.cc:492] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102: Bootstrap starting.
I20260709 13:22:45.959111 30501 tablet_bootstrap.cc:654] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:45.961261 30499 tablet_bootstrap.cc:654] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:45.966557 30503 tablet_bootstrap.cc:492] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947: No bootstrap required, opened a new log
I20260709 13:22:45.967119 30503 ts_tablet_manager.cc:1403] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.004s
I20260709 13:22:45.970212 30503 raft_consensus.cc:359] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.970999 30503 raft_consensus.cc:385] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:45.971335 30503 raft_consensus.cc:740] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Initialized, Role: FOLLOWER
I20260709 13:22:45.972249 30503 consensus_queue.cc:260] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.974913 30499 tablet_bootstrap.cc:492] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102: No bootstrap required, opened a new log
I20260709 13:22:45.975677 30499 ts_tablet_manager.cc:1403] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:22:45.977577 30503 ts_tablet_manager.cc:1434] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:22:45.978945 30503 tablet_bootstrap.cc:492] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947: Bootstrap starting.
I20260709 13:22:45.979966 30499 raft_consensus.cc:359] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.981072 30499 raft_consensus.cc:385] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:45.981454 30499 raft_consensus.cc:740] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Initialized, Role: FOLLOWER
I20260709 13:22:45.982867 30499 consensus_queue.cc:260] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.986510 30499 ts_tablet_manager.cc:1434] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.004s
I20260709 13:22:45.987807 30499 tablet_bootstrap.cc:492] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102: Bootstrap starting.
I20260709 13:22:45.988308 30503 tablet_bootstrap.cc:654] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:45.989743 30501 tablet_bootstrap.cc:492] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c: No bootstrap required, opened a new log
I20260709 13:22:45.990319 30501 ts_tablet_manager.cc:1403] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.016s
I20260709 13:22:45.994858 30499 tablet_bootstrap.cc:654] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:45.997568 30501 raft_consensus.cc:359] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:45.998471 30501 raft_consensus.cc:385] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:45.998812 30503 tablet_bootstrap.cc:492] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947: No bootstrap required, opened a new log
I20260709 13:22:45.998776 30501 raft_consensus.cc:740] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Initialized, Role: FOLLOWER
I20260709 13:22:45.999521 30503 ts_tablet_manager.cc:1403] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.009s
I20260709 13:22:45.999936 30501 consensus_queue.cc:260] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.001190 30507 raft_consensus.cc:493] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:46.001958 30499 tablet_bootstrap.cc:492] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102: No bootstrap required, opened a new log
I20260709 13:22:46.001775 30507 raft_consensus.cc:515] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.002597 30499 ts_tablet_manager.cc:1403] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.003s
I20260709 13:22:46.003661 30503 raft_consensus.cc:359] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.004468 30503 raft_consensus.cc:385] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:46.004833 30503 raft_consensus.cc:740] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Initialized, Role: FOLLOWER
I20260709 13:22:46.005496 30501 ts_tablet_manager.cc:1434] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:22:46.005594 30503 consensus_queue.cc:260] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.006738 30501 tablet_bootstrap.cc:492] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c: Bootstrap starting.
I20260709 13:22:46.006325 30499 raft_consensus.cc:359] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.007300 30499 raft_consensus.cc:385] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:46.007678 30499 raft_consensus.cc:740] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Initialized, Role: FOLLOWER
I20260709 13:22:46.008894 30499 consensus_queue.cc:260] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.011844 30499 ts_tablet_manager.cc:1434] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:22:46.013087 30499 tablet_bootstrap.cc:492] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102: Bootstrap starting.
I20260709 13:22:46.017226 30501 tablet_bootstrap.cc:654] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:46.018164 30503 ts_tablet_manager.cc:1434] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.015s
I20260709 13:22:46.019374 30503 tablet_bootstrap.cc:492] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947: Bootstrap starting.
I20260709 13:22:46.024859 30499 tablet_bootstrap.cc:654] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:46.028930 30503 tablet_bootstrap.cc:654] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:46.033121 30507 leader_election.cc:290] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.035332 30502 raft_consensus.cc:493] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:46.036017 30502 raft_consensus.cc:515] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.036682 30501 tablet_bootstrap.cc:492] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c: No bootstrap required, opened a new log
I20260709 13:22:46.037218 30501 ts_tablet_manager.cc:1403] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.004s
I20260709 13:22:46.038744 30499 tablet_bootstrap.cc:492] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102: No bootstrap required, opened a new log
I20260709 13:22:46.039404 30499 ts_tablet_manager.cc:1403] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
I20260709 13:22:46.039952 30503 tablet_bootstrap.cc:492] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947: No bootstrap required, opened a new log
I20260709 13:22:46.040504 30503 ts_tablet_manager.cc:1403] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 13:22:46.040441 30501 raft_consensus.cc:359] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.041508 30501 raft_consensus.cc:385] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:46.041870 30501 raft_consensus.cc:740] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Initialized, Role: FOLLOWER
I20260709 13:22:46.042789 30501 consensus_queue.cc:260] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.044401 30503 raft_consensus.cc:359] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.045234 30503 raft_consensus.cc:385] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:46.045429 30501 ts_tablet_manager.cc:1434] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:22:46.045565 30503 raft_consensus.cc:740] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Initialized, Role: FOLLOWER
I20260709 13:22:46.046692 30501 tablet_bootstrap.cc:492] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c: Bootstrap starting.
I20260709 13:22:46.046615 30503 consensus_queue.cc:260] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.049285 30499 raft_consensus.cc:359] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.050135 30499 raft_consensus.cc:385] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:46.050426 30499 raft_consensus.cc:740] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Initialized, Role: FOLLOWER
I20260709 13:22:46.051314 30499 consensus_queue.cc:260] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.040584 30502 leader_election.cc:290] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.051792 30503 ts_tablet_manager.cc:1434] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:22:46.059077 30503 tablet_bootstrap.cc:492] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947: Bootstrap starting.
I20260709 13:22:46.067293 30503 tablet_bootstrap.cc:654] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:46.068382 30501 tablet_bootstrap.cc:654] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:46.077687 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e430433b8145deab5c06f7847d3e24" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:46.078771 30385 raft_consensus.cc:2468] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 0.
I20260709 13:22:46.082507 30459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e430433b8145deab5c06f7847d3e24" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c" is_pre_election: true
I20260709 13:22:46.083492 30499 ts_tablet_manager.cc:1434] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102: Time spent starting tablet: real 0.044s	user 0.016s	sys 0.010s
I20260709 13:22:46.080884 30275 leader_election.cc:304] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:46.085680 30459 raft_consensus.cc:2468] T f0e430433b8145deab5c06f7847d3e24 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 0.
I20260709 13:22:46.088622 30507 raft_consensus.cc:2804] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:46.089094 30507 raft_consensus.cc:493] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:46.089504 30507 raft_consensus.cc:3060] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.084976 30499 tablet_bootstrap.cc:492] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102: Bootstrap starting.
I20260709 13:22:46.089845 30458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f6c2ce665341a2add61bcbcf5c3422" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c" is_pre_election: true
W20260709 13:22:46.096019 30256 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:46.107590 30527 raft_consensus.cc:493] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:22:46.110873 30351 leader_election.cc:343] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:46.118929 30499 tablet_bootstrap.cc:654] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:46.124162 30501 tablet_bootstrap.cc:492] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c: No bootstrap required, opened a new log
I20260709 13:22:46.124866 30501 ts_tablet_manager.cc:1403] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c: Time spent bootstrapping tablet: real 0.078s	user 0.020s	sys 0.026s
I20260709 13:22:46.129061 30499 tablet_bootstrap.cc:492] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102: No bootstrap required, opened a new log
I20260709 13:22:46.119802 30527 raft_consensus.cc:515] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.129601 30499 ts_tablet_manager.cc:1403] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.014s
I20260709 13:22:46.131927 30518 raft_consensus.cc:493] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:46.132488 30518 raft_consensus.cc:515] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.135888 30527 leader_election.cc:290] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.136695 30458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00e306130342489b1cea7120ab1b62" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c" is_pre_election: true
I20260709 13:22:46.136989 30503 tablet_bootstrap.cc:492] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947: No bootstrap required, opened a new log
I20260709 13:22:46.137588 30503 ts_tablet_manager.cc:1403] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.032s
I20260709 13:22:46.137382 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c353b5fb791243328ce69dee051716c8" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947" is_pre_election: true
I20260709 13:22:46.138491 30459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c353b5fb791243328ce69dee051716c8" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c" is_pre_election: true
I20260709 13:22:46.139130 30310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f6c2ce665341a2add61bcbcf5c3422" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947" is_pre_election: true
W20260709 13:22:46.140216 30351 leader_election.cc:343] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:46.140911 30349 leader_election.cc:343] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:46.140976 30503 raft_consensus.cc:359] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.141418 30349 leader_election.cc:304] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102; no voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947
I20260709 13:22:46.141835 30503 raft_consensus.cc:385] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:46.142180 30503 raft_consensus.cc:740] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Initialized, Role: FOLLOWER
I20260709 13:22:46.137457 30458 raft_consensus.cc:2468] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 0.
W20260709 13:22:46.142731 30349 leader_election.cc:343] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:46.142838 30518 leader_election.cc:290] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.143306 30349 leader_election.cc:304] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102; no voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947
I20260709 13:22:46.142100 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00e306130342489b1cea7120ab1b62" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:46.139133 30501 raft_consensus.cc:359] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.143869 30276 leader_election.cc:304] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:46.144204 30502 raft_consensus.cc:2749] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:46.144402 30501 raft_consensus.cc:385] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:46.144824 30518 raft_consensus.cc:2804] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:46.144821 30501 raft_consensus.cc:740] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Initialized, Role: FOLLOWER
W20260709 13:22:46.145141 30275 leader_election.cc:343] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:46.145321 30518 raft_consensus.cc:493] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:46.144997 30502 raft_consensus.cc:2749] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:46.146018 30518 raft_consensus.cc:3060] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.145929 30501 consensus_queue.cc:260] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.148351 30501 ts_tablet_manager.cc:1434] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:22:46.148090 30499 raft_consensus.cc:359] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.148931 30499 raft_consensus.cc:385] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:46.149258 30499 raft_consensus.cc:740] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Initialized, Role: FOLLOWER
I20260709 13:22:46.149443 30501 tablet_bootstrap.cc:492] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c: Bootstrap starting.
I20260709 13:22:46.150234 30499 consensus_queue.cc:260] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.152681 30499 ts_tablet_manager.cc:1434] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:22:46.153885 30499 tablet_bootstrap.cc:492] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102: Bootstrap starting.
I20260709 13:22:46.156847 30501 tablet_bootstrap.cc:654] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:46.156685 30518 raft_consensus.cc:515] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.159713 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00e306130342489b1cea7120ab1b62" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:46.160490 30499 tablet_bootstrap.cc:654] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:46.161231 30275 leader_election.cc:343] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:46.162483 30503 consensus_queue.cc:260] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.167606 30503 ts_tablet_manager.cc:1434] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.001s
I20260709 13:22:46.169912 30458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00e306130342489b1cea7120ab1b62" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:46.170653 30458 raft_consensus.cc:3060] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.143309 30507 raft_consensus.cc:515] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.174722 30499 tablet_bootstrap.cc:492] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102: No bootstrap required, opened a new log
I20260709 13:22:46.175599 30499 ts_tablet_manager.cc:1403] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.012s
I20260709 13:22:46.175824 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e430433b8145deab5c06f7847d3e24" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:46.176047 30507 leader_election.cc:290] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Requested vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.176564 30385 raft_consensus.cc:3060] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.179956 30499 raft_consensus.cc:359] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.181072 30499 raft_consensus.cc:385] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:46.181502 30499 raft_consensus.cc:740] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Initialized, Role: FOLLOWER
I20260709 13:22:46.182893 30499 consensus_queue.cc:260] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.184206 30518 leader_election.cc:290] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Requested vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.183660 30458 raft_consensus.cc:2468] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 1.
I20260709 13:22:46.187824 30276 leader_election.cc:304] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947; no voters: a2c1f703ee334f54aaf22e4c25886102
I20260709 13:22:46.188179 30499 ts_tablet_manager.cc:1434] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:22:46.189334 30518 raft_consensus.cc:493] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:46.189394 30532 raft_consensus.cc:2804] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:46.190577 30503 tablet_bootstrap.cc:492] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947: Bootstrap starting.
I20260709 13:22:46.191190 30501 tablet_bootstrap.cc:492] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c: No bootstrap required, opened a new log
I20260709 13:22:46.191843 30501 ts_tablet_manager.cc:1403] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.028s
I20260709 13:22:46.191097 30518 raft_consensus.cc:515] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.195212 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588be62bafd94913b204edb157d4ba7e" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:46.195544 30501 raft_consensus.cc:359] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.196030 30384 raft_consensus.cc:2468] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 0.
I20260709 13:22:46.197005 30458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e430433b8145deab5c06f7847d3e24" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:46.197659 30275 leader_election.cc:304] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:46.191279 30532 raft_consensus.cc:697] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Becoming Leader. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:46.199914 30507 raft_consensus.cc:2804] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:46.200457 30507 raft_consensus.cc:493] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:46.201022 30507 raft_consensus.cc:3060] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.201180 30503 tablet_bootstrap.cc:654] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:46.198732 30385 raft_consensus.cc:2468] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 1.
I20260709 13:22:46.200555 30532 consensus_queue.cc:237] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.204128 30458 raft_consensus.cc:3060] T f0e430433b8145deab5c06f7847d3e24 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.198277 30501 raft_consensus.cc:385] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:46.205466 30518 leader_election.cc:290] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.208280 30503 tablet_bootstrap.cc:492] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947: No bootstrap required, opened a new log
I20260709 13:22:46.208565 30459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588be62bafd94913b204edb157d4ba7e" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c" is_pre_election: true
I20260709 13:22:46.206794 30275 leader_election.cc:304] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:46.214560 30518 raft_consensus.cc:2804] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:22:46.215098 30276 leader_election.cc:343] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:46.215129 30518 raft_consensus.cc:697] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Becoming Leader. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:46.216355 30503 ts_tablet_manager.cc:1403] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.007s
I20260709 13:22:46.215967 30207 catalog_manager.cc:5697] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 reported cstate change: term changed from 0 to 1, leader changed from <none> to e72c3640883d4c0d88571a0839c5f947 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "e72c3640883d4c0d88571a0839c5f947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:46.216326 30518 consensus_queue.cc:237] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.219030 30507 raft_consensus.cc:515] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.219901 30503 raft_consensus.cc:359] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.220767 30503 raft_consensus.cc:385] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:46.221148 30503 raft_consensus.cc:740] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Initialized, Role: FOLLOWER
I20260709 13:22:46.221709 30501 raft_consensus.cc:740] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Initialized, Role: FOLLOWER
I20260709 13:22:46.221943 30503 consensus_queue.cc:260] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.222882 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588be62bafd94913b204edb157d4ba7e" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:46.223500 30385 raft_consensus.cc:3060] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.223026 30501 consensus_queue.cc:260] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.224463 30503 ts_tablet_manager.cc:1434] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:22:46.225553 30503 tablet_bootstrap.cc:492] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947: Bootstrap starting.
I20260709 13:22:46.230073 30501 ts_tablet_manager.cc:1434] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.001s
I20260709 13:22:46.231276 30501 tablet_bootstrap.cc:492] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c: Bootstrap starting.
I20260709 13:22:46.232221 30385 raft_consensus.cc:2468] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 1.
I20260709 13:22:46.232440 30503 tablet_bootstrap.cc:654] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:46.233749 30275 leader_election.cc:304] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:46.234784 30532 raft_consensus.cc:2804] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:46.236038 30507 leader_election.cc:290] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Requested vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.239363 30458 raft_consensus.cc:2468] T f0e430433b8145deab5c06f7847d3e24 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 1.
I20260709 13:22:46.242785 30509 raft_consensus.cc:493] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:46.243485 30509 raft_consensus.cc:515] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.246114 30459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588be62bafd94913b204edb157d4ba7e" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:46.251549 30532 raft_consensus.cc:697] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Becoming Leader. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:46.252710 30532 consensus_queue.cc:237] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.254437 30509 leader_election.cc:290] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:46.265834 30501 tablet_bootstrap.cc:654] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:46.279966 30509 raft_consensus.cc:493] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:46.280808 30509 raft_consensus.cc:515] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
W20260709 13:22:46.279896 30276 leader_election.cc:343] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:46.283123 30527 raft_consensus.cc:493] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:46.283752 30527 raft_consensus.cc:515] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.284063 30509 leader_election.cc:290] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:46.286002 30527 leader_election.cc:290] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.286556 30527 raft_consensus.cc:493] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:46.289322 30459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5915d8c7314cd48dd19e7d16167e66" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c" is_pre_election: true
I20260709 13:22:46.289672 30503 tablet_bootstrap.cc:492] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947: No bootstrap required, opened a new log
I20260709 13:22:46.290231 30503 ts_tablet_manager.cc:1403] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947: Time spent bootstrapping tablet: real 0.065s	user 0.021s	sys 0.020s
W20260709 13:22:46.290839 30351 leader_election.cc:343] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:46.290706 30310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5915d8c7314cd48dd19e7d16167e66" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947" is_pre_election: true
I20260709 13:22:46.293491 30310 raft_consensus.cc:2468] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 0.
I20260709 13:22:46.293053 30503 raft_consensus.cc:359] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.295313 30503 raft_consensus.cc:385] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:46.295689 30503 raft_consensus.cc:740] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Initialized, Role: FOLLOWER
I20260709 13:22:46.295349 30349 leader_election.cc:304] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 2f149ae7a84c46288c47962524d5240c
I20260709 13:22:46.288008 30527 raft_consensus.cc:515] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.296964 30502 raft_consensus.cc:2804] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:46.297327 30502 raft_consensus.cc:493] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:46.298103 30503 consensus_queue.cc:260] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.298442 30502 raft_consensus.cc:3060] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.300074 30518 raft_consensus.cc:493] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:46.300285 30503 ts_tablet_manager.cc:1434] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:22:46.300544 30518 raft_consensus.cc:515] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.301299 30503 tablet_bootstrap.cc:492] T f2f6c2ce665341a2add61bcbcf5c3422 P e72c3640883d4c0d88571a0839c5f947: Bootstrap starting.
I20260709 13:22:46.302744 30518 leader_election.cc:290] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.304507 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a990d537d854b3793ccf4c5bc144715" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:46.306447 30385 raft_consensus.cc:2468] T 7a990d537d854b3793ccf4c5bc144715 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 0.
I20260709 13:22:46.308526 30459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a990d537d854b3793ccf4c5bc144715" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c" is_pre_election: true
I20260709 13:22:46.308766 30275 leader_election.cc:304] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:46.309345 30527 leader_election.cc:290] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.310429 30518 raft_consensus.cc:2804] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:46.310505 30458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6650c8247d604ebbb4f9c9105acb6edf" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c" is_pre_election: true
I20260709 13:22:46.310899 30518 raft_consensus.cc:493] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:46.311203 30458 raft_consensus.cc:2468] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 0.
I20260709 13:22:46.311451 30518 raft_consensus.cc:3060] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.312881 30501 tablet_bootstrap.cc:492] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c: No bootstrap required, opened a new log
I20260709 13:22:46.312809 30351 leader_election.cc:304] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, a2c1f703ee334f54aaf22e4c25886102; no voters: 
I20260709 13:22:46.313494 30501 ts_tablet_manager.cc:1403] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c: Time spent bootstrapping tablet: real 0.082s	user 0.007s	sys 0.019s
I20260709 13:22:46.313812 30527 raft_consensus.cc:2804] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:46.314216 30527 raft_consensus.cc:493] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:46.314564 30527 raft_consensus.cc:3060] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.315140 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9e4f158f64b23bb4c0ca79a584d63" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947" is_pre_election: true
I20260709 13:22:46.315799 30309 raft_consensus.cc:2468] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 0.
I20260709 13:22:46.315615 30502 raft_consensus.cc:515] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.316581 30501 raft_consensus.cc:359] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.309300 30459 raft_consensus.cc:2468] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 0.
I20260709 13:22:46.317129 30308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a990d537d854b3793ccf4c5bc144715" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947" is_pre_election: true
I20260709 13:22:46.317373 30501 raft_consensus.cc:385] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:46.318771 30501 raft_consensus.cc:740] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Initialized, Role: FOLLOWER
I20260709 13:22:46.319446 30423 leader_election.cc:304] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:46.320713 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5915d8c7314cd48dd19e7d16167e66" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:46.321353 30309 raft_consensus.cc:3060] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.321759 30509 raft_consensus.cc:2804] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:46.322149 30509 raft_consensus.cc:493] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:46.322467 30509 raft_consensus.cc:3060] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.323323 30503 tablet_bootstrap.cc:654] T f2f6c2ce665341a2add61bcbcf5c3422 P e72c3640883d4c0d88571a0839c5f947: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:46.323829 30527 raft_consensus.cc:515] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.310788 30310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6650c8247d604ebbb4f9c9105acb6edf" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947" is_pre_election: true
I20260709 13:22:46.325856 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a990d537d854b3793ccf4c5bc144715" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:46.326987 30384 raft_consensus.cc:2468] T 7a990d537d854b3793ccf4c5bc144715 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 0.
I20260709 13:22:46.327389 30310 raft_consensus.cc:2468] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 0.
I20260709 13:22:46.328019 30459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6650c8247d604ebbb4f9c9105acb6edf" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:46.328310 30527 leader_election.cc:290] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.328850 30459 raft_consensus.cc:3060] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.330246 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9e4f158f64b23bb4c0ca79a584d63" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:46.330546 30310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6650c8247d604ebbb4f9c9105acb6edf" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:46.330925 30385 raft_consensus.cc:2468] T e5f9e4f158f64b23bb4c0ca79a584d63 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 0.
I20260709 13:22:46.331364 30310 raft_consensus.cc:3060] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.336565 30459 raft_consensus.cc:2468] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 1.
I20260709 13:22:46.337985 30351 leader_election.cc:304] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, a2c1f703ee334f54aaf22e4c25886102; no voters: 
I20260709 13:22:46.339120 30424 leader_election.cc:304] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, a2c1f703ee334f54aaf22e4c25886102; no voters: 
I20260709 13:22:46.339323 30527 raft_consensus.cc:2804] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:46.342866 30502 leader_election.cc:290] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.347834 30509 raft_consensus.cc:515] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.352970 30307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9e4f158f64b23bb4c0ca79a584d63" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:46.354043 30307 raft_consensus.cc:3060] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.362078 30501 consensus_queue.cc:260] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.364024 30547 raft_consensus.cc:2804] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:46.365130 30547 raft_consensus.cc:493] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:46.365510 30547 raft_consensus.cc:3060] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.366250 30509 leader_election.cc:290] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:46.347802 30310 raft_consensus.cc:2468] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 1.
I20260709 13:22:46.369765 30527 raft_consensus.cc:697] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Becoming Leader. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Running, Role: LEADER
I20260709 13:22:46.370474 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9e4f158f64b23bb4c0ca79a584d63" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:46.371107 30385 raft_consensus.cc:3060] T e5f9e4f158f64b23bb4c0ca79a584d63 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.370811 30527 consensus_queue.cc:237] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.371562 30307 raft_consensus.cc:2468] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 1.
I20260709 13:22:46.373073 30423 leader_election.cc:304] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:46.361132 30518 raft_consensus.cc:515] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.374822 30308 raft_consensus.cc:2393] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f149ae7a84c46288c47962524d5240c in current term 1: Already voted for candidate e72c3640883d4c0d88571a0839c5f947 in this term.
I20260709 13:22:46.376612 30518 leader_election.cc:290] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Requested vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.364583 30459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5915d8c7314cd48dd19e7d16167e66" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c"
W20260709 13:22:46.380924 30351 leader_election.cc:343] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:46.381418 30385 raft_consensus.cc:2468] T e5f9e4f158f64b23bb4c0ca79a584d63 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 1.
I20260709 13:22:46.382448 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a990d537d854b3793ccf4c5bc144715" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:46.383051 30384 raft_consensus.cc:3060] T 7a990d537d854b3793ccf4c5bc144715 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.382961 30458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a990d537d854b3793ccf4c5bc144715" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:46.387491 30549 raft_consensus.cc:2804] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:46.389077 30501 ts_tablet_manager.cc:1434] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c: Time spent starting tablet: real 0.075s	user 0.000s	sys 0.014s
I20260709 13:22:46.353015 30309 raft_consensus.cc:2468] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 1.
I20260709 13:22:46.396132 30349 leader_election.cc:304] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 2f149ae7a84c46288c47962524d5240c
I20260709 13:22:46.396935 30549 raft_consensus.cc:697] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Becoming Leader. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Running, Role: LEADER
I20260709 13:22:46.397215 30208 catalog_manager.cc:5697] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "a2c1f703ee334f54aaf22e4c25886102" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:46.397926 30549 consensus_queue.cc:237] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.398567 30548 raft_consensus.cc:2804] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:46.396648 30547 raft_consensus.cc:515] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.404469 30503 tablet_bootstrap.cc:492] T f2f6c2ce665341a2add61bcbcf5c3422 P e72c3640883d4c0d88571a0839c5f947: No bootstrap required, opened a new log
I20260709 13:22:46.404843 30458 raft_consensus.cc:2393] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e72c3640883d4c0d88571a0839c5f947 in current term 1: Already voted for candidate 2f149ae7a84c46288c47962524d5240c in this term.
I20260709 13:22:46.404976 30503 ts_tablet_manager.cc:1403] T f2f6c2ce665341a2add61bcbcf5c3422 P e72c3640883d4c0d88571a0839c5f947: Time spent bootstrapping tablet: real 0.104s	user 0.023s	sys 0.049s
I20260709 13:22:46.406819 30501 tablet_bootstrap.cc:492] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c: Bootstrap starting.
I20260709 13:22:46.407630 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a990d537d854b3793ccf4c5bc144715" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:46.408058 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a990d537d854b3793ccf4c5bc144715" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:46.409905 30309 raft_consensus.cc:2393] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f149ae7a84c46288c47962524d5240c in current term 1: Already voted for candidate e72c3640883d4c0d88571a0839c5f947 in this term.
I20260709 13:22:46.411011 30423 leader_election.cc:304] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c; no voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947
I20260709 13:22:46.410485 30547 leader_election.cc:290] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:46.412114 30551 raft_consensus.cc:2749] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:46.404210 30548 raft_consensus.cc:697] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Becoming Leader. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Running, Role: LEADER
I20260709 13:22:46.415004 30548 consensus_queue.cc:237] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.416779 30501 tablet_bootstrap.cc:654] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:46.404166 30384 raft_consensus.cc:2468] T 7a990d537d854b3793ccf4c5bc144715 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 1.
I20260709 13:22:46.420264 30275 leader_election.cc:304] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 2f149ae7a84c46288c47962524d5240c
I20260709 13:22:46.421891 30518 raft_consensus.cc:2804] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:46.422544 30518 raft_consensus.cc:697] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Becoming Leader. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:46.423141 30503 raft_consensus.cc:359] T f2f6c2ce665341a2add61bcbcf5c3422 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.423664 30518 consensus_queue.cc:237] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.426812 30503 raft_consensus.cc:385] T f2f6c2ce665341a2add61bcbcf5c3422 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:46.427232 30503 raft_consensus.cc:740] T f2f6c2ce665341a2add61bcbcf5c3422 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Initialized, Role: FOLLOWER
I20260709 13:22:46.435353 30207 catalog_manager.cc:5697] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 reported cstate change: term changed from 0 to 1, leader changed from <none> to e72c3640883d4c0d88571a0839c5f947 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "e72c3640883d4c0d88571a0839c5f947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:46.437112 30503 consensus_queue.cc:260] T f2f6c2ce665341a2add61bcbcf5c3422 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.438740 30501 tablet_bootstrap.cc:492] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c: No bootstrap required, opened a new log
I20260709 13:22:46.438906 30503 ts_tablet_manager.cc:1434] T f2f6c2ce665341a2add61bcbcf5c3422 P e72c3640883d4c0d88571a0839c5f947: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:22:46.439287 30501 ts_tablet_manager.cc:1403] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.003s
I20260709 13:22:46.439419 30206 catalog_manager.cc:5697] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "a2c1f703ee334f54aaf22e4c25886102" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:46.439939 30207 catalog_manager.cc:5697] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 reported cstate change: term changed from 0 to 1, leader changed from <none> to e72c3640883d4c0d88571a0839c5f947 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "e72c3640883d4c0d88571a0839c5f947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:46.442310 30501 raft_consensus.cc:359] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.443020 30501 raft_consensus.cc:385] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:46.443274 30501 raft_consensus.cc:740] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Initialized, Role: FOLLOWER
I20260709 13:22:46.443987 30501 consensus_queue.cc:260] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.445228 30549 raft_consensus.cc:493] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:46.445714 30549 raft_consensus.cc:515] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.446036 30501 ts_tablet_manager.cc:1434] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:22:46.447079 30501 tablet_bootstrap.cc:492] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c: Bootstrap starting.
I20260709 13:22:46.448764 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c353b5fb791243328ce69dee051716c8" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947" is_pre_election: true
I20260709 13:22:46.448856 30549 leader_election.cc:290] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:46.449079 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c353b5fb791243328ce69dee051716c8" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:46.449412 30309 raft_consensus.cc:2468] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 0.
I20260709 13:22:46.449771 30384 raft_consensus.cc:2468] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 0.
I20260709 13:22:46.450693 30423 leader_election.cc:304] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:46.451753 30549 raft_consensus.cc:2804] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:46.452114 30549 raft_consensus.cc:493] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:46.452450 30549 raft_consensus.cc:3060] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.454377 30501 tablet_bootstrap.cc:654] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:46.459558 30501 tablet_bootstrap.cc:492] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c: No bootstrap required, opened a new log
I20260709 13:22:46.460026 30501 ts_tablet_manager.cc:1403] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:22:46.459889 30208 catalog_manager.cc:5697] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f149ae7a84c46288c47962524d5240c (127.17.251.131). New cstate: current_term: 1 leader_uuid: "2f149ae7a84c46288c47962524d5240c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:46.460484 30549 raft_consensus.cc:515] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.463083 30551 raft_consensus.cc:493] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:46.463559 30551 raft_consensus.cc:515] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.463902 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c353b5fb791243328ce69dee051716c8" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:46.464484 30309 raft_consensus.cc:3060] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.465153 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c353b5fb791243328ce69dee051716c8" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:46.465811 30384 raft_consensus.cc:3060] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.465919 30551 leader_election.cc:290] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:46.467926 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f6c2ce665341a2add61bcbcf5c3422" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:46.468420 30385 raft_consensus.cc:2468] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 0.
I20260709 13:22:46.469799 30424 leader_election.cc:304] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, a2c1f703ee334f54aaf22e4c25886102; no voters: 
I20260709 13:22:46.469954 30307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f6c2ce665341a2add61bcbcf5c3422" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947" is_pre_election: true
I20260709 13:22:46.470722 30551 raft_consensus.cc:2804] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:46.470679 30307 raft_consensus.cc:2468] T f2f6c2ce665341a2add61bcbcf5c3422 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 0.
I20260709 13:22:46.471194 30551 raft_consensus.cc:493] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:46.471555 30551 raft_consensus.cc:3060] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.473368 30384 raft_consensus.cc:2468] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 1.
I20260709 13:22:46.474663 30424 leader_election.cc:304] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, a2c1f703ee334f54aaf22e4c25886102; no voters: 
I20260709 13:22:46.475445 30549 leader_election.cc:290] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:46.475459 30547 raft_consensus.cc:2804] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:46.476162 30547 raft_consensus.cc:697] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Becoming Leader. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Running, Role: LEADER
I20260709 13:22:46.477118 30501 raft_consensus.cc:359] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.477056 30547 consensus_queue.cc:237] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.477746 30501 raft_consensus.cc:385] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:46.478077 30501 raft_consensus.cc:740] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Initialized, Role: FOLLOWER
I20260709 13:22:46.478899 30501 consensus_queue.cc:260] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.479487 30309 raft_consensus.cc:2468] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 1.
I20260709 13:22:46.481009 30501 ts_tablet_manager.cc:1434] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:22:46.482384 30207 catalog_manager.cc:5697] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 reported cstate change: term changed from 0 to 1, leader changed from <none> to e72c3640883d4c0d88571a0839c5f947 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "e72c3640883d4c0d88571a0839c5f947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:46.485347 30551 raft_consensus.cc:515] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.487651 30551 leader_election.cc:290] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:46.488335 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f6c2ce665341a2add61bcbcf5c3422" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:46.489137 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f6c2ce665341a2add61bcbcf5c3422" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:46.489894 30384 raft_consensus.cc:3060] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.490342 30208 catalog_manager.cc:5697] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f149ae7a84c46288c47962524d5240c (127.17.251.131). New cstate: current_term: 1 leader_uuid: "2f149ae7a84c46288c47962524d5240c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:46.493836 30309 raft_consensus.cc:3060] T f2f6c2ce665341a2add61bcbcf5c3422 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.497937 30384 raft_consensus.cc:2468] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 1.
I20260709 13:22:46.499229 30424 leader_election.cc:304] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, a2c1f703ee334f54aaf22e4c25886102; no voters: 
I20260709 13:22:46.500144 30551 raft_consensus.cc:2804] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:46.500705 30551 raft_consensus.cc:697] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Becoming Leader. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Running, Role: LEADER
I20260709 13:22:46.501214 30309 raft_consensus.cc:2468] T f2f6c2ce665341a2add61bcbcf5c3422 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 1.
I20260709 13:22:46.501466 30551 consensus_queue.cc:237] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.509974 30208 catalog_manager.cc:5697] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f149ae7a84c46288c47962524d5240c (127.17.251.131). New cstate: current_term: 1 leader_uuid: "2f149ae7a84c46288c47962524d5240c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:46.573019 30384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de5915d8c7314cd48dd19e7d16167e66"
dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
mode: GRACEFUL
new_leader_uuid: "e72c3640883d4c0d88571a0839c5f947"
 from {username='slave'} at 127.0.0.1:35560
I20260709 13:22:46.573629 30384 raft_consensus.cc:606] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Received request to transfer leadership to TS e72c3640883d4c0d88571a0839c5f947
I20260709 13:22:46.575474 30548 raft_consensus.cc:493] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:46.576018 30548 raft_consensus.cc:515] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.578835 30548 leader_election.cc:290] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.579779 30458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00e306130342489b1cea7120ab1b62" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c" is_pre_election: true
I20260709 13:22:46.580842 30458 raft_consensus.cc:2393] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2c1f703ee334f54aaf22e4c25886102 in current term 1: Already voted for candidate e72c3640883d4c0d88571a0839c5f947 in this term.
I20260709 13:22:46.579666 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00e306130342489b1cea7120ab1b62" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947" is_pre_election: true
I20260709 13:22:46.583045 30351 leader_election.cc:304] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102; no voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947
I20260709 13:22:46.583897 30548 raft_consensus.cc:3060] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.591189 30458 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c353b5fb791243328ce69dee051716c8"
dest_uuid: "2f149ae7a84c46288c47962524d5240c"
mode: GRACEFUL
new_leader_uuid: "e72c3640883d4c0d88571a0839c5f947"
 from {username='slave'} at 127.0.0.1:49290
I20260709 13:22:46.591915 30458 raft_consensus.cc:606] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Received request to transfer leadership to TS e72c3640883d4c0d88571a0839c5f947
I20260709 13:22:46.591964 30548 raft_consensus.cc:2749] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:46.592732 30551 raft_consensus.cc:493] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:46.593345 30551 raft_consensus.cc:515] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.595737 30551 leader_election.cc:290] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845)
I20260709 13:22:46.596426 30518 consensus_queue.cc:1048] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:46.597223 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5915d8c7314cd48dd19e7d16167e66" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947" is_pre_election: true
I20260709 13:22:46.598049 30309 raft_consensus.cc:2393] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f149ae7a84c46288c47962524d5240c in current term 1: Already voted for candidate a2c1f703ee334f54aaf22e4c25886102 in this term.
I20260709 13:22:46.598003 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5915d8c7314cd48dd19e7d16167e66" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:46.599943 30423 leader_election.cc:304] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c; no voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947
I20260709 13:22:46.600777 30551 raft_consensus.cc:3060] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.603142 30458 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5f9e4f158f64b23bb4c0ca79a584d63"
dest_uuid: "2f149ae7a84c46288c47962524d5240c"
mode: GRACEFUL
new_leader_uuid: "e72c3640883d4c0d88571a0839c5f947"
 from {username='slave'} at 127.0.0.1:49290
I20260709 13:22:46.603844 30458 raft_consensus.cc:606] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Received request to transfer leadership to TS e72c3640883d4c0d88571a0839c5f947
I20260709 13:22:46.608331 30551 raft_consensus.cc:2749] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:46.619504 30518 consensus_queue.cc:1048] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:46.627568 30309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0e430433b8145deab5c06f7847d3e24"
dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
mode: GRACEFUL
new_leader_uuid: "a2c1f703ee334f54aaf22e4c25886102"
 from {username='slave'} at 127.0.0.1:36752
I20260709 13:22:46.628248 30309 raft_consensus.cc:606] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Received request to transfer leadership to TS a2c1f703ee334f54aaf22e4c25886102
I20260709 13:22:46.641028 30309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a00e306130342489b1cea7120ab1b62"
dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
mode: GRACEFUL
new_leader_uuid: "a2c1f703ee334f54aaf22e4c25886102"
 from {username='slave'} at 127.0.0.1:36752
I20260709 13:22:46.641578 30309 raft_consensus.cc:606] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Received request to transfer leadership to TS a2c1f703ee334f54aaf22e4c25886102
I20260709 13:22:46.647655 30309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "588be62bafd94913b204edb157d4ba7e"
dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
mode: GRACEFUL
new_leader_uuid: "a2c1f703ee334f54aaf22e4c25886102"
 from {username='slave'} at 127.0.0.1:36752
I20260709 13:22:46.648191 30309 raft_consensus.cc:606] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Received request to transfer leadership to TS a2c1f703ee334f54aaf22e4c25886102
I20260709 13:22:46.689064 30551 raft_consensus.cc:493] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:46.689780 30551 raft_consensus.cc:515] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.691761 30551 leader_election.cc:290] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:46.692669 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588be62bafd94913b204edb157d4ba7e" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947" is_pre_election: true
I20260709 13:22:46.692984 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588be62bafd94913b204edb157d4ba7e" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:46.693887 30385 raft_consensus.cc:2393] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f149ae7a84c46288c47962524d5240c in current term 1: Already voted for candidate e72c3640883d4c0d88571a0839c5f947 in this term.
I20260709 13:22:46.694871 30424 leader_election.cc:304] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c; no voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947
I20260709 13:22:46.695525 30551 raft_consensus.cc:3060] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:46.701181 30551 raft_consensus.cc:2749] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:46.703509 30532 consensus_queue.cc:1048] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:46.711139 30518 raft_consensus.cc:993] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947: : Instructing follower a2c1f703ee334f54aaf22e4c25886102 to start an election
I20260709 13:22:46.711684 30518 raft_consensus.cc:1081] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Signalling peer a2c1f703ee334f54aaf22e4c25886102 to start an election
I20260709 13:22:46.713775 30384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0e430433b8145deab5c06f7847d3e24"
dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
 from {username='slave'} at 127.0.0.1:35542
I20260709 13:22:46.714592 30384 raft_consensus.cc:493] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:46.714975 30384 raft_consensus.cc:3060] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.716905 30538 consensus_queue.cc:1048] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:46.724115 30384 raft_consensus.cc:515] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.725391 30385 raft_consensus.cc:1240] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Rejecting Update request from peer e72c3640883d4c0d88571a0839c5f947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:46.727276 30384 leader_election.cc:290] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 2 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.728092 30458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e430433b8145deab5c06f7847d3e24" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:46.728124 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e430433b8145deab5c06f7847d3e24" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:46.728848 30458 raft_consensus.cc:3060] T f0e430433b8145deab5c06f7847d3e24 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.728775 30538 consensus_queue.cc:1059] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:46.731005 30309 raft_consensus.cc:3055] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:46.731365 30309 raft_consensus.cc:740] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:46.732241 30309 consensus_queue.cc:260] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.733520 30309 raft_consensus.cc:3060] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.736318 30458 raft_consensus.cc:2468] T f0e430433b8145deab5c06f7847d3e24 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 2.
I20260709 13:22:46.737444 30351 leader_election.cc:304] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, a2c1f703ee334f54aaf22e4c25886102; no voters: 
I20260709 13:22:46.738229 30548 raft_consensus.cc:2804] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:46.738723 30548 raft_consensus.cc:697] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [term 2 LEADER]: Becoming Leader. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Running, Role: LEADER
I20260709 13:22:46.739749 30309 raft_consensus.cc:2468] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 2.
I20260709 13:22:46.739589 30548 consensus_queue.cc:237] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
W20260709 13:22:46.740340 30507 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:22:46.746857 30208 catalog_manager.cc:5697] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 reported cstate change: term changed from 1 to 2, leader changed from e72c3640883d4c0d88571a0839c5f947 (127.17.251.129) to a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "a2c1f703ee334f54aaf22e4c25886102" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:46.795375 30507 consensus_queue.cc:1048] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:46.795403 30551 consensus_queue.cc:1048] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:46.799578 30538 consensus_queue.cc:1048] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:46.814679 30518 raft_consensus.cc:993] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947: : Instructing follower a2c1f703ee334f54aaf22e4c25886102 to start an election
I20260709 13:22:46.815285 30518 raft_consensus.cc:1081] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Signalling peer a2c1f703ee334f54aaf22e4c25886102 to start an election
I20260709 13:22:46.818574 30547 consensus_queue.cc:1048] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:46.822579 30385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "588be62bafd94913b204edb157d4ba7e"
dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
 from {username='slave'} at 127.0.0.1:35542
I20260709 13:22:46.826793 30385 raft_consensus.cc:493] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:46.827334 30385 raft_consensus.cc:3060] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.834712 30551 raft_consensus.cc:993] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c: : Instructing follower e72c3640883d4c0d88571a0839c5f947 to start an election
I20260709 13:22:46.835330 30551 raft_consensus.cc:1081] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Signalling peer e72c3640883d4c0d88571a0839c5f947 to start an election
I20260709 13:22:46.837318 30309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5f9e4f158f64b23bb4c0ca79a584d63"
dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
 from {username='slave'} at 127.0.0.1:36750
I20260709 13:22:46.837448 30385 raft_consensus.cc:515] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.838021 30309 raft_consensus.cc:493] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:46.838501 30309 raft_consensus.cc:3060] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.842581 30385 leader_election.cc:290] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 2 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.843734 30307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588be62bafd94913b204edb157d4ba7e" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:46.844461 30307 raft_consensus.cc:3055] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:46.844771 30307 raft_consensus.cc:740] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:46.844794 30527 consensus_queue.cc:1048] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:46.845752 30307 consensus_queue.cc:260] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.848626 30309 raft_consensus.cc:515] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.847235 30458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588be62bafd94913b204edb157d4ba7e" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:46.850170 30458 raft_consensus.cc:3060] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.851123 30309 leader_election.cc:290] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 2 election: Requested vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.851919 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9e4f158f64b23bb4c0ca79a584d63" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:46.847244 30307 raft_consensus.cc:3060] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.852572 30385 raft_consensus.cc:3060] T e5f9e4f158f64b23bb4c0ca79a584d63 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.853078 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9e4f158f64b23bb4c0ca79a584d63" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:46.853878 30457 raft_consensus.cc:3055] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:46.854223 30457 raft_consensus.cc:740] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Running, Role: LEADER
I20260709 13:22:46.855110 30457 consensus_queue.cc:260] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.856555 30457 raft_consensus.cc:3060] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.860150 30458 raft_consensus.cc:2468] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 2.
I20260709 13:22:46.861352 30307 raft_consensus.cc:2468] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 2.
I20260709 13:22:46.861527 30351 leader_election.cc:304] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, a2c1f703ee334f54aaf22e4c25886102; no voters: 
I20260709 13:22:46.862536 30527 raft_consensus.cc:2804] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:46.863024 30527 raft_consensus.cc:697] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [term 2 LEADER]: Becoming Leader. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Running, Role: LEADER
I20260709 13:22:46.863837 30527 consensus_queue.cc:237] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.865950 30385 raft_consensus.cc:2468] T e5f9e4f158f64b23bb4c0ca79a584d63 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 2.
I20260709 13:22:46.866969 30457 raft_consensus.cc:2468] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 2.
I20260709 13:22:46.867280 30275 leader_election.cc:304] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:46.868260 30532 raft_consensus.cc:2804] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:46.868745 30532 raft_consensus.cc:697] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [term 2 LEADER]: Becoming Leader. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:46.869648 30532 consensus_queue.cc:237] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.876420 30527 consensus_queue.cc:1048] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:46.884042 30208 catalog_manager.cc:5697] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 reported cstate change: term changed from 1 to 2, leader changed from e72c3640883d4c0d88571a0839c5f947 (127.17.251.129) to a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "a2c1f703ee334f54aaf22e4c25886102" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:46.885445 30207 catalog_manager.cc:5697] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 reported cstate change: term changed from 1 to 2, leader changed from 2f149ae7a84c46288c47962524d5240c (127.17.251.131) to e72c3640883d4c0d88571a0839c5f947 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "e72c3640883d4c0d88571a0839c5f947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:46.886862 30548 consensus_queue.cc:1048] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:46.899498 30502 consensus_queue.cc:1048] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:46.915182 30527 raft_consensus.cc:993] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102: : Instructing follower e72c3640883d4c0d88571a0839c5f947 to start an election
I20260709 13:22:46.915743 30502 raft_consensus.cc:1081] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Signalling peer e72c3640883d4c0d88571a0839c5f947 to start an election
I20260709 13:22:46.918061 30307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de5915d8c7314cd48dd19e7d16167e66"
dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
 from {username='slave'} at 127.0.0.1:36742
I20260709 13:22:46.918718 30307 raft_consensus.cc:493] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:46.919176 30307 raft_consensus.cc:3060] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.925540 30307 raft_consensus.cc:515] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.926191 30532 consensus_queue.cc:1048] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:46.927759 30307 leader_election.cc:290] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 2 election: Requested vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.928545 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5915d8c7314cd48dd19e7d16167e66" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:46.929018 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5915d8c7314cd48dd19e7d16167e66" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:46.929214 30385 raft_consensus.cc:3055] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:46.929653 30385 raft_consensus.cc:740] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Running, Role: LEADER
I20260709 13:22:46.929670 30457 raft_consensus.cc:3060] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.930881 30385 consensus_queue.cc:260] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.932375 30385 raft_consensus.cc:3060] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.938246 30457 raft_consensus.cc:2468] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 2.
I20260709 13:22:46.938360 30507 consensus_queue.cc:1048] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:46.940380 30276 leader_election.cc:304] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:46.943857 30507 raft_consensus.cc:2804] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:46.944545 30507 raft_consensus.cc:697] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [term 2 LEADER]: Becoming Leader. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:46.945467 30507 consensus_queue.cc:237] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.947202 30385 raft_consensus.cc:2468] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 2.
I20260709 13:22:46.955636 30207 catalog_manager.cc:5697] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 reported cstate change: term changed from 1 to 2, leader changed from a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130) to e72c3640883d4c0d88571a0839c5f947 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "e72c3640883d4c0d88571a0839c5f947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:46.957032 30551 consensus_queue.cc:1048] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:46.971252 30547 raft_consensus.cc:993] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c: : Instructing follower e72c3640883d4c0d88571a0839c5f947 to start an election
I20260709 13:22:46.971796 30549 raft_consensus.cc:1081] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Signalling peer e72c3640883d4c0d88571a0839c5f947 to start an election
I20260709 13:22:46.974745 30309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c353b5fb791243328ce69dee051716c8"
dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
 from {username='slave'} at 127.0.0.1:36750
I20260709 13:22:46.977037 30309 raft_consensus.cc:493] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:46.977505 30309 raft_consensus.cc:3060] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.977911 30551 consensus_queue.cc:1048] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:46.985082 30309 raft_consensus.cc:515] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.989271 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c353b5fb791243328ce69dee051716c8" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:46.989344 30309 leader_election.cc:290] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 2 election: Requested vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:46.989554 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c353b5fb791243328ce69dee051716c8" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:46.990185 30385 raft_consensus.cc:3060] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.990288 30457 raft_consensus.cc:3055] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:46.990810 30457 raft_consensus.cc:740] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Running, Role: LEADER
I20260709 13:22:46.991698 30457 consensus_queue.cc:260] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:46.992885 30457 raft_consensus.cc:3060] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.997509 30385 raft_consensus.cc:2468] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 2.
I20260709 13:22:46.998773 30275 leader_election.cc:304] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:46.999516 30532 raft_consensus.cc:2804] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:46.999636 30457 raft_consensus.cc:2468] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 2.
I20260709 13:22:47.000005 30532 raft_consensus.cc:697] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 2 LEADER]: Becoming Leader. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:47.000943 30532 consensus_queue.cc:237] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:47.008055 30208 catalog_manager.cc:5697] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 reported cstate change: term changed from 1 to 2, leader changed from 2f149ae7a84c46288c47962524d5240c (127.17.251.131) to e72c3640883d4c0d88571a0839c5f947 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "e72c3640883d4c0d88571a0839c5f947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:47.009212 30551 consensus_queue.cc:1048] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:47.022352 30549 consensus_queue.cc:1048] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:47.117592 30518 raft_consensus.cc:993] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947: : Instructing follower a2c1f703ee334f54aaf22e4c25886102 to start an election
I20260709 13:22:47.118065 30532 raft_consensus.cc:1081] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Signalling peer a2c1f703ee334f54aaf22e4c25886102 to start an election
I20260709 13:22:47.119580 30385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a00e306130342489b1cea7120ab1b62"
dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
 from {username='slave'} at 127.0.0.1:35542
I20260709 13:22:47.120078 30385 raft_consensus.cc:493] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:47.120378 30385 raft_consensus.cc:3060] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:47.125340 30385 raft_consensus.cc:515] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:47.127107 30385 leader_election.cc:290] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 2 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:47.128194 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00e306130342489b1cea7120ab1b62" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:47.128194 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00e306130342489b1cea7120ab1b62" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:47.129076 30457 raft_consensus.cc:3060] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:47.129130 30309 raft_consensus.cc:3055] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:47.129592 30309 raft_consensus.cc:740] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:47.130445 30309 consensus_queue.cc:260] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:47.131691 30309 raft_consensus.cc:3060] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:47.136795 30457 raft_consensus.cc:2468] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 2.
I20260709 13:22:47.138262 30351 leader_election.cc:304] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, a2c1f703ee334f54aaf22e4c25886102; no voters: 
I20260709 13:22:47.139009 30309 raft_consensus.cc:2468] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 2.
I20260709 13:22:47.139110 30527 raft_consensus.cc:2804] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:47.139696 30527 raft_consensus.cc:697] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [term 2 LEADER]: Becoming Leader. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Running, Role: LEADER
I20260709 13:22:47.140568 30527 consensus_queue.cc:237] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:47.147151 30207 catalog_manager.cc:5697] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 reported cstate change: term changed from 1 to 2, leader changed from e72c3640883d4c0d88571a0839c5f947 (127.17.251.129) to a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "a2c1f703ee334f54aaf22e4c25886102" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:47.210485 30309 raft_consensus.cc:1275] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Refusing update from remote peer a2c1f703ee334f54aaf22e4c25886102: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:47.211822 30527 consensus_queue.cc:1048] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:47.220578 30457 raft_consensus.cc:1275] T f0e430433b8145deab5c06f7847d3e24 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Refusing update from remote peer a2c1f703ee334f54aaf22e4c25886102: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:47.222371 30583 consensus_queue.cc:1048] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:47.336123 30457 raft_consensus.cc:1275] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Refusing update from remote peer e72c3640883d4c0d88571a0839c5f947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:47.337486 30532 consensus_queue.cc:1048] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:47.345525 30385 raft_consensus.cc:1275] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Refusing update from remote peer e72c3640883d4c0d88571a0839c5f947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:47.347409 30532 consensus_queue.cc:1048] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:47.361894 30385 raft_consensus.cc:1275] T e5f9e4f158f64b23bb4c0ca79a584d63 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Refusing update from remote peer e72c3640883d4c0d88571a0839c5f947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:47.363210 30532 consensus_queue.cc:1048] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:47.370784 30457 raft_consensus.cc:1275] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Refusing update from remote peer e72c3640883d4c0d88571a0839c5f947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:47.372475 30532 consensus_queue.cc:1048] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:47.440683 30309 raft_consensus.cc:1275] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Refusing update from remote peer a2c1f703ee334f54aaf22e4c25886102: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:47.442157 30583 consensus_queue.cc:1048] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:47.450074 30457 raft_consensus.cc:1275] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Refusing update from remote peer a2c1f703ee334f54aaf22e4c25886102: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:47.451619 30527 consensus_queue.cc:1048] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:47.557257 30457 raft_consensus.cc:1275] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Refusing update from remote peer e72c3640883d4c0d88571a0839c5f947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:47.559001 30532 consensus_queue.cc:1048] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:47.568549 30385 raft_consensus.cc:1275] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Refusing update from remote peer e72c3640883d4c0d88571a0839c5f947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:47.570609 30584 consensus_queue.cc:1048] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:47.579324 30457 raft_consensus.cc:1275] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Refusing update from remote peer a2c1f703ee334f54aaf22e4c25886102: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:47.580888 30527 consensus_queue.cc:1048] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:47.589162 30309 raft_consensus.cc:1275] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Refusing update from remote peer a2c1f703ee334f54aaf22e4c25886102: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:47.591156 30502 consensus_queue.cc:1048] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:49.680225 30206 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60026:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:49.683650 30206 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:49.740960 30292 tablet_service.cc:1511] Processing CreateTablet for tablet 4067cde5d1274c7b9c494761260868bd (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:49.742257 30292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4067cde5d1274c7b9c494761260868bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.742235 30369 tablet_service.cc:1511] Processing CreateTablet for tablet 4067cde5d1274c7b9c494761260868bd (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:49.743724 30369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4067cde5d1274c7b9c494761260868bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.743456 30449 tablet_service.cc:1511] Processing CreateTablet for tablet 4067cde5d1274c7b9c494761260868bd (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:49.744752 30449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4067cde5d1274c7b9c494761260868bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.747555 30368 tablet_service.cc:1511] Processing CreateTablet for tablet 949b6bfe52ed4ced899250cbc0613304 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:49.748914 30368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 949b6bfe52ed4ced899250cbc0613304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.749637 30373 tablet_service.cc:1511] Processing CreateTablet for tablet f4d7af6286a04a0ca3ef0aaa869b5223 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:49.750993 30373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d7af6286a04a0ca3ef0aaa869b5223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.755198 30299 tablet_service.cc:1511] Processing CreateTablet for tablet 949b6bfe52ed4ced899250cbc0613304 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:49.755846 30295 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed9e678f5f74f0697bcb9858e4330f8 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:49.756181 30298 tablet_service.cc:1511] Processing CreateTablet for tablet f4d7af6286a04a0ca3ef0aaa869b5223 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:49.756230 30297 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4922ebd8d54d42b96f5ba84599e71b (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:49.756706 30299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 949b6bfe52ed4ced899250cbc0613304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.757654 30295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed9e678f5f74f0697bcb9858e4330f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.758711 30445 tablet_service.cc:1511] Processing CreateTablet for tablet 949b6bfe52ed4ced899250cbc0613304 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:49.759344 30375 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed9e678f5f74f0697bcb9858e4330f8 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:49.760107 30445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 949b6bfe52ed4ced899250cbc0613304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.760666 30375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed9e678f5f74f0697bcb9858e4330f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.760447 30448 tablet_service.cc:1511] Processing CreateTablet for tablet f4d7af6286a04a0ca3ef0aaa869b5223 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:49.761828 30448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d7af6286a04a0ca3ef0aaa869b5223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.764470 30297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4922ebd8d54d42b96f5ba84599e71b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.766052 30298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d7af6286a04a0ca3ef0aaa869b5223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.769935 30442 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed9e678f5f74f0697bcb9858e4330f8 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:49.771626 30442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed9e678f5f74f0697bcb9858e4330f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.788065 30294 tablet_service.cc:1511] Processing CreateTablet for tablet 04758565c2a646508349c072165e38f9 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:49.789834 30294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04758565c2a646508349c072165e38f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.790653 30441 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4922ebd8d54d42b96f5ba84599e71b (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:49.792245 30441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4922ebd8d54d42b96f5ba84599e71b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.792462 30370 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4922ebd8d54d42b96f5ba84599e71b (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:49.794075 30370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4922ebd8d54d42b96f5ba84599e71b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.795827 30597 tablet_bootstrap.cc:492] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947: Bootstrap starting.
I20260709 13:22:49.804255 30597 tablet_bootstrap.cc:654] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:49.843434 30367 tablet_service.cc:1511] Processing CreateTablet for tablet 04758565c2a646508349c072165e38f9 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:49.844970 30367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04758565c2a646508349c072165e38f9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:22:49.849735 30193 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.17.251.129:34845, user_credentials={real_user=slave}} blocked reactor thread for 58511us
I20260709 13:22:49.854923 30292 tablet_service.cc:1511] Processing CreateTablet for tablet c84b4be1bf0d4bcd88c34e94305b60e3 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:49.856283 30292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84b4be1bf0d4bcd88c34e94305b60e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.857543 30372 tablet_service.cc:1511] Processing CreateTablet for tablet c84b4be1bf0d4bcd88c34e94305b60e3 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:49.859071 30372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84b4be1bf0d4bcd88c34e94305b60e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.886718 30599 tablet_bootstrap.cc:492] T 949b6bfe52ed4ced899250cbc0613304 P a2c1f703ee334f54aaf22e4c25886102: Bootstrap starting.
I20260709 13:22:49.890287 30299 tablet_service.cc:1511] Processing CreateTablet for tablet 5587a30b9c834ca0987f84ec30c35c32 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:49.891670 30299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5587a30b9c834ca0987f84ec30c35c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.872572 30445 tablet_service.cc:1511] Processing CreateTablet for tablet 04758565c2a646508349c072165e38f9 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:49.898027 30600 tablet_bootstrap.cc:492] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c: Bootstrap starting.
I20260709 13:22:49.898165 30445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04758565c2a646508349c072165e38f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.899166 30368 tablet_service.cc:1511] Processing CreateTablet for tablet 5587a30b9c834ca0987f84ec30c35c32 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:49.899849 30448 tablet_service.cc:1511] Processing CreateTablet for tablet c84b4be1bf0d4bcd88c34e94305b60e3 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:49.900532 30368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5587a30b9c834ca0987f84ec30c35c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.920349 30441 tablet_service.cc:1511] Processing CreateTablet for tablet 5587a30b9c834ca0987f84ec30c35c32 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:49.926766 30297 tablet_service.cc:1511] Processing CreateTablet for tablet 516496d8276142fea3b6466e33910497 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:49.928050 30597 tablet_bootstrap.cc:492] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947: No bootstrap required, opened a new log
I20260709 13:22:49.928768 30597 ts_tablet_manager.cc:1403] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947: Time spent bootstrapping tablet: real 0.133s	user 0.041s	sys 0.033s
I20260709 13:22:49.901399 30448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84b4be1bf0d4bcd88c34e94305b60e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.932091 30597 raft_consensus.cc:359] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:49.932878 30597 raft_consensus.cc:385] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.933164 30597 raft_consensus.cc:740] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.934298 30597 consensus_queue.cc:260] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:49.935616 30600 tablet_bootstrap.cc:654] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:49.938757 30599 tablet_bootstrap.cc:654] T 949b6bfe52ed4ced899250cbc0613304 P a2c1f703ee334f54aaf22e4c25886102: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:49.940099 30597 ts_tablet_manager.cc:1434] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:22:49.941303 30441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5587a30b9c834ca0987f84ec30c35c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.942771 30370 tablet_service.cc:1511] Processing CreateTablet for tablet 516496d8276142fea3b6466e33910497 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:49.928131 30297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 516496d8276142fea3b6466e33910497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.944109 30370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 516496d8276142fea3b6466e33910497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.968554 30596 raft_consensus.cc:493] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:49.969223 30596 raft_consensus.cc:515] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:49.971855 30596 leader_election.cc:290] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:49.973544 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4067cde5d1274c7b9c494761260868bd" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:49.974222 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4067cde5d1274c7b9c494761260868bd" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c" is_pre_election: true
W20260709 13:22:49.975217 30275 leader_election.cc:343] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:49.976456 30276 leader_election.cc:343] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:49.976979 30276 leader_election.cc:304] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e72c3640883d4c0d88571a0839c5f947; no voters: 2f149ae7a84c46288c47962524d5240c, a2c1f703ee334f54aaf22e4c25886102
I20260709 13:22:49.977254 30597 tablet_bootstrap.cc:492] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947: Bootstrap starting.
I20260709 13:22:49.977836 30596 raft_consensus.cc:2749] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:49.981062 30442 tablet_service.cc:1511] Processing CreateTablet for tablet 516496d8276142fea3b6466e33910497 (DEFAULT_TABLE table=soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:49.982618 30442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 516496d8276142fea3b6466e33910497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.986050 30597 tablet_bootstrap.cc:654] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:49.993516 30597 tablet_bootstrap.cc:492] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947: No bootstrap required, opened a new log
I20260709 13:22:49.994081 30597 ts_tablet_manager.cc:1403] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:22:49.996603 30597 raft_consensus.cc:359] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:49.997176 30597 raft_consensus.cc:385] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.997429 30597 raft_consensus.cc:740] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.998172 30597 consensus_queue.cc:260] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:49.998545 30599 tablet_bootstrap.cc:492] T 949b6bfe52ed4ced899250cbc0613304 P a2c1f703ee334f54aaf22e4c25886102: No bootstrap required, opened a new log
I20260709 13:22:49.999135 30599 ts_tablet_manager.cc:1403] T 949b6bfe52ed4ced899250cbc0613304 P a2c1f703ee334f54aaf22e4c25886102: Time spent bootstrapping tablet: real 0.113s	user 0.012s	sys 0.007s
I20260709 13:22:50.002672 30597 ts_tablet_manager.cc:1434] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:22:50.003829 30597 tablet_bootstrap.cc:492] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947: Bootstrap starting.
I20260709 13:22:50.018365 30600 tablet_bootstrap.cc:492] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c: No bootstrap required, opened a new log
I20260709 13:22:50.019045 30600 ts_tablet_manager.cc:1403] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c: Time spent bootstrapping tablet: real 0.121s	user 0.020s	sys 0.006s
I20260709 13:22:50.022313 30600 raft_consensus.cc:359] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.023066 30600 raft_consensus.cc:385] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.023350 30600 raft_consensus.cc:740] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.024196 30599 raft_consensus.cc:359] T 949b6bfe52ed4ced899250cbc0613304 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.024250 30600 consensus_queue.cc:260] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.025190 30599 raft_consensus.cc:385] T 949b6bfe52ed4ced899250cbc0613304 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.025907 30599 raft_consensus.cc:740] T 949b6bfe52ed4ced899250cbc0613304 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.026976 30600 ts_tablet_manager.cc:1434] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:50.026609 30599 consensus_queue.cc:260] T 949b6bfe52ed4ced899250cbc0613304 P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.027977 30600 tablet_bootstrap.cc:492] T 949b6bfe52ed4ced899250cbc0613304 P 2f149ae7a84c46288c47962524d5240c: Bootstrap starting.
I20260709 13:22:50.028857 30597 tablet_bootstrap.cc:654] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.029950 30599 ts_tablet_manager.cc:1434] T 949b6bfe52ed4ced899250cbc0613304 P a2c1f703ee334f54aaf22e4c25886102: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260709 13:22:50.031071 30599 tablet_bootstrap.cc:492] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102: Bootstrap starting.
I20260709 13:22:50.039927 30599 tablet_bootstrap.cc:654] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.046154 30597 tablet_bootstrap.cc:492] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947: No bootstrap required, opened a new log
I20260709 13:22:50.046854 30597 ts_tablet_manager.cc:1403] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.008s
I20260709 13:22:50.050923 30597 raft_consensus.cc:359] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.051671 30600 tablet_bootstrap.cc:654] T 949b6bfe52ed4ced899250cbc0613304 P 2f149ae7a84c46288c47962524d5240c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.051950 30597 raft_consensus.cc:385] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.052410 30597 raft_consensus.cc:740] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.053447 30597 consensus_queue.cc:260] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.056042 30597 ts_tablet_manager.cc:1434] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:22:50.057950 30599 tablet_bootstrap.cc:492] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102: No bootstrap required, opened a new log
I20260709 13:22:50.058429 30597 tablet_bootstrap.cc:492] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947: Bootstrap starting.
I20260709 13:22:50.058490 30599 ts_tablet_manager.cc:1403] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.007s
I20260709 13:22:50.061847 30599 raft_consensus.cc:359] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.062599 30599 raft_consensus.cc:385] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.062930 30599 raft_consensus.cc:740] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.063809 30599 consensus_queue.cc:260] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.066021 30597 tablet_bootstrap.cc:654] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.066169 30599 ts_tablet_manager.cc:1434] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:50.067262 30599 tablet_bootstrap.cc:492] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102: Bootstrap starting.
I20260709 13:22:50.072000 30600 tablet_bootstrap.cc:492] T 949b6bfe52ed4ced899250cbc0613304 P 2f149ae7a84c46288c47962524d5240c: No bootstrap required, opened a new log
I20260709 13:22:50.072608 30600 ts_tablet_manager.cc:1403] T 949b6bfe52ed4ced899250cbc0613304 P 2f149ae7a84c46288c47962524d5240c: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.011s
I20260709 13:22:50.074219 30599 tablet_bootstrap.cc:654] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.076371 30597 tablet_bootstrap.cc:492] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947: No bootstrap required, opened a new log
I20260709 13:22:50.076057 30600 raft_consensus.cc:359] T 949b6bfe52ed4ced899250cbc0613304 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.076867 30600 raft_consensus.cc:385] T 949b6bfe52ed4ced899250cbc0613304 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.077229 30597 ts_tablet_manager.cc:1403] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.006s
I20260709 13:22:50.077458 30600 raft_consensus.cc:740] T 949b6bfe52ed4ced899250cbc0613304 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.078447 30600 consensus_queue.cc:260] T 949b6bfe52ed4ced899250cbc0613304 P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.080859 30599 tablet_bootstrap.cc:492] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102: No bootstrap required, opened a new log
I20260709 13:22:50.081029 30600 ts_tablet_manager.cc:1434] T 949b6bfe52ed4ced899250cbc0613304 P 2f149ae7a84c46288c47962524d5240c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 13:22:50.080598 30597 raft_consensus.cc:359] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.081455 30599 ts_tablet_manager.cc:1403] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.006s
I20260709 13:22:50.081519 30597 raft_consensus.cc:385] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.082216 30597 raft_consensus.cc:740] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.082319 30600 tablet_bootstrap.cc:492] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c: Bootstrap starting.
I20260709 13:22:50.083019 30597 consensus_queue.cc:260] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.084694 30599 raft_consensus.cc:359] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.085438 30599 raft_consensus.cc:385] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.085563 30597 ts_tablet_manager.cc:1434] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:22:50.085879 30599 raft_consensus.cc:740] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.087020 30597 tablet_bootstrap.cc:492] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947: Bootstrap starting.
I20260709 13:22:50.086767 30599 consensus_queue.cc:260] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.089231 30599 ts_tablet_manager.cc:1434] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:22:50.090441 30599 tablet_bootstrap.cc:492] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102: Bootstrap starting.
I20260709 13:22:50.094625 30597 tablet_bootstrap.cc:654] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.094653 30600 tablet_bootstrap.cc:654] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.098276 30599 tablet_bootstrap.cc:654] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.110215 30600 tablet_bootstrap.cc:492] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c: No bootstrap required, opened a new log
I20260709 13:22:50.110777 30597 tablet_bootstrap.cc:492] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947: No bootstrap required, opened a new log
I20260709 13:22:50.110920 30600 ts_tablet_manager.cc:1403] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.013s
I20260709 13:22:50.111521 30597 ts_tablet_manager.cc:1403] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.007s
I20260709 13:22:50.115020 30600 raft_consensus.cc:359] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.116003 30600 raft_consensus.cc:385] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.116353 30600 raft_consensus.cc:740] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.117216 30600 consensus_queue.cc:260] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.117491 30597 raft_consensus.cc:359] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.118330 30597 raft_consensus.cc:385] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.118659 30597 raft_consensus.cc:740] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.119902 30600 ts_tablet_manager.cc:1434] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:50.115622 30599 tablet_bootstrap.cc:492] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102: No bootstrap required, opened a new log
I20260709 13:22:50.120676 30599 ts_tablet_manager.cc:1403] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.004s
I20260709 13:22:50.121109 30600 tablet_bootstrap.cc:492] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c: Bootstrap starting.
I20260709 13:22:50.124318 30599 raft_consensus.cc:359] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.125161 30599 raft_consensus.cc:385] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.125520 30599 raft_consensus.cc:740] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.126063 30596 raft_consensus.cc:493] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:50.126634 30596 raft_consensus.cc:515] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.119473 30597 consensus_queue.cc:260] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.128866 30596 leader_election.cc:290] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:50.129411 30597 ts_tablet_manager.cc:1434] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:22:50.130406 30600 tablet_bootstrap.cc:654] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.130692 30597 tablet_bootstrap.cc:492] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947: Bootstrap starting.
I20260709 13:22:50.132577 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4922ebd8d54d42b96f5ba84599e71b" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c" is_pre_election: true
W20260709 13:22:50.134225 30276 leader_election.cc:343] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:50.126412 30599 consensus_queue.cc:260] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
W20260709 13:22:50.138783 30256 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:50.139983 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4922ebd8d54d42b96f5ba84599e71b" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:50.140688 30385 raft_consensus.cc:2468] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 0.
I20260709 13:22:50.140930 30597 tablet_bootstrap.cc:654] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.142132 30275 leader_election.cc:304] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 2f149ae7a84c46288c47962524d5240c
I20260709 13:22:50.145264 30584 raft_consensus.cc:2804] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:50.148211 30599 ts_tablet_manager.cc:1434] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:22:50.150202 30584 raft_consensus.cc:493] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:50.150942 30584 raft_consensus.cc:3060] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.158631 30599 tablet_bootstrap.cc:492] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102: Bootstrap starting.
I20260709 13:22:50.166205 30599 tablet_bootstrap.cc:654] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.175056 30584 raft_consensus.cc:515] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.178586 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4922ebd8d54d42b96f5ba84599e71b" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:50.179204 30385 raft_consensus.cc:3060] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.182593 30599 tablet_bootstrap.cc:492] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102: No bootstrap required, opened a new log
I20260709 13:22:50.183262 30599 ts_tablet_manager.cc:1403] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.009s
I20260709 13:22:50.186112 30603 raft_consensus.cc:493] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:50.186617 30603 raft_consensus.cc:515] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.186534 30599 raft_consensus.cc:359] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.187592 30599 raft_consensus.cc:385] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.187948 30599 raft_consensus.cc:740] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.189263 30599 consensus_queue.cc:260] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.189795 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84b4be1bf0d4bcd88c34e94305b60e3" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947" is_pre_election: true
I20260709 13:22:50.190502 30309 raft_consensus.cc:2468] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 0.
I20260709 13:22:50.191866 30349 leader_election.cc:304] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:50.192739 30583 raft_consensus.cc:2804] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:50.193090 30583 raft_consensus.cc:493] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:50.193464 30583 raft_consensus.cc:3060] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.194231 30599 ts_tablet_manager.cc:1434] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:22:50.195433 30599 tablet_bootstrap.cc:492] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102: Bootstrap starting.
I20260709 13:22:50.202337 30599 tablet_bootstrap.cc:654] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.203222 30603 leader_election.cc:290] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:50.204871 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84b4be1bf0d4bcd88c34e94305b60e3" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c" is_pre_election: true
W20260709 13:22:50.207175 30351 leader_election.cc:343] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:50.207613 30385 raft_consensus.cc:2468] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 1.
I20260709 13:22:50.210153 30275 leader_election.cc:304] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:50.211031 30615 raft_consensus.cc:2804] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:50.212293 30615 raft_consensus.cc:697] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Becoming Leader. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:50.223407 30615 consensus_queue.cc:237] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.232462 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4922ebd8d54d42b96f5ba84599e71b" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c"
W20260709 13:22:50.235127 30276 leader_election.cc:343] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:50.237452 30583 raft_consensus.cc:515] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.242304 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84b4be1bf0d4bcd88c34e94305b60e3" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:50.243242 30309 raft_consensus.cc:3060] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.265812 30584 leader_election.cc:290] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Requested vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:50.270633 30600 tablet_bootstrap.cc:492] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c: No bootstrap required, opened a new log
I20260709 13:22:50.271275 30600 ts_tablet_manager.cc:1403] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c: Time spent bootstrapping tablet: real 0.150s	user 0.061s	sys 0.081s
I20260709 13:22:50.272248 30309 raft_consensus.cc:2468] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 1.
I20260709 13:22:50.270679 30583 leader_election.cc:290] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:50.274639 30600 raft_consensus.cc:359] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.274946 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84b4be1bf0d4bcd88c34e94305b60e3" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:50.275493 30600 raft_consensus.cc:385] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.275868 30600 raft_consensus.cc:740] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.275645 30349 leader_election.cc:304] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:50.276696 30599 tablet_bootstrap.cc:492] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102: No bootstrap required, opened a new log
I20260709 13:22:50.277046 30583 raft_consensus.cc:2804] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:50.277257 30599 ts_tablet_manager.cc:1403] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102: Time spent bootstrapping tablet: real 0.082s	user 0.034s	sys 0.033s
I20260709 13:22:50.276867 30600 consensus_queue.cc:260] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.278210 30583 raft_consensus.cc:697] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Becoming Leader. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Running, Role: LEADER
I20260709 13:22:50.279493 30600 ts_tablet_manager.cc:1434] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:22:50.279189 30583 consensus_queue.cc:237] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.280648 30600 tablet_bootstrap.cc:492] T 1ed9e678f5f74f0697bcb9858e4330f8 P 2f149ae7a84c46288c47962524d5240c: Bootstrap starting.
I20260709 13:22:50.282048 30599 raft_consensus.cc:359] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.282850 30599 raft_consensus.cc:385] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.283159 30599 raft_consensus.cc:740] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.283972 30599 consensus_queue.cc:260] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
W20260709 13:22:50.284690 30351 leader_election.cc:343] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:50.285497 30597 tablet_bootstrap.cc:492] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947: No bootstrap required, opened a new log
I20260709 13:22:50.286151 30597 ts_tablet_manager.cc:1403] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947: Time spent bootstrapping tablet: real 0.156s	user 0.048s	sys 0.059s
I20260709 13:22:50.286677 30599 ts_tablet_manager.cc:1434] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:22:50.287838 30600 tablet_bootstrap.cc:654] T 1ed9e678f5f74f0697bcb9858e4330f8 P 2f149ae7a84c46288c47962524d5240c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.278652 30208 catalog_manager.cc:5697] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 reported cstate change: term changed from 0 to 1, leader changed from <none> to e72c3640883d4c0d88571a0839c5f947 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "e72c3640883d4c0d88571a0839c5f947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:50.289994 30615 raft_consensus.cc:493] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:50.290572 30615 raft_consensus.cc:515] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.287835 30599 tablet_bootstrap.cc:492] T 1ed9e678f5f74f0697bcb9858e4330f8 P a2c1f703ee334f54aaf22e4c25886102: Bootstrap starting.
I20260709 13:22:50.293896 30615 leader_election.cc:290] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:50.302911 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949b6bfe52ed4ced899250cbc0613304" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c" is_pre_election: true
I20260709 13:22:50.303746 30457 raft_consensus.cc:2468] T 949b6bfe52ed4ced899250cbc0613304 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 0.
I20260709 13:22:50.304111 30615 raft_consensus.cc:493] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:50.302953 30597 raft_consensus.cc:359] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.304764 30597 raft_consensus.cc:385] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.304699 30615 raft_consensus.cc:515] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.305357 30597 raft_consensus.cc:740] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.305500 30547 raft_consensus.cc:493] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:50.306104 30547 raft_consensus.cc:515] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.306519 30597 consensus_queue.cc:260] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.302927 30599 tablet_bootstrap.cc:654] T 1ed9e678f5f74f0697bcb9858e4330f8 P a2c1f703ee334f54aaf22e4c25886102: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.308276 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed9e678f5f74f0697bcb9858e4330f8" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:50.302213 30206 catalog_manager.cc:5697] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "a2c1f703ee334f54aaf22e4c25886102" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
W20260709 13:22:50.309942 30275 leader_election.cc:343] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:50.310070 30276 leader_election.cc:304] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:50.311386 30596 raft_consensus.cc:2804] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:50.311813 30596 raft_consensus.cc:493] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:50.312126 30597 ts_tablet_manager.cc:1434] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:22:50.312191 30596 raft_consensus.cc:3060] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.313513 30547 leader_election.cc:290] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:50.313980 30597 tablet_bootstrap.cc:492] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947: Bootstrap starting.
I20260709 13:22:50.315349 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4067cde5d1274c7b9c494761260868bd" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947" is_pre_election: true
I20260709 13:22:50.316284 30309 raft_consensus.cc:2468] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 0.
I20260709 13:22:50.318524 30423 leader_election.cc:304] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:50.320207 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4067cde5d1274c7b9c494761260868bd" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:50.321130 30384 raft_consensus.cc:2468] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 0.
I20260709 13:22:50.323449 30547 raft_consensus.cc:2804] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:50.323958 30547 raft_consensus.cc:493] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:50.324342 30547 raft_consensus.cc:3060] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.328454 30597 tablet_bootstrap.cc:654] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.330715 30600 tablet_bootstrap.cc:492] T 1ed9e678f5f74f0697bcb9858e4330f8 P 2f149ae7a84c46288c47962524d5240c: No bootstrap required, opened a new log
I20260709 13:22:50.331362 30600 ts_tablet_manager.cc:1403] T 1ed9e678f5f74f0697bcb9858e4330f8 P 2f149ae7a84c46288c47962524d5240c: Time spent bootstrapping tablet: real 0.051s	user 0.023s	sys 0.020s
I20260709 13:22:50.334970 30600 raft_consensus.cc:359] T 1ed9e678f5f74f0697bcb9858e4330f8 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.335218 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed9e678f5f74f0697bcb9858e4330f8" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c" is_pre_election: true
I20260709 13:22:50.303288 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949b6bfe52ed4ced899250cbc0613304" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:50.335920 30600 raft_consensus.cc:385] T 1ed9e678f5f74f0697bcb9858e4330f8 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.336354 30385 raft_consensus.cc:2468] T 949b6bfe52ed4ced899250cbc0613304 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 0.
I20260709 13:22:50.336409 30600 raft_consensus.cc:740] T 1ed9e678f5f74f0697bcb9858e4330f8 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.338121 30615 leader_election.cc:290] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:50.337910 30600 consensus_queue.cc:260] T 1ed9e678f5f74f0697bcb9858e4330f8 P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.339207 30457 raft_consensus.cc:2468] T 1ed9e678f5f74f0697bcb9858e4330f8 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 0.
I20260709 13:22:50.342655 30276 leader_election.cc:304] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947; no voters: a2c1f703ee334f54aaf22e4c25886102
I20260709 13:22:50.344448 30584 raft_consensus.cc:2804] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:50.345013 30584 raft_consensus.cc:493] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:50.347817 30600 ts_tablet_manager.cc:1434] T 1ed9e678f5f74f0697bcb9858e4330f8 P 2f149ae7a84c46288c47962524d5240c: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.003s
I20260709 13:22:50.349226 30600 tablet_bootstrap.cc:492] T 04758565c2a646508349c072165e38f9 P 2f149ae7a84c46288c47962524d5240c: Bootstrap starting.
I20260709 13:22:50.353226 30547 raft_consensus.cc:515] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.356664 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4067cde5d1274c7b9c494761260868bd" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:50.357271 30600 tablet_bootstrap.cc:654] T 04758565c2a646508349c072165e38f9 P 2f149ae7a84c46288c47962524d5240c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.357343 30309 raft_consensus.cc:3060] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.358413 30597 tablet_bootstrap.cc:492] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947: No bootstrap required, opened a new log
I20260709 13:22:50.358945 30597 ts_tablet_manager.cc:1403] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.012s
I20260709 13:22:50.363775 30597 raft_consensus.cc:359] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.364540 30597 raft_consensus.cc:385] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.364902 30597 raft_consensus.cc:740] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.372412 30597 consensus_queue.cc:260] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.374799 30597 ts_tablet_manager.cc:1434] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:22:50.376614 30597 tablet_bootstrap.cc:492] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947: Bootstrap starting.
I20260709 13:22:50.386065 30597 tablet_bootstrap.cc:654] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.345497 30584 raft_consensus.cc:3060] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.381188 30309 raft_consensus.cc:2468] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 1.
I20260709 13:22:50.395270 30423 leader_election.cc:304] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:50.396392 30626 raft_consensus.cc:2804] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:50.399449 30597 tablet_bootstrap.cc:492] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947: No bootstrap required, opened a new log
I20260709 13:22:50.400445 30597 ts_tablet_manager.cc:1403] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 13:22:50.349112 30596 raft_consensus.cc:515] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.404611 30597 raft_consensus.cc:359] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.405535 30597 raft_consensus.cc:385] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.406116 30597 raft_consensus.cc:740] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.407011 30597 consensus_queue.cc:260] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.410539 30597 ts_tablet_manager.cc:1434] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:22:50.411799 30597 tablet_bootstrap.cc:492] T 516496d8276142fea3b6466e33910497 P e72c3640883d4c0d88571a0839c5f947: Bootstrap starting.
I20260709 13:22:50.416958 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949b6bfe52ed4ced899250cbc0613304" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:50.417883 30385 raft_consensus.cc:3060] T 949b6bfe52ed4ced899250cbc0613304 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.425738 30597 tablet_bootstrap.cc:654] T 516496d8276142fea3b6466e33910497 P e72c3640883d4c0d88571a0839c5f947: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.430044 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949b6bfe52ed4ced899250cbc0613304" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:50.430967 30457 raft_consensus.cc:3060] T 949b6bfe52ed4ced899250cbc0613304 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.447572 30457 raft_consensus.cc:2468] T 949b6bfe52ed4ced899250cbc0613304 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 1.
I20260709 13:22:50.449429 30276 leader_election.cc:304] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:50.450860 30615 raft_consensus.cc:2804] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:50.464526 30599 tablet_bootstrap.cc:492] T 1ed9e678f5f74f0697bcb9858e4330f8 P a2c1f703ee334f54aaf22e4c25886102: No bootstrap required, opened a new log
I20260709 13:22:50.470609 30596 leader_election.cc:290] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Requested vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:50.471961 30547 leader_election.cc:290] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:50.472864 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4067cde5d1274c7b9c494761260868bd" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:50.473791 30384 raft_consensus.cc:3060] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.474447 30385 raft_consensus.cc:2468] T 949b6bfe52ed4ced899250cbc0613304 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 1.
I20260709 13:22:50.465432 30599 ts_tablet_manager.cc:1403] T 1ed9e678f5f74f0697bcb9858e4330f8 P a2c1f703ee334f54aaf22e4c25886102: Time spent bootstrapping tablet: real 0.178s	user 0.026s	sys 0.034s
I20260709 13:22:50.478837 30626 raft_consensus.cc:697] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Becoming Leader. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Running, Role: LEADER
I20260709 13:22:50.480105 30626 consensus_queue.cc:237] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.482513 30597 tablet_bootstrap.cc:492] T 516496d8276142fea3b6466e33910497 P e72c3640883d4c0d88571a0839c5f947: No bootstrap required, opened a new log
I20260709 13:22:50.483053 30597 ts_tablet_manager.cc:1403] T 516496d8276142fea3b6466e33910497 P e72c3640883d4c0d88571a0839c5f947: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.040s
I20260709 13:22:50.486050 30597 raft_consensus.cc:359] T 516496d8276142fea3b6466e33910497 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.486755 30597 raft_consensus.cc:385] T 516496d8276142fea3b6466e33910497 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.487206 30597 raft_consensus.cc:740] T 516496d8276142fea3b6466e33910497 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.475960 30584 raft_consensus.cc:515] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.488266 30597 consensus_queue.cc:260] T 516496d8276142fea3b6466e33910497 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.490504 30584 leader_election.cc:290] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Requested vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:50.491295 30597 ts_tablet_manager.cc:1434] T 516496d8276142fea3b6466e33910497 P e72c3640883d4c0d88571a0839c5f947: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:50.491058 30599 raft_consensus.cc:359] T 1ed9e678f5f74f0697bcb9858e4330f8 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.486588 30384 raft_consensus.cc:2468] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 1.
I20260709 13:22:50.491964 30599 raft_consensus.cc:385] T 1ed9e678f5f74f0697bcb9858e4330f8 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.492421 30599 raft_consensus.cc:740] T 1ed9e678f5f74f0697bcb9858e4330f8 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.493172 30599 consensus_queue.cc:260] T 1ed9e678f5f74f0697bcb9858e4330f8 P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.494379 30600 tablet_bootstrap.cc:492] T 04758565c2a646508349c072165e38f9 P 2f149ae7a84c46288c47962524d5240c: No bootstrap required, opened a new log
I20260709 13:22:50.495126 30600 ts_tablet_manager.cc:1403] T 04758565c2a646508349c072165e38f9 P 2f149ae7a84c46288c47962524d5240c: Time spent bootstrapping tablet: real 0.146s	user 0.065s	sys 0.066s
I20260709 13:22:50.495645 30599 ts_tablet_manager.cc:1434] T 1ed9e678f5f74f0697bcb9858e4330f8 P a2c1f703ee334f54aaf22e4c25886102: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:22:50.496657 30599 tablet_bootstrap.cc:492] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102: Bootstrap starting.
I20260709 13:22:50.497262 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed9e678f5f74f0697bcb9858e4330f8" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:50.497936 30457 raft_consensus.cc:3060] T 1ed9e678f5f74f0697bcb9858e4330f8 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.502132 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed9e678f5f74f0697bcb9858e4330f8" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:50.502997 30384 raft_consensus.cc:3060] T 1ed9e678f5f74f0697bcb9858e4330f8 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.503311 30599 tablet_bootstrap.cc:654] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.517742 30615 raft_consensus.cc:697] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Becoming Leader. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:50.540809 30583 raft_consensus.cc:493] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:50.541640 30583 raft_consensus.cc:515] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.552829 30459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d7af6286a04a0ca3ef0aaa869b5223" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c" is_pre_election: true
I20260709 13:22:50.553694 30459 raft_consensus.cc:2468] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 0.
I20260709 13:22:50.553150 30600 raft_consensus.cc:359] T 04758565c2a646508349c072165e38f9 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.554458 30600 raft_consensus.cc:385] T 04758565c2a646508349c072165e38f9 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.554888 30600 raft_consensus.cc:740] T 04758565c2a646508349c072165e38f9 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.555229 30351 leader_election.cc:304] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, a2c1f703ee334f54aaf22e4c25886102; no voters: 
I20260709 13:22:50.556363 30601 raft_consensus.cc:2804] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:50.556833 30601 raft_consensus.cc:493] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:50.557267 30601 raft_consensus.cc:3060] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.560063 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d7af6286a04a0ca3ef0aaa869b5223" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947" is_pre_election: true
I20260709 13:22:50.561003 30309 raft_consensus.cc:2468] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 0.
I20260709 13:22:50.556090 30600 consensus_queue.cc:260] T 04758565c2a646508349c072165e38f9 P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.561750 30583 leader_election.cc:290] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:50.566162 30599 tablet_bootstrap.cc:492] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102: No bootstrap required, opened a new log
I20260709 13:22:50.566094 30601 raft_consensus.cc:515] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.566924 30599 ts_tablet_manager.cc:1403] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.012s
I20260709 13:22:50.566351 30615 consensus_queue.cc:237] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.569680 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d7af6286a04a0ca3ef0aaa869b5223" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:50.570310 30309 raft_consensus.cc:3060] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.570356 30599 raft_consensus.cc:359] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.571444 30599 raft_consensus.cc:385] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.571794 30599 raft_consensus.cc:740] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.572821 30599 consensus_queue.cc:260] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.575695 30599 ts_tablet_manager.cc:1434] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:50.565383 30600 ts_tablet_manager.cc:1434] T 04758565c2a646508349c072165e38f9 P 2f149ae7a84c46288c47962524d5240c: Time spent starting tablet: real 0.070s	user 0.018s	sys 0.025s
I20260709 13:22:50.576961 30599 tablet_bootstrap.cc:492] T 516496d8276142fea3b6466e33910497 P a2c1f703ee334f54aaf22e4c25886102: Bootstrap starting.
I20260709 13:22:50.578626 30600 tablet_bootstrap.cc:492] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c: Bootstrap starting.
I20260709 13:22:50.579711 30309 raft_consensus.cc:2468] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 1.
I20260709 13:22:50.581130 30349 leader_election.cc:304] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:50.582166 30583 raft_consensus.cc:2804] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:50.582686 30583 raft_consensus.cc:697] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Becoming Leader. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Running, Role: LEADER
I20260709 13:22:50.583513 30583 consensus_queue.cc:237] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.584671 30599 tablet_bootstrap.cc:654] T 516496d8276142fea3b6466e33910497 P a2c1f703ee334f54aaf22e4c25886102: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.584861 30457 raft_consensus.cc:2468] T 1ed9e678f5f74f0697bcb9858e4330f8 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 1.
I20260709 13:22:50.586373 30276 leader_election.cc:304] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:50.587284 30633 raft_consensus.cc:2804] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:50.587747 30633 raft_consensus.cc:697] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Becoming Leader. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:50.588601 30633 consensus_queue.cc:237] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.590675 30459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d7af6286a04a0ca3ef0aaa869b5223" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:50.591136 30384 raft_consensus.cc:2468] T 1ed9e678f5f74f0697bcb9858e4330f8 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 1.
I20260709 13:22:50.591670 30459 raft_consensus.cc:3060] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.606680 30584 raft_consensus.cc:493] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:50.607321 30584 raft_consensus.cc:515] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.608925 30601 leader_election.cc:290] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 1 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:50.611290 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04758565c2a646508349c072165e38f9" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:50.612039 30384 raft_consensus.cc:2468] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 0.
I20260709 13:22:50.612648 30584 leader_election.cc:290] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:50.612807 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04758565c2a646508349c072165e38f9" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c" is_pre_election: true
I20260709 13:22:50.612941 30459 raft_consensus.cc:2468] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 1.
I20260709 13:22:50.613533 30457 raft_consensus.cc:2468] T 04758565c2a646508349c072165e38f9 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 0.
I20260709 13:22:50.615486 30275 leader_election.cc:304] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:50.617592 30207 catalog_manager.cc:5697] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f149ae7a84c46288c47962524d5240c (127.17.251.131). New cstate: current_term: 1 leader_uuid: "2f149ae7a84c46288c47962524d5240c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:50.625442 30615 raft_consensus.cc:2804] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:50.625990 30615 raft_consensus.cc:493] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:50.626391 30615 raft_consensus.cc:3060] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.620988 30600 tablet_bootstrap.cc:654] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.632153 30208 catalog_manager.cc:5697] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "a2c1f703ee334f54aaf22e4c25886102" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:50.639536 30615 raft_consensus.cc:515] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.644642 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04758565c2a646508349c072165e38f9" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:50.645488 30384 raft_consensus.cc:3060] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.645658 30599 tablet_bootstrap.cc:492] T 516496d8276142fea3b6466e33910497 P a2c1f703ee334f54aaf22e4c25886102: No bootstrap required, opened a new log
I20260709 13:22:50.646318 30599 ts_tablet_manager.cc:1403] T 516496d8276142fea3b6466e33910497 P a2c1f703ee334f54aaf22e4c25886102: Time spent bootstrapping tablet: real 0.070s	user 0.029s	sys 0.023s
I20260709 13:22:50.649122 30599 raft_consensus.cc:359] T 516496d8276142fea3b6466e33910497 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.649835 30599 raft_consensus.cc:385] T 516496d8276142fea3b6466e33910497 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.650121 30599 raft_consensus.cc:740] T 516496d8276142fea3b6466e33910497 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.650811 30599 consensus_queue.cc:260] T 516496d8276142fea3b6466e33910497 P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.652899 30599 ts_tablet_manager.cc:1434] T 516496d8276142fea3b6466e33910497 P a2c1f703ee334f54aaf22e4c25886102: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:22:50.656184 30600 tablet_bootstrap.cc:492] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c: No bootstrap required, opened a new log
I20260709 13:22:50.656775 30600 ts_tablet_manager.cc:1403] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c: Time spent bootstrapping tablet: real 0.078s	user 0.020s	sys 0.008s
I20260709 13:22:50.659328 30384 raft_consensus.cc:2468] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 1.
I20260709 13:22:50.659859 30600 raft_consensus.cc:359] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.660610 30615 leader_election.cc:290] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Requested vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:50.660617 30275 leader_election.cc:304] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:50.660640 30600 raft_consensus.cc:385] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.661780 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04758565c2a646508349c072165e38f9" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:50.662031 30600 raft_consensus.cc:740] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.662443 30457 raft_consensus.cc:3060] T 04758565c2a646508349c072165e38f9 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.662940 30600 consensus_queue.cc:260] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.665403 30600 ts_tablet_manager.cc:1434] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:22:50.662066 30615 raft_consensus.cc:2804] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:50.666412 30600 tablet_bootstrap.cc:492] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c: Bootstrap starting.
I20260709 13:22:50.667001 30615 raft_consensus.cc:697] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Becoming Leader. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:50.667925 30615 consensus_queue.cc:237] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.673151 30600 tablet_bootstrap.cc:654] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.675328 30633 raft_consensus.cc:493] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:50.676090 30633 raft_consensus.cc:515] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.679780 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5587a30b9c834ca0987f84ec30c35c32" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:50.680472 30384 raft_consensus.cc:2468] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 0.
I20260709 13:22:50.681082 30459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5587a30b9c834ca0987f84ec30c35c32" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c" is_pre_election: true
I20260709 13:22:50.681802 30459 raft_consensus.cc:2468] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 0.
I20260709 13:22:50.681933 30275 leader_election.cc:304] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:50.682981 30584 raft_consensus.cc:2804] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:50.683331 30584 raft_consensus.cc:493] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:50.683633 30584 raft_consensus.cc:3060] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.687740 30633 leader_election.cc:290] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:50.688160 30206 catalog_manager.cc:5697] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 reported cstate change: term changed from 0 to 1, leader changed from <none> to e72c3640883d4c0d88571a0839c5f947 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "e72c3640883d4c0d88571a0839c5f947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:50.689400 30457 raft_consensus.cc:2468] T 04758565c2a646508349c072165e38f9 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 1.
I20260709 13:22:50.692338 30584 raft_consensus.cc:515] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.692978 30600 tablet_bootstrap.cc:492] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c: No bootstrap required, opened a new log
I20260709 13:22:50.693532 30600 ts_tablet_manager.cc:1403] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.005s
I20260709 13:22:50.695142 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5587a30b9c834ca0987f84ec30c35c32" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:50.695552 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5587a30b9c834ca0987f84ec30c35c32" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:50.695777 30384 raft_consensus.cc:3060] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.696156 30457 raft_consensus.cc:3060] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.696499 30600 raft_consensus.cc:359] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.697206 30600 raft_consensus.cc:385] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.697450 30600 raft_consensus.cc:740] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.698156 30600 consensus_queue.cc:260] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.700203 30600 ts_tablet_manager.cc:1434] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:22:50.701095 30600 tablet_bootstrap.cc:492] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c: Bootstrap starting.
I20260709 13:22:50.703289 30384 raft_consensus.cc:2468] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 1.
I20260709 13:22:50.703774 30457 raft_consensus.cc:2468] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 1.
I20260709 13:22:50.704648 30275 leader_election.cc:304] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:50.705396 30584 leader_election.cc:290] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 1 election: Requested vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:50.705904 30615 raft_consensus.cc:2804] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:50.706420 30615 raft_consensus.cc:697] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Becoming Leader. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:50.706966 30600 tablet_bootstrap.cc:654] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.707265 30615 consensus_queue.cc:237] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.713570 30600 tablet_bootstrap.cc:492] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c: No bootstrap required, opened a new log
I20260709 13:22:50.714201 30600 ts_tablet_manager.cc:1403] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 13:22:50.716722 30600 raft_consensus.cc:359] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.717260 30600 raft_consensus.cc:385] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.717489 30600 raft_consensus.cc:740] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.718192 30600 consensus_queue.cc:260] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.720033 30600 ts_tablet_manager.cc:1434] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:22:50.722335 30206 catalog_manager.cc:5697] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 reported cstate change: term changed from 0 to 1, leader changed from <none> to e72c3640883d4c0d88571a0839c5f947 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "e72c3640883d4c0d88571a0839c5f947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:50.723577 30206 catalog_manager.cc:5697] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 reported cstate change: term changed from 0 to 1, leader changed from <none> to e72c3640883d4c0d88571a0839c5f947 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "e72c3640883d4c0d88571a0839c5f947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:50.725114 30206 catalog_manager.cc:5697] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 reported cstate change: term changed from 0 to 1, leader changed from <none> to e72c3640883d4c0d88571a0839c5f947 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "e72c3640883d4c0d88571a0839c5f947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:50.727500 30626 raft_consensus.cc:493] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:50.728058 30626 raft_consensus.cc:515] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.730247 30626 leader_election.cc:290] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:50.732120 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4922ebd8d54d42b96f5ba84599e71b" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947" is_pre_election: true
I20260709 13:22:50.733811 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4922ebd8d54d42b96f5ba84599e71b" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:50.734561 30384 raft_consensus.cc:2393] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f149ae7a84c46288c47962524d5240c in current term 1: Already voted for candidate e72c3640883d4c0d88571a0839c5f947 in this term.
I20260709 13:22:50.735507 30626 raft_consensus.cc:493] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:50.735641 30424 leader_election.cc:304] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c; no voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947
I20260709 13:22:50.736137 30626 raft_consensus.cc:515] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.736512 30547 raft_consensus.cc:3060] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.738598 30626 leader_election.cc:290] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:50.739269 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516496d8276142fea3b6466e33910497" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947" is_pre_election: true
I20260709 13:22:50.739671 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516496d8276142fea3b6466e33910497" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:50.739846 30309 raft_consensus.cc:2468] T 516496d8276142fea3b6466e33910497 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 0.
I20260709 13:22:50.740329 30384 raft_consensus.cc:2468] T 516496d8276142fea3b6466e33910497 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 0.
I20260709 13:22:50.740851 30423 leader_election.cc:304] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:50.741698 30626 raft_consensus.cc:2804] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:50.742105 30626 raft_consensus.cc:493] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:50.742393 30626 raft_consensus.cc:3060] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.744696 30547 raft_consensus.cc:2749] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:50.747826 30626 raft_consensus.cc:515] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.749704 30626 leader_election.cc:290] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:50.750437 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516496d8276142fea3b6466e33910497" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:50.750708 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516496d8276142fea3b6466e33910497" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:50.751005 30309 raft_consensus.cc:3060] T 516496d8276142fea3b6466e33910497 P e72c3640883d4c0d88571a0839c5f947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.751330 30384 raft_consensus.cc:3060] T 516496d8276142fea3b6466e33910497 P a2c1f703ee334f54aaf22e4c25886102 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.756819 30309 raft_consensus.cc:2468] T 516496d8276142fea3b6466e33910497 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 1.
I20260709 13:22:50.757418 30384 raft_consensus.cc:2468] T 516496d8276142fea3b6466e33910497 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 1.
I20260709 13:22:50.757953 30423 leader_election.cc:304] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:50.758765 30626 raft_consensus.cc:2804] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:50.759248 30626 raft_consensus.cc:697] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Becoming Leader. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Running, Role: LEADER
I20260709 13:22:50.759883 30626 consensus_queue.cc:237] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.767967 30206 catalog_manager.cc:5697] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f149ae7a84c46288c47962524d5240c (127.17.251.131). New cstate: current_term: 1 leader_uuid: "2f149ae7a84c46288c47962524d5240c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:50.773131 30626 raft_consensus.cc:493] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:50.773782 30626 raft_consensus.cc:515] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:50.776098 30626 leader_election.cc:290] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:50.776882 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84b4be1bf0d4bcd88c34e94305b60e3" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72c3640883d4c0d88571a0839c5f947" is_pre_election: true
I20260709 13:22:50.777287 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84b4be1bf0d4bcd88c34e94305b60e3" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c1f703ee334f54aaf22e4c25886102" is_pre_election: true
I20260709 13:22:50.777781 30309 raft_consensus.cc:2393] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f149ae7a84c46288c47962524d5240c in current term 1: Already voted for candidate a2c1f703ee334f54aaf22e4c25886102 in this term.
I20260709 13:22:50.778785 30424 leader_election.cc:304] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c; no voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947
I20260709 13:22:50.779400 30626 raft_consensus.cc:3060] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:50.784761 30626 raft_consensus.cc:2749] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:50.809208 30615 consensus_queue.cc:1048] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:50.823408 30633 consensus_queue.cc:1048] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:50.852119 30601 consensus_queue.cc:1048] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:50.864588 30601 consensus_queue.cc:1048] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:50.970656 30626 consensus_queue.cc:1048] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:50.981179 30626 consensus_queue.cc:1048] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:50.989051 30584 consensus_queue.cc:1048] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:50.998060 30457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4067cde5d1274c7b9c494761260868bd"
dest_uuid: "2f149ae7a84c46288c47962524d5240c"
mode: GRACEFUL
new_leader_uuid: "e72c3640883d4c0d88571a0839c5f947"
 from {username='slave'} at 127.0.0.1:49290
I20260709 13:22:50.998639 30457 raft_consensus.cc:606] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Received request to transfer leadership to TS e72c3640883d4c0d88571a0839c5f947
I20260709 13:22:51.006947 30633 consensus_queue.cc:1048] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:51.014308 30601 consensus_queue.cc:1048] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:51.019959 30384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4d7af6286a04a0ca3ef0aaa869b5223"
dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
mode: GRACEFUL
new_leader_uuid: "e72c3640883d4c0d88571a0839c5f947"
 from {username='slave'} at 127.0.0.1:35560
I20260709 13:22:51.020615 30384 raft_consensus.cc:606] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Received request to transfer leadership to TS e72c3640883d4c0d88571a0839c5f947
I20260709 13:22:51.030570 30652 consensus_queue.cc:1048] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:51.032006 30309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d4922ebd8d54d42b96f5ba84599e71b"
dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
mode: GRACEFUL
new_leader_uuid: "a2c1f703ee334f54aaf22e4c25886102"
 from {username='slave'} at 127.0.0.1:36752
I20260709 13:22:51.032714 30309 raft_consensus.cc:606] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Received request to transfer leadership to TS a2c1f703ee334f54aaf22e4c25886102
I20260709 13:22:51.042024 30307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04758565c2a646508349c072165e38f9"
dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
mode: GRACEFUL
new_leader_uuid: "a2c1f703ee334f54aaf22e4c25886102"
 from {username='slave'} at 127.0.0.1:36752
I20260709 13:22:51.042675 30307 raft_consensus.cc:606] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Received request to transfer leadership to TS a2c1f703ee334f54aaf22e4c25886102
I20260709 13:22:51.044950 30652 raft_consensus.cc:993] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102: : Instructing follower e72c3640883d4c0d88571a0839c5f947 to start an election
I20260709 13:22:51.045432 30601 raft_consensus.cc:1081] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Signalling peer e72c3640883d4c0d88571a0839c5f947 to start an election
I20260709 13:22:51.047436 30309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4d7af6286a04a0ca3ef0aaa869b5223"
dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
 from {username='slave'} at 127.0.0.1:36742
I20260709 13:22:51.047956 30309 raft_consensus.cc:493] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:51.048319 30309 raft_consensus.cc:3060] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:51.053012 30307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5587a30b9c834ca0987f84ec30c35c32"
dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
mode: GRACEFUL
new_leader_uuid: "a2c1f703ee334f54aaf22e4c25886102"
 from {username='slave'} at 127.0.0.1:36752
I20260709 13:22:51.053758 30307 raft_consensus.cc:606] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Received request to transfer leadership to TS a2c1f703ee334f54aaf22e4c25886102
I20260709 13:22:51.053974 30633 consensus_queue.cc:1048] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:51.059068 30309 raft_consensus.cc:515] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:51.062062 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d7af6286a04a0ca3ef0aaa869b5223" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:51.062639 30385 raft_consensus.cc:3055] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:51.062932 30385 raft_consensus.cc:740] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Running, Role: LEADER
I20260709 13:22:51.063681 30385 consensus_queue.cc:260] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:51.064693 30385 raft_consensus.cc:3060] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:51.068142 30584 consensus_queue.cc:1048] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:51.069981 30459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d7af6286a04a0ca3ef0aaa869b5223" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:51.070600 30459 raft_consensus.cc:3060] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:51.079964 30385 raft_consensus.cc:2468] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 2.
I20260709 13:22:51.081329 30275 leader_election.cc:304] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:51.082093 30584 raft_consensus.cc:2804] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:51.082595 30584 raft_consensus.cc:697] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [term 2 LEADER]: Becoming Leader. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:51.083153 30309 leader_election.cc:290] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 2 election: Requested vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:51.083446 30584 consensus_queue.cc:237] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:51.089368 30459 raft_consensus.cc:2468] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 2.
I20260709 13:22:51.093516 30207 catalog_manager.cc:5697] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 reported cstate change: term changed from 1 to 2, leader changed from a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130) to e72c3640883d4c0d88571a0839c5f947 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "e72c3640883d4c0d88571a0839c5f947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:51.134187 30584 consensus_queue.cc:1048] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:51.141312 30615 raft_consensus.cc:993] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947: : Instructing follower a2c1f703ee334f54aaf22e4c25886102 to start an election
I20260709 13:22:51.141829 30615 raft_consensus.cc:1081] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Signalling peer a2c1f703ee334f54aaf22e4c25886102 to start an election
I20260709 13:22:51.144244 30384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04758565c2a646508349c072165e38f9"
dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
 from {username='slave'} at 127.0.0.1:35542
I20260709 13:22:51.145047 30384 raft_consensus.cc:493] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:51.145520 30384 raft_consensus.cc:3060] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:51.147797 30596 consensus_queue.cc:1048] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:51.162300 30384 raft_consensus.cc:515] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:51.163498 30385 raft_consensus.cc:1240] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Rejecting Update request from peer e72c3640883d4c0d88571a0839c5f947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:51.165510 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04758565c2a646508349c072165e38f9" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:51.165818 30615 consensus_queue.cc:1059] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:51.166868 30309 raft_consensus.cc:3055] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:51.167234 30309 raft_consensus.cc:740] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:51.168020 30309 consensus_queue.cc:260] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:51.168646 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04758565c2a646508349c072165e38f9" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:51.169104 30309 raft_consensus.cc:3060] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:51.171551 30384 leader_election.cc:290] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 2 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:51.179298 30309 raft_consensus.cc:2468] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 2.
W20260709 13:22:51.180037 30596 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:22:51.180795 30349 leader_election.cc:304] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 2f149ae7a84c46288c47962524d5240c
I20260709 13:22:51.181849 30601 raft_consensus.cc:2804] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:51.182371 30601 raft_consensus.cc:697] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [term 2 LEADER]: Becoming Leader. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Running, Role: LEADER
I20260709 13:22:51.183324 30601 consensus_queue.cc:237] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:51.193908 30615 consensus_queue.cc:1048] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:51.194221 30207 catalog_manager.cc:5697] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 reported cstate change: term changed from 1 to 2, leader changed from e72c3640883d4c0d88571a0839c5f947 (127.17.251.129) to a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "a2c1f703ee334f54aaf22e4c25886102" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:51.202142 30596 raft_consensus.cc:993] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947: : Instructing follower a2c1f703ee334f54aaf22e4c25886102 to start an election
I20260709 13:22:51.202721 30584 raft_consensus.cc:1081] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Signalling peer a2c1f703ee334f54aaf22e4c25886102 to start an election
I20260709 13:22:51.208375 30615 consensus_queue.cc:1048] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:51.211030 30384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5587a30b9c834ca0987f84ec30c35c32"
dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
 from {username='slave'} at 127.0.0.1:35542
I20260709 13:22:51.216835 30384 raft_consensus.cc:493] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:51.217399 30384 raft_consensus.cc:3060] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:51.224690 30384 raft_consensus.cc:515] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:51.228536 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5587a30b9c834ca0987f84ec30c35c32" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:51.228543 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5587a30b9c834ca0987f84ec30c35c32" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:51.229203 30309 raft_consensus.cc:3055] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:51.229656 30457 raft_consensus.cc:3060] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:51.229684 30309 raft_consensus.cc:740] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:51.230701 30309 consensus_queue.cc:260] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:51.231954 30309 raft_consensus.cc:3060] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:51.233855 30384 leader_election.cc:290] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 2 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:51.235486 30457 raft_consensus.cc:2468] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 2.
I20260709 13:22:51.236568 30351 leader_election.cc:304] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, a2c1f703ee334f54aaf22e4c25886102; no voters: 
I20260709 13:22:51.237300 30601 raft_consensus.cc:2804] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:51.237747 30601 raft_consensus.cc:697] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [term 2 LEADER]: Becoming Leader. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Running, Role: LEADER
I20260709 13:22:51.238675 30309 raft_consensus.cc:2468] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 2.
I20260709 13:22:51.238551 30601 consensus_queue.cc:237] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:51.247246 30205 catalog_manager.cc:5697] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 reported cstate change: term changed from 1 to 2, leader changed from e72c3640883d4c0d88571a0839c5f947 (127.17.251.129) to a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "a2c1f703ee334f54aaf22e4c25886102" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:51.300350 30596 raft_consensus.cc:993] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947: : Instructing follower a2c1f703ee334f54aaf22e4c25886102 to start an election
I20260709 13:22:51.300943 30615 raft_consensus.cc:1081] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Signalling peer a2c1f703ee334f54aaf22e4c25886102 to start an election
I20260709 13:22:51.302702 30384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d4922ebd8d54d42b96f5ba84599e71b"
dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
 from {username='slave'} at 127.0.0.1:35542
I20260709 13:22:51.303215 30384 raft_consensus.cc:493] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:51.303509 30384 raft_consensus.cc:3060] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:51.310387 30384 raft_consensus.cc:515] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:51.312127 30384 leader_election.cc:290] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 2 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:51.312990 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4922ebd8d54d42b96f5ba84599e71b" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:51.313354 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4922ebd8d54d42b96f5ba84599e71b" candidate_uuid: "a2c1f703ee334f54aaf22e4c25886102" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:51.313750 30309 raft_consensus.cc:3055] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:51.314021 30457 raft_consensus.cc:3060] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:51.314167 30309 raft_consensus.cc:740] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:51.315025 30309 consensus_queue.cc:260] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:51.315963 30309 raft_consensus.cc:3060] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:51.319453 30457 raft_consensus.cc:2468] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 2.
I20260709 13:22:51.320709 30351 leader_election.cc:304] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, a2c1f703ee334f54aaf22e4c25886102; no voters: 
I20260709 13:22:51.321465 30601 raft_consensus.cc:2804] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:51.321877 30309 raft_consensus.cc:2468] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2c1f703ee334f54aaf22e4c25886102 in term 2.
I20260709 13:22:51.322067 30601 raft_consensus.cc:697] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [term 2 LEADER]: Becoming Leader. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Running, Role: LEADER
I20260709 13:22:51.322961 30601 consensus_queue.cc:237] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:51.330200 30205 catalog_manager.cc:5697] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 reported cstate change: term changed from 1 to 2, leader changed from e72c3640883d4c0d88571a0839c5f947 (127.17.251.129) to a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "a2c1f703ee334f54aaf22e4c25886102" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:51.362725 30626 consensus_queue.cc:1048] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:51.374866 30668 consensus_queue.cc:1048] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:51.416747 30655 raft_consensus.cc:993] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c: : Instructing follower e72c3640883d4c0d88571a0839c5f947 to start an election
I20260709 13:22:51.417292 30668 raft_consensus.cc:1081] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Signalling peer e72c3640883d4c0d88571a0839c5f947 to start an election
I20260709 13:22:51.419005 30309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4067cde5d1274c7b9c494761260868bd"
dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
 from {username='slave'} at 127.0.0.1:36750
I20260709 13:22:51.419509 30309 raft_consensus.cc:493] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:51.419929 30309 raft_consensus.cc:3060] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:51.426317 30309 raft_consensus.cc:515] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:51.428889 30309 leader_election.cc:290] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 2 election: Requested vote from peers a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447), 2f149ae7a84c46288c47962524d5240c (127.17.251.131:33861)
I20260709 13:22:51.431046 30384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4067cde5d1274c7b9c494761260868bd" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:51.431102 30457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4067cde5d1274c7b9c494761260868bd" candidate_uuid: "e72c3640883d4c0d88571a0839c5f947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f149ae7a84c46288c47962524d5240c"
I20260709 13:22:51.431758 30457 raft_consensus.cc:3055] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:51.432078 30457 raft_consensus.cc:740] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Running, Role: LEADER
I20260709 13:22:51.432374 30384 raft_consensus.cc:3060] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:51.432865 30457 consensus_queue.cc:260] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:51.434187 30457 raft_consensus.cc:3060] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:51.439579 30384 raft_consensus.cc:2468] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 2.
I20260709 13:22:51.440924 30457 raft_consensus.cc:2468] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e72c3640883d4c0d88571a0839c5f947 in term 2.
I20260709 13:22:51.441025 30275 leader_election.cc:304] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2c1f703ee334f54aaf22e4c25886102, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:51.442081 30615 raft_consensus.cc:2804] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:51.442574 30615 raft_consensus.cc:697] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 2 LEADER]: Becoming Leader. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:51.443392 30615 consensus_queue.cc:237] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:51.450309 30207 catalog_manager.cc:5697] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 reported cstate change: term changed from 1 to 2, leader changed from 2f149ae7a84c46288c47962524d5240c (127.17.251.131) to e72c3640883d4c0d88571a0839c5f947 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "e72c3640883d4c0d88571a0839c5f947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:51.486820 30384 raft_consensus.cc:1275] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Refusing update from remote peer e72c3640883d4c0d88571a0839c5f947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:51.488632 30596 consensus_queue.cc:1048] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:51.498154 30457 raft_consensus.cc:1275] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Refusing update from remote peer e72c3640883d4c0d88571a0839c5f947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:51.499684 30596 consensus_queue.cc:1048] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:51.569516 30457 raft_consensus.cc:3060] T 04758565c2a646508349c072165e38f9 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:51.574554 30457 raft_consensus.cc:1275] T 04758565c2a646508349c072165e38f9 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Refusing update from remote peer a2c1f703ee334f54aaf22e4c25886102: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:51.575850 30583 consensus_queue.cc:1048] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:51.583649 30307 raft_consensus.cc:1275] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Refusing update from remote peer a2c1f703ee334f54aaf22e4c25886102: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:51.585211 30652 consensus_queue.cc:1048] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:51.742192 30457 raft_consensus.cc:1275] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Refusing update from remote peer a2c1f703ee334f54aaf22e4c25886102: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:51.743542 30652 consensus_queue.cc:1048] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:51.751984 30307 raft_consensus.cc:1275] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Refusing update from remote peer a2c1f703ee334f54aaf22e4c25886102: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:51.753805 30583 consensus_queue.cc:1048] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:51.870159 30307 raft_consensus.cc:1275] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Refusing update from remote peer a2c1f703ee334f54aaf22e4c25886102: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:51.871827 30583 consensus_queue.cc:1048] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:51.879594 30459 raft_consensus.cc:1275] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Refusing update from remote peer a2c1f703ee334f54aaf22e4c25886102: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:51.882282 30601 consensus_queue.cc:1048] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:51.925714 30457 raft_consensus.cc:1275] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Refusing update from remote peer e72c3640883d4c0d88571a0839c5f947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:51.926975 30615 consensus_queue.cc:1048] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:51.934460 30385 raft_consensus.cc:1275] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Refusing update from remote peer e72c3640883d4c0d88571a0839c5f947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:51.935998 30633 consensus_queue.cc:1048] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:54.060672 30207 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60026:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:22:54.080966 30207 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60026:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:22:54.185650 18414 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:22:54.235657 30349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.129:34845, user_credentials={real_user=slave}} blocked reactor thread for 78896.2us
I20260709 13:22:54.289196 30714 tablet.cc:1724] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:54.322741 30411 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:8d4922ebd8d54d42b96f5ba84599e71b)
W20260709 13:22:54.333278 30411 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:8d4922ebd8d54d42b96f5ba84599e71b)
W20260709 13:22:54.334875 30411 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:8d4922ebd8d54d42b96f5ba84599e71b)
I20260709 13:22:54.362941 30727 tablet.cc:1724] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:54.382097 30717 log.cc:927] Time spent T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:22:54.437474 30729 tablet.cc:1724] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.455106 30735 tablet.cc:1724] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.446887 30731 tablet.cc:1724] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:54.496114 30275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.130:33447, user_credentials={real_user=slave}} blocked reactor thread for 74185.2us
I20260709 13:22:54.522251 30742 tablet.cc:1724] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.398783 30720 tablet.cc:1724] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.466094 30738 tablet.cc:1724] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.596576 30745 tablet.cc:1724] T 1ed9e678f5f74f0697bcb9858e4330f8 P 2f149ae7a84c46288c47962524d5240c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.622695 30309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4067cde5d1274c7b9c494761260868bd"
dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
mode: GRACEFUL
new_leader_uuid: "2f149ae7a84c46288c47962524d5240c"
 from {username='slave'} at 127.0.0.1:58564
I20260709 13:22:54.623790 30309 raft_consensus.cc:606] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 2 LEADER]: Received request to transfer leadership to TS 2f149ae7a84c46288c47962524d5240c
I20260709 13:22:54.630323 30740 tablet.cc:1724] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.518970 30744 tablet.cc:1724] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.666254 30738 tablet.cc:1724] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.676244 30747 tablet.cc:1724] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.680099 30727 tablet.cc:1724] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.692185 30745 tablet.cc:1724] T 949b6bfe52ed4ced899250cbc0613304 P 2f149ae7a84c46288c47962524d5240c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.664944 30729 tablet.cc:1724] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:54.695298 30351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.251.131:33861, user_credentials={real_user=slave}} blocked reactor thread for 95201.3us
I20260709 13:22:54.697506 30713 raft_consensus.cc:993] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947: : Instructing follower 2f149ae7a84c46288c47962524d5240c to start an election
I20260709 13:22:54.698164 30713 raft_consensus.cc:1081] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 2 LEADER]: Signalling peer 2f149ae7a84c46288c47962524d5240c to start an election
I20260709 13:22:54.700407 30714 tablet.cc:1724] T 1ed9e678f5f74f0697bcb9858e4330f8 P a2c1f703ee334f54aaf22e4c25886102: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.703287 30735 tablet.cc:1724] T 516496d8276142fea3b6466e33910497 P e72c3640883d4c0d88571a0839c5f947: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.706585 30454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4067cde5d1274c7b9c494761260868bd"
dest_uuid: "2f149ae7a84c46288c47962524d5240c"
 from {username='slave'} at 127.0.0.1:49280
I20260709 13:22:54.709054 30454 raft_consensus.cc:493] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:54.712075 30454 raft_consensus.cc:3060] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:54.719308 30731 tablet.cc:1724] T 516496d8276142fea3b6466e33910497 P a2c1f703ee334f54aaf22e4c25886102: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.723515 30738 tablet.cc:1724] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.743556 30745 tablet.cc:1724] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.719317 30720 tablet.cc:1724] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.750809 30454 raft_consensus.cc:515] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:54.731906 30742 tablet.cc:1724] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.767082 30456 raft_consensus.cc:1240] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 3 FOLLOWER]: Rejecting Update request from peer e72c3640883d4c0d88571a0839c5f947 for earlier term 2. Current term is 3. Ops: []
I20260709 13:22:54.767659 30729 tablet.cc:1724] T 949b6bfe52ed4ced899250cbc0613304 P a2c1f703ee334f54aaf22e4c25886102: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.768767 30454 leader_election.cc:290] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 3 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:54.769160 30307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4067cde5d1274c7b9c494761260868bd" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:54.770051 30307 raft_consensus.cc:3055] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:54.770362 30307 raft_consensus.cc:740] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:54.771301 30307 consensus_queue.cc:260] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:54.772717 30383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4067cde5d1274c7b9c494761260868bd" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:54.773103 30307 raft_consensus.cc:3060] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:22:54.773837 30713 consensus_queue.cc:1175] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2f149ae7a84c46288c47962524d5240c" responder_term: 3 status { last_received { term: 2 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e72c3640883d4c0d88571a0839c5f947 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:22:54.773536 30383 raft_consensus.cc:3060] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:54.760871 30735 tablet.cc:1724] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.788123 30738 tablet.cc:1724] T 04758565c2a646508349c072165e38f9 P 2f149ae7a84c46288c47962524d5240c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.799701 30731 tablet.cc:1724] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:54.807869 30307 raft_consensus.cc:2468] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 3.
I20260709 13:22:54.816781 30423 leader_election.cc:304] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:54.817945 30668 raft_consensus.cc:2804] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:54.818503 30668 raft_consensus.cc:697] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 3 LEADER]: Becoming Leader. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Running, Role: LEADER
I20260709 13:22:54.819531 30668 consensus_queue.cc:237] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:54.820096 30383 raft_consensus.cc:2468] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 3.
I20260709 13:22:54.828703 30383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c84b4be1bf0d4bcd88c34e94305b60e3"
dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
mode: GRACEFUL
new_leader_uuid: "2f149ae7a84c46288c47962524d5240c"
 from {username='slave'} at 127.0.0.1:55304
I20260709 13:22:54.829893 30383 raft_consensus.cc:606] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Received request to transfer leadership to TS 2f149ae7a84c46288c47962524d5240c
I20260709 13:22:54.832154 18414 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:22:54.833673 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:54.840498 30207 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8: soft_deleted_table [id=202e0a6396e7426390d0417bfeac183f] alter complete (version 1)
I20260709 13:22:54.850986 30383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6650c8247d604ebbb4f9c9105acb6edf"
dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
mode: GRACEFUL
new_leader_uuid: "2f149ae7a84c46288c47962524d5240c"
 from {username='slave'} at 127.0.0.1:55304
I20260709 13:22:54.854470 30206 catalog_manager.cc:5697] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c reported cstate change: term changed from 2 to 3, leader changed from e72c3640883d4c0d88571a0839c5f947 (127.17.251.129) to 2f149ae7a84c46288c47962524d5240c (127.17.251.131). New cstate: current_term: 3 leader_uuid: "2f149ae7a84c46288c47962524d5240c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:54.856061 30383 raft_consensus.cc:606] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Received request to transfer leadership to TS 2f149ae7a84c46288c47962524d5240c
I20260709 13:22:54.859197 30309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c353b5fb791243328ce69dee051716c8"
dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
mode: GRACEFUL
new_leader_uuid: "2f149ae7a84c46288c47962524d5240c"
 from {username='slave'} at 127.0.0.1:58564
I20260709 13:22:54.859831 30309 raft_consensus.cc:606] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 2 LEADER]: Received request to transfer leadership to TS 2f149ae7a84c46288c47962524d5240c
I20260709 13:22:54.861137 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:54.861733 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:54.957796 30694 raft_consensus.cc:993] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102: : Instructing follower 2f149ae7a84c46288c47962524d5240c to start an election
I20260709 13:22:54.958498 30703 raft_consensus.cc:1081] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Signalling peer 2f149ae7a84c46288c47962524d5240c to start an election
I20260709 13:22:54.959954 30454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c84b4be1bf0d4bcd88c34e94305b60e3"
dest_uuid: "2f149ae7a84c46288c47962524d5240c"
 from {username='slave'} at 127.0.0.1:49286
I20260709 13:22:54.960481 30454 raft_consensus.cc:493] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:54.960806 30454 raft_consensus.cc:3060] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:54.966964 30454 raft_consensus.cc:515] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:54.968770 30454 leader_election.cc:290] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 2 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:54.969710 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84b4be1bf0d4bcd88c34e94305b60e3" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:54.970180 30383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84b4be1bf0d4bcd88c34e94305b60e3" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:54.970491 30309 raft_consensus.cc:3060] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:54.970821 30383 raft_consensus.cc:3055] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:54.971194 30383 raft_consensus.cc:740] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Running, Role: LEADER
I20260709 13:22:54.972026 30383 consensus_queue.cc:260] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:54.973663 30383 raft_consensus.cc:3060] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:54.977672 30309 raft_consensus.cc:2468] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 2.
I20260709 13:22:54.978951 30423 leader_election.cc:304] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:54.979748 30668 raft_consensus.cc:2804] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:54.980130 30383 raft_consensus.cc:2468] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 2.
I20260709 13:22:54.980189 30668 raft_consensus.cc:697] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [term 2 LEADER]: Becoming Leader. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Running, Role: LEADER
I20260709 13:22:54.981383 30668 consensus_queue.cc:237] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:54.989215 30206 catalog_manager.cc:5697] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c reported cstate change: term changed from 1 to 2, leader changed from a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130) to 2f149ae7a84c46288c47962524d5240c (127.17.251.131). New cstate: current_term: 2 leader_uuid: "2f149ae7a84c46288c47962524d5240c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:55.008793 30674 raft_consensus.cc:993] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947: : Instructing follower 2f149ae7a84c46288c47962524d5240c to start an election
I20260709 13:22:55.009341 30713 raft_consensus.cc:1081] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 2 LEADER]: Signalling peer 2f149ae7a84c46288c47962524d5240c to start an election
I20260709 13:22:55.010916 30454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c353b5fb791243328ce69dee051716c8"
dest_uuid: "2f149ae7a84c46288c47962524d5240c"
 from {username='slave'} at 127.0.0.1:49280
I20260709 13:22:55.011420 30454 raft_consensus.cc:493] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:55.011739 30454 raft_consensus.cc:3060] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:55.017831 30454 raft_consensus.cc:515] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:55.019626 30454 leader_election.cc:290] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 3 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:55.020514 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c353b5fb791243328ce69dee051716c8" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:55.020627 30383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c353b5fb791243328ce69dee051716c8" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:55.021340 30309 raft_consensus.cc:3055] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:55.021404 30383 raft_consensus.cc:3060] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:55.021814 30309 raft_consensus.cc:740] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e72c3640883d4c0d88571a0839c5f947, State: Running, Role: LEADER
I20260709 13:22:55.022720 30309 consensus_queue.cc:260] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:55.024060 30309 raft_consensus.cc:3060] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:55.029078 30383 raft_consensus.cc:2468] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 3.
I20260709 13:22:55.031363 30309 raft_consensus.cc:2468] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 3.
I20260709 13:22:55.031772 30424 leader_election.cc:304] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, a2c1f703ee334f54aaf22e4c25886102; no voters: 
I20260709 13:22:55.032742 30668 raft_consensus.cc:2804] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:55.033221 30668 raft_consensus.cc:697] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 3 LEADER]: Becoming Leader. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Running, Role: LEADER
I20260709 13:22:55.034186 30668 consensus_queue.cc:237] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:55.042657 30206 catalog_manager.cc:5697] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c reported cstate change: term changed from 2 to 3, leader changed from e72c3640883d4c0d88571a0839c5f947 (127.17.251.129) to 2f149ae7a84c46288c47962524d5240c (127.17.251.131). New cstate: current_term: 3 leader_uuid: "2f149ae7a84c46288c47962524d5240c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:55.251919 30746 raft_consensus.cc:993] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102: : Instructing follower 2f149ae7a84c46288c47962524d5240c to start an election
I20260709 13:22:55.252375 30703 raft_consensus.cc:1081] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Signalling peer 2f149ae7a84c46288c47962524d5240c to start an election
I20260709 13:22:55.253943 30454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6650c8247d604ebbb4f9c9105acb6edf"
dest_uuid: "2f149ae7a84c46288c47962524d5240c"
 from {username='slave'} at 127.0.0.1:49286
I20260709 13:22:55.254441 30454 raft_consensus.cc:493] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:55.254755 30454 raft_consensus.cc:3060] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:55.260285 30454 raft_consensus.cc:515] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:55.262435 30454 leader_election.cc:290] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 2 election: Requested vote from peers e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845), a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447)
I20260709 13:22:55.263412 30309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6650c8247d604ebbb4f9c9105acb6edf" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e72c3640883d4c0d88571a0839c5f947"
I20260709 13:22:55.263978 30385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6650c8247d604ebbb4f9c9105acb6edf" candidate_uuid: "2f149ae7a84c46288c47962524d5240c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2c1f703ee334f54aaf22e4c25886102"
I20260709 13:22:55.264132 30309 raft_consensus.cc:3060] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:55.264580 30385 raft_consensus.cc:3055] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:55.264899 30385 raft_consensus.cc:740] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2c1f703ee334f54aaf22e4c25886102, State: Running, Role: LEADER
I20260709 13:22:55.265699 30385 consensus_queue.cc:260] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:55.266772 30385 raft_consensus.cc:3060] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:55.272145 30309 raft_consensus.cc:2468] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 2.
I20260709 13:22:55.272990 30308 raft_consensus.cc:1240] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Rejecting Update request from peer a2c1f703ee334f54aaf22e4c25886102 for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:55.273661 30423 leader_election.cc:304] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f149ae7a84c46288c47962524d5240c, e72c3640883d4c0d88571a0839c5f947; no voters: 
I20260709 13:22:55.274549 30668 raft_consensus.cc:2804] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:55.275027 30668 raft_consensus.cc:697] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [term 2 LEADER]: Becoming Leader. State: Replica: 2f149ae7a84c46288c47962524d5240c, State: Running, Role: LEADER
I20260709 13:22:55.275892 30385 raft_consensus.cc:2468] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f149ae7a84c46288c47962524d5240c in term 2.
I20260709 13:22:55.276057 30668 consensus_queue.cc:237] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } }
I20260709 13:22:55.283946 30206 catalog_manager.cc:5697] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c reported cstate change: term changed from 1 to 2, leader changed from a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130) to 2f149ae7a84c46288c47962524d5240c (127.17.251.131). New cstate: current_term: 2 leader_uuid: "2f149ae7a84c46288c47962524d5240c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f149ae7a84c46288c47962524d5240c" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 33861 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:55.299254 30385 raft_consensus.cc:1275] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102 [term 3 FOLLOWER]: Refusing update from remote peer 2f149ae7a84c46288c47962524d5240c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:22:55.300379 30668 consensus_queue.cc:1048] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:55.309141 30308 raft_consensus.cc:1275] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 3 FOLLOWER]: Refusing update from remote peer 2f149ae7a84c46288c47962524d5240c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:22:55.310789 30668 consensus_queue.cc:1048] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:55.477890 30308 raft_consensus.cc:1275] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Refusing update from remote peer 2f149ae7a84c46288c47962524d5240c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:22:55.479147 30668 consensus_queue.cc:1048] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:55.487103 30385 raft_consensus.cc:1275] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Refusing update from remote peer 2f149ae7a84c46288c47962524d5240c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:22:55.488739 30728 consensus_queue.cc:1048] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:55.510794 30385 raft_consensus.cc:1275] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [term 3 FOLLOWER]: Refusing update from remote peer 2f149ae7a84c46288c47962524d5240c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:55.512099 30728 consensus_queue.cc:1048] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:55.521332 30308 raft_consensus.cc:1275] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 3 FOLLOWER]: Refusing update from remote peer 2f149ae7a84c46288c47962524d5240c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:55.523063 30668 consensus_queue.cc:1048] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:55.695703 30309 raft_consensus.cc:1275] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Refusing update from remote peer 2f149ae7a84c46288c47962524d5240c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:55.696954 30668 consensus_queue.cc:1048] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72c3640883d4c0d88571a0839c5f947" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:55.713168 30385 raft_consensus.cc:1275] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Refusing update from remote peer 2f149ae7a84c46288c47962524d5240c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:55.714576 30668 consensus_queue.cc:1048] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c1f703ee334f54aaf22e4c25886102" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 33447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:55.919858 18414 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:22:55.925705 18414 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:22:55.926288 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:55.934943 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:22:55.935621 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:56.965152 18414 tablet_server.cc:179] TabletServer@127.17.251.129:0 shutting down...
I20260709 13:22:57.001724 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:57.002633 18414 tablet_replica.cc:333] T 516496d8276142fea3b6466e33910497 P e72c3640883d4c0d88571a0839c5f947: stopping tablet replica
I20260709 13:22:57.003407 18414 raft_consensus.cc:2243] T 516496d8276142fea3b6466e33910497 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.003993 18414 raft_consensus.cc:2272] T 516496d8276142fea3b6466e33910497 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.006521 18414 tablet_replica.cc:333] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947: stopping tablet replica
I20260709 13:22:57.007738 18414 raft_consensus.cc:2243] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.008554 18414 raft_consensus.cc:2272] T c84b4be1bf0d4bcd88c34e94305b60e3 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:57.009403 30349 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
I20260709 13:22:57.011344 18414 tablet_replica.cc:333] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947: stopping tablet replica
I20260709 13:22:57.012377 18414 raft_consensus.cc:2243] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:57.012686 30349 consensus_peers.cc:597] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 -> Peer e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845): Couldn't send request to peer e72c3640883d4c0d88571a0839c5f947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:57.013096 18414 raft_consensus.cc:2272] T 5587a30b9c834ca0987f84ec30c35c32 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.015588 18414 tablet_replica.cc:333] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947: stopping tablet replica
I20260709 13:22:57.016340 18414 raft_consensus.cc:2243] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.016865 18414 raft_consensus.cc:2272] T 04758565c2a646508349c072165e38f9 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.019109 18414 tablet_replica.cc:333] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947: stopping tablet replica
I20260709 13:22:57.019750 18414 raft_consensus.cc:2243] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.020287 18414 raft_consensus.cc:2272] T 8d4922ebd8d54d42b96f5ba84599e71b P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.022466 18414 tablet_replica.cc:333] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947: stopping tablet replica
I20260709 13:22:57.023026 18414 raft_consensus.cc:2243] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:57.023806 18414 raft_consensus.cc:2272] T 949b6bfe52ed4ced899250cbc0613304 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.026037 18414 tablet_replica.cc:333] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947: stopping tablet replica
I20260709 13:22:57.026793 18414 raft_consensus.cc:2243] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:57.027597 18414 raft_consensus.cc:2272] T 1ed9e678f5f74f0697bcb9858e4330f8 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.029902 18414 tablet_replica.cc:333] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947: stopping tablet replica
I20260709 13:22:57.030437 18414 raft_consensus.cc:2243] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.030814 18414 raft_consensus.cc:2272] T c353b5fb791243328ce69dee051716c8 P e72c3640883d4c0d88571a0839c5f947 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.032960 18414 tablet_replica.cc:333] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947: stopping tablet replica
I20260709 13:22:57.033546 18414 raft_consensus.cc:2243] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:57.034363 18414 raft_consensus.cc:2272] T f4d7af6286a04a0ca3ef0aaa869b5223 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.036415 18414 tablet_replica.cc:333] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947: stopping tablet replica
I20260709 13:22:57.036995 18414 raft_consensus.cc:2243] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:57.037778 18414 raft_consensus.cc:2272] T 7a990d537d854b3793ccf4c5bc144715 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.039893 18414 tablet_replica.cc:333] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947: stopping tablet replica
I20260709 13:22:57.040514 18414 raft_consensus.cc:2243] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.041028 18414 raft_consensus.cc:2272] T 3a00e306130342489b1cea7120ab1b62 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.043294 18414 tablet_replica.cc:333] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947: stopping tablet replica
I20260709 13:22:57.043880 18414 raft_consensus.cc:2243] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.044335 18414 raft_consensus.cc:2272] T 6650c8247d604ebbb4f9c9105acb6edf P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.046509 18414 tablet_replica.cc:333] T f2f6c2ce665341a2add61bcbcf5c3422 P e72c3640883d4c0d88571a0839c5f947: stopping tablet replica
I20260709 13:22:57.047053 18414 raft_consensus.cc:2243] T f2f6c2ce665341a2add61bcbcf5c3422 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.047500 18414 raft_consensus.cc:2272] T f2f6c2ce665341a2add61bcbcf5c3422 P e72c3640883d4c0d88571a0839c5f947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.049686 18414 tablet_replica.cc:333] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947: stopping tablet replica
I20260709 13:22:57.050269 18414 raft_consensus.cc:2243] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.050762 18414 raft_consensus.cc:2272] T 588be62bafd94913b204edb157d4ba7e P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.053089 18414 tablet_replica.cc:333] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947: stopping tablet replica
I20260709 13:22:57.053697 18414 raft_consensus.cc:2243] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:57.054627 18414 raft_consensus.cc:2272] T de5915d8c7314cd48dd19e7d16167e66 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.056810 18414 tablet_replica.cc:333] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947: stopping tablet replica
I20260709 13:22:57.057394 18414 raft_consensus.cc:2243] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.057904 18414 raft_consensus.cc:2272] T f0e430433b8145deab5c06f7847d3e24 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.060425 18414 tablet_replica.cc:333] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947: stopping tablet replica
I20260709 13:22:57.061106 18414 raft_consensus.cc:2243] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:57.062071 18414 raft_consensus.cc:2272] T e5f9e4f158f64b23bb4c0ca79a584d63 P e72c3640883d4c0d88571a0839c5f947 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.064674 18414 tablet_replica.cc:333] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947: stopping tablet replica
I20260709 13:22:57.065158 18414 raft_consensus.cc:2243] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.065651 18414 raft_consensus.cc:2272] T 4067cde5d1274c7b9c494761260868bd P e72c3640883d4c0d88571a0839c5f947 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:57.086007 30423 consensus_peers.cc:597] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c -> Peer e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845): Couldn't send request to peer e72c3640883d4c0d88571a0839c5f947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:57.109035 18414 tablet_server.cc:196] TabletServer@127.17.251.129:0 shutdown complete.
I20260709 13:22:57.147447 18414 tablet_server.cc:179] TabletServer@127.17.251.130:0 shutting down...
W20260709 13:22:57.177953 30424 consensus_peers.cc:597] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c -> Peer a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447): Couldn't send request to peer a2c1f703ee334f54aaf22e4c25886102. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:57.179765 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:57.180755 18414 tablet_replica.cc:333] T 516496d8276142fea3b6466e33910497 P a2c1f703ee334f54aaf22e4c25886102: stopping tablet replica
I20260709 13:22:57.181850 18414 raft_consensus.cc:2243] T 516496d8276142fea3b6466e33910497 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.182600 18414 raft_consensus.cc:2272] T 516496d8276142fea3b6466e33910497 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:57.182642 30423 consensus_peers.cc:597] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c -> Peer e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845): Couldn't send request to peer e72c3640883d4c0d88571a0839c5f947. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:34845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:57.184859 18414 tablet_replica.cc:333] T 1ed9e678f5f74f0697bcb9858e4330f8 P a2c1f703ee334f54aaf22e4c25886102: stopping tablet replica
I20260709 13:22:57.185564 18414 raft_consensus.cc:2243] T 1ed9e678f5f74f0697bcb9858e4330f8 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.186153 18414 raft_consensus.cc:2272] T 1ed9e678f5f74f0697bcb9858e4330f8 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.188315 18414 tablet_replica.cc:333] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102: stopping tablet replica
I20260709 13:22:57.189134 18414 raft_consensus.cc:2243] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.189800 18414 raft_consensus.cc:2272] T 4067cde5d1274c7b9c494761260868bd P a2c1f703ee334f54aaf22e4c25886102 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.191987 18414 tablet_replica.cc:333] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102: stopping tablet replica
I20260709 13:22:57.192869 18414 raft_consensus.cc:2243] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:57.193938 18414 raft_consensus.cc:2272] T 5587a30b9c834ca0987f84ec30c35c32 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:57.194434 30349 consensus_peers.cc:597] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 -> Peer e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845): Couldn't send request to peer e72c3640883d4c0d88571a0839c5f947. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:34845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:57.197057 18414 tablet_replica.cc:333] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102: stopping tablet replica
I20260709 13:22:57.198027 18414 raft_consensus.cc:2243] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:22:57.198764 30423 consensus_peers.cc:597] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c -> Peer e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845): Couldn't send request to peer e72c3640883d4c0d88571a0839c5f947. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:34845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:57.199193 18414 raft_consensus.cc:2272] T 04758565c2a646508349c072165e38f9 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.202229 18414 tablet_replica.cc:333] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102: stopping tablet replica
I20260709 13:22:57.203097 18414 raft_consensus.cc:2243] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:22:57.203122 30349 consensus_peers.cc:597] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 -> Peer e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845): Couldn't send request to peer e72c3640883d4c0d88571a0839c5f947. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:34845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:57.204133 18414 raft_consensus.cc:2272] T 8d4922ebd8d54d42b96f5ba84599e71b P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.206322 18414 tablet_replica.cc:333] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102: stopping tablet replica
I20260709 13:22:57.206921 18414 raft_consensus.cc:2243] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.207301 18414 raft_consensus.cc:2272] T c84b4be1bf0d4bcd88c34e94305b60e3 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.209700 18414 tablet_replica.cc:333] T 7a990d537d854b3793ccf4c5bc144715 P a2c1f703ee334f54aaf22e4c25886102: stopping tablet replica
I20260709 13:22:57.210348 18414 raft_consensus.cc:2243] T 7a990d537d854b3793ccf4c5bc144715 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.210850 18414 raft_consensus.cc:2272] T 7a990d537d854b3793ccf4c5bc144715 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:57.212697 30424 consensus_peers.cc:597] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c -> Peer a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447): Couldn't send request to peer a2c1f703ee334f54aaf22e4c25886102. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:57.213753 18414 tablet_replica.cc:333] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102: stopping tablet replica
I20260709 13:22:57.214439 18414 raft_consensus.cc:2243] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.214991 18414 raft_consensus.cc:2272] T f4d7af6286a04a0ca3ef0aaa869b5223 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.216955 18414 tablet_replica.cc:333] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102: stopping tablet replica
I20260709 13:22:57.217460 18414 raft_consensus.cc:2243] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:57.218385 18414 raft_consensus.cc:2272] T 3a00e306130342489b1cea7120ab1b62 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.220554 18414 tablet_replica.cc:333] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102: stopping tablet replica
I20260709 13:22:57.221101 18414 raft_consensus.cc:2243] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.221524 18414 raft_consensus.cc:2272] T 6650c8247d604ebbb4f9c9105acb6edf P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.223690 18414 tablet_replica.cc:333] T 949b6bfe52ed4ced899250cbc0613304 P a2c1f703ee334f54aaf22e4c25886102: stopping tablet replica
I20260709 13:22:57.224242 18414 raft_consensus.cc:2243] T 949b6bfe52ed4ced899250cbc0613304 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.224722 18414 raft_consensus.cc:2272] T 949b6bfe52ed4ced899250cbc0613304 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.226835 18414 tablet_replica.cc:333] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102: stopping tablet replica
I20260709 13:22:57.227387 18414 raft_consensus.cc:2243] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:57.228242 18414 raft_consensus.cc:2272] T 588be62bafd94913b204edb157d4ba7e P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.230330 18414 tablet_replica.cc:333] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102: stopping tablet replica
I20260709 13:22:57.230876 18414 raft_consensus.cc:2243] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.231338 18414 raft_consensus.cc:2272] T de5915d8c7314cd48dd19e7d16167e66 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.233556 18414 tablet_replica.cc:333] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102: stopping tablet replica
I20260709 13:22:57.234100 18414 raft_consensus.cc:2243] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.234553 18414 raft_consensus.cc:2272] T f2f6c2ce665341a2add61bcbcf5c3422 P a2c1f703ee334f54aaf22e4c25886102 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.236685 18414 tablet_replica.cc:333] T e5f9e4f158f64b23bb4c0ca79a584d63 P a2c1f703ee334f54aaf22e4c25886102: stopping tablet replica
I20260709 13:22:57.237201 18414 raft_consensus.cc:2243] T e5f9e4f158f64b23bb4c0ca79a584d63 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.237715 18414 raft_consensus.cc:2272] T e5f9e4f158f64b23bb4c0ca79a584d63 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.239784 18414 tablet_replica.cc:333] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102: stopping tablet replica
I20260709 13:22:57.240422 18414 raft_consensus.cc:2243] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:57.241442 18414 raft_consensus.cc:2272] T f0e430433b8145deab5c06f7847d3e24 P a2c1f703ee334f54aaf22e4c25886102 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.244282 18414 tablet_replica.cc:333] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102: stopping tablet replica
I20260709 13:22:57.244972 18414 raft_consensus.cc:2243] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.245545 18414 raft_consensus.cc:2272] T c353b5fb791243328ce69dee051716c8 P a2c1f703ee334f54aaf22e4c25886102 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:57.257386 30423 consensus_peers.cc:597] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c -> Peer e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845): Couldn't send request to peer e72c3640883d4c0d88571a0839c5f947. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:34845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:57.289269 18414 tablet_server.cc:196] TabletServer@127.17.251.130:0 shutdown complete.
W20260709 13:22:57.302027 30423 consensus_peers.cc:597] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c -> Peer e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845): Couldn't send request to peer e72c3640883d4c0d88571a0839c5f947. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:34845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:57.329317 30424 consensus_peers.cc:597] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c -> Peer a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447): Couldn't send request to peer a2c1f703ee334f54aaf22e4c25886102. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:33447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:57.333261 18414 tablet_server.cc:179] TabletServer@127.17.251.131:0 shutting down...
W20260709 13:22:57.342744 30424 consensus_peers.cc:597] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c -> Peer a2c1f703ee334f54aaf22e4c25886102 (127.17.251.130:33447): Couldn't send request to peer a2c1f703ee334f54aaf22e4c25886102. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:33447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:57.366446 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:57.367393 18414 tablet_replica.cc:333] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c: stopping tablet replica
I20260709 13:22:57.368465 18414 raft_consensus.cc:2243] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:57.369725 18414 raft_consensus.cc:2272] T c84b4be1bf0d4bcd88c34e94305b60e3 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.372031 18414 tablet_replica.cc:333] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c: stopping tablet replica
I20260709 13:22:57.372856 18414 raft_consensus.cc:2243] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:57.374104 18414 raft_consensus.cc:2272] T 516496d8276142fea3b6466e33910497 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.377449 18414 tablet_replica.cc:333] T 1ed9e678f5f74f0697bcb9858e4330f8 P 2f149ae7a84c46288c47962524d5240c: stopping tablet replica
W20260709 13:22:57.378464 30423 consensus_peers.cc:597] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c -> Peer e72c3640883d4c0d88571a0839c5f947 (127.17.251.129:34845): Couldn't send request to peer e72c3640883d4c0d88571a0839c5f947. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:34845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:57.378495 18414 raft_consensus.cc:2243] T 1ed9e678f5f74f0697bcb9858e4330f8 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.379290 18414 raft_consensus.cc:2272] T 1ed9e678f5f74f0697bcb9858e4330f8 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.381572 18414 tablet_replica.cc:333] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c: stopping tablet replica
I20260709 13:22:57.382301 18414 raft_consensus.cc:2243] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.382810 18414 raft_consensus.cc:2272] T 5587a30b9c834ca0987f84ec30c35c32 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.384915 18414 tablet_replica.cc:333] T 04758565c2a646508349c072165e38f9 P 2f149ae7a84c46288c47962524d5240c: stopping tablet replica
I20260709 13:22:57.385550 18414 raft_consensus.cc:2243] T 04758565c2a646508349c072165e38f9 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.386224 18414 raft_consensus.cc:2272] T 04758565c2a646508349c072165e38f9 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.388311 18414 tablet_replica.cc:333] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c: stopping tablet replica
I20260709 13:22:57.388993 18414 raft_consensus.cc:2243] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.389515 18414 raft_consensus.cc:2272] T 8d4922ebd8d54d42b96f5ba84599e71b P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.391768 18414 tablet_replica.cc:333] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c: stopping tablet replica
I20260709 13:22:57.392413 18414 raft_consensus.cc:2243] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:57.393297 18414 raft_consensus.cc:2272] T c353b5fb791243328ce69dee051716c8 P 2f149ae7a84c46288c47962524d5240c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.395797 18414 tablet_replica.cc:333] T 949b6bfe52ed4ced899250cbc0613304 P 2f149ae7a84c46288c47962524d5240c: stopping tablet replica
I20260709 13:22:57.396428 18414 raft_consensus.cc:2243] T 949b6bfe52ed4ced899250cbc0613304 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.396942 18414 raft_consensus.cc:2272] T 949b6bfe52ed4ced899250cbc0613304 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.399233 18414 tablet_replica.cc:333] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c: stopping tablet replica
I20260709 13:22:57.399883 18414 raft_consensus.cc:2243] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.400414 18414 raft_consensus.cc:2272] T 588be62bafd94913b204edb157d4ba7e P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.402894 18414 tablet_replica.cc:333] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c: stopping tablet replica
I20260709 13:22:57.403527 18414 raft_consensus.cc:2243] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.404037 18414 raft_consensus.cc:2272] T de5915d8c7314cd48dd19e7d16167e66 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.406373 18414 tablet_replica.cc:333] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c: stopping tablet replica
I20260709 13:22:57.407094 18414 raft_consensus.cc:2243] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:57.408059 18414 raft_consensus.cc:2272] T f2f6c2ce665341a2add61bcbcf5c3422 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.410511 18414 tablet_replica.cc:333] T f0e430433b8145deab5c06f7847d3e24 P 2f149ae7a84c46288c47962524d5240c: stopping tablet replica
I20260709 13:22:57.411158 18414 raft_consensus.cc:2243] T f0e430433b8145deab5c06f7847d3e24 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.411645 18414 raft_consensus.cc:2272] T f0e430433b8145deab5c06f7847d3e24 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.414098 18414 tablet_replica.cc:333] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c: stopping tablet replica
I20260709 13:22:57.414812 18414 raft_consensus.cc:2243] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.415426 18414 raft_consensus.cc:2272] T e5f9e4f158f64b23bb4c0ca79a584d63 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.417650 18414 tablet_replica.cc:333] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c: stopping tablet replica
I20260709 13:22:57.418247 18414 raft_consensus.cc:2243] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.418735 18414 raft_consensus.cc:2272] T f4d7af6286a04a0ca3ef0aaa869b5223 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.420842 18414 tablet_replica.cc:333] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c: stopping tablet replica
I20260709 13:22:57.421447 18414 raft_consensus.cc:2243] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.421953 18414 raft_consensus.cc:2272] T 7a990d537d854b3793ccf4c5bc144715 P 2f149ae7a84c46288c47962524d5240c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.424098 18414 tablet_replica.cc:333] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c: stopping tablet replica
I20260709 13:22:57.424671 18414 raft_consensus.cc:2243] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:57.425194 18414 raft_consensus.cc:2272] T 3a00e306130342489b1cea7120ab1b62 P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.427376 18414 tablet_replica.cc:333] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c: stopping tablet replica
I20260709 13:22:57.427932 18414 raft_consensus.cc:2243] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:57.428776 18414 raft_consensus.cc:2272] T 6650c8247d604ebbb4f9c9105acb6edf P 2f149ae7a84c46288c47962524d5240c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.430884 18414 tablet_replica.cc:333] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c: stopping tablet replica
I20260709 13:22:57.431401 18414 raft_consensus.cc:2243] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:57.432219 18414 raft_consensus.cc:2272] T 4067cde5d1274c7b9c494761260868bd P 2f149ae7a84c46288c47962524d5240c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.473711 18414 tablet_server.cc:196] TabletServer@127.17.251.131:0 shutdown complete.
I20260709 13:22:57.511756 18414 master.cc:562] Master@127.17.251.190:41769 shutting down...
I20260709 13:22:57.540933 18414 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:57.541502 18414 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:57.541893 18414 tablet_replica.cc:333] T 00000000000000000000000000000000 P 634d0ef2b002426d86b6312ac66feaa8: stopping tablet replica
I20260709 13:22:57.563678 18414 master.cc:584] Master@127.17.251.190:41769 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12671 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:22:57.618464 18414 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.251.190:38559
I20260709 13:22:57.619758 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:57.626644 30770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:57.627259 30772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:57.626695 30769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:57.628197 18414 server_base.cc:1061] running on GCE node
I20260709 13:22:57.629140 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:57.629325 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:57.629441 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603377629429 us; error 0 us; skew 500 ppm
I20260709 13:22:57.630177 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:57.633013 18414 webserver.cc:533] Webserver started at http://127.17.251.190:36861/ using document root <none> and password file <none>
I20260709 13:22:57.633666 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:57.633905 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:57.634246 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:57.635493 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/master-0-root/instance:
uuid: "f4b13e4cce6a4fdeb2e0050d6cb17df4"
format_stamp: "Formatted at 2026-07-09 13:22:57 on dist-test-slave-7f95"
I20260709 13:22:57.640731 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:22:57.644413 30777 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:57.645356 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:57.645759 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/master-0-root
uuid: "f4b13e4cce6a4fdeb2e0050d6cb17df4"
format_stamp: "Formatted at 2026-07-09 13:22:57 on dist-test-slave-7f95"
I20260709 13:22:57.646095 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:57.655999 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:57.657294 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:57.696144 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.190:38559
I20260709 13:22:57.696246 30828 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.190:38559 every 8 connection(s)
I20260709 13:22:57.700146 30829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.711355 30829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4: Bootstrap starting.
I20260709 13:22:57.717041 30829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.721508 30829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4: No bootstrap required, opened a new log
I20260709 13:22:57.723837 30829 raft_consensus.cc:359] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4b13e4cce6a4fdeb2e0050d6cb17df4" member_type: VOTER }
I20260709 13:22:57.724236 30829 raft_consensus.cc:385] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.724534 30829 raft_consensus.cc:740] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4b13e4cce6a4fdeb2e0050d6cb17df4, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.725157 30829 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4b13e4cce6a4fdeb2e0050d6cb17df4" member_type: VOTER }
I20260709 13:22:57.725593 30829 raft_consensus.cc:399] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:57.725870 30829 raft_consensus.cc:493] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:57.726081 30829 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.731217 30829 raft_consensus.cc:515] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4b13e4cce6a4fdeb2e0050d6cb17df4" member_type: VOTER }
I20260709 13:22:57.731727 30829 leader_election.cc:304] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4b13e4cce6a4fdeb2e0050d6cb17df4; no voters: 
I20260709 13:22:57.732861 30829 leader_election.cc:290] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:57.733340 30832 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:57.734805 30832 raft_consensus.cc:697] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [term 1 LEADER]: Becoming Leader. State: Replica: f4b13e4cce6a4fdeb2e0050d6cb17df4, State: Running, Role: LEADER
I20260709 13:22:57.735488 30832 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4b13e4cce6a4fdeb2e0050d6cb17df4" member_type: VOTER }
I20260709 13:22:57.735848 30829 sys_catalog.cc:565] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:57.740085 30834 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4b13e4cce6a4fdeb2e0050d6cb17df4. Latest consensus state: current_term: 1 leader_uuid: "f4b13e4cce6a4fdeb2e0050d6cb17df4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4b13e4cce6a4fdeb2e0050d6cb17df4" member_type: VOTER } }
I20260709 13:22:57.740171 30833 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4b13e4cce6a4fdeb2e0050d6cb17df4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4b13e4cce6a4fdeb2e0050d6cb17df4" member_type: VOTER } }
I20260709 13:22:57.740893 30834 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:57.741016 30833 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:57.746492 30839 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:57.753046 30839 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:57.754122 18414 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:57.761703 30839 catalog_manager.cc:1383] Generated new cluster ID: bedb91c5a24244f7b57fdbc853f438df
I20260709 13:22:57.762015 30839 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:57.779673 30839 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:57.781111 30839 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:57.799492 30839 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4: Generated new TSK 0
I20260709 13:22:57.800149 30839 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:57.820950 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:57.827294 30850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:57.828111 30851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:57.830283 18414 server_base.cc:1061] running on GCE node
W20260709 13:22:57.830508 30853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:57.831563 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:57.831794 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:57.831965 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603377831950 us; error 0 us; skew 500 ppm
I20260709 13:22:57.832492 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:57.834874 18414 webserver.cc:533] Webserver started at http://127.17.251.129:38013/ using document root <none> and password file <none>
I20260709 13:22:57.835354 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:57.835564 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:57.835837 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:57.836930 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/ts-0-root/instance:
uuid: "ee4524bd626f435e9a2fe90de49d7c03"
format_stamp: "Formatted at 2026-07-09 13:22:57 on dist-test-slave-7f95"
I20260709 13:22:57.842037 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:22:57.845541 30858 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:57.846439 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:22:57.846776 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/ts-0-root
uuid: "ee4524bd626f435e9a2fe90de49d7c03"
format_stamp: "Formatted at 2026-07-09 13:22:57 on dist-test-slave-7f95"
I20260709 13:22:57.847079 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:57.858908 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:57.860162 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:57.861734 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:57.864245 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:57.864533 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:57.864782 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:57.864979 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:57.907195 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.129:46627
I20260709 13:22:57.907325 30920 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.129:46627 every 8 connection(s)
I20260709 13:22:57.912740 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:57.920406 30925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:57.920629 30926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:57.924675 30928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:57.925163 18414 server_base.cc:1061] running on GCE node
I20260709 13:22:57.926743 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:57.927062 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:57.927254 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603377927236 us; error 0 us; skew 500 ppm
I20260709 13:22:57.927819 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:57.930729 30921 heartbeater.cc:344] Connected to a master server at 127.17.251.190:38559
I20260709 13:22:57.931216 30921 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:57.931222 18414 webserver.cc:533] Webserver started at http://127.17.251.130:43087/ using document root <none> and password file <none>
I20260709 13:22:57.931975 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:57.932049 30921 heartbeater.cc:507] Master 127.17.251.190:38559 requested a full tablet report, sending...
I20260709 13:22:57.932195 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:57.932646 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:57.934170 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/ts-1-root/instance:
uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
format_stamp: "Formatted at 2026-07-09 13:22:57 on dist-test-slave-7f95"
I20260709 13:22:57.934583 30794 ts_manager.cc:194] Registered new tserver with Master: ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627)
I20260709 13:22:57.936492 30794 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43186
I20260709 13:22:57.939730 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:22:57.943723 30933 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:57.944650 18414 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:22:57.944978 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/ts-1-root
uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
format_stamp: "Formatted at 2026-07-09 13:22:57 on dist-test-slave-7f95"
I20260709 13:22:57.945291 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:57.963254 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:57.964504 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:57.966243 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:57.968576 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:57.968817 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:57.969087 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:57.969260 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:58.010836 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.130:46035
I20260709 13:22:58.010967 30995 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.130:46035 every 8 connection(s)
I20260709 13:22:58.015828 18414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:58.023962 30999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:58.026356 31000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:58.027854 31002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:58.030162 30996 heartbeater.cc:344] Connected to a master server at 127.17.251.190:38559
I20260709 13:22:58.030614 18414 server_base.cc:1061] running on GCE node
I20260709 13:22:58.030627 30996 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:58.031980 30996 heartbeater.cc:507] Master 127.17.251.190:38559 requested a full tablet report, sending...
I20260709 13:22:58.032017 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:58.032503 18414 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:58.032749 18414 hybrid_clock.cc:648] HybridClock initialized: now 1783603378032730 us; error 0 us; skew 500 ppm
I20260709 13:22:58.033733 18414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:58.034825 30794 ts_manager.cc:194] Registered new tserver with Master: c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035)
I20260709 13:22:58.036616 30794 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43202
I20260709 13:22:58.036728 18414 webserver.cc:533] Webserver started at http://127.17.251.131:40879/ using document root <none> and password file <none>
I20260709 13:22:58.037498 18414 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:58.037777 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:58.038127 18414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:58.039345 18414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/ts-2-root/instance:
uuid: "d02e5f60274b43a3a8d95c337273cf50"
format_stamp: "Formatted at 2026-07-09 13:22:58 on dist-test-slave-7f95"
I20260709 13:22:58.043995 18414 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:22:58.047645 31007 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:58.048709 18414 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:22:58.049113 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/ts-2-root
uuid: "d02e5f60274b43a3a8d95c337273cf50"
format_stamp: "Formatted at 2026-07-09 13:22:58 on dist-test-slave-7f95"
I20260709 13:22:58.049520 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskaDxKma/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603012191013-18414-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:58.068377 18414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:58.069813 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:58.071388 18414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:58.073836 18414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:58.074059 18414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:58.074353 18414 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:58.074509 18414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:58.117264 18414 rpc_server.cc:307] RPC server started. Bound to: 127.17.251.131:40837
I20260709 13:22:58.117370 31069 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.251.131:40837 every 8 connection(s)
I20260709 13:22:58.132268 31070 heartbeater.cc:344] Connected to a master server at 127.17.251.190:38559
I20260709 13:22:58.132717 31070 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:58.133512 31070 heartbeater.cc:507] Master 127.17.251.190:38559 requested a full tablet report, sending...
I20260709 13:22:58.135511 30794 ts_manager.cc:194] Registered new tserver with Master: d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:58.136288 18414 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015196027s
I20260709 13:22:58.137179 30794 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43204
I20260709 13:22:58.164701 30794 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43220:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:58.167488 30794 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:58.248257 31035 tablet_service.cc:1511] Processing CreateTablet for tablet 07d7dad17fdb4fa495557b40e4eb1c80 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:58.248802 31034 tablet_service.cc:1511] Processing CreateTablet for tablet b2c2136eb300414197996c612117d877 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:58.249342 31033 tablet_service.cc:1511] Processing CreateTablet for tablet 9e4a9d8abc0c4effb03b7d5a2512e73a (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:58.249897 31035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d7dad17fdb4fa495557b40e4eb1c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.250648 31034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2c2136eb300414197996c612117d877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.251719 31032 tablet_service.cc:1511] Processing CreateTablet for tablet 6157a9dbb7f346cf9c9ddc0a8dc58ed5 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:58.253123 31032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6157a9dbb7f346cf9c9ddc0a8dc58ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.256780 31031 tablet_service.cc:1511] Processing CreateTablet for tablet 936c14ae8b8240ffafd1ab0ea5601ed4 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:58.259048 31030 tablet_service.cc:1511] Processing CreateTablet for tablet d465cabde728440889b584045b8761d8 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:58.260474 31033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e4a9d8abc0c4effb03b7d5a2512e73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.268958 31030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d465cabde728440889b584045b8761d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.273170 31031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 936c14ae8b8240ffafd1ab0ea5601ed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.275269 31029 tablet_service.cc:1511] Processing CreateTablet for tablet 91a973e7abfd46a28ee2da9015c6a055 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:58.277709 31028 tablet_service.cc:1511] Processing CreateTablet for tablet beea6eb6f1f04ef8ba2e1df730e9122a (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:58.280424 31027 tablet_service.cc:1511] Processing CreateTablet for tablet b43ee13ab88e433a94c659f8e6176ba4 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:58.284016 31028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beea6eb6f1f04ef8ba2e1df730e9122a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.286831 30960 tablet_service.cc:1511] Processing CreateTablet for tablet b2c2136eb300414197996c612117d877 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:58.287832 30955 tablet_service.cc:1511] Processing CreateTablet for tablet 91a973e7abfd46a28ee2da9015c6a055 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:58.288317 30960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2c2136eb300414197996c612117d877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.289202 30955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a973e7abfd46a28ee2da9015c6a055. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.290277 31029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a973e7abfd46a28ee2da9015c6a055. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.290546 30959 tablet_service.cc:1511] Processing CreateTablet for tablet 9e4a9d8abc0c4effb03b7d5a2512e73a (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:58.291997 30959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e4a9d8abc0c4effb03b7d5a2512e73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.292788 30954 tablet_service.cc:1511] Processing CreateTablet for tablet beea6eb6f1f04ef8ba2e1df730e9122a (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:58.294114 31027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b43ee13ab88e433a94c659f8e6176ba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.294816 30958 tablet_service.cc:1511] Processing CreateTablet for tablet 6157a9dbb7f346cf9c9ddc0a8dc58ed5 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:58.296322 30953 tablet_service.cc:1511] Processing CreateTablet for tablet b43ee13ab88e433a94c659f8e6176ba4 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:58.294248 30954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beea6eb6f1f04ef8ba2e1df730e9122a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.298693 30956 tablet_service.cc:1511] Processing CreateTablet for tablet d465cabde728440889b584045b8761d8 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:58.297029 30957 tablet_service.cc:1511] Processing CreateTablet for tablet 936c14ae8b8240ffafd1ab0ea5601ed4 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:58.299998 30956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d465cabde728440889b584045b8761d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.300827 30957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 936c14ae8b8240ffafd1ab0ea5601ed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.301981 30953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b43ee13ab88e433a94c659f8e6176ba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.285223 30961 tablet_service.cc:1511] Processing CreateTablet for tablet 07d7dad17fdb4fa495557b40e4eb1c80 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:58.305720 30961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d7dad17fdb4fa495557b40e4eb1c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.308135 30958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6157a9dbb7f346cf9c9ddc0a8dc58ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.331939 30886 tablet_service.cc:1511] Processing CreateTablet for tablet 07d7dad17fdb4fa495557b40e4eb1c80 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:58.335283 30885 tablet_service.cc:1511] Processing CreateTablet for tablet b2c2136eb300414197996c612117d877 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:58.337435 30886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d7dad17fdb4fa495557b40e4eb1c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.339165 30885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2c2136eb300414197996c612117d877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.344992 30884 tablet_service.cc:1511] Processing CreateTablet for tablet 9e4a9d8abc0c4effb03b7d5a2512e73a (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:58.346577 30884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e4a9d8abc0c4effb03b7d5a2512e73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.350895 30882 tablet_service.cc:1511] Processing CreateTablet for tablet 936c14ae8b8240ffafd1ab0ea5601ed4 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:58.352675 30882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 936c14ae8b8240ffafd1ab0ea5601ed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.354796 30881 tablet_service.cc:1511] Processing CreateTablet for tablet d465cabde728440889b584045b8761d8 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:58.356292 30881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d465cabde728440889b584045b8761d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.358908 30880 tablet_service.cc:1511] Processing CreateTablet for tablet 91a973e7abfd46a28ee2da9015c6a055 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:58.360338 30880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a973e7abfd46a28ee2da9015c6a055. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.362934 30879 tablet_service.cc:1511] Processing CreateTablet for tablet beea6eb6f1f04ef8ba2e1df730e9122a (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:58.364845 30879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beea6eb6f1f04ef8ba2e1df730e9122a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.367386 30878 tablet_service.cc:1511] Processing CreateTablet for tablet b43ee13ab88e433a94c659f8e6176ba4 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:58.368933 30878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b43ee13ab88e433a94c659f8e6176ba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.349073 30883 tablet_service.cc:1511] Processing CreateTablet for tablet 6157a9dbb7f346cf9c9ddc0a8dc58ed5 (DEFAULT_TABLE table=test-workload [id=7cea37acdf22413796b8482a63b25a40]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:58.373291 30883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6157a9dbb7f346cf9c9ddc0a8dc58ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:58.465021 31086 tablet_bootstrap.cc:492] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507: Bootstrap starting.
I20260709 13:22:58.490363 31085 tablet_bootstrap.cc:492] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50: Bootstrap starting.
I20260709 13:22:58.510896 31087 tablet_bootstrap.cc:492] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03: Bootstrap starting.
I20260709 13:22:58.516955 31086 tablet_bootstrap.cc:654] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.518597 31087 tablet_bootstrap.cc:654] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.521301 31085 tablet_bootstrap.cc:654] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.525810 31086 tablet_bootstrap.cc:492] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507: No bootstrap required, opened a new log
I20260709 13:22:58.526470 31087 tablet_bootstrap.cc:492] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03: No bootstrap required, opened a new log
I20260709 13:22:58.526434 31086 ts_tablet_manager.cc:1403] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent bootstrapping tablet: real 0.062s	user 0.007s	sys 0.007s
I20260709 13:22:58.527170 31087 ts_tablet_manager.cc:1403] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.006s
I20260709 13:22:58.536137 31087 raft_consensus.cc:359] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.536001 31086 raft_consensus.cc:359] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.536763 31085 tablet_bootstrap.cc:492] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50: No bootstrap required, opened a new log
I20260709 13:22:58.537019 31087 raft_consensus.cc:385] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.537042 31086 raft_consensus.cc:385] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.537343 31085 ts_tablet_manager.cc:1403] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.000s
I20260709 13:22:58.537436 31087 raft_consensus.cc:740] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.537595 31086 raft_consensus.cc:740] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.538580 31087 consensus_queue.cc:260] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.538815 31086 consensus_queue.cc:260] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.540802 30921 heartbeater.cc:499] Master 127.17.251.190:38559 was elected leader, sending a full tablet report...
I20260709 13:22:58.541357 31087 ts_tablet_manager.cc:1434] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.012s
I20260709 13:22:58.541064 31085 raft_consensus.cc:359] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } }
I20260709 13:22:58.542227 31085 raft_consensus.cc:385] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.542433 31087 tablet_bootstrap.cc:492] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03: Bootstrap starting.
I20260709 13:22:58.542687 31085 raft_consensus.cc:740] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.543941 31085 consensus_queue.cc:260] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } }
I20260709 13:22:58.549957 31087 tablet_bootstrap.cc:654] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.550109 31086 ts_tablet_manager.cc:1434] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.011s
I20260709 13:22:58.551224 30996 heartbeater.cc:499] Master 127.17.251.190:38559 was elected leader, sending a full tablet report...
I20260709 13:22:58.554351 31085 ts_tablet_manager.cc:1434] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.008s
I20260709 13:22:58.555137 31070 heartbeater.cc:499] Master 127.17.251.190:38559 was elected leader, sending a full tablet report...
I20260709 13:22:58.557169 31086 tablet_bootstrap.cc:492] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507: Bootstrap starting.
I20260709 13:22:58.564911 31086 tablet_bootstrap.cc:654] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.566735 31085 tablet_bootstrap.cc:492] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50: Bootstrap starting.
I20260709 13:22:58.570598 31087 tablet_bootstrap.cc:492] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03: No bootstrap required, opened a new log
I20260709 13:22:58.571229 31087 ts_tablet_manager.cc:1403] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.014s
I20260709 13:22:58.575412 31085 tablet_bootstrap.cc:654] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.575155 31087 raft_consensus.cc:359] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.577708 31087 raft_consensus.cc:385] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.578051 31087 raft_consensus.cc:740] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.578838 31087 consensus_queue.cc:260] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.580243 31086 tablet_bootstrap.cc:492] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507: No bootstrap required, opened a new log
I20260709 13:22:58.581048 31086 ts_tablet_manager.cc:1403] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.001s
I20260709 13:22:58.585440 31086 raft_consensus.cc:359] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.581063 31087 ts_tablet_manager.cc:1434] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:22:58.587677 31087 tablet_bootstrap.cc:492] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03: Bootstrap starting.
I20260709 13:22:58.589782 31086 raft_consensus.cc:385] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.590144 31086 raft_consensus.cc:740] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.591113 31086 consensus_queue.cc:260] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.594882 31085 tablet_bootstrap.cc:492] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50: No bootstrap required, opened a new log
I20260709 13:22:58.594959 31086 ts_tablet_manager.cc:1434] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:22:58.595547 31085 ts_tablet_manager.cc:1403] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.004s
I20260709 13:22:58.595911 31087 tablet_bootstrap.cc:654] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.596303 31086 tablet_bootstrap.cc:492] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507: Bootstrap starting.
I20260709 13:22:58.598863 31085 raft_consensus.cc:359] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.599838 31085 raft_consensus.cc:385] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.600214 31085 raft_consensus.cc:740] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.601353 31085 consensus_queue.cc:260] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.603652 31086 tablet_bootstrap.cc:654] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.604833 31085 ts_tablet_manager.cc:1434] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:22:58.606247 31085 tablet_bootstrap.cc:492] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50: Bootstrap starting.
I20260709 13:22:58.609566 31087 tablet_bootstrap.cc:492] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03: No bootstrap required, opened a new log
I20260709 13:22:58.610342 31087 ts_tablet_manager.cc:1403] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.011s
I20260709 13:22:58.612804 31085 tablet_bootstrap.cc:654] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.613782 31086 tablet_bootstrap.cc:492] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507: No bootstrap required, opened a new log
I20260709 13:22:58.613689 31087 raft_consensus.cc:359] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.614548 31086 ts_tablet_manager.cc:1403] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:22:58.614840 31087 raft_consensus.cc:385] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.615247 31087 raft_consensus.cc:740] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.616276 31087 consensus_queue.cc:260] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.617810 31086 raft_consensus.cc:359] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.618647 31086 raft_consensus.cc:385] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.618955 31086 raft_consensus.cc:740] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.620127 31087 ts_tablet_manager.cc:1434] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:22:58.619886 31086 consensus_queue.cc:260] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.623185 31087 tablet_bootstrap.cc:492] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03: Bootstrap starting.
I20260709 13:22:58.624701 31085 tablet_bootstrap.cc:492] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50: No bootstrap required, opened a new log
I20260709 13:22:58.625308 31085 ts_tablet_manager.cc:1403] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:22:58.626840 31086 ts_tablet_manager.cc:1434] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:22:58.627938 31086 tablet_bootstrap.cc:492] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507: Bootstrap starting.
I20260709 13:22:58.628512 31085 raft_consensus.cc:359] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.629341 31085 raft_consensus.cc:385] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.629676 31085 raft_consensus.cc:740] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.630688 31085 consensus_queue.cc:260] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.631690 31087 tablet_bootstrap.cc:654] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.635106 31086 tablet_bootstrap.cc:654] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.640232 31091 raft_consensus.cc:493] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.640789 31091 raft_consensus.cc:515] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.641759 31085 ts_tablet_manager.cc:1434] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:22:58.645520 31085 tablet_bootstrap.cc:492] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50: Bootstrap starting.
I20260709 13:22:58.646390 31091 leader_election.cc:290] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:58.653873 31085 tablet_bootstrap.cc:654] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.667090 31085 tablet_bootstrap.cc:492] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50: No bootstrap required, opened a new log
I20260709 13:22:58.667819 31085 ts_tablet_manager.cc:1403] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.004s
I20260709 13:22:58.669303 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a973e7abfd46a28ee2da9015c6a055" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50" is_pre_election: true
W20260709 13:22:58.671236 30861 leader_election.cc:343] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.671604 31087 tablet_bootstrap.cc:492] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03: No bootstrap required, opened a new log
I20260709 13:22:58.672140 31087 ts_tablet_manager.cc:1403] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.007s
I20260709 13:22:58.671888 31085 raft_consensus.cc:359] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.673050 31085 raft_consensus.cc:385] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.673491 31085 raft_consensus.cc:740] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.674872 31087 raft_consensus.cc:359] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.674604 31085 consensus_queue.cc:260] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.675513 31087 raft_consensus.cc:385] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.675858 31087 raft_consensus.cc:740] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.676640 31087 consensus_queue.cc:260] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.677933 31085 ts_tablet_manager.cc:1434] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 13:22:58.679491 31085 tablet_bootstrap.cc:492] T d465cabde728440889b584045b8761d8 P d02e5f60274b43a3a8d95c337273cf50: Bootstrap starting.
I20260709 13:22:58.681914 31086 tablet_bootstrap.cc:492] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507: No bootstrap required, opened a new log
I20260709 13:22:58.682564 31086 ts_tablet_manager.cc:1403] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent bootstrapping tablet: real 0.055s	user 0.028s	sys 0.022s
I20260709 13:22:58.685680 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a973e7abfd46a28ee2da9015c6a055" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" is_pre_election: true
I20260709 13:22:58.686192 31085 tablet_bootstrap.cc:654] T d465cabde728440889b584045b8761d8 P d02e5f60274b43a3a8d95c337273cf50: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.685865 31086 raft_consensus.cc:359] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.686621 31087 ts_tablet_manager.cc:1434] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:22:58.686658 31086 raft_consensus.cc:385] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.687296 31086 raft_consensus.cc:740] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.687915 31087 tablet_bootstrap.cc:492] T 936c14ae8b8240ffafd1ab0ea5601ed4 P ee4524bd626f435e9a2fe90de49d7c03: Bootstrap starting.
I20260709 13:22:58.688304 31086 consensus_queue.cc:260] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.695330 31086 ts_tablet_manager.cc:1434] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:22:58.695920 31087 tablet_bootstrap.cc:654] T 936c14ae8b8240ffafd1ab0ea5601ed4 P ee4524bd626f435e9a2fe90de49d7c03: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.696178 31093 raft_consensus.cc:493] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.696568 31086 tablet_bootstrap.cc:492] T 9e4a9d8abc0c4effb03b7d5a2512e73a P c8c0111e08ed44e5ba8ff1018fcb7507: Bootstrap starting.
I20260709 13:22:58.696698 31093 raft_consensus.cc:515] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.700052 31093 leader_election.cc:290] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035)
I20260709 13:22:58.686515 30971 raft_consensus.cc:2468] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 0.
I20260709 13:22:58.710067 31085 tablet_bootstrap.cc:492] T d465cabde728440889b584045b8761d8 P d02e5f60274b43a3a8d95c337273cf50: No bootstrap required, opened a new log
I20260709 13:22:58.710758 31085 ts_tablet_manager.cc:1403] T d465cabde728440889b584045b8761d8 P d02e5f60274b43a3a8d95c337273cf50: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.007s
I20260709 13:22:58.711174 30862 leader_election.cc:304] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: d02e5f60274b43a3a8d95c337273cf50
I20260709 13:22:58.712224 31091 raft_consensus.cc:2804] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.713317 31086 tablet_bootstrap.cc:654] T 9e4a9d8abc0c4effb03b7d5a2512e73a P c8c0111e08ed44e5ba8ff1018fcb7507: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.713956 31091 raft_consensus.cc:493] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.715870 31091 raft_consensus.cc:3060] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.721072 31087 tablet_bootstrap.cc:492] T 936c14ae8b8240ffafd1ab0ea5601ed4 P ee4524bd626f435e9a2fe90de49d7c03: No bootstrap required, opened a new log
I20260709 13:22:58.721891 31087 ts_tablet_manager.cc:1403] T 936c14ae8b8240ffafd1ab0ea5601ed4 P ee4524bd626f435e9a2fe90de49d7c03: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.006s
I20260709 13:22:58.728688 31086 tablet_bootstrap.cc:492] T 9e4a9d8abc0c4effb03b7d5a2512e73a P c8c0111e08ed44e5ba8ff1018fcb7507: No bootstrap required, opened a new log
I20260709 13:22:58.729313 31086 ts_tablet_manager.cc:1403] T 9e4a9d8abc0c4effb03b7d5a2512e73a P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.001s
I20260709 13:22:58.730187 31087 raft_consensus.cc:359] T 936c14ae8b8240ffafd1ab0ea5601ed4 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.730942 31087 raft_consensus.cc:385] T 936c14ae8b8240ffafd1ab0ea5601ed4 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.731261 31087 raft_consensus.cc:740] T 936c14ae8b8240ffafd1ab0ea5601ed4 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.732060 31087 consensus_queue.cc:260] T 936c14ae8b8240ffafd1ab0ea5601ed4 P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.733105 31086 raft_consensus.cc:359] T 9e4a9d8abc0c4effb03b7d5a2512e73a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.733995 31086 raft_consensus.cc:385] T 9e4a9d8abc0c4effb03b7d5a2512e73a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.733595 31091 raft_consensus.cc:515] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.734359 31086 raft_consensus.cc:740] T 9e4a9d8abc0c4effb03b7d5a2512e73a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.735224 31086 consensus_queue.cc:260] T 9e4a9d8abc0c4effb03b7d5a2512e73a P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.732455 31109 raft_consensus.cc:493] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.729247 31085 raft_consensus.cc:359] T d465cabde728440889b584045b8761d8 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.737414 31085 raft_consensus.cc:385] T d465cabde728440889b584045b8761d8 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.737973 31085 raft_consensus.cc:740] T d465cabde728440889b584045b8761d8 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.737182 31109 raft_consensus.cc:515] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.738937 31085 consensus_queue.cc:260] T d465cabde728440889b584045b8761d8 P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.741458 31086 ts_tablet_manager.cc:1434] T 9e4a9d8abc0c4effb03b7d5a2512e73a P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:22:58.741755 31092 raft_consensus.cc:493] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.742543 31085 ts_tablet_manager.cc:1434] T d465cabde728440889b584045b8761d8 P d02e5f60274b43a3a8d95c337273cf50: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.001s
I20260709 13:22:58.742357 31092 raft_consensus.cc:515] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.743810 31085 tablet_bootstrap.cc:492] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50: Bootstrap starting.
I20260709 13:22:58.746496 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a973e7abfd46a28ee2da9015c6a055" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:22:58.747231 30971 raft_consensus.cc:3060] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:58.749673 30842 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:58.754242 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6157a9dbb7f346cf9c9ddc0a8dc58ed5" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" is_pre_election: true
I20260709 13:22:58.754602 31086 tablet_bootstrap.cc:492] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507: Bootstrap starting.
I20260709 13:22:58.757863 31092 leader_election.cc:290] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:58.754181 31085 tablet_bootstrap.cc:654] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.770390 31091 leader_election.cc:290] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Requested vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
W20260709 13:22:58.769114 31011 leader_election.cc:343] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.774940 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4a9d8abc0c4effb03b7d5a2512e73a" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" is_pre_election: true
I20260709 13:22:58.775015 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a973e7abfd46a28ee2da9015c6a055" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:22:58.775913 30970 raft_consensus.cc:2468] T 9e4a9d8abc0c4effb03b7d5a2512e73a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 0.
I20260709 13:22:58.777493 30862 leader_election.cc:304] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:22:58.779043 31093 raft_consensus.cc:493] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:22:58.779667 30861 leader_election.cc:343] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.779629 31093 raft_consensus.cc:515] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.786749 31109 leader_election.cc:290] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:58.787950 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4a9d8abc0c4effb03b7d5a2512e73a" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50" is_pre_election: true
I20260709 13:22:58.788697 31045 raft_consensus.cc:2468] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 0.
I20260709 13:22:58.788127 30971 raft_consensus.cc:2468] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 1.
I20260709 13:22:58.793839 31093 leader_election.cc:290] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035)
I20260709 13:22:58.793938 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6157a9dbb7f346cf9c9ddc0a8dc58ed5" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03" is_pre_election: true
I20260709 13:22:58.784004 31091 raft_consensus.cc:2804] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.794986 31091 raft_consensus.cc:493] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.795334 31091 raft_consensus.cc:3060] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:58.795817 31011 leader_election.cc:343] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.794480 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c2136eb300414197996c612117d877" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03" is_pre_election: true
I20260709 13:22:58.796342 31011 leader_election.cc:304] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50; no voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03
I20260709 13:22:58.796885 30895 raft_consensus.cc:2468] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 0.
I20260709 13:22:58.797565 31093 raft_consensus.cc:2749] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.797673 31109 raft_consensus.cc:493] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.798372 31092 raft_consensus.cc:493] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.798274 31109 raft_consensus.cc:515] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.798554 31011 leader_election.cc:304] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:22:58.799057 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936c14ae8b8240ffafd1ab0ea5601ed4" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50" is_pre_election: true
I20260709 13:22:58.798861 31092 raft_consensus.cc:515] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.799723 31093 raft_consensus.cc:2804] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.800137 31093 raft_consensus.cc:493] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.800477 31093 raft_consensus.cc:3060] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:58.800751 30936 leader_election.cc:343] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.800899 31109 leader_election.cc:290] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:58.801179 31092 leader_election.cc:290] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:58.802429 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43ee13ab88e433a94c659f8e6176ba4" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50" is_pre_election: true
I20260709 13:22:58.803069 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d465cabde728440889b584045b8761d8" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50" is_pre_election: true
I20260709 13:22:58.803779 31044 raft_consensus.cc:2468] T d465cabde728440889b584045b8761d8 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 0.
W20260709 13:22:58.804090 30936 leader_election.cc:343] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.804636 31086 tablet_bootstrap.cc:654] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.796126 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c2136eb300414197996c612117d877" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" is_pre_election: true
I20260709 13:22:58.804992 30861 leader_election.cc:304] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:22:58.807991 30862 leader_election.cc:304] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: d02e5f60274b43a3a8d95c337273cf50
I20260709 13:22:58.806272 31109 raft_consensus.cc:2804] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.810320 31109 raft_consensus.cc:493] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.810777 31109 raft_consensus.cc:3060] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.811218 31087 ts_tablet_manager.cc:1434] T 936c14ae8b8240ffafd1ab0ea5601ed4 P ee4524bd626f435e9a2fe90de49d7c03: Time spent starting tablet: real 0.089s	user 0.013s	sys 0.005s
I20260709 13:22:58.811914 31111 raft_consensus.cc:2804] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.815814 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d465cabde728440889b584045b8761d8" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" is_pre_election: true
I20260709 13:22:58.816738 30971 raft_consensus.cc:2468] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 0.
I20260709 13:22:58.818293 31087 tablet_bootstrap.cc:492] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03: Bootstrap starting.
I20260709 13:22:58.822000 31093 raft_consensus.cc:515] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.822432 31109 raft_consensus.cc:515] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.824332 31093 leader_election.cc:290] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 election: Requested vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035)
W20260709 13:22:58.820554 31011 leader_election.cc:343] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.825765 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d465cabde728440889b584045b8761d8" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:22:58.826488 31044 raft_consensus.cc:3060] T d465cabde728440889b584045b8761d8 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.826560 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c2136eb300414197996c612117d877" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
I20260709 13:22:58.827260 30895 raft_consensus.cc:3060] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.831058 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d465cabde728440889b584045b8761d8" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:22:58.831853 30971 raft_consensus.cc:3060] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.835155 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c2136eb300414197996c612117d877" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:22:58.835289 31044 raft_consensus.cc:2468] T d465cabde728440889b584045b8761d8 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 1.
I20260709 13:22:58.836014 30895 raft_consensus.cc:2468] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 1.
I20260709 13:22:58.837001 30861 leader_election.cc:304] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
W20260709 13:22:58.837214 31011 leader_election.cc:343] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.841790 31085 tablet_bootstrap.cc:492] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50: No bootstrap required, opened a new log
I20260709 13:22:58.841926 31109 leader_election.cc:290] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Requested vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:58.842593 31085 ts_tablet_manager.cc:1403] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50: Time spent bootstrapping tablet: real 0.099s	user 0.027s	sys 0.004s
I20260709 13:22:58.842240 31091 raft_consensus.cc:515] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.844466 31109 raft_consensus.cc:2804] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.845036 31109 raft_consensus.cc:697] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Becoming Leader. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:22:58.846153 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4a9d8abc0c4effb03b7d5a2512e73a" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:22:58.846405 31085 raft_consensus.cc:359] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.846994 30970 raft_consensus.cc:3060] T 9e4a9d8abc0c4effb03b7d5a2512e73a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.847376 31085 raft_consensus.cc:385] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.847836 31085 raft_consensus.cc:740] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.844724 31087 tablet_bootstrap.cc:654] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.846031 31109 consensus_queue.cc:237] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.849206 31085 consensus_queue.cc:260] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.855844 31011 leader_election.cc:304] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50, ee4524bd626f435e9a2fe90de49d7c03; no voters: c8c0111e08ed44e5ba8ff1018fcb7507
I20260709 13:22:58.857168 31093 raft_consensus.cc:2804] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.857790 31093 raft_consensus.cc:697] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 1 LEADER]: Becoming Leader. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Running, Role: LEADER
I20260709 13:22:58.858750 31093 consensus_queue.cc:237] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.862396 31085 ts_tablet_manager.cc:1434] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:22:58.863754 31085 tablet_bootstrap.cc:492] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50: Bootstrap starting.
I20260709 13:22:58.867311 30970 raft_consensus.cc:2468] T 9e4a9d8abc0c4effb03b7d5a2512e73a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 1.
I20260709 13:22:58.868556 31111 raft_consensus.cc:697] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Becoming Leader. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:22:58.870434 30862 leader_election.cc:304] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:22:58.871783 31119 raft_consensus.cc:2804] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.872364 31119 raft_consensus.cc:697] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Becoming Leader. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:22:58.871475 31111 consensus_queue.cc:237] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.874239 31085 tablet_bootstrap.cc:654] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.874830 31119 consensus_queue.cc:237] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.880191 31091 leader_election.cc:290] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Requested vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:58.885190 31116 raft_consensus.cc:493] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.887450 31116 raft_consensus.cc:515] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.888110 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4a9d8abc0c4effb03b7d5a2512e73a" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:22:58.889181 31044 raft_consensus.cc:3060] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.889590 31116 leader_election.cc:290] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035)
I20260709 13:22:58.891587 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a973e7abfd46a28ee2da9015c6a055" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03" is_pre_election: true
I20260709 13:22:58.893074 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a973e7abfd46a28ee2da9015c6a055" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" is_pre_election: true
I20260709 13:22:58.895107 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936c14ae8b8240ffafd1ab0ea5601ed4" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03" is_pre_election: true
I20260709 13:22:58.895292 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43ee13ab88e433a94c659f8e6176ba4" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03" is_pre_election: true
I20260709 13:22:58.895859 30895 raft_consensus.cc:2468] T 936c14ae8b8240ffafd1ab0ea5601ed4 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 0.
I20260709 13:22:58.891156 31086 tablet_bootstrap.cc:492] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507: No bootstrap required, opened a new log
I20260709 13:22:58.894098 30970 raft_consensus.cc:2393] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02e5f60274b43a3a8d95c337273cf50 in current term 1: Already voted for candidate ee4524bd626f435e9a2fe90de49d7c03 in this term.
W20260709 13:22:58.898139 30937 leader_election.cc:343] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.898916 30937 leader_election.cc:304] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507; no voters: d02e5f60274b43a3a8d95c337273cf50, ee4524bd626f435e9a2fe90de49d7c03
I20260709 13:22:58.899142 30793 catalog_manager.cc:5697] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "d02e5f60274b43a3a8d95c337273cf50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:58.900842 30937 leader_election.cc:304] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: d02e5f60274b43a3a8d95c337273cf50
I20260709 13:22:58.898154 31086 ts_tablet_manager.cc:1403] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent bootstrapping tablet: real 0.144s	user 0.014s	sys 0.008s
I20260709 13:22:58.905558 31092 raft_consensus.cc:2749] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.910624 31092 raft_consensus.cc:2804] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.910727 31044 raft_consensus.cc:2468] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 1.
I20260709 13:22:58.911053 31092 raft_consensus.cc:493] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.908723 31116 raft_consensus.cc:493] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.912179 31011 leader_election.cc:304] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50; no voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03
I20260709 13:22:58.913285 30971 raft_consensus.cc:2468] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 1.
I20260709 13:22:58.917666 31093 raft_consensus.cc:3060] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.918465 31086 raft_consensus.cc:359] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.919543 31086 raft_consensus.cc:385] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.915228 31092 raft_consensus.cc:3060] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.914969 31116 raft_consensus.cc:515] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } }
I20260709 13:22:58.924043 31116 leader_election.cc:290] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627)
I20260709 13:22:58.926869 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d7dad17fdb4fa495557b40e4eb1c80" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" is_pre_election: true
I20260709 13:22:58.919948 31086 raft_consensus.cc:740] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.930064 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d7dad17fdb4fa495557b40e4eb1c80" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03" is_pre_election: true
W20260709 13:22:58.932636 31011 leader_election.cc:343] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:58.933431 31011 leader_election.cc:343] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.933841 31011 leader_election.cc:304] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50; no voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03
I20260709 13:22:58.933941 31086 consensus_queue.cc:260] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.927413 31093 raft_consensus.cc:2749] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.935814 31116 raft_consensus.cc:2749] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.937947 31092 raft_consensus.cc:515] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.940281 31086 ts_tablet_manager.cc:1434] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.003s
I20260709 13:22:58.941015 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936c14ae8b8240ffafd1ab0ea5601ed4" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
I20260709 13:22:58.945108 30895 raft_consensus.cc:3060] T 936c14ae8b8240ffafd1ab0ea5601ed4 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.945722 31086 tablet_bootstrap.cc:492] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507: Bootstrap starting.
I20260709 13:22:58.949530 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936c14ae8b8240ffafd1ab0ea5601ed4" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:22:58.951797 31087 tablet_bootstrap.cc:492] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03: No bootstrap required, opened a new log
I20260709 13:22:58.952414 31087 ts_tablet_manager.cc:1403] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03: Time spent bootstrapping tablet: real 0.134s	user 0.016s	sys 0.008s
I20260709 13:22:58.954294 30895 raft_consensus.cc:2468] T 936c14ae8b8240ffafd1ab0ea5601ed4 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 1.
I20260709 13:22:58.942782 31092 leader_election.cc:290] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 election: Requested vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
W20260709 13:22:58.955248 30936 leader_election.cc:343] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.944609 31085 tablet_bootstrap.cc:492] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50: No bootstrap required, opened a new log
I20260709 13:22:58.956187 31085 ts_tablet_manager.cc:1403] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50: Time spent bootstrapping tablet: real 0.093s	user 0.021s	sys 0.007s
I20260709 13:22:58.956239 30937 leader_election.cc:304] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: d02e5f60274b43a3a8d95c337273cf50
I20260709 13:22:58.958226 31092 raft_consensus.cc:2804] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.958977 31092 raft_consensus.cc:697] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Becoming Leader. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Running, Role: LEADER
I20260709 13:22:58.961089 31092 consensus_queue.cc:237] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.955891 31087 raft_consensus.cc:359] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.959530 31085 raft_consensus.cc:359] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.964310 31087 raft_consensus.cc:385] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.964383 31085 raft_consensus.cc:385] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.964677 31087 raft_consensus.cc:740] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.964861 31085 raft_consensus.cc:740] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.965749 31085 consensus_queue.cc:260] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.965605 31087 consensus_queue.cc:260] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.968519 31085 ts_tablet_manager.cc:1434] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:22:58.968883 31087 ts_tablet_manager.cc:1434] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:22:58.969709 31085 tablet_bootstrap.cc:492] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50: Bootstrap starting.
I20260709 13:22:58.970376 31087 tablet_bootstrap.cc:492] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03: Bootstrap starting.
I20260709 13:22:58.976812 31086 tablet_bootstrap.cc:654] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.977051 31085 tablet_bootstrap.cc:654] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.978905 31087 tablet_bootstrap.cc:654] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.981388 30791 catalog_manager.cc:5697] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "ee4524bd626f435e9a2fe90de49d7c03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:58.987294 30794 catalog_manager.cc:5697] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:58.991816 31085 tablet_bootstrap.cc:492] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50: No bootstrap required, opened a new log
I20260709 13:22:58.992301 31087 tablet_bootstrap.cc:492] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03: No bootstrap required, opened a new log
I20260709 13:22:58.993287 31085 ts_tablet_manager.cc:1403] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.004s
I20260709 13:22:58.993422 31087 ts_tablet_manager.cc:1403] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.002s
I20260709 13:22:58.996387 31085 raft_consensus.cc:359] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.996596 31087 raft_consensus.cc:359] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } }
I20260709 13:22:58.997191 31085 raft_consensus.cc:385] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.997254 31087 raft_consensus.cc:385] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.997670 31085 raft_consensus.cc:740] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.997779 31087 raft_consensus.cc:740] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.998842 31085 consensus_queue.cc:260] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:58.999038 31087 consensus_queue.cc:260] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } }
I20260709 13:22:59.000285 31086 tablet_bootstrap.cc:492] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507: No bootstrap required, opened a new log
I20260709 13:22:59.000958 31086 ts_tablet_manager.cc:1403] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent bootstrapping tablet: real 0.056s	user 0.004s	sys 0.014s
I20260709 13:22:59.001462 31085 ts_tablet_manager.cc:1434] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:59.001827 31087 ts_tablet_manager.cc:1434] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:59.002574 31085 tablet_bootstrap.cc:492] T 936c14ae8b8240ffafd1ab0ea5601ed4 P d02e5f60274b43a3a8d95c337273cf50: Bootstrap starting.
I20260709 13:22:59.003006 31087 tablet_bootstrap.cc:492] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03: Bootstrap starting.
I20260709 13:22:59.004408 31086 raft_consensus.cc:359] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.007436 31086 raft_consensus.cc:385] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.007825 31086 raft_consensus.cc:740] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.009166 31085 tablet_bootstrap.cc:654] T 936c14ae8b8240ffafd1ab0ea5601ed4 P d02e5f60274b43a3a8d95c337273cf50: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.008776 31086 consensus_queue.cc:260] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.010533 31087 tablet_bootstrap.cc:654] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.011811 31086 ts_tablet_manager.cc:1434] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 13:22:59.013441 31086 tablet_bootstrap.cc:492] T 07d7dad17fdb4fa495557b40e4eb1c80 P c8c0111e08ed44e5ba8ff1018fcb7507: Bootstrap starting.
I20260709 13:22:59.022930 31087 tablet_bootstrap.cc:492] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03: No bootstrap required, opened a new log
I20260709 13:22:59.023844 31087 ts_tablet_manager.cc:1403] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:22:59.025426 31092 raft_consensus.cc:493] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.026331 31092 raft_consensus.cc:515] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.030661 31087 raft_consensus.cc:359] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.031540 31087 raft_consensus.cc:385] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.031801 31087 raft_consensus.cc:740] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.032541 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6157a9dbb7f346cf9c9ddc0a8dc58ed5" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50" is_pre_election: true
I20260709 13:22:59.032656 31087 consensus_queue.cc:260] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.033825 31044 raft_consensus.cc:2468] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 0.
I20260709 13:22:59.035694 31087 ts_tablet_manager.cc:1434] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:22:59.036850 31087 tablet_bootstrap.cc:492] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03: Bootstrap starting.
I20260709 13:22:59.038794 31085 tablet_bootstrap.cc:492] T 936c14ae8b8240ffafd1ab0ea5601ed4 P d02e5f60274b43a3a8d95c337273cf50: No bootstrap required, opened a new log
I20260709 13:22:59.039376 31085 ts_tablet_manager.cc:1403] T 936c14ae8b8240ffafd1ab0ea5601ed4 P d02e5f60274b43a3a8d95c337273cf50: Time spent bootstrapping tablet: real 0.037s	user 0.023s	sys 0.012s
I20260709 13:22:59.041895 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6157a9dbb7f346cf9c9ddc0a8dc58ed5" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03" is_pre_election: true
I20260709 13:22:59.042725 30895 raft_consensus.cc:2468] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 0.
I20260709 13:22:59.043166 31087 tablet_bootstrap.cc:654] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.044373 30937 leader_election.cc:304] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:22:59.045400 31092 leader_election.cc:290] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:59.045486 31125 raft_consensus.cc:2804] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:59.045418 31085 raft_consensus.cc:359] T 936c14ae8b8240ffafd1ab0ea5601ed4 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.046243 31125 raft_consensus.cc:493] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:59.046245 31086 tablet_bootstrap.cc:654] T 07d7dad17fdb4fa495557b40e4eb1c80 P c8c0111e08ed44e5ba8ff1018fcb7507: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.046782 31125 raft_consensus.cc:3060] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.052050 30794 catalog_manager.cc:5697] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "ee4524bd626f435e9a2fe90de49d7c03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:59.054179 30794 catalog_manager.cc:5697] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "ee4524bd626f435e9a2fe90de49d7c03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:59.055366 31085 raft_consensus.cc:385] T 936c14ae8b8240ffafd1ab0ea5601ed4 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.055739 31085 raft_consensus.cc:740] T 936c14ae8b8240ffafd1ab0ea5601ed4 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.058040 31085 consensus_queue.cc:260] T 936c14ae8b8240ffafd1ab0ea5601ed4 P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.056849 31125 raft_consensus.cc:515] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.061403 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6157a9dbb7f346cf9c9ddc0a8dc58ed5" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
I20260709 13:22:59.062002 30895 raft_consensus.cc:3060] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.069921 30895 raft_consensus.cc:2468] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 1.
I20260709 13:22:59.078984 30937 leader_election.cc:304] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:22:59.079262 31087 tablet_bootstrap.cc:492] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03: No bootstrap required, opened a new log
I20260709 13:22:59.079452 31086 tablet_bootstrap.cc:492] T 07d7dad17fdb4fa495557b40e4eb1c80 P c8c0111e08ed44e5ba8ff1018fcb7507: No bootstrap required, opened a new log
I20260709 13:22:59.079850 31087 ts_tablet_manager.cc:1403] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.024s
I20260709 13:22:59.080011 31086 ts_tablet_manager.cc:1403] T 07d7dad17fdb4fa495557b40e4eb1c80 P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.020s
I20260709 13:22:59.079885 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6157a9dbb7f346cf9c9ddc0a8dc58ed5" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:22:59.080965 31044 raft_consensus.cc:3060] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.083017 31087 raft_consensus.cc:359] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.083313 31086 raft_consensus.cc:359] T 07d7dad17fdb4fa495557b40e4eb1c80 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } }
I20260709 13:22:59.083834 31087 raft_consensus.cc:385] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.084169 31086 raft_consensus.cc:385] T 07d7dad17fdb4fa495557b40e4eb1c80 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.084234 31087 raft_consensus.cc:740] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.084568 31086 raft_consensus.cc:740] T 07d7dad17fdb4fa495557b40e4eb1c80 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.085153 31087 consensus_queue.cc:260] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.086395 31085 ts_tablet_manager.cc:1434] T 936c14ae8b8240ffafd1ab0ea5601ed4 P d02e5f60274b43a3a8d95c337273cf50: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:22:59.087282 31087 ts_tablet_manager.cc:1434] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:59.089015 31044 raft_consensus.cc:2468] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 1.
I20260709 13:22:59.080277 31092 raft_consensus.cc:2804] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:59.085557 31086 consensus_queue.cc:260] T 07d7dad17fdb4fa495557b40e4eb1c80 P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } }
I20260709 13:22:59.093102 31092 raft_consensus.cc:697] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Becoming Leader. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Running, Role: LEADER
I20260709 13:22:59.094309 31092 consensus_queue.cc:237] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.097666 31125 leader_election.cc:290] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 election: Requested vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:59.101482 31086 ts_tablet_manager.cc:1434] T 07d7dad17fdb4fa495557b40e4eb1c80 P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent starting tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 13:22:59.102584 31086 tablet_bootstrap.cc:492] T b2c2136eb300414197996c612117d877 P c8c0111e08ed44e5ba8ff1018fcb7507: Bootstrap starting.
I20260709 13:22:59.104712 30793 catalog_manager.cc:5697] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:59.107429 31086 tablet_bootstrap.cc:654] T b2c2136eb300414197996c612117d877 P c8c0111e08ed44e5ba8ff1018fcb7507: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.111660 31086 tablet_bootstrap.cc:492] T b2c2136eb300414197996c612117d877 P c8c0111e08ed44e5ba8ff1018fcb7507: No bootstrap required, opened a new log
I20260709 13:22:59.112123 31086 ts_tablet_manager.cc:1403] T b2c2136eb300414197996c612117d877 P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent bootstrapping tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:22:59.114699 31086 raft_consensus.cc:359] T b2c2136eb300414197996c612117d877 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.115381 31086 raft_consensus.cc:385] T b2c2136eb300414197996c612117d877 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.115646 31086 raft_consensus.cc:740] T b2c2136eb300414197996c612117d877 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.116307 31086 consensus_queue.cc:260] T b2c2136eb300414197996c612117d877 P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.118116 31086 ts_tablet_manager.cc:1434] T b2c2136eb300414197996c612117d877 P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:22:59.130071 31111 raft_consensus.cc:493] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.130661 31111 raft_consensus.cc:515] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.132486 31111 leader_election.cc:290] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:59.133252 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43ee13ab88e433a94c659f8e6176ba4" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" is_pre_election: true
I20260709 13:22:59.133495 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43ee13ab88e433a94c659f8e6176ba4" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50" is_pre_election: true
I20260709 13:22:59.133901 30970 raft_consensus.cc:2468] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 0.
I20260709 13:22:59.134196 31044 raft_consensus.cc:2468] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 0.
I20260709 13:22:59.135038 30862 leader_election.cc:304] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:22:59.135802 31111 raft_consensus.cc:2804] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:59.135931 31119 raft_consensus.cc:493] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.136229 31111 raft_consensus.cc:493] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:59.136644 31111 raft_consensus.cc:3060] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.136499 31119 raft_consensus.cc:515] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.138578 31119 leader_election.cc:290] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:59.139426 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beea6eb6f1f04ef8ba2e1df730e9122a" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" is_pre_election: true
I20260709 13:22:59.139714 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beea6eb6f1f04ef8ba2e1df730e9122a" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50" is_pre_election: true
I20260709 13:22:59.140059 30970 raft_consensus.cc:2468] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 0.
I20260709 13:22:59.140429 31044 raft_consensus.cc:2468] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 0.
I20260709 13:22:59.141534 30862 leader_election.cc:304] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:22:59.142735 31119 raft_consensus.cc:2804] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:59.143101 31119 raft_consensus.cc:493] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:59.143435 31119 raft_consensus.cc:3060] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.144243 31111 raft_consensus.cc:515] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.146143 31111 leader_election.cc:290] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Requested vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:59.146945 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43ee13ab88e433a94c659f8e6176ba4" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:22:59.147141 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43ee13ab88e433a94c659f8e6176ba4" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:22:59.147516 30970 raft_consensus.cc:3060] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.147802 31044 raft_consensus.cc:3060] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.152563 31119 raft_consensus.cc:515] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.154495 31044 raft_consensus.cc:2468] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 1.
I20260709 13:22:59.154601 31119 leader_election.cc:290] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Requested vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:59.155422 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beea6eb6f1f04ef8ba2e1df730e9122a" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:22:59.155761 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beea6eb6f1f04ef8ba2e1df730e9122a" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:22:59.156013 30971 raft_consensus.cc:3060] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.156394 31045 raft_consensus.cc:3060] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.158226 30861 leader_election.cc:304] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:22:59.159341 31119 raft_consensus.cc:2804] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:59.160645 30970 raft_consensus.cc:2468] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 1.
I20260709 13:22:59.160740 31119 raft_consensus.cc:697] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Becoming Leader. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:22:59.161998 31119 consensus_queue.cc:237] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.163301 30971 raft_consensus.cc:2468] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 1.
I20260709 13:22:59.164422 30862 leader_election.cc:304] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:22:59.165102 31111 raft_consensus.cc:2804] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:59.165561 31111 raft_consensus.cc:697] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Becoming Leader. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:22:59.166639 31111 consensus_queue.cc:237] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.168036 31045 raft_consensus.cc:2468] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 1.
I20260709 13:22:59.171903 30793 catalog_manager.cc:5697] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "ee4524bd626f435e9a2fe90de49d7c03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:59.185997 30793 catalog_manager.cc:5697] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "ee4524bd626f435e9a2fe90de49d7c03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:59.243237 31111 raft_consensus.cc:493] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.243813 31111 raft_consensus.cc:515] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } }
I20260709 13:22:59.245702 31111 leader_election.cc:290] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837), c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035)
I20260709 13:22:59.246443 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d7dad17fdb4fa495557b40e4eb1c80" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50" is_pre_election: true
I20260709 13:22:59.246754 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d7dad17fdb4fa495557b40e4eb1c80" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" is_pre_election: true
I20260709 13:22:59.247284 31045 raft_consensus.cc:2468] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 0.
I20260709 13:22:59.247431 30971 raft_consensus.cc:2468] T 07d7dad17fdb4fa495557b40e4eb1c80 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 0.
I20260709 13:22:59.248664 30861 leader_election.cc:304] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:22:59.249389 31111 raft_consensus.cc:2804] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:59.249804 31111 raft_consensus.cc:493] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:59.250087 31111 raft_consensus.cc:3060] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.255704 31111 raft_consensus.cc:515] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } }
I20260709 13:22:59.257555 31111 leader_election.cc:290] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Requested vote from peers d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837), c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035)
I20260709 13:22:59.258424 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d7dad17fdb4fa495557b40e4eb1c80" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:22:59.258631 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d7dad17fdb4fa495557b40e4eb1c80" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:22:59.259145 30971 raft_consensus.cc:3060] T 07d7dad17fdb4fa495557b40e4eb1c80 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.259145 31045 raft_consensus.cc:3060] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.266518 31045 raft_consensus.cc:2468] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 1.
I20260709 13:22:59.266518 30971 raft_consensus.cc:2468] T 07d7dad17fdb4fa495557b40e4eb1c80 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 1.
I20260709 13:22:59.267853 30862 leader_election.cc:304] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:22:59.268548 31111 raft_consensus.cc:2804] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:59.268972 31111 raft_consensus.cc:697] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Becoming Leader. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:22:59.269783 31111 consensus_queue.cc:237] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } }
I20260709 13:22:59.277680 30793 catalog_manager.cc:5697] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "ee4524bd626f435e9a2fe90de49d7c03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:59.304874 31111 consensus_queue.cc:1048] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.308977 31119 consensus_queue.cc:1048] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:59.334856 31111 consensus_queue.cc:1048] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.346480 31119 consensus_queue.cc:1048] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.355115 31119 consensus_queue.cc:1048] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.358486 31119 consensus_queue.cc:1048] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.370198 30971 raft_consensus.cc:3060] T b2c2136eb300414197996c612117d877 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.379482 31116 consensus_queue.cc:1048] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.395776 31044 raft_consensus.cc:3060] T 936c14ae8b8240ffafd1ab0ea5601ed4 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.393699 31116 consensus_queue.cc:1048] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:22:59.416332 31139 consensus_queue.cc:1048] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:59.433008 31092 consensus_queue.cc:1048] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.446889 31044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2c2136eb300414197996c612117d877"
dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
mode: GRACEFUL
new_leader_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
 from {username='slave'} at 127.0.0.1:41330
I20260709 13:22:59.447732 31044 raft_consensus.cc:606] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 1 LEADER]: Received request to transfer leadership to TS ee4524bd626f435e9a2fe90de49d7c03
I20260709 13:22:59.466389 30970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6157a9dbb7f346cf9c9ddc0a8dc58ed5"
dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
mode: GRACEFUL
new_leader_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
 from {username='slave'} at 127.0.0.1:46836
I20260709 13:22:59.467029 30970 raft_consensus.cc:606] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Received request to transfer leadership to TS ee4524bd626f435e9a2fe90de49d7c03
I20260709 13:22:59.483592 30895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d465cabde728440889b584045b8761d8"
dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
mode: GRACEFUL
new_leader_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
 from {username='slave'} at 127.0.0.1:55652
I20260709 13:22:59.484102 30895 raft_consensus.cc:606] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Received request to transfer leadership to TS c8c0111e08ed44e5ba8ff1018fcb7507
I20260709 13:22:59.489493 30895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91a973e7abfd46a28ee2da9015c6a055"
dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
mode: GRACEFUL
new_leader_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
 from {username='slave'} at 127.0.0.1:55652
I20260709 13:22:59.490072 30895 raft_consensus.cc:606] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Received request to transfer leadership to TS c8c0111e08ed44e5ba8ff1018fcb7507
I20260709 13:22:59.495460 30895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "beea6eb6f1f04ef8ba2e1df730e9122a"
dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
mode: GRACEFUL
new_leader_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
 from {username='slave'} at 127.0.0.1:55652
I20260709 13:22:59.495949 30895 raft_consensus.cc:606] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Received request to transfer leadership to TS c8c0111e08ed44e5ba8ff1018fcb7507
I20260709 13:22:59.501056 30895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b43ee13ab88e433a94c659f8e6176ba4"
dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
mode: GRACEFUL
new_leader_uuid: "d02e5f60274b43a3a8d95c337273cf50"
 from {username='slave'} at 127.0.0.1:55652
I20260709 13:22:59.501535 30895 raft_consensus.cc:606] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Received request to transfer leadership to TS d02e5f60274b43a3a8d95c337273cf50
I20260709 13:22:59.517683 31092 consensus_queue.cc:1048] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.524238 31139 raft_consensus.cc:993] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507: : Instructing follower ee4524bd626f435e9a2fe90de49d7c03 to start an election
I20260709 13:22:59.524793 31138 raft_consensus.cc:1081] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Signalling peer ee4524bd626f435e9a2fe90de49d7c03 to start an election
I20260709 13:22:59.526656 30896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6157a9dbb7f346cf9c9ddc0a8dc58ed5"
dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
 from {username='slave'} at 127.0.0.1:55644
I20260709 13:22:59.527709 30896 raft_consensus.cc:493] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:59.528129 30896 raft_consensus.cc:3060] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:59.531138 31138 consensus_queue.cc:1048] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:59.536460 30896 raft_consensus.cc:515] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.540910 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6157a9dbb7f346cf9c9ddc0a8dc58ed5" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:22:59.541584 30970 raft_consensus.cc:3055] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:59.541740 30896 leader_election.cc:290] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 2 election: Requested vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:59.542619 30970 raft_consensus.cc:740] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Running, Role: LEADER
I20260709 13:22:59.542461 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6157a9dbb7f346cf9c9ddc0a8dc58ed5" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:22:59.543565 31044 raft_consensus.cc:3060] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:59.543859 30970 consensus_queue.cc:260] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.545259 30970 raft_consensus.cc:3060] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:59.552889 31044 raft_consensus.cc:2468] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 2.
I20260709 13:22:59.553475 30970 raft_consensus.cc:2468] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 2.
I20260709 13:22:59.554937 30862 leader_election.cc:304] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:22:59.555804 31091 raft_consensus.cc:2804] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:59.556376 31091 raft_consensus.cc:697] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 LEADER]: Becoming Leader. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:22:59.557317 31091 consensus_queue.cc:237] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.563984 30794 catalog_manager.cc:5697] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 reported cstate change: term changed from 1 to 2, leader changed from c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130) to ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "ee4524bd626f435e9a2fe90de49d7c03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:59.654485 31091 consensus_queue.cc:1048] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.660778 31091 consensus_queue.cc:1048] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.671212 31091 raft_consensus.cc:993] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03: : Instructing follower d02e5f60274b43a3a8d95c337273cf50 to start an election
I20260709 13:22:59.671751 31119 raft_consensus.cc:1081] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Signalling peer d02e5f60274b43a3a8d95c337273cf50 to start an election
I20260709 13:22:59.673601 31044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b43ee13ab88e433a94c659f8e6176ba4"
dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
 from {username='slave'} at 127.0.0.1:41314
I20260709 13:22:59.674224 31044 raft_consensus.cc:493] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:59.674602 31044 raft_consensus.cc:3060] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:59.680266 31044 raft_consensus.cc:515] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.682137 31044 leader_election.cc:290] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 2 election: Requested vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035)
I20260709 13:22:59.683148 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43ee13ab88e433a94c659f8e6176ba4" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
I20260709 13:22:59.683506 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43ee13ab88e433a94c659f8e6176ba4" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:22:59.683951 30896 raft_consensus.cc:3055] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:59.684420 30896 raft_consensus.cc:740] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:22:59.684526 30970 raft_consensus.cc:3060] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:59.685427 30896 consensus_queue.cc:260] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.687141 30896 raft_consensus.cc:3060] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:59.692732 30896 raft_consensus.cc:2468] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 2.
I20260709 13:22:59.693902 31011 leader_election.cc:304] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:22:59.694119 30970 raft_consensus.cc:2468] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 2.
I20260709 13:22:59.694871 31093 raft_consensus.cc:2804] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:59.695328 31093 raft_consensus.cc:697] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [term 2 LEADER]: Becoming Leader. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Running, Role: LEADER
I20260709 13:22:59.696058 31093 consensus_queue.cc:237] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.702208 30791 catalog_manager.cc:5697] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 reported cstate change: term changed from 1 to 2, leader changed from ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129) to d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131). New cstate: current_term: 2 leader_uuid: "d02e5f60274b43a3a8d95c337273cf50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:59.780871 31119 consensus_queue.cc:1048] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.788223 31119 consensus_queue.cc:1048] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.799216 31111 raft_consensus.cc:993] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03: : Instructing follower c8c0111e08ed44e5ba8ff1018fcb7507 to start an election
I20260709 13:22:59.799712 31111 raft_consensus.cc:1081] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Signalling peer c8c0111e08ed44e5ba8ff1018fcb7507 to start an election
I20260709 13:22:59.802554 30971 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "beea6eb6f1f04ef8ba2e1df730e9122a"
dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
 from {username='slave'} at 127.0.0.1:46806
I20260709 13:22:59.803406 30971 raft_consensus.cc:493] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:59.803829 30971 raft_consensus.cc:3060] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:59.810459 30971 raft_consensus.cc:515] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.813005 30971 leader_election.cc:290] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 2 election: Requested vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:59.813290 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beea6eb6f1f04ef8ba2e1df730e9122a" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
I20260709 13:22:59.813696 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beea6eb6f1f04ef8ba2e1df730e9122a" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:22:59.814081 30896 raft_consensus.cc:3055] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:59.814287 31044 raft_consensus.cc:3060] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:59.814489 30896 raft_consensus.cc:740] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:22:59.815455 30896 consensus_queue.cc:260] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.816763 30896 raft_consensus.cc:3060] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:59.820639 31119 consensus_queue.cc:1048] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.822238 31044 raft_consensus.cc:2468] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 2.
I20260709 13:22:59.823704 30936 leader_election.cc:304] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, d02e5f60274b43a3a8d95c337273cf50; no voters: 
I20260709 13:22:59.824345 30896 raft_consensus.cc:2468] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 2.
I20260709 13:22:59.824719 31139 raft_consensus.cc:2804] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:59.825378 31139 raft_consensus.cc:697] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 LEADER]: Becoming Leader. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Running, Role: LEADER
I20260709 13:22:59.826365 31139 consensus_queue.cc:237] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.829370 31111 consensus_queue.cc:1048] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:59.836539 30791 catalog_manager.cc:5697] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 reported cstate change: term changed from 1 to 2, leader changed from ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129) to c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:59.906394 31155 raft_consensus.cc:993] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50: : Instructing follower ee4524bd626f435e9a2fe90de49d7c03 to start an election
I20260709 13:22:59.906910 31093 raft_consensus.cc:1081] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 1 LEADER]: Signalling peer ee4524bd626f435e9a2fe90de49d7c03 to start an election
I20260709 13:22:59.908567 30896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2c2136eb300414197996c612117d877"
dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
 from {username='slave'} at 127.0.0.1:55634
I20260709 13:22:59.909083 30896 raft_consensus.cc:493] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:59.909405 30896 raft_consensus.cc:3060] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:59.914732 30896 raft_consensus.cc:515] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.916574 30896 leader_election.cc:290] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 2 election: Requested vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:59.917021 31118 raft_consensus.cc:993] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03: : Instructing follower c8c0111e08ed44e5ba8ff1018fcb7507 to start an election
I20260709 13:22:59.917533 31119 raft_consensus.cc:1081] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Signalling peer c8c0111e08ed44e5ba8ff1018fcb7507 to start an election
I20260709 13:22:59.917380 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c2136eb300414197996c612117d877" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:22:59.918238 30971 raft_consensus.cc:3060] T b2c2136eb300414197996c612117d877 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:59.918529 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c2136eb300414197996c612117d877" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:22:59.919703 31045 raft_consensus.cc:3055] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:59.920037 31045 raft_consensus.cc:740] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Running, Role: LEADER
I20260709 13:22:59.920333 30969 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d465cabde728440889b584045b8761d8"
dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
 from {username='slave'} at 127.0.0.1:46806
I20260709 13:22:59.920960 30969 raft_consensus.cc:493] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:59.920876 31045 consensus_queue.cc:260] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.921382 30969 raft_consensus.cc:3060] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:59.921958 31045 raft_consensus.cc:3060] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:59.926879 30971 raft_consensus.cc:2468] T b2c2136eb300414197996c612117d877 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 2.
I20260709 13:22:59.928066 31045 raft_consensus.cc:2468] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 2.
I20260709 13:22:59.928508 30970 raft_consensus.cc:1240] T b2c2136eb300414197996c612117d877 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Rejecting Update request from peer d02e5f60274b43a3a8d95c337273cf50 for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:59.928567 30862 leader_election.cc:304] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:22:59.928972 30969 raft_consensus.cc:515] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.929853 31119 raft_consensus.cc:2804] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:59.930398 31119 raft_consensus.cc:697] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 LEADER]: Becoming Leader. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:22:59.931272 31119 consensus_queue.cc:237] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.932709 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d465cabde728440889b584045b8761d8" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
I20260709 13:22:59.933285 30896 raft_consensus.cc:3055] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:59.933646 30896 raft_consensus.cc:740] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:22:59.934473 30896 consensus_queue.cc:260] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.934975 30969 leader_election.cc:290] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 2 election: Requested vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:59.935667 30896 raft_consensus.cc:3060] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:59.937230 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d465cabde728440889b584045b8761d8" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:22:59.937899 31045 raft_consensus.cc:3060] T d465cabde728440889b584045b8761d8 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:59.939730 30790 catalog_manager.cc:5697] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 reported cstate change: term changed from 1 to 2, leader changed from d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131) to ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "ee4524bd626f435e9a2fe90de49d7c03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:59.943146 31045 raft_consensus.cc:2468] T d465cabde728440889b584045b8761d8 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 2.
I20260709 13:22:59.943343 30896 raft_consensus.cc:2468] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 2.
I20260709 13:22:59.944288 30936 leader_election.cc:304] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, d02e5f60274b43a3a8d95c337273cf50; no voters: 
I20260709 13:22:59.945189 31139 raft_consensus.cc:2804] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:59.945760 31139 raft_consensus.cc:697] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 LEADER]: Becoming Leader. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Running, Role: LEADER
I20260709 13:22:59.946555 31139 consensus_queue.cc:237] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.951732 30969 raft_consensus.cc:1275] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Refusing update from remote peer ee4524bd626f435e9a2fe90de49d7c03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:59.952876 31119 consensus_queue.cc:1048] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:59.954257 30790 catalog_manager.cc:5697] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 reported cstate change: term changed from 1 to 2, leader changed from ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129) to c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:59.965816 31045 raft_consensus.cc:1275] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Refusing update from remote peer ee4524bd626f435e9a2fe90de49d7c03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:59.967423 31119 consensus_queue.cc:1048] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:59.969040 31118 raft_consensus.cc:993] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03: : Instructing follower c8c0111e08ed44e5ba8ff1018fcb7507 to start an election
I20260709 13:22:59.969550 31118 raft_consensus.cc:1081] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Signalling peer c8c0111e08ed44e5ba8ff1018fcb7507 to start an election
I20260709 13:22:59.971573 30969 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91a973e7abfd46a28ee2da9015c6a055"
dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
 from {username='slave'} at 127.0.0.1:46806
I20260709 13:22:59.972090 30969 raft_consensus.cc:493] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:59.972484 30969 raft_consensus.cc:3060] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:59.979897 30969 raft_consensus.cc:515] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.982192 30969 leader_election.cc:290] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 2 election: Requested vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:22:59.982368 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a973e7abfd46a28ee2da9015c6a055" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
I20260709 13:22:59.983597 30896 raft_consensus.cc:3055] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:59.983947 30896 raft_consensus.cc:740] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:22:59.984778 30896 consensus_queue.cc:260] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:22:59.985551 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a973e7abfd46a28ee2da9015c6a055" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:22:59.986193 30896 raft_consensus.cc:3060] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:59.986225 31045 raft_consensus.cc:3060] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:59.999557 30896 raft_consensus.cc:2468] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 2.
I20260709 13:22:59.999557 31045 raft_consensus.cc:2468] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 2.
I20260709 13:23:00.000960 30937 leader_election.cc:304] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:23:00.001739 31092 raft_consensus.cc:2804] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:00.002180 31092 raft_consensus.cc:697] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 LEADER]: Becoming Leader. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Running, Role: LEADER
I20260709 13:23:00.002909 31092 consensus_queue.cc:237] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:00.009227 30791 catalog_manager.cc:5697] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 reported cstate change: term changed from 1 to 2, leader changed from ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129) to c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:00.194213 30969 raft_consensus.cc:1275] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Refusing update from remote peer d02e5f60274b43a3a8d95c337273cf50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:00.195531 31093 consensus_queue.cc:1048] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:00.203474 30896 raft_consensus.cc:1275] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Refusing update from remote peer d02e5f60274b43a3a8d95c337273cf50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:00.205288 31116 consensus_queue.cc:1048] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:00.331174 31045 raft_consensus.cc:1275] T d465cabde728440889b584045b8761d8 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Refusing update from remote peer c8c0111e08ed44e5ba8ff1018fcb7507: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:00.332521 31092 consensus_queue.cc:1048] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:00.341951 30896 raft_consensus.cc:1275] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Refusing update from remote peer c8c0111e08ed44e5ba8ff1018fcb7507: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:00.343621 31138 consensus_queue.cc:1048] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:00.355283 31045 raft_consensus.cc:1275] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Refusing update from remote peer c8c0111e08ed44e5ba8ff1018fcb7507: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:00.357010 31138 consensus_queue.cc:1048] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:00.365654 30896 raft_consensus.cc:1275] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Refusing update from remote peer c8c0111e08ed44e5ba8ff1018fcb7507: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:00.367491 31139 consensus_queue.cc:1048] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:00.388993 30896 raft_consensus.cc:1275] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Refusing update from remote peer c8c0111e08ed44e5ba8ff1018fcb7507: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:00.390492 31139 consensus_queue.cc:1048] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:00.393266 30969 raft_consensus.cc:1275] T b2c2136eb300414197996c612117d877 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Refusing update from remote peer ee4524bd626f435e9a2fe90de49d7c03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:00.394766 31119 consensus_queue.cc:1048] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:00.402792 31045 raft_consensus.cc:1275] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Refusing update from remote peer c8c0111e08ed44e5ba8ff1018fcb7507: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:00.403430 31044 raft_consensus.cc:1275] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Refusing update from remote peer ee4524bd626f435e9a2fe90de49d7c03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:00.404673 31138 consensus_queue.cc:1048] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:00.405321 31109 consensus_queue.cc:1048] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:02.528668 30790 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57684:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:02.531355 30790 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:02.597914 30879 tablet_service.cc:1511] Processing CreateTablet for tablet 74750d56a0f5492091226aad1869538c (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:02.599309 30879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74750d56a0f5492091226aad1869538c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.599130 30960 tablet_service.cc:1511] Processing CreateTablet for tablet 74750d56a0f5492091226aad1869538c (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:02.601495 30960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74750d56a0f5492091226aad1869538c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.602123 30883 tablet_service.cc:1511] Processing CreateTablet for tablet 8e7cd07bf1024d319a5ba81f318fee7a (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:02.603485 30883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e7cd07bf1024d319a5ba81f318fee7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.604539 31031 tablet_service.cc:1511] Processing CreateTablet for tablet 74750d56a0f5492091226aad1869538c (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:02.605896 31031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74750d56a0f5492091226aad1869538c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.606599 31028 tablet_service.cc:1511] Processing CreateTablet for tablet 8e7cd07bf1024d319a5ba81f318fee7a (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:02.607859 31027 tablet_service.cc:1511] Processing CreateTablet for tablet 5ac04addd4de4c08b675378caad669eb (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:02.607893 31028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e7cd07bf1024d319a5ba81f318fee7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.611150 30886 tablet_service.cc:1511] Processing CreateTablet for tablet 5ac04addd4de4c08b675378caad669eb (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:02.612462 30886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac04addd4de4c08b675378caad669eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.612303 31030 tablet_service.cc:1511] Processing CreateTablet for tablet 6320819f0ea6431d9b458283989e15af (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:02.612610 30954 tablet_service.cc:1511] Processing CreateTablet for tablet 5ac04addd4de4c08b675378caad669eb (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:02.613694 31030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6320819f0ea6431d9b458283989e15af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.614624 30881 tablet_service.cc:1511] Processing CreateTablet for tablet 6320819f0ea6431d9b458283989e15af (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:02.615263 31027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac04addd4de4c08b675378caad669eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.615943 30881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6320819f0ea6431d9b458283989e15af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.614694 30961 tablet_service.cc:1511] Processing CreateTablet for tablet 6320819f0ea6431d9b458283989e15af (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:02.619079 30961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6320819f0ea6431d9b458283989e15af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.621973 30954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac04addd4de4c08b675378caad669eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.604633 30955 tablet_service.cc:1511] Processing CreateTablet for tablet 8e7cd07bf1024d319a5ba81f318fee7a (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:02.623538 30955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e7cd07bf1024d319a5ba81f318fee7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.627665 30878 tablet_service.cc:1511] Processing CreateTablet for tablet 45f974fe0e6d49edbb2662bc75a1f8e1 (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:02.629027 30878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45f974fe0e6d49edbb2662bc75a1f8e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.631075 31029 tablet_service.cc:1511] Processing CreateTablet for tablet 45f974fe0e6d49edbb2662bc75a1f8e1 (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:02.632457 31029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45f974fe0e6d49edbb2662bc75a1f8e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.631116 30958 tablet_service.cc:1511] Processing CreateTablet for tablet 45f974fe0e6d49edbb2662bc75a1f8e1 (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:02.635082 30958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45f974fe0e6d49edbb2662bc75a1f8e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.638680 30882 tablet_service.cc:1511] Processing CreateTablet for tablet f2564f17e51f4543bcdd61e46f2d509c (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:02.640112 30882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2564f17e51f4543bcdd61e46f2d509c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.649899 30959 tablet_service.cc:1511] Processing CreateTablet for tablet f2564f17e51f4543bcdd61e46f2d509c (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:02.650419 31032 tablet_service.cc:1511] Processing CreateTablet for tablet f2564f17e51f4543bcdd61e46f2d509c (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:02.651407 30959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2564f17e51f4543bcdd61e46f2d509c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.651726 31032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2564f17e51f4543bcdd61e46f2d509c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.672829 30884 tablet_service.cc:1511] Processing CreateTablet for tablet 52a08358734c42b1b8c11568606c82bb (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:02.674329 30884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a08358734c42b1b8c11568606c82bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.677919 30885 tablet_service.cc:1511] Processing CreateTablet for tablet 38f084e479b04ba394f83d3c1f7069ef (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:02.679311 30885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38f084e479b04ba394f83d3c1f7069ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.682888 30956 tablet_service.cc:1511] Processing CreateTablet for tablet 52a08358734c42b1b8c11568606c82bb (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:02.684278 30956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a08358734c42b1b8c11568606c82bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.687006 30957 tablet_service.cc:1511] Processing CreateTablet for tablet 38f084e479b04ba394f83d3c1f7069ef (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:02.688393 30957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38f084e479b04ba394f83d3c1f7069ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.689563 30880 tablet_service.cc:1511] Processing CreateTablet for tablet 1cfb6780d4ab49c2afa79d6ae7c7bb23 (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:02.690831 30880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cfb6780d4ab49c2afa79d6ae7c7bb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.700868 31033 tablet_service.cc:1511] Processing CreateTablet for tablet 38f084e479b04ba394f83d3c1f7069ef (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:02.702337 31033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38f084e479b04ba394f83d3c1f7069ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.707561 31035 tablet_service.cc:1511] Processing CreateTablet for tablet 1cfb6780d4ab49c2afa79d6ae7c7bb23 (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:02.708899 31035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cfb6780d4ab49c2afa79d6ae7c7bb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.710079 30953 tablet_service.cc:1511] Processing CreateTablet for tablet 1cfb6780d4ab49c2afa79d6ae7c7bb23 (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:02.711422 30953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cfb6780d4ab49c2afa79d6ae7c7bb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:02.726928 31030 tablet_service.cc:1511] Processing CreateTablet for tablet 52a08358734c42b1b8c11568606c82bb (DEFAULT_TABLE table=soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:02.737982 31190 tablet_bootstrap.cc:492] T 6320819f0ea6431d9b458283989e15af P d02e5f60274b43a3a8d95c337273cf50: Bootstrap starting.
I20260709 13:23:02.728410 31030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a08358734c42b1b8c11568606c82bb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:23:02.794617 30842 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:02.803910 31190 tablet_bootstrap.cc:654] T 6320819f0ea6431d9b458283989e15af P d02e5f60274b43a3a8d95c337273cf50: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.810858 31191 tablet_bootstrap.cc:492] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03: Bootstrap starting.
I20260709 13:23:02.834306 31193 tablet_bootstrap.cc:492] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507: Bootstrap starting.
I20260709 13:23:02.842307 31190 tablet_bootstrap.cc:492] T 6320819f0ea6431d9b458283989e15af P d02e5f60274b43a3a8d95c337273cf50: No bootstrap required, opened a new log
I20260709 13:23:02.843022 31190 ts_tablet_manager.cc:1403] T 6320819f0ea6431d9b458283989e15af P d02e5f60274b43a3a8d95c337273cf50: Time spent bootstrapping tablet: real 0.105s	user 0.007s	sys 0.006s
I20260709 13:23:02.845296 31191 tablet_bootstrap.cc:654] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.849050 31193 tablet_bootstrap.cc:654] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.846241 31190 raft_consensus.cc:359] T 6320819f0ea6431d9b458283989e15af P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.850620 31190 raft_consensus.cc:385] T 6320819f0ea6431d9b458283989e15af P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.850940 31190 raft_consensus.cc:740] T 6320819f0ea6431d9b458283989e15af P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.851982 31190 consensus_queue.cc:260] T 6320819f0ea6431d9b458283989e15af P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.854619 31190 ts_tablet_manager.cc:1434] T 6320819f0ea6431d9b458283989e15af P d02e5f60274b43a3a8d95c337273cf50: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:23:02.856298 31190 tablet_bootstrap.cc:492] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50: Bootstrap starting.
I20260709 13:23:02.863150 31190 tablet_bootstrap.cc:654] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.864334 31193 tablet_bootstrap.cc:492] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507: No bootstrap required, opened a new log
I20260709 13:23:02.864939 31191 tablet_bootstrap.cc:492] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03: No bootstrap required, opened a new log
I20260709 13:23:02.865100 31193 ts_tablet_manager.cc:1403] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.008s
I20260709 13:23:02.865661 31191 ts_tablet_manager.cc:1403] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.009s
I20260709 13:23:02.869029 31193 raft_consensus.cc:359] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.870179 31193 raft_consensus.cc:385] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.870034 31191 raft_consensus.cc:359] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.870929 31193 raft_consensus.cc:740] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.871224 31191 raft_consensus.cc:385] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.871688 31191 raft_consensus.cc:740] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.871899 31190 tablet_bootstrap.cc:492] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50: No bootstrap required, opened a new log
I20260709 13:23:02.871992 31193 consensus_queue.cc:260] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.872978 31190 ts_tablet_manager.cc:1403] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:23:02.872737 31191 consensus_queue.cc:260] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.875438 31191 ts_tablet_manager.cc:1434] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:23:02.877046 31191 tablet_bootstrap.cc:492] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03: Bootstrap starting.
I20260709 13:23:02.876798 31190 raft_consensus.cc:359] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.877817 31190 raft_consensus.cc:385] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.878223 31190 raft_consensus.cc:740] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.879055 31193 ts_tablet_manager.cc:1434] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:23:02.879293 31190 consensus_queue.cc:260] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.880465 31193 tablet_bootstrap.cc:492] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507: Bootstrap starting.
I20260709 13:23:02.882540 31190 ts_tablet_manager.cc:1434] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:23:02.883806 31190 tablet_bootstrap.cc:492] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50: Bootstrap starting.
I20260709 13:23:02.886700 31191 tablet_bootstrap.cc:654] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.888774 31193 tablet_bootstrap.cc:654] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.895578 31190 tablet_bootstrap.cc:654] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.901388 31193 tablet_bootstrap.cc:492] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507: No bootstrap required, opened a new log
I20260709 13:23:02.901993 31193 ts_tablet_manager.cc:1403] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.002s
I20260709 13:23:02.905041 31193 raft_consensus.cc:359] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.905889 31193 raft_consensus.cc:385] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.906190 31193 raft_consensus.cc:740] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.907141 31191 tablet_bootstrap.cc:492] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03: No bootstrap required, opened a new log
I20260709 13:23:02.907797 31191 ts_tablet_manager.cc:1403] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.001s
I20260709 13:23:02.907147 31193 consensus_queue.cc:260] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.910424 31190 tablet_bootstrap.cc:492] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50: No bootstrap required, opened a new log
I20260709 13:23:02.911078 31193 ts_tablet_manager.cc:1434] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:23:02.911137 31190 ts_tablet_manager.cc:1403] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.008s
I20260709 13:23:02.911185 31191 raft_consensus.cc:359] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.912249 31191 raft_consensus.cc:385] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.912496 31193 tablet_bootstrap.cc:492] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507: Bootstrap starting.
I20260709 13:23:02.912552 31191 raft_consensus.cc:740] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.913661 31191 consensus_queue.cc:260] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.915637 31190 raft_consensus.cc:359] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.916599 31190 raft_consensus.cc:385] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.917011 31190 raft_consensus.cc:740] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.918139 31190 consensus_queue.cc:260] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.921262 31193 tablet_bootstrap.cc:654] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.924368 31191 ts_tablet_manager.cc:1434] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:23:02.925494 31191 tablet_bootstrap.cc:492] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03: Bootstrap starting.
I20260709 13:23:02.929507 31178 raft_consensus.cc:493] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.930136 31178 raft_consensus.cc:515] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.931197 31190 ts_tablet_manager.cc:1434] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:23:02.932458 31178 leader_election.cc:290] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:02.934021 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e7cd07bf1024d319a5ba81f318fee7a" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03" is_pre_election: true
I20260709 13:23:02.935133 30896 raft_consensus.cc:2468] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 0.
I20260709 13:23:02.936182 31191 tablet_bootstrap.cc:654] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.935153 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e7cd07bf1024d319a5ba81f318fee7a" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50" is_pre_election: true
I20260709 13:23:02.937579 31045 raft_consensus.cc:2468] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 0.
I20260709 13:23:02.938755 31178 raft_consensus.cc:493] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.939302 31178 raft_consensus.cc:515] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.939215 30936 leader_election.cc:304] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, d02e5f60274b43a3a8d95c337273cf50; no voters: 
I20260709 13:23:02.940464 31193 tablet_bootstrap.cc:492] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507: No bootstrap required, opened a new log
I20260709 13:23:02.941037 31193 ts_tablet_manager.cc:1403] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.011s
I20260709 13:23:02.939361 31190 tablet_bootstrap.cc:492] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50: Bootstrap starting.
I20260709 13:23:02.941577 31178 leader_election.cc:290] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:02.942241 31178 raft_consensus.cc:2804] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:02.942621 31178 raft_consensus.cc:493] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:02.942950 31178 raft_consensus.cc:3060] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.944564 31193 raft_consensus.cc:359] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.945391 31193 raft_consensus.cc:385] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.945544 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb6780d4ab49c2afa79d6ae7c7bb23" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03" is_pre_election: true
I20260709 13:23:02.951558 31190 tablet_bootstrap.cc:654] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:02.951773 30937 leader_election.cc:343] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.951656 31178 raft_consensus.cc:515] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.955726 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e7cd07bf1024d319a5ba81f318fee7a" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
I20260709 13:23:02.956344 30896 raft_consensus.cc:3060] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:02.947232 31071 tablet.cc:2406] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:23:02.945708 31193 raft_consensus.cc:740] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.959050 31193 consensus_queue.cc:260] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.964346 30896 raft_consensus.cc:2468] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 1.
I20260709 13:23:02.966028 30937 leader_election.cc:304] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:23:02.966642 31190 tablet_bootstrap.cc:492] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50: No bootstrap required, opened a new log
I20260709 13:23:02.967417 31190 ts_tablet_manager.cc:1403] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50: Time spent bootstrapping tablet: real 0.028s	user 0.022s	sys 0.000s
I20260709 13:23:02.968696 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb6780d4ab49c2afa79d6ae7c7bb23" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50" is_pre_election: true
W20260709 13:23:02.970481 30936 leader_election.cc:343] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.970978 30936 leader_election.cc:304] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507; no voters: d02e5f60274b43a3a8d95c337273cf50, ee4524bd626f435e9a2fe90de49d7c03
I20260709 13:23:02.972427 31193 ts_tablet_manager.cc:1434] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent starting tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 13:23:02.975145 31205 raft_consensus.cc:493] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.975669 31202 raft_consensus.cc:2804] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:02.976400 31202 raft_consensus.cc:697] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Becoming Leader. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Running, Role: LEADER
I20260709 13:23:02.975785 31205 raft_consensus.cc:515] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.976569 31190 raft_consensus.cc:359] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.977284 31178 leader_election.cc:290] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 election: Requested vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:02.977751 31190 raft_consensus.cc:385] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.979108 31190 raft_consensus.cc:740] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.979990 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2564f17e51f4543bcdd61e46f2d509c" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03" is_pre_election: true
I20260709 13:23:02.977485 31202 consensus_queue.cc:237] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.980268 31190 consensus_queue.cc:260] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:02.979298 31193 tablet_bootstrap.cc:492] T 74750d56a0f5492091226aad1869538c P c8c0111e08ed44e5ba8ff1018fcb7507: Bootstrap starting.
W20260709 13:23:02.981604 30937 leader_election.cc:343] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.978876 31205 leader_election.cc:290] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:02.985673 31190 ts_tablet_manager.cc:1434] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:23:02.986886 31190 tablet_bootstrap.cc:492] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50: Bootstrap starting.
I20260709 13:23:02.989928 31193 tablet_bootstrap.cc:654] T 74750d56a0f5492091226aad1869538c P c8c0111e08ed44e5ba8ff1018fcb7507: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.977942 31178 raft_consensus.cc:2749] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:02.997329 31190 tablet_bootstrap.cc:654] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.000440 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e7cd07bf1024d319a5ba81f318fee7a" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:23:03.001214 31045 raft_consensus.cc:3060] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.997288 30791 catalog_manager.cc:5697] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:03.005607 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2564f17e51f4543bcdd61e46f2d509c" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50" is_pre_election: true
W20260709 13:23:03.009964 30936 leader_election.cc:343] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.010557 30936 leader_election.cc:304] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507; no voters: d02e5f60274b43a3a8d95c337273cf50, ee4524bd626f435e9a2fe90de49d7c03
I20260709 13:23:03.011535 31178 raft_consensus.cc:2749] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:03.015981 31045 raft_consensus.cc:2468] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 1.
I20260709 13:23:03.022671 31191 tablet_bootstrap.cc:492] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03: No bootstrap required, opened a new log
I20260709 13:23:03.023479 31191 ts_tablet_manager.cc:1403] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.003s
I20260709 13:23:03.023412 31193 tablet_bootstrap.cc:492] T 74750d56a0f5492091226aad1869538c P c8c0111e08ed44e5ba8ff1018fcb7507: No bootstrap required, opened a new log
I20260709 13:23:03.024824 31193 ts_tablet_manager.cc:1403] T 74750d56a0f5492091226aad1869538c P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.011s
I20260709 13:23:03.025169 31190 tablet_bootstrap.cc:492] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50: No bootstrap required, opened a new log
I20260709 13:23:03.027667 31190 ts_tablet_manager.cc:1403] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.016s
I20260709 13:23:03.028059 31191 raft_consensus.cc:359] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.028854 31191 raft_consensus.cc:385] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.029152 31191 raft_consensus.cc:740] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.029917 31191 consensus_queue.cc:260] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.030741 31190 raft_consensus.cc:359] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.031569 31190 raft_consensus.cc:385] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.031216 31193 raft_consensus.cc:359] T 74750d56a0f5492091226aad1869538c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.031870 31190 raft_consensus.cc:740] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.031992 31193 raft_consensus.cc:385] T 74750d56a0f5492091226aad1869538c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.032145 31191 ts_tablet_manager.cc:1434] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:23:03.032310 31193 raft_consensus.cc:740] T 74750d56a0f5492091226aad1869538c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.032698 31190 consensus_queue.cc:260] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.033416 31191 tablet_bootstrap.cc:492] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03: Bootstrap starting.
I20260709 13:23:03.033445 31193 consensus_queue.cc:260] T 74750d56a0f5492091226aad1869538c P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.035545 31190 ts_tablet_manager.cc:1434] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:23:03.036593 31190 tablet_bootstrap.cc:492] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50: Bootstrap starting.
I20260709 13:23:03.041536 31191 tablet_bootstrap.cc:654] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.041980 31177 raft_consensus.cc:493] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.042968 31190 tablet_bootstrap.cc:654] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.043165 31177 raft_consensus.cc:515] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.045465 31177 leader_election.cc:290] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035)
I20260709 13:23:03.050302 31193 ts_tablet_manager.cc:1434] T 74750d56a0f5492091226aad1869538c P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:23:03.052091 31193 tablet_bootstrap.cc:492] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507: Bootstrap starting.
I20260709 13:23:03.061944 31193 tablet_bootstrap.cc:654] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.068673 31191 tablet_bootstrap.cc:492] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03: No bootstrap required, opened a new log
I20260709 13:23:03.069284 31191 ts_tablet_manager.cc:1403] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.003s
I20260709 13:23:03.073273 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac04addd4de4c08b675378caad669eb" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03" is_pre_election: true
I20260709 13:23:03.075968 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac04addd4de4c08b675378caad669eb" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" is_pre_election: true
I20260709 13:23:03.077286 31191 raft_consensus.cc:359] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.084277 31191 raft_consensus.cc:385] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.084635 31191 raft_consensus.cc:740] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.085461 31191 consensus_queue.cc:260] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
W20260709 13:23:03.087563 31011 leader_election.cc:343] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:03.089129 31011 leader_election.cc:343] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.089776 31190 tablet_bootstrap.cc:492] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50: No bootstrap required, opened a new log
I20260709 13:23:03.090464 31190 ts_tablet_manager.cc:1403] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.036s
I20260709 13:23:03.089795 31011 leader_election.cc:304] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50; no voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03
I20260709 13:23:03.091318 31211 raft_consensus.cc:2749] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:03.093918 31190 raft_consensus.cc:359] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.094614 31191 ts_tablet_manager.cc:1434] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:23:03.094761 31193 tablet_bootstrap.cc:492] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507: No bootstrap required, opened a new log
I20260709 13:23:03.094699 31190 raft_consensus.cc:385] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.095449 31190 raft_consensus.cc:740] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.095531 31193 ts_tablet_manager.cc:1403] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.027s
I20260709 13:23:03.095988 31191 tablet_bootstrap.cc:492] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03: Bootstrap starting.
I20260709 13:23:03.096439 31190 consensus_queue.cc:260] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.099107 31190 ts_tablet_manager.cc:1434] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:23:03.098837 31193 raft_consensus.cc:359] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.099694 31193 raft_consensus.cc:385] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.100059 31193 raft_consensus.cc:740] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.100570 31190 tablet_bootstrap.cc:492] T 74750d56a0f5492091226aad1869538c P d02e5f60274b43a3a8d95c337273cf50: Bootstrap starting.
I20260709 13:23:03.100872 31193 consensus_queue.cc:260] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.106806 31192 raft_consensus.cc:493] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.110275 31190 tablet_bootstrap.cc:654] T 74750d56a0f5492091226aad1869538c P d02e5f60274b43a3a8d95c337273cf50: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.110033 31192 raft_consensus.cc:515] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.107255 31193 ts_tablet_manager.cc:1434] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:23:03.112284 31192 leader_election.cc:290] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:03.113041 31193 tablet_bootstrap.cc:492] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507: Bootstrap starting.
I20260709 13:23:03.113359 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6320819f0ea6431d9b458283989e15af" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" is_pre_election: true
I20260709 13:23:03.106379 31191 tablet_bootstrap.cc:654] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.119832 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6320819f0ea6431d9b458283989e15af" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50" is_pre_election: true
I20260709 13:23:03.120440 31193 tablet_bootstrap.cc:654] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.120956 31044 raft_consensus.cc:2468] T 6320819f0ea6431d9b458283989e15af P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 0.
W20260709 13:23:03.124233 30862 leader_election.cc:343] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.127648 31193 tablet_bootstrap.cc:492] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507: No bootstrap required, opened a new log
I20260709 13:23:03.127648 31191 tablet_bootstrap.cc:492] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03: No bootstrap required, opened a new log
I20260709 13:23:03.128511 31193 ts_tablet_manager.cc:1403] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.002s
I20260709 13:23:03.128511 31191 ts_tablet_manager.cc:1403] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.005s
I20260709 13:23:03.129040 30861 leader_election.cc:304] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50, ee4524bd626f435e9a2fe90de49d7c03; no voters: c8c0111e08ed44e5ba8ff1018fcb7507
I20260709 13:23:03.131081 31192 raft_consensus.cc:2804] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:03.131656 31192 raft_consensus.cc:493] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:03.132190 31192 raft_consensus.cc:3060] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.133158 31193 raft_consensus.cc:359] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.133970 31193 raft_consensus.cc:385] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.134240 31193 raft_consensus.cc:740] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.135309 31193 consensus_queue.cc:260] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.131953 31191 raft_consensus.cc:359] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.136842 31191 raft_consensus.cc:385] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.137157 31191 raft_consensus.cc:740] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.138005 31191 consensus_queue.cc:260] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.140283 31193 ts_tablet_manager.cc:1434] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:23:03.140422 31190 tablet_bootstrap.cc:492] T 74750d56a0f5492091226aad1869538c P d02e5f60274b43a3a8d95c337273cf50: No bootstrap required, opened a new log
I20260709 13:23:03.140870 31191 ts_tablet_manager.cc:1434] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:23:03.141088 31190 ts_tablet_manager.cc:1403] T 74750d56a0f5492091226aad1869538c P d02e5f60274b43a3a8d95c337273cf50: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.025s
I20260709 13:23:03.141557 31193 tablet_bootstrap.cc:492] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507: Bootstrap starting.
I20260709 13:23:03.141969 31191 tablet_bootstrap.cc:492] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P ee4524bd626f435e9a2fe90de49d7c03: Bootstrap starting.
I20260709 13:23:03.144650 31190 raft_consensus.cc:359] T 74750d56a0f5492091226aad1869538c P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.145458 31190 raft_consensus.cc:385] T 74750d56a0f5492091226aad1869538c P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.145823 31190 raft_consensus.cc:740] T 74750d56a0f5492091226aad1869538c P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.146616 31190 consensus_queue.cc:260] T 74750d56a0f5492091226aad1869538c P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.149224 31191 tablet_bootstrap.cc:654] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P ee4524bd626f435e9a2fe90de49d7c03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.149296 31190 ts_tablet_manager.cc:1434] T 74750d56a0f5492091226aad1869538c P d02e5f60274b43a3a8d95c337273cf50: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:23:03.150701 31190 tablet_bootstrap.cc:492] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50: Bootstrap starting.
I20260709 13:23:03.149224 31193 tablet_bootstrap.cc:654] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.158551 31190 tablet_bootstrap.cc:654] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.170712 31192 raft_consensus.cc:515] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.179391 31191 tablet_bootstrap.cc:492] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P ee4524bd626f435e9a2fe90de49d7c03: No bootstrap required, opened a new log
I20260709 13:23:03.180037 31191 ts_tablet_manager.cc:1403] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P ee4524bd626f435e9a2fe90de49d7c03: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.011s
I20260709 13:23:03.180663 31190 tablet_bootstrap.cc:492] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50: No bootstrap required, opened a new log
I20260709 13:23:03.181252 31190 ts_tablet_manager.cc:1403] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.012s
I20260709 13:23:03.181397 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6320819f0ea6431d9b458283989e15af" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
W20260709 13:23:03.183019 30862 leader_election.cc:343] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.183140 31191 raft_consensus.cc:359] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.184296 31191 raft_consensus.cc:385] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.184751 31191 raft_consensus.cc:740] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.184398 31190 raft_consensus.cc:359] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.184919 31192 leader_election.cc:290] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Requested vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:03.185272 31190 raft_consensus.cc:385] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.185787 31190 raft_consensus.cc:740] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.185567 31191 consensus_queue.cc:260] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.186606 31190 consensus_queue.cc:260] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.186606 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6320819f0ea6431d9b458283989e15af" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:23:03.187688 31044 raft_consensus.cc:3060] T 6320819f0ea6431d9b458283989e15af P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.188081 31191 ts_tablet_manager.cc:1434] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P ee4524bd626f435e9a2fe90de49d7c03: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:23:03.189121 31191 tablet_bootstrap.cc:492] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03: Bootstrap starting.
I20260709 13:23:03.189159 31190 ts_tablet_manager.cc:1434] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:23:03.190308 31190 tablet_bootstrap.cc:492] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50: Bootstrap starting.
I20260709 13:23:03.191850 31193 tablet_bootstrap.cc:492] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507: No bootstrap required, opened a new log
I20260709 13:23:03.192427 31193 ts_tablet_manager.cc:1403] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.011s
I20260709 13:23:03.193430 31211 raft_consensus.cc:493] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.194078 31211 raft_consensus.cc:515] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.195627 31192 raft_consensus.cc:493] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.196110 31177 raft_consensus.cc:493] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.196183 31192 raft_consensus.cc:515] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.196768 31177 raft_consensus.cc:515] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.198794 31190 tablet_bootstrap.cc:654] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.198812 31177 leader_election.cc:290] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035)
I20260709 13:23:03.199343 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74750d56a0f5492091226aad1869538c" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" is_pre_election: true
I20260709 13:23:03.200007 30969 raft_consensus.cc:2468] T 74750d56a0f5492091226aad1869538c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 0.
I20260709 13:23:03.200585 31191 tablet_bootstrap.cc:654] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.201404 30862 leader_election.cc:304] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:23:03.202358 31111 raft_consensus.cc:2804] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:03.202724 31111 raft_consensus.cc:493] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:03.202894 31192 leader_election.cc:290] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:03.203112 31111 raft_consensus.cc:3060] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.203895 31193 raft_consensus.cc:359] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.204715 31193 raft_consensus.cc:385] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.204368 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb6780d4ab49c2afa79d6ae7c7bb23" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03" is_pre_election: true
I20260709 13:23:03.205068 31193 raft_consensus.cc:740] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.205461 30896 raft_consensus.cc:2468] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 0.
I20260709 13:23:03.206060 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f084e479b04ba394f83d3c1f7069ef" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" is_pre_election: true
I20260709 13:23:03.206234 31193 consensus_queue.cc:260] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.207052 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f084e479b04ba394f83d3c1f7069ef" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03" is_pre_election: true
W20260709 13:23:03.207688 31011 leader_election.cc:343] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.208875 31193 ts_tablet_manager.cc:1434] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:23:03.210057 31193 tablet_bootstrap.cc:492] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507: Bootstrap starting.
I20260709 13:23:03.210952 31190 tablet_bootstrap.cc:492] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50: No bootstrap required, opened a new log
I20260709 13:23:03.211524 31190 ts_tablet_manager.cc:1403] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 13:23:03.214241 31111 raft_consensus.cc:515] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.214828 31190 raft_consensus.cc:359] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.215567 31190 raft_consensus.cc:385] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.215864 31190 raft_consensus.cc:740] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.216563 31190 consensus_queue.cc:260] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.217013 31193 tablet_bootstrap.cc:654] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.217650 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74750d56a0f5492091226aad1869538c" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:23:03.218327 30970 raft_consensus.cc:3060] T 74750d56a0f5492091226aad1869538c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.218575 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74750d56a0f5492091226aad1869538c" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50" is_pre_election: true
I20260709 13:23:03.219223 31045 raft_consensus.cc:2468] T 74750d56a0f5492091226aad1869538c P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 0.
I20260709 13:23:03.221817 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb6780d4ab49c2afa79d6ae7c7bb23" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" is_pre_election: true
I20260709 13:23:03.222514 30969 raft_consensus.cc:2468] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 0.
I20260709 13:23:03.221015 31111 leader_election.cc:290] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Requested vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:03.226271 30970 raft_consensus.cc:2468] T 74750d56a0f5492091226aad1869538c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 1.
I20260709 13:23:03.227828 30862 leader_election.cc:304] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:23:03.218300 31190 ts_tablet_manager.cc:1434] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:23:03.228638 31111 raft_consensus.cc:2804] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:03.229380 31111 raft_consensus.cc:697] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Becoming Leader. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:23:03.230237 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74750d56a0f5492091226aad1869538c" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:23:03.230259 31111 consensus_queue.cc:237] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.231079 31045 raft_consensus.cc:3060] T 74750d56a0f5492091226aad1869538c P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.233498 31191 tablet_bootstrap.cc:492] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03: No bootstrap required, opened a new log
I20260709 13:23:03.234112 31191 ts_tablet_manager.cc:1403] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.004s
I20260709 13:23:03.196584 31211 leader_election.cc:290] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035)
I20260709 13:23:03.237282 31191 raft_consensus.cc:359] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.238101 31191 raft_consensus.cc:385] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.237500 31011 leader_election.cc:304] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, d02e5f60274b43a3a8d95c337273cf50; no voters: 
W20260709 13:23:03.239396 31011 leader_election.cc:343] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.239841 31011 leader_election.cc:304] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50; no voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03
I20260709 13:23:03.240589 31177 raft_consensus.cc:2804] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:03.240974 31177 raft_consensus.cc:493] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:03.241295 31177 raft_consensus.cc:3060] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.246048 31211 raft_consensus.cc:2749] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:03.252658 31177 raft_consensus.cc:515] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.265249 31191 raft_consensus.cc:740] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.268126 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb6780d4ab49c2afa79d6ae7c7bb23" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:23:03.269089 30970 raft_consensus.cc:3060] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.265705 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb6780d4ab49c2afa79d6ae7c7bb23" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
I20260709 13:23:03.270046 30895 raft_consensus.cc:3060] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.266850 31177 leader_election.cc:290] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 election: Requested vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035)
I20260709 13:23:03.280228 30970 raft_consensus.cc:2468] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 1.
I20260709 13:23:03.282254 31011 leader_election.cc:304] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, d02e5f60274b43a3a8d95c337273cf50; no voters: 
I20260709 13:23:03.283550 31177 raft_consensus.cc:2804] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:03.285496 31177 raft_consensus.cc:697] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [term 1 LEADER]: Becoming Leader. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Running, Role: LEADER
I20260709 13:23:03.286104 31044 raft_consensus.cc:2468] T 6320819f0ea6431d9b458283989e15af P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 1.
I20260709 13:23:03.286860 31177 consensus_queue.cc:237] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.288398 30861 leader_election.cc:304] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50, ee4524bd626f435e9a2fe90de49d7c03; no voters: c8c0111e08ed44e5ba8ff1018fcb7507
I20260709 13:23:03.289702 31192 raft_consensus.cc:2804] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:03.290423 31193 tablet_bootstrap.cc:492] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507: No bootstrap required, opened a new log
I20260709 13:23:03.289989 31191 consensus_queue.cc:260] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.290985 31193 ts_tablet_manager.cc:1403] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.012s
I20260709 13:23:03.294776 31193 raft_consensus.cc:359] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.295722 31193 raft_consensus.cc:385] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.296057 31193 raft_consensus.cc:740] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.296847 31045 raft_consensus.cc:2468] T 74750d56a0f5492091226aad1869538c P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 1.
I20260709 13:23:03.301011 31193 consensus_queue.cc:260] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.304301 31193 ts_tablet_manager.cc:1434] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:23:03.309438 31192 raft_consensus.cc:697] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Becoming Leader. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:23:03.310576 31193 tablet_bootstrap.cc:492] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507: Bootstrap starting.
I20260709 13:23:03.310957 31192 consensus_queue.cc:237] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.315224 30895 raft_consensus.cc:2468] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 1.
I20260709 13:23:03.321889 31211 raft_consensus.cc:493] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.322880 31211 raft_consensus.cc:515] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.324431 31193 tablet_bootstrap.cc:654] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.328200 31211 leader_election.cc:290] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035)
I20260709 13:23:03.332056 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f974fe0e6d49edbb2662bc75a1f8e1" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" is_pre_election: true
I20260709 13:23:03.332964 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f974fe0e6d49edbb2662bc75a1f8e1" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03" is_pre_election: true
I20260709 13:23:03.333215 30970 raft_consensus.cc:2468] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 0.
I20260709 13:23:03.334034 30896 raft_consensus.cc:2468] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 0.
I20260709 13:23:03.335498 31011 leader_election.cc:304] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:23:03.337646 31202 raft_consensus.cc:493] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.338213 31202 raft_consensus.cc:515] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.338797 31211 raft_consensus.cc:2804] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:03.339298 31211 raft_consensus.cc:493] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:03.339625 31211 raft_consensus.cc:3060] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.344866 31202 leader_election.cc:290] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:03.345201 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6320819f0ea6431d9b458283989e15af" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03" is_pre_election: true
I20260709 13:23:03.343998 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6320819f0ea6431d9b458283989e15af" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50" is_pre_election: true
I20260709 13:23:03.348841 31045 raft_consensus.cc:2393] T 6320819f0ea6431d9b458283989e15af P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c8c0111e08ed44e5ba8ff1018fcb7507 in current term 1: Already voted for candidate ee4524bd626f435e9a2fe90de49d7c03 in this term.
I20260709 13:23:03.350917 30936 leader_election.cc:304] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507; no voters: d02e5f60274b43a3a8d95c337273cf50, ee4524bd626f435e9a2fe90de49d7c03
I20260709 13:23:03.352140 31202 raft_consensus.cc:3060] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.348826 31193 tablet_bootstrap.cc:492] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507: No bootstrap required, opened a new log
I20260709 13:23:03.355468 31193 ts_tablet_manager.cc:1403] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.003s
I20260709 13:23:03.381500 31193 raft_consensus.cc:359] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.388937 31193 raft_consensus.cc:385] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.389288 31193 raft_consensus.cc:740] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.390226 31193 consensus_queue.cc:260] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.399947 31193 ts_tablet_manager.cc:1434] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.008s
I20260709 13:23:03.388260 31211 raft_consensus.cc:515] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.403563 31211 leader_election.cc:290] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 election: Requested vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035)
I20260709 13:23:03.407413 30791 catalog_manager.cc:5697] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "ee4524bd626f435e9a2fe90de49d7c03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:03.409464 30794 catalog_manager.cc:5697] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "d02e5f60274b43a3a8d95c337273cf50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:03.415210 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f974fe0e6d49edbb2662bc75a1f8e1" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:23:03.415908 30970 raft_consensus.cc:3060] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.411586 31225 raft_consensus.cc:493] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.416850 31225 raft_consensus.cc:515] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.418597 31202 raft_consensus.cc:2749] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:03.419059 31225 leader_election.cc:290] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:03.419752 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f974fe0e6d49edbb2662bc75a1f8e1" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
I20260709 13:23:03.420413 30895 raft_consensus.cc:3060] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.422964 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2564f17e51f4543bcdd61e46f2d509c" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50" is_pre_election: true
I20260709 13:23:03.423660 31044 raft_consensus.cc:2468] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 0.
I20260709 13:23:03.423780 30970 raft_consensus.cc:2468] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 1.
I20260709 13:23:03.427457 30895 raft_consensus.cc:2468] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 1.
I20260709 13:23:03.428011 31011 leader_election.cc:304] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, d02e5f60274b43a3a8d95c337273cf50; no voters: 
I20260709 13:23:03.428398 31202 raft_consensus.cc:493] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.428910 31202 raft_consensus.cc:515] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.431455 31177 raft_consensus.cc:2804] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:03.431949 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac04addd4de4c08b675378caad669eb" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50" is_pre_election: true
I20260709 13:23:03.428244 30861 leader_election.cc:304] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:23:03.432602 31044 raft_consensus.cc:2468] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 0.
I20260709 13:23:03.433866 30936 leader_election.cc:304] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, d02e5f60274b43a3a8d95c337273cf50; no voters: 
I20260709 13:23:03.434742 31207 raft_consensus.cc:2804] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:03.434891 31225 raft_consensus.cc:2804] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:03.435138 31207 raft_consensus.cc:493] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:03.435406 31225 raft_consensus.cc:493] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:03.435534 31207 raft_consensus.cc:3060] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.435786 31225 raft_consensus.cc:3060] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.440645 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac04addd4de4c08b675378caad669eb" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03" is_pre_election: true
I20260709 13:23:03.441376 30894 raft_consensus.cc:2468] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 0.
I20260709 13:23:03.441761 31191 ts_tablet_manager.cc:1434] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03: Time spent starting tablet: real 0.207s	user 0.032s	sys 0.057s
I20260709 13:23:03.444729 31191 tablet_bootstrap.cc:492] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03: Bootstrap starting.
I20260709 13:23:03.445664 31207 raft_consensus.cc:515] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.447157 31177 raft_consensus.cc:697] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 1 LEADER]: Becoming Leader. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Running, Role: LEADER
I20260709 13:23:03.448112 31177 consensus_queue.cc:237] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.448647 31178 consensus_queue.cc:1048] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:03.448900 31202 leader_election.cc:290] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:03.449018 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2564f17e51f4543bcdd61e46f2d509c" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" is_pre_election: true
I20260709 13:23:03.449792 30970 raft_consensus.cc:2468] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 0.
I20260709 13:23:03.454809 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac04addd4de4c08b675378caad669eb" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:23:03.455405 31044 raft_consensus.cc:3060] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.457238 31191 tablet_bootstrap.cc:654] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.456918 30794 catalog_manager.cc:5697] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "ee4524bd626f435e9a2fe90de49d7c03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:03.460004 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac04addd4de4c08b675378caad669eb" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
I20260709 13:23:03.460669 30894 raft_consensus.cc:3060] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.464141 31044 raft_consensus.cc:2468] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 1.
I20260709 13:23:03.464941 31207 leader_election.cc:290] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 election: Requested vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:03.464326 30791 catalog_manager.cc:5697] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "d02e5f60274b43a3a8d95c337273cf50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:03.465572 30936 leader_election.cc:304] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, d02e5f60274b43a3a8d95c337273cf50; no voters: 
I20260709 13:23:03.467584 31207 raft_consensus.cc:2804] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:03.467283 31225 raft_consensus.cc:515] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.468429 30894 raft_consensus.cc:2468] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 1.
I20260709 13:23:03.469050 31207 raft_consensus.cc:697] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Becoming Leader. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Running, Role: LEADER
I20260709 13:23:03.470058 31207 consensus_queue.cc:237] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.470381 31225 leader_election.cc:290] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Requested vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:03.471517 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2564f17e51f4543bcdd61e46f2d509c" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:23:03.471891 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2564f17e51f4543bcdd61e46f2d509c" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:23:03.472180 30970 raft_consensus.cc:3060] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.472668 31045 raft_consensus.cc:3060] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.480351 30970 raft_consensus.cc:2468] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 1.
I20260709 13:23:03.482247 30862 leader_election.cc:304] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:23:03.483355 31192 raft_consensus.cc:2804] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:03.484740 31192 raft_consensus.cc:697] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Becoming Leader. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:23:03.487843 31192 consensus_queue.cc:237] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.489542 31045 raft_consensus.cc:2468] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 1.
I20260709 13:23:03.494738 31205 consensus_queue.cc:1048] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:03.509605 30791 catalog_manager.cc:5697] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:03.520780 30794 catalog_manager.cc:5697] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129). New cstate: current_term: 1 leader_uuid: "ee4524bd626f435e9a2fe90de49d7c03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:03.521886 31191 tablet_bootstrap.cc:492] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03: No bootstrap required, opened a new log
I20260709 13:23:03.522429 31191 ts_tablet_manager.cc:1403] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03: Time spent bootstrapping tablet: real 0.080s	user 0.018s	sys 0.002s
I20260709 13:23:03.525508 31191 raft_consensus.cc:359] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.526321 31191 raft_consensus.cc:385] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.526602 31191 raft_consensus.cc:740] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.527371 31191 consensus_queue.cc:260] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.529945 31191 ts_tablet_manager.cc:1434] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:23:03.531071 31191 tablet_bootstrap.cc:492] T 38f084e479b04ba394f83d3c1f7069ef P ee4524bd626f435e9a2fe90de49d7c03: Bootstrap starting.
I20260709 13:23:03.532145 31177 raft_consensus.cc:493] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.532752 31177 raft_consensus.cc:515] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.534688 31177 leader_election.cc:290] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035)
I20260709 13:23:03.536633 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a08358734c42b1b8c11568606c82bb" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" is_pre_election: true
I20260709 13:23:03.537179 31191 tablet_bootstrap.cc:654] T 38f084e479b04ba394f83d3c1f7069ef P ee4524bd626f435e9a2fe90de49d7c03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.537340 30970 raft_consensus.cc:2468] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 0.
I20260709 13:23:03.538493 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a08358734c42b1b8c11568606c82bb" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03" is_pre_election: true
I20260709 13:23:03.539220 30896 raft_consensus.cc:2468] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 0.
I20260709 13:23:03.539356 31011 leader_election.cc:304] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, d02e5f60274b43a3a8d95c337273cf50; no voters: 
I20260709 13:23:03.541122 31177 raft_consensus.cc:2804] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:03.541518 31177 raft_consensus.cc:493] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:03.541880 31177 raft_consensus.cc:3060] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.542930 31191 tablet_bootstrap.cc:492] T 38f084e479b04ba394f83d3c1f7069ef P ee4524bd626f435e9a2fe90de49d7c03: No bootstrap required, opened a new log
I20260709 13:23:03.543458 31191 ts_tablet_manager.cc:1403] T 38f084e479b04ba394f83d3c1f7069ef P ee4524bd626f435e9a2fe90de49d7c03: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:23:03.546535 31191 raft_consensus.cc:359] T 38f084e479b04ba394f83d3c1f7069ef P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.547260 31191 raft_consensus.cc:385] T 38f084e479b04ba394f83d3c1f7069ef P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.547537 31191 raft_consensus.cc:740] T 38f084e479b04ba394f83d3c1f7069ef P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.548246 31191 consensus_queue.cc:260] T 38f084e479b04ba394f83d3c1f7069ef P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.550413 31191 ts_tablet_manager.cc:1434] T 38f084e479b04ba394f83d3c1f7069ef P ee4524bd626f435e9a2fe90de49d7c03: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:23:03.554420 31177 raft_consensus.cc:515] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.556293 31177 leader_election.cc:290] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 election: Requested vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035)
I20260709 13:23:03.557204 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a08358734c42b1b8c11568606c82bb" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
I20260709 13:23:03.557500 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a08358734c42b1b8c11568606c82bb" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:23:03.558108 30970 raft_consensus.cc:3060] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.558354 30896 raft_consensus.cc:3060] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.565809 30970 raft_consensus.cc:2468] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 1.
I20260709 13:23:03.565809 30896 raft_consensus.cc:2468] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 1.
I20260709 13:23:03.567327 31011 leader_election.cc:304] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, d02e5f60274b43a3a8d95c337273cf50; no voters: 
I20260709 13:23:03.568177 31177 raft_consensus.cc:2804] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:03.568704 31177 raft_consensus.cc:697] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 1 LEADER]: Becoming Leader. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Running, Role: LEADER
I20260709 13:23:03.569360 31177 consensus_queue.cc:237] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.577558 30794 catalog_manager.cc:5697] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131). New cstate: current_term: 1 leader_uuid: "d02e5f60274b43a3a8d95c337273cf50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:03.634843 31192 consensus_queue.cc:1048] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:03.647028 31226 consensus_queue.cc:1048] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:03.664798 31202 raft_consensus.cc:493] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.665499 31202 raft_consensus.cc:515] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.667311 31202 leader_election.cc:290] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:03.668164 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f084e479b04ba394f83d3c1f7069ef" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03" is_pre_election: true
I20260709 13:23:03.668329 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f084e479b04ba394f83d3c1f7069ef" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50" is_pre_election: true
I20260709 13:23:03.668973 30894 raft_consensus.cc:2468] T 38f084e479b04ba394f83d3c1f7069ef P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 0.
I20260709 13:23:03.669134 31045 raft_consensus.cc:2468] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 0.
I20260709 13:23:03.670280 30937 leader_election.cc:304] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:23:03.670979 31202 raft_consensus.cc:2804] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:03.671324 31202 raft_consensus.cc:493] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:03.671609 31202 raft_consensus.cc:3060] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.677011 31202 raft_consensus.cc:515] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.678881 31202 leader_election.cc:290] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 election: Requested vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:03.679876 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f084e479b04ba394f83d3c1f7069ef" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
I20260709 13:23:03.680081 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f084e479b04ba394f83d3c1f7069ef" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:23:03.680487 30894 raft_consensus.cc:3060] T 38f084e479b04ba394f83d3c1f7069ef P ee4524bd626f435e9a2fe90de49d7c03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.680737 31045 raft_consensus.cc:3060] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.686697 30894 raft_consensus.cc:2468] T 38f084e479b04ba394f83d3c1f7069ef P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 1.
I20260709 13:23:03.686725 31045 raft_consensus.cc:2468] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 1.
I20260709 13:23:03.689193 30937 leader_election.cc:304] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:23:03.690073 31202 raft_consensus.cc:2804] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:03.690698 31202 raft_consensus.cc:697] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Becoming Leader. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Running, Role: LEADER
I20260709 13:23:03.691551 31202 consensus_queue.cc:237] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.700474 30791 catalog_manager.cc:5697] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130). New cstate: current_term: 1 leader_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:03.760188 31177 consensus_queue.cc:1048] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:03.764961 31225 consensus_queue.cc:1048] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:03.776178 31211 consensus_queue.cc:1048] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:03.787384 31192 consensus_queue.cc:1048] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:03.802892 30971 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e7cd07bf1024d319a5ba81f318fee7a"
dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
mode: GRACEFUL
new_leader_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
 from {username='slave'} at 127.0.0.1:46836
I20260709 13:23:03.803597 30971 raft_consensus.cc:606] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Received request to transfer leadership to TS ee4524bd626f435e9a2fe90de49d7c03
I20260709 13:23:03.813664 30970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ac04addd4de4c08b675378caad669eb"
dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
mode: GRACEFUL
new_leader_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
 from {username='slave'} at 127.0.0.1:46836
I20260709 13:23:03.814380 30970 raft_consensus.cc:606] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Received request to transfer leadership to TS ee4524bd626f435e9a2fe90de49d7c03
I20260709 13:23:03.824128 31045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45f974fe0e6d49edbb2662bc75a1f8e1"
dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
mode: GRACEFUL
new_leader_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
 from {username='slave'} at 127.0.0.1:41330
I20260709 13:23:03.824818 31045 raft_consensus.cc:606] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 1 LEADER]: Received request to transfer leadership to TS c8c0111e08ed44e5ba8ff1018fcb7507
I20260709 13:23:03.831369 30894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2564f17e51f4543bcdd61e46f2d509c"
dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
mode: GRACEFUL
new_leader_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
 from {username='slave'} at 127.0.0.1:55652
I20260709 13:23:03.832068 30894 raft_consensus.cc:606] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Received request to transfer leadership to TS c8c0111e08ed44e5ba8ff1018fcb7507
I20260709 13:23:03.838446 31044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52a08358734c42b1b8c11568606c82bb"
dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
mode: GRACEFUL
new_leader_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
 from {username='slave'} at 127.0.0.1:41330
I20260709 13:23:03.838990 31044 raft_consensus.cc:606] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 1 LEADER]: Received request to transfer leadership to TS c8c0111e08ed44e5ba8ff1018fcb7507
I20260709 13:23:03.926585 31211 consensus_queue.cc:1048] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:03.930382 31192 consensus_queue.cc:1048] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:03.934343 31232 raft_consensus.cc:993] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50: : Instructing follower c8c0111e08ed44e5ba8ff1018fcb7507 to start an election
I20260709 13:23:03.934798 31232 raft_consensus.cc:1081] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 1 LEADER]: Signalling peer c8c0111e08ed44e5ba8ff1018fcb7507 to start an election
I20260709 13:23:03.938194 30969 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45f974fe0e6d49edbb2662bc75a1f8e1"
dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
 from {username='slave'} at 127.0.0.1:46822
I20260709 13:23:03.938895 30969 raft_consensus.cc:493] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:03.939294 30969 raft_consensus.cc:3060] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.940776 31232 consensus_queue.cc:1048] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:03.948208 31202 raft_consensus.cc:993] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507: : Instructing follower ee4524bd626f435e9a2fe90de49d7c03 to start an election
I20260709 13:23:03.948737 31202 raft_consensus.cc:1081] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Signalling peer ee4524bd626f435e9a2fe90de49d7c03 to start an election
I20260709 13:23:03.950779 31225 consensus_queue.cc:1048] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:03.951511 30896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e7cd07bf1024d319a5ba81f318fee7a"
dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
 from {username='slave'} at 127.0.0.1:55644
I20260709 13:23:03.952154 30896 raft_consensus.cc:493] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:03.952584 30896 raft_consensus.cc:3060] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.961387 30969 raft_consensus.cc:515] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.967761 30896 raft_consensus.cc:515] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.971642 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e7cd07bf1024d319a5ba81f318fee7a" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:23:03.972316 31044 raft_consensus.cc:3060] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.971974 31207 consensus_queue.cc:1048] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:03.975248 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e7cd07bf1024d319a5ba81f318fee7a" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:23:03.976192 30970 raft_consensus.cc:3055] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:03.976536 30970 raft_consensus.cc:740] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Running, Role: LEADER
I20260709 13:23:03.977346 31192 raft_consensus.cc:993] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03: : Instructing follower c8c0111e08ed44e5ba8ff1018fcb7507 to start an election
I20260709 13:23:03.977933 31192 raft_consensus.cc:1081] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Signalling peer c8c0111e08ed44e5ba8ff1018fcb7507 to start an election
I20260709 13:23:03.977408 30970 consensus_queue.cc:260] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.978833 30970 raft_consensus.cc:3060] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.979763 30971 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2564f17e51f4543bcdd61e46f2d509c"
dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
 from {username='slave'} at 127.0.0.1:46806
I20260709 13:23:03.980410 30971 raft_consensus.cc:493] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:03.980767 30971 raft_consensus.cc:3060] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.981869 31044 raft_consensus.cc:2468] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 2.
I20260709 13:23:03.983419 30861 leader_election.cc:304] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:23:03.985411 31225 raft_consensus.cc:2804] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:03.986442 31225 raft_consensus.cc:697] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [term 2 LEADER]: Becoming Leader. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:23:03.987671 31225 consensus_queue.cc:237] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:03.990787 31207 consensus_queue.cc:1048] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:03.993400 30896 leader_election.cc:290] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 2 election: Requested vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:03.998781 30969 leader_election.cc:290] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 2 election: Requested vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:03.999459 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f974fe0e6d49edbb2662bc75a1f8e1" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
I20260709 13:23:04.000176 30896 raft_consensus.cc:3060] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:04.000800 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f974fe0e6d49edbb2662bc75a1f8e1" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:23:04.001422 31044 raft_consensus.cc:3055] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:04.001724 31044 raft_consensus.cc:740] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Running, Role: LEADER
I20260709 13:23:04.002760 31205 raft_consensus.cc:993] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507: : Instructing follower ee4524bd626f435e9a2fe90de49d7c03 to start an election
I20260709 13:23:04.002557 31044 consensus_queue.cc:260] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:04.003350 31205 raft_consensus.cc:1081] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Signalling peer ee4524bd626f435e9a2fe90de49d7c03 to start an election
I20260709 13:23:04.003852 31044 raft_consensus.cc:3060] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:04.006889 30895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ac04addd4de4c08b675378caad669eb"
dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
 from {username='slave'} at 127.0.0.1:55644
I20260709 13:23:04.007692 30895 raft_consensus.cc:493] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:04.002656 30970 raft_consensus.cc:2468] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 2.
I20260709 13:23:04.008211 30895 raft_consensus.cc:3060] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:04.008867 30971 raft_consensus.cc:515] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:04.014580 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2564f17e51f4543bcdd61e46f2d509c" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:23:04.015273 31043 raft_consensus.cc:3060] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:04.021044 31044 raft_consensus.cc:2468] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 2.
I20260709 13:23:04.022542 30936 leader_election.cc:304] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, d02e5f60274b43a3a8d95c337273cf50; no voters: 
I20260709 13:23:04.023505 31205 raft_consensus.cc:2804] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:04.024021 31205 raft_consensus.cc:697] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 LEADER]: Becoming Leader. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Running, Role: LEADER
I20260709 13:23:04.024893 31205 consensus_queue.cc:237] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:04.007658 30794 catalog_manager.cc:5697] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 reported cstate change: term changed from 1 to 2, leader changed from c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130) to ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "ee4524bd626f435e9a2fe90de49d7c03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:04.032552 30895 raft_consensus.cc:515] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:04.033907 30893 raft_consensus.cc:1240] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Rejecting Update request from peer c8c0111e08ed44e5ba8ff1018fcb7507 for earlier term 1. Current term is 2. Ops: []
I20260709 13:23:04.034955 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2564f17e51f4543bcdd61e46f2d509c" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
I20260709 13:23:04.035624 30894 raft_consensus.cc:3055] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:04.035952 30894 raft_consensus.cc:740] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:23:04.037240 30971 leader_election.cc:290] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 2 election: Requested vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:04.038518 31202 consensus_queue.cc:1059] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:04.038331 30894 consensus_queue.cc:260] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:04.039359 30896 raft_consensus.cc:2468] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 2.
I20260709 13:23:04.032860 31043 raft_consensus.cc:2468] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 2.
I20260709 13:23:04.040205 30894 raft_consensus.cc:3060] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:04.041128 30936 leader_election.cc:304] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, d02e5f60274b43a3a8d95c337273cf50; no voters: 
I20260709 13:23:04.041435 31205 raft_consensus.cc:3055] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:04.041929 31205 raft_consensus.cc:740] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Running, Role: LEADER
I20260709 13:23:04.042164 31207 raft_consensus.cc:2804] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:04.042829 31205 consensus_queue.cc:260] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:04.040238 30895 leader_election.cc:290] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 2 election: Requested vote from peers c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:04.048761 30894 raft_consensus.cc:2468] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 2.
I20260709 13:23:04.050020 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac04addd4de4c08b675378caad669eb" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:23:04.050735 31043 raft_consensus.cc:3060] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:04.052173 31207 raft_consensus.cc:697] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 LEADER]: Becoming Leader. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Running, Role: LEADER
I20260709 13:23:04.052794 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac04addd4de4c08b675378caad669eb" candidate_uuid: "ee4524bd626f435e9a2fe90de49d7c03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:23:04.059098 31207 consensus_queue.cc:237] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:04.060613 31205 raft_consensus.cc:3060] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:04.069157 31043 raft_consensus.cc:2468] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 2.
I20260709 13:23:04.070397 30861 leader_election.cc:304] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:23:04.071245 31225 raft_consensus.cc:2804] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:04.071765 31225 raft_consensus.cc:697] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [term 2 LEADER]: Becoming Leader. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:23:04.072595 31225 consensus_queue.cc:237] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:04.073035 30794 catalog_manager.cc:5697] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 reported cstate change: term changed from 1 to 2, leader changed from d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131) to c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:04.074855 30794 catalog_manager.cc:5697] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 reported cstate change: term changed from 1 to 2, leader changed from ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129) to c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:04.077239 31202 consensus_queue.cc:1048] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:04.080591 30971 raft_consensus.cc:2468] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4524bd626f435e9a2fe90de49d7c03 in term 2.
I20260709 13:23:04.081822 30790 catalog_manager.cc:5697] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 reported cstate change: term changed from 1 to 2, leader changed from c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130) to ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129). New cstate: current_term: 2 leader_uuid: "ee4524bd626f435e9a2fe90de49d7c03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:04.093169 31177 consensus_queue.cc:1048] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:04.095310 31202 consensus_queue.cc:1048] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:04.111366 31232 consensus_queue.cc:1048] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:04.123620 31211 raft_consensus.cc:993] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50: : Instructing follower c8c0111e08ed44e5ba8ff1018fcb7507 to start an election
I20260709 13:23:04.124132 31211 raft_consensus.cc:1081] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 1 LEADER]: Signalling peer c8c0111e08ed44e5ba8ff1018fcb7507 to start an election
I20260709 13:23:04.126577 30971 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52a08358734c42b1b8c11568606c82bb"
dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
 from {username='slave'} at 127.0.0.1:46822
I20260709 13:23:04.127188 30971 raft_consensus.cc:493] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:04.127568 30971 raft_consensus.cc:3060] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:04.133741 30971 raft_consensus.cc:515] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:04.136106 30971 leader_election.cc:290] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 2 election: Requested vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131:40837)
I20260709 13:23:04.136750 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a08358734c42b1b8c11568606c82bb" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
I20260709 13:23:04.137483 30895 raft_consensus.cc:3060] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:04.138638 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a08358734c42b1b8c11568606c82bb" candidate_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
I20260709 13:23:04.139246 31043 raft_consensus.cc:3055] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:04.139520 31043 raft_consensus.cc:740] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Running, Role: LEADER
I20260709 13:23:04.140264 31043 consensus_queue.cc:260] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:04.141326 31043 raft_consensus.cc:3060] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:04.143739 30895 raft_consensus.cc:2468] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 2.
I20260709 13:23:04.144941 30937 leader_election.cc:304] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:23:04.145604 31207 raft_consensus.cc:2804] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:04.146131 31207 raft_consensus.cc:697] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 LEADER]: Becoming Leader. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Running, Role: LEADER
I20260709 13:23:04.146670 31043 raft_consensus.cc:2468] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c0111e08ed44e5ba8ff1018fcb7507 in term 2.
I20260709 13:23:04.146977 31207 consensus_queue.cc:237] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:04.154090 30791 catalog_manager.cc:5697] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 reported cstate change: term changed from 1 to 2, leader changed from d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131) to c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130). New cstate: current_term: 2 leader_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:04.429209 31043 raft_consensus.cc:1275] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Refusing update from remote peer c8c0111e08ed44e5ba8ff1018fcb7507: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.430540 31207 consensus_queue.cc:1048] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:04.438290 30895 raft_consensus.cc:1275] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Refusing update from remote peer c8c0111e08ed44e5ba8ff1018fcb7507: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.440513 31205 consensus_queue.cc:1048] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:04.522761 30971 raft_consensus.cc:1275] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Refusing update from remote peer ee4524bd626f435e9a2fe90de49d7c03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.524251 31230 consensus_queue.cc:1048] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:04.525434 30971 raft_consensus.cc:1275] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Refusing update from remote peer ee4524bd626f435e9a2fe90de49d7c03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.526979 31230 consensus_queue.cc:1048] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:04.539273 31043 raft_consensus.cc:1275] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Refusing update from remote peer ee4524bd626f435e9a2fe90de49d7c03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.540031 31044 raft_consensus.cc:1275] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Refusing update from remote peer ee4524bd626f435e9a2fe90de49d7c03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.546054 30894 raft_consensus.cc:1275] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Refusing update from remote peer c8c0111e08ed44e5ba8ff1018fcb7507: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.546996 31265 consensus_queue.cc:1048] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:04.547919 31192 consensus_queue.cc:1048] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:04.549140 30895 raft_consensus.cc:1275] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Refusing update from remote peer c8c0111e08ed44e5ba8ff1018fcb7507: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.550114 31205 consensus_queue.cc:1048] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:04.554118 31205 consensus_queue.cc:1048] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:04.563912 31044 raft_consensus.cc:1275] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Refusing update from remote peer c8c0111e08ed44e5ba8ff1018fcb7507: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.565402 31043 raft_consensus.cc:1275] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Refusing update from remote peer c8c0111e08ed44e5ba8ff1018fcb7507: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.565744 31258 consensus_queue.cc:1048] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:04.566972 31202 consensus_queue.cc:1048] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:06.849056 30791 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57684:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:23:06.873842 30791 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57684:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:23:06.903240 18414 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:23:07.197510 31295 log.cc:927] Time spent T 74750d56a0f5492091226aad1869538c P c8c0111e08ed44e5ba8ff1018fcb7507: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 13:23:07.198185 31294 log.cc:927] Time spent T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:23:07.281847 31327 tablet.cc:1724] T 74750d56a0f5492091226aad1869538c P d02e5f60274b43a3a8d95c337273cf50: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.277086 31321 tablet.cc:1724] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:23:07.321300 31309 log.cc:927] Time spent T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507: Append to log took a long time: real 0.207s	user 0.000s	sys 0.002s
I20260709 13:23:07.385466 31330 tablet.cc:1724] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.411588 31339 tablet.cc:1724] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.415772 31340 tablet.cc:1724] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.419829 31341 tablet.cc:1724] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.434367 31333 tablet.cc:1724] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.434748 31338 tablet.cc:1724] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.442106 31335 tablet.cc:1724] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.445959 31334 tablet.cc:1724] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.433251 31329 tablet.cc:1724] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.470057 30895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e4a9d8abc0c4effb03b7d5a2512e73a"
dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
mode: GRACEFUL
new_leader_uuid: "d02e5f60274b43a3a8d95c337273cf50"
 from {username='slave'} at 127.0.0.1:42592
I20260709 13:23:07.471091 30895 raft_consensus.cc:606] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Received request to transfer leadership to TS d02e5f60274b43a3a8d95c337273cf50
I20260709 13:23:07.521780 31327 tablet.cc:1724] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.522630 31340 tablet.cc:1724] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.538453 31302 raft_consensus.cc:993] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03: : Instructing follower d02e5f60274b43a3a8d95c337273cf50 to start an election
I20260709 13:23:07.539081 31302 raft_consensus.cc:1081] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Signalling peer d02e5f60274b43a3a8d95c337273cf50 to start an election
I20260709 13:23:07.544042 31334 tablet.cc:1724] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.559826 31321 tablet.cc:1724] T 38f084e479b04ba394f83d3c1f7069ef P ee4524bd626f435e9a2fe90de49d7c03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.561839 31335 tablet.cc:1724] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.564653 31042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e4a9d8abc0c4effb03b7d5a2512e73a"
dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
 from {username='slave'} at 127.0.0.1:41314
I20260709 13:23:07.582698 31042 raft_consensus.cc:493] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:07.583163 31042 raft_consensus.cc:3060] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:07.580017 31330 tablet.cc:1724] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.590469 31338 tablet.cc:1724] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P ee4524bd626f435e9a2fe90de49d7c03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.543143 31342 tablet.cc:1724] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.581362 31339 tablet.cc:1724] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.602274 31334 tablet.cc:1724] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.598062 31333 tablet.cc:1724] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.605847 31330 tablet.cc:1724] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.568567 31329 tablet.cc:1724] T 74750d56a0f5492091226aad1869538c P c8c0111e08ed44e5ba8ff1018fcb7507: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.609724 31341 tablet.cc:1724] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.638628 31327 tablet.cc:1724] T 6320819f0ea6431d9b458283989e15af P d02e5f60274b43a3a8d95c337273cf50: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.596105 30968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "beea6eb6f1f04ef8ba2e1df730e9122a"
dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
mode: GRACEFUL
new_leader_uuid: "d02e5f60274b43a3a8d95c337273cf50"
 from {username='slave'} at 127.0.0.1:45106
I20260709 13:23:07.646167 30968 raft_consensus.cc:606] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 LEADER]: Received request to transfer leadership to TS d02e5f60274b43a3a8d95c337273cf50
I20260709 13:23:07.647918 18414 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:23:07.648684 18414 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:07.614338 31042 raft_consensus.cc:515] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:07.659004 31042 leader_election.cc:290] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 2 election: Requested vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035)
I20260709 13:23:07.660247 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4a9d8abc0c4effb03b7d5a2512e73a" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
I20260709 13:23:07.660879 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4a9d8abc0c4effb03b7d5a2512e73a" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:23:07.661094 30893 raft_consensus.cc:3055] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:07.661536 30893 raft_consensus.cc:740] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee4524bd626f435e9a2fe90de49d7c03, State: Running, Role: LEADER
I20260709 13:23:07.662565 30893 consensus_queue.cc:260] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:07.663797 30893 raft_consensus.cc:3060] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:07.661551 30970 raft_consensus.cc:3060] T 9e4a9d8abc0c4effb03b7d5a2512e73a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:07.682354 30970 raft_consensus.cc:2468] T 9e4a9d8abc0c4effb03b7d5a2512e73a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 2.
I20260709 13:23:07.683835 31011 leader_election.cc:304] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c0111e08ed44e5ba8ff1018fcb7507, d02e5f60274b43a3a8d95c337273cf50; no voters: 
I20260709 13:23:07.684890 31307 raft_consensus.cc:2804] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:07.685429 31307 raft_consensus.cc:697] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [term 2 LEADER]: Becoming Leader. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Running, Role: LEADER
I20260709 13:23:07.686479 31307 consensus_queue.cc:237] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:07.640785 31330 tablet.cc:1724] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:07.696321 30893 raft_consensus.cc:2468] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 2.
I20260709 13:23:07.717190 30790 catalog_manager.cc:6242] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4: soft_deleted_table [id=49928aea39cc49b6913c98e8e52336ab] alter complete (version 1)
I20260709 13:23:07.728812 30791 catalog_manager.cc:5697] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 reported cstate change: term changed from 1 to 2, leader changed from ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129) to d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131). New cstate: current_term: 2 leader_uuid: "d02e5f60274b43a3a8d95c337273cf50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:07.770406 31316 raft_consensus.cc:993] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507: : Instructing follower d02e5f60274b43a3a8d95c337273cf50 to start an election
I20260709 13:23:07.771030 31317 raft_consensus.cc:1081] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 LEADER]: Signalling peer d02e5f60274b43a3a8d95c337273cf50 to start an election
I20260709 13:23:07.772962 31045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "beea6eb6f1f04ef8ba2e1df730e9122a"
dest_uuid: "d02e5f60274b43a3a8d95c337273cf50"
 from {username='slave'} at 127.0.0.1:41318
I20260709 13:23:07.773697 31045 raft_consensus.cc:493] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:07.774092 31045 raft_consensus.cc:3060] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:07.782961 31045 raft_consensus.cc:515] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:07.785117 31045 leader_election.cc:290] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 3 election: Requested vote from peers ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627), c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035)
I20260709 13:23:07.786459 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beea6eb6f1f04ef8ba2e1df730e9122a" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507"
I20260709 13:23:07.787019 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beea6eb6f1f04ef8ba2e1df730e9122a" candidate_uuid: "d02e5f60274b43a3a8d95c337273cf50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ee4524bd626f435e9a2fe90de49d7c03"
I20260709 13:23:07.787135 30970 raft_consensus.cc:3055] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:07.787810 30970 raft_consensus.cc:740] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c8c0111e08ed44e5ba8ff1018fcb7507, State: Running, Role: LEADER
I20260709 13:23:07.787837 30893 raft_consensus.cc:3060] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:07.788662 30970 consensus_queue.cc:260] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:07.790153 30970 raft_consensus.cc:3060] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:07.796267 30893 raft_consensus.cc:2468] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 3.
I20260709 13:23:07.797202 30970 raft_consensus.cc:2468] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02e5f60274b43a3a8d95c337273cf50 in term 3.
I20260709 13:23:07.797529 31011 leader_election.cc:304] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d02e5f60274b43a3a8d95c337273cf50, ee4524bd626f435e9a2fe90de49d7c03; no voters: 
I20260709 13:23:07.798743 31307 raft_consensus.cc:2804] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:07.799219 31307 raft_consensus.cc:697] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [term 3 LEADER]: Becoming Leader. State: Replica: d02e5f60274b43a3a8d95c337273cf50, State: Running, Role: LEADER
I20260709 13:23:07.800078 31307 consensus_queue.cc:237] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } }
I20260709 13:23:07.810662 30791 catalog_manager.cc:5697] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 reported cstate change: term changed from 2 to 3, leader changed from c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130) to d02e5f60274b43a3a8d95c337273cf50 (127.17.251.131). New cstate: current_term: 3 leader_uuid: "d02e5f60274b43a3a8d95c337273cf50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02e5f60274b43a3a8d95c337273cf50" member_type: VOTER last_known_addr { host: "127.17.251.131" port: 40837 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:08.103411 30970 raft_consensus.cc:1275] T 9e4a9d8abc0c4effb03b7d5a2512e73a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Refusing update from remote peer d02e5f60274b43a3a8d95c337273cf50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:08.104501 31307 consensus_queue.cc:1048] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:08.122457 30893 raft_consensus.cc:1275] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Refusing update from remote peer d02e5f60274b43a3a8d95c337273cf50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:08.124977 31307 consensus_queue.cc:1048] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:08.186189 30970 raft_consensus.cc:1275] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 3 FOLLOWER]: Refusing update from remote peer d02e5f60274b43a3a8d95c337273cf50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:08.187309 31307 consensus_queue.cc:1048] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c0111e08ed44e5ba8ff1018fcb7507" member_type: VOTER last_known_addr { host: "127.17.251.130" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:08.202354 30893 raft_consensus.cc:1275] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 3 FOLLOWER]: Refusing update from remote peer d02e5f60274b43a3a8d95c337273cf50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:08.204224 31354 consensus_queue.cc:1048] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4524bd626f435e9a2fe90de49d7c03" member_type: VOTER last_known_addr { host: "127.17.251.129" port: 46627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:08.712641 18414 tablet_server.cc:179] TabletServer@127.17.251.129:0 shutting down...
I20260709 13:23:08.742619 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:23:08.743574 30937 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
I20260709 13:23:08.743566 18414 tablet_replica.cc:333] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P ee4524bd626f435e9a2fe90de49d7c03: stopping tablet replica
I20260709 13:23:08.744928 18414 raft_consensus.cc:2243] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.745512 18414 raft_consensus.cc:2272] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:08.746953 30937 consensus_peers.cc:597] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 -> Peer ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627): Couldn't send request to peer ee4524bd626f435e9a2fe90de49d7c03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:08.748639 18414 tablet_replica.cc:333] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03: stopping tablet replica
I20260709 13:23:08.749473 18414 raft_consensus.cc:2243] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.750349 18414 raft_consensus.cc:2272] T 5ac04addd4de4c08b675378caad669eb P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.752676 18414 tablet_replica.cc:333] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03: stopping tablet replica
I20260709 13:23:08.753372 18414 raft_consensus.cc:2243] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.753911 18414 raft_consensus.cc:2272] T f2564f17e51f4543bcdd61e46f2d509c P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.756147 18414 tablet_replica.cc:333] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03: stopping tablet replica
I20260709 13:23:08.757009 18414 raft_consensus.cc:2243] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.757895 18414 raft_consensus.cc:2272] T 74750d56a0f5492091226aad1869538c P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.760061 18414 tablet_replica.cc:333] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03: stopping tablet replica
I20260709 13:23:08.760664 18414 raft_consensus.cc:2243] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.761435 18414 raft_consensus.cc:2272] T 6320819f0ea6431d9b458283989e15af P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.763677 18414 tablet_replica.cc:333] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03: stopping tablet replica
I20260709 13:23:08.764259 18414 raft_consensus.cc:2243] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.765100 18414 raft_consensus.cc:2272] T 8e7cd07bf1024d319a5ba81f318fee7a P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.767356 18414 tablet_replica.cc:333] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03: stopping tablet replica
I20260709 13:23:08.768026 18414 raft_consensus.cc:2243] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.768510 18414 raft_consensus.cc:2272] T b43ee13ab88e433a94c659f8e6176ba4 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.770710 18414 tablet_replica.cc:333] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03: stopping tablet replica
I20260709 13:23:08.771282 18414 raft_consensus.cc:2243] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.772107 18414 raft_consensus.cc:2272] T b2c2136eb300414197996c612117d877 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.774616 18414 tablet_replica.cc:333] T 936c14ae8b8240ffafd1ab0ea5601ed4 P ee4524bd626f435e9a2fe90de49d7c03: stopping tablet replica
I20260709 13:23:08.775154 18414 raft_consensus.cc:2243] T 936c14ae8b8240ffafd1ab0ea5601ed4 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.775585 18414 raft_consensus.cc:2272] T 936c14ae8b8240ffafd1ab0ea5601ed4 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.777756 18414 tablet_replica.cc:333] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03: stopping tablet replica
I20260709 13:23:08.778316 18414 raft_consensus.cc:2243] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.779109 18414 raft_consensus.cc:2272] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.781327 18414 tablet_replica.cc:333] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03: stopping tablet replica
I20260709 13:23:08.781973 18414 raft_consensus.cc:2243] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.782366 18414 raft_consensus.cc:2272] T 91a973e7abfd46a28ee2da9015c6a055 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.784719 18414 tablet_replica.cc:333] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03: stopping tablet replica
I20260709 13:23:08.785297 18414 raft_consensus.cc:2243] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.785866 18414 raft_consensus.cc:2272] T beea6eb6f1f04ef8ba2e1df730e9122a P ee4524bd626f435e9a2fe90de49d7c03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.788690 18414 tablet_replica.cc:333] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03: stopping tablet replica
I20260709 13:23:08.789261 18414 raft_consensus.cc:2243] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.789819 18414 raft_consensus.cc:2272] T 52a08358734c42b1b8c11568606c82bb P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.791888 18414 tablet_replica.cc:333] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03: stopping tablet replica
I20260709 13:23:08.792362 18414 raft_consensus.cc:2243] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.792725 18414 raft_consensus.cc:2272] T 9e4a9d8abc0c4effb03b7d5a2512e73a P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.795413 18414 tablet_replica.cc:333] T 38f084e479b04ba394f83d3c1f7069ef P ee4524bd626f435e9a2fe90de49d7c03: stopping tablet replica
I20260709 13:23:08.795928 18414 raft_consensus.cc:2243] T 38f084e479b04ba394f83d3c1f7069ef P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.796325 18414 raft_consensus.cc:2272] T 38f084e479b04ba394f83d3c1f7069ef P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.798410 18414 tablet_replica.cc:333] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03: stopping tablet replica
I20260709 13:23:08.798890 18414 raft_consensus.cc:2243] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.799275 18414 raft_consensus.cc:2272] T 45f974fe0e6d49edbb2662bc75a1f8e1 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.801132 18414 tablet_replica.cc:333] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03: stopping tablet replica
I20260709 13:23:08.801644 18414 raft_consensus.cc:2243] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.802394 18414 raft_consensus.cc:2272] T 07d7dad17fdb4fa495557b40e4eb1c80 P ee4524bd626f435e9a2fe90de49d7c03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.804560 18414 tablet_replica.cc:333] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03: stopping tablet replica
I20260709 13:23:08.805130 18414 raft_consensus.cc:2243] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.805598 18414 raft_consensus.cc:2272] T d465cabde728440889b584045b8761d8 P ee4524bd626f435e9a2fe90de49d7c03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.845973 18414 tablet_server.cc:196] TabletServer@127.17.251.129:0 shutdown complete.
I20260709 13:23:08.885684 18414 tablet_server.cc:179] TabletServer@127.17.251.130:0 shutting down...
W20260709 13:23:08.905551 30937 consensus_peers.cc:597] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 -> Peer ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627): Couldn't send request to peer ee4524bd626f435e9a2fe90de49d7c03. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:46627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:08.914938 31011 consensus_peers.cc:597] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 -> Peer ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627): Couldn't send request to peer ee4524bd626f435e9a2fe90de49d7c03. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:46627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:08.916720 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:08.917564 18414 tablet_replica.cc:333] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507: stopping tablet replica
I20260709 13:23:08.918673 18414 raft_consensus.cc:2243] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.919166 18414 raft_consensus.cc:2272] T 5ac04addd4de4c08b675378caad669eb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.921270 18414 tablet_replica.cc:333] T 74750d56a0f5492091226aad1869538c P c8c0111e08ed44e5ba8ff1018fcb7507: stopping tablet replica
I20260709 13:23:08.922087 18414 raft_consensus.cc:2243] T 74750d56a0f5492091226aad1869538c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.922576 18414 raft_consensus.cc:2272] T 74750d56a0f5492091226aad1869538c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.925117 18414 tablet_replica.cc:333] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507: stopping tablet replica
I20260709 13:23:08.925930 18414 raft_consensus.cc:2243] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:23:08.926896 30937 consensus_peers.cc:597] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 -> Peer ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627): Couldn't send request to peer ee4524bd626f435e9a2fe90de49d7c03. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:46627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:08.926970 18414 raft_consensus.cc:2272] T f2564f17e51f4543bcdd61e46f2d509c P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:08.928571 31011 consensus_peers.cc:597] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 -> Peer c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035): Couldn't send request to peer c8c0111e08ed44e5ba8ff1018fcb7507. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:08.929589 18414 tablet_replica.cc:333] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507: stopping tablet replica
I20260709 13:23:08.930281 18414 raft_consensus.cc:2243] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.930751 18414 raft_consensus.cc:2272] T 6320819f0ea6431d9b458283989e15af P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.932866 18414 tablet_replica.cc:333] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507: stopping tablet replica
I20260709 13:23:08.933488 18414 raft_consensus.cc:2243] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.934022 18414 raft_consensus.cc:2272] T 8e7cd07bf1024d319a5ba81f318fee7a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.936132 18414 tablet_replica.cc:333] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507: stopping tablet replica
I20260709 13:23:08.936744 18414 raft_consensus.cc:2243] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.937229 18414 raft_consensus.cc:2272] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.939635 18414 tablet_replica.cc:333] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507: stopping tablet replica
I20260709 13:23:08.940285 18414 raft_consensus.cc:2243] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.941138 18414 raft_consensus.cc:2272] T 936c14ae8b8240ffafd1ab0ea5601ed4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.943490 18414 tablet_replica.cc:333] T b2c2136eb300414197996c612117d877 P c8c0111e08ed44e5ba8ff1018fcb7507: stopping tablet replica
I20260709 13:23:08.944084 18414 raft_consensus.cc:2243] T b2c2136eb300414197996c612117d877 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.944577 18414 raft_consensus.cc:2272] T b2c2136eb300414197996c612117d877 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.946943 18414 tablet_replica.cc:333] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507: stopping tablet replica
I20260709 13:23:08.947693 18414 raft_consensus.cc:2243] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.948238 18414 raft_consensus.cc:2272] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.950700 18414 tablet_replica.cc:333] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507: stopping tablet replica
I20260709 13:23:08.951297 18414 raft_consensus.cc:2243] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.952221 18414 raft_consensus.cc:2272] T 91a973e7abfd46a28ee2da9015c6a055 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.954699 18414 tablet_replica.cc:333] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507: stopping tablet replica
I20260709 13:23:08.955264 18414 raft_consensus.cc:2243] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.955705 18414 raft_consensus.cc:2272] T beea6eb6f1f04ef8ba2e1df730e9122a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.958516 18414 tablet_replica.cc:333] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507: stopping tablet replica
I20260709 13:23:08.959127 18414 raft_consensus.cc:2243] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.959930 18414 raft_consensus.cc:2272] T 52a08358734c42b1b8c11568606c82bb P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.961963 18414 tablet_replica.cc:333] T 9e4a9d8abc0c4effb03b7d5a2512e73a P c8c0111e08ed44e5ba8ff1018fcb7507: stopping tablet replica
I20260709 13:23:08.962520 18414 raft_consensus.cc:2243] T 9e4a9d8abc0c4effb03b7d5a2512e73a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.962961 18414 raft_consensus.cc:2272] T 9e4a9d8abc0c4effb03b7d5a2512e73a P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.965497 18414 tablet_replica.cc:333] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507: stopping tablet replica
I20260709 13:23:08.966082 18414 raft_consensus.cc:2243] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.966866 18414 raft_consensus.cc:2272] T 38f084e479b04ba394f83d3c1f7069ef P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.968919 18414 tablet_replica.cc:333] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507: stopping tablet replica
I20260709 13:23:08.969488 18414 raft_consensus.cc:2243] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.970257 18414 raft_consensus.cc:2272] T 45f974fe0e6d49edbb2662bc75a1f8e1 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.972249 18414 tablet_replica.cc:333] T 07d7dad17fdb4fa495557b40e4eb1c80 P c8c0111e08ed44e5ba8ff1018fcb7507: stopping tablet replica
I20260709 13:23:08.972752 18414 raft_consensus.cc:2243] T 07d7dad17fdb4fa495557b40e4eb1c80 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.973196 18414 raft_consensus.cc:2272] T 07d7dad17fdb4fa495557b40e4eb1c80 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.975327 18414 tablet_replica.cc:333] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507: stopping tablet replica
I20260709 13:23:08.975860 18414 raft_consensus.cc:2243] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.976657 18414 raft_consensus.cc:2272] T d465cabde728440889b584045b8761d8 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.978729 18414 tablet_replica.cc:333] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507: stopping tablet replica
I20260709 13:23:08.979208 18414 raft_consensus.cc:2243] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.979650 18414 raft_consensus.cc:2272] T b43ee13ab88e433a94c659f8e6176ba4 P c8c0111e08ed44e5ba8ff1018fcb7507 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.011392 18414 tablet_server.cc:196] TabletServer@127.17.251.130:0 shutdown complete.
W20260709 13:23:09.033490 31011 consensus_peers.cc:597] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 -> Peer ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627): Couldn't send request to peer ee4524bd626f435e9a2fe90de49d7c03. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:46627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:09.048766 18414 tablet_server.cc:179] TabletServer@127.17.251.131:0 shutting down...
W20260709 13:23:09.055819 31011 consensus_peers.cc:597] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 -> Peer ee4524bd626f435e9a2fe90de49d7c03 (127.17.251.129:46627): Couldn't send request to peer ee4524bd626f435e9a2fe90de49d7c03. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.129:46627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:09.077942 18414 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:09.078801 18414 tablet_replica.cc:333] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50: stopping tablet replica
I20260709 13:23:09.079892 18414 raft_consensus.cc:2243] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:09.080333 18414 raft_consensus.cc:2272] T f2564f17e51f4543bcdd61e46f2d509c P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.082401 18414 tablet_replica.cc:333] T 74750d56a0f5492091226aad1869538c P d02e5f60274b43a3a8d95c337273cf50: stopping tablet replica
I20260709 13:23:09.082932 18414 raft_consensus.cc:2243] T 74750d56a0f5492091226aad1869538c P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:09.083333 18414 raft_consensus.cc:2272] T 74750d56a0f5492091226aad1869538c P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.085245 18414 tablet_replica.cc:333] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50: stopping tablet replica
I20260709 13:23:09.085857 18414 raft_consensus.cc:2243] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:09.086632 18414 raft_consensus.cc:2272] T 1cfb6780d4ab49c2afa79d6ae7c7bb23 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.088567 18414 tablet_replica.cc:333] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50: stopping tablet replica
I20260709 13:23:09.089108 18414 raft_consensus.cc:2243] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:09.089502 18414 raft_consensus.cc:2272] T 5ac04addd4de4c08b675378caad669eb P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.091688 18414 tablet_replica.cc:333] T 6320819f0ea6431d9b458283989e15af P d02e5f60274b43a3a8d95c337273cf50: stopping tablet replica
I20260709 13:23:09.092276 18414 raft_consensus.cc:2243] T 6320819f0ea6431d9b458283989e15af P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:09.092772 18414 raft_consensus.cc:2272] T 6320819f0ea6431d9b458283989e15af P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.094988 18414 tablet_replica.cc:333] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50: stopping tablet replica
W20260709 13:23:09.095592 31011 consensus_peers.cc:597] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 -> Peer c8c0111e08ed44e5ba8ff1018fcb7507 (127.17.251.130:46035): Couldn't send request to peer c8c0111e08ed44e5ba8ff1018fcb7507. Status: Network error: Client connection negotiation failed: client connection to 127.17.251.130:46035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:09.095600 18414 raft_consensus.cc:2243] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:09.096395 18414 raft_consensus.cc:2272] T 8e7cd07bf1024d319a5ba81f318fee7a P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.098807 18414 tablet_replica.cc:333] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50: stopping tablet replica
I20260709 13:23:09.100647 18414 raft_consensus.cc:2243] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:09.101497 18414 raft_consensus.cc:2272] T b43ee13ab88e433a94c659f8e6176ba4 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.103649 18414 tablet_replica.cc:333] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50: stopping tablet replica
I20260709 13:23:09.104203 18414 raft_consensus.cc:2243] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:09.104671 18414 raft_consensus.cc:2272] T 45f974fe0e6d49edbb2662bc75a1f8e1 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.106721 18414 tablet_replica.cc:333] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50: stopping tablet replica
I20260709 13:23:09.107250 18414 raft_consensus.cc:2243] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:09.107699 18414 raft_consensus.cc:2272] T 38f084e479b04ba394f83d3c1f7069ef P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.109555 18414 tablet_replica.cc:333] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50: stopping tablet replica
I20260709 13:23:09.110121 18414 raft_consensus.cc:2243] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:09.110574 18414 raft_consensus.cc:2272] T 07d7dad17fdb4fa495557b40e4eb1c80 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.112612 18414 tablet_replica.cc:333] T d465cabde728440889b584045b8761d8 P d02e5f60274b43a3a8d95c337273cf50: stopping tablet replica
I20260709 13:23:09.113317 18414 raft_consensus.cc:2243] T d465cabde728440889b584045b8761d8 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:09.113873 18414 raft_consensus.cc:2272] T d465cabde728440889b584045b8761d8 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.115983 18414 tablet_replica.cc:333] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50: stopping tablet replica
I20260709 13:23:09.116503 18414 raft_consensus.cc:2243] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:09.117260 18414 raft_consensus.cc:2272] T beea6eb6f1f04ef8ba2e1df730e9122a P d02e5f60274b43a3a8d95c337273cf50 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.119685 18414 tablet_replica.cc:333] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50: stopping tablet replica
I20260709 13:23:09.120235 18414 raft_consensus.cc:2243] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:09.120680 18414 raft_consensus.cc:2272] T 52a08358734c42b1b8c11568606c82bb P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.122571 18414 tablet_replica.cc:333] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50: stopping tablet replica
I20260709 13:23:09.123117 18414 raft_consensus.cc:2243] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:09.123874 18414 raft_consensus.cc:2272] T 9e4a9d8abc0c4effb03b7d5a2512e73a P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.125947 18414 tablet_replica.cc:333] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50: stopping tablet replica
I20260709 13:23:09.126480 18414 raft_consensus.cc:2243] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:09.126919 18414 raft_consensus.cc:2272] T 6157a9dbb7f346cf9c9ddc0a8dc58ed5 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.128901 18414 tablet_replica.cc:333] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50: stopping tablet replica
I20260709 13:23:09.129390 18414 raft_consensus.cc:2243] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:09.129894 18414 raft_consensus.cc:2272] T b2c2136eb300414197996c612117d877 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.131909 18414 tablet_replica.cc:333] T 936c14ae8b8240ffafd1ab0ea5601ed4 P d02e5f60274b43a3a8d95c337273cf50: stopping tablet replica
I20260709 13:23:09.132395 18414 raft_consensus.cc:2243] T 936c14ae8b8240ffafd1ab0ea5601ed4 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:09.132817 18414 raft_consensus.cc:2272] T 936c14ae8b8240ffafd1ab0ea5601ed4 P d02e5f60274b43a3a8d95c337273cf50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.134934 18414 tablet_replica.cc:333] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50: stopping tablet replica
I20260709 13:23:09.135377 18414 raft_consensus.cc:2243] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:09.135813 18414 raft_consensus.cc:2272] T 91a973e7abfd46a28ee2da9015c6a055 P d02e5f60274b43a3a8d95c337273cf50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.176380 18414 tablet_server.cc:196] TabletServer@127.17.251.131:0 shutdown complete.
I20260709 13:23:09.212169 18414 master.cc:562] Master@127.17.251.190:38559 shutting down...
I20260709 13:23:09.231896 18414 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:09.232488 18414 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:09.232846 18414 tablet_replica.cc:333] T 00000000000000000000000000000000 P f4b13e4cce6a4fdeb2e0050d6cb17df4: stopping tablet replica
I20260709 13:23:09.252892 18414 master.cc:584] Master@127.17.251.190:38559 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11686 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24357 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (376947 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:23:09.307945 18414 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 413 messages since previous log ~14 seconds ago
I20260709 13:23:09.308202 18414 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 411 messages since previous log ~14 seconds ago
I20260709 13:23:09.308403 18414 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 406 messages since previous log ~14 seconds ago
I20260709 13:23:09.308617 18414 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:23:09.308812 18414 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:23:09.309051 18414 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~151 seconds ago
I20260709 13:23:09.309247 18414 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5227: suppressed but not reported on 5 messages since previous log ~123 seconds ago
I20260709 13:23:09.309525 18414 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 7 messages since previous log ~0 seconds ago
I20260709 13:23:09.309886 18414 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
